Category Archives: PowerShell

Reordering Columns Using PowerShell

One of the regular issues that is discussed on the SSIS forum is what to do when a source file changes the order of columns. You build your SSIS package to handle Col1, Col2, Col3 and you get the files … Continue reading

Posted in ETL, PowerShell, SSIS | Leave a comment

Removing quotes from CSV created by PowerShell

In a previous post, I demonstrate how to reshape a comma delimited file (CSV) using PowerShell. I noted that the results put all of the column values in double quotes: "ID","Name","State" "5","Stephanie","Arizona" "4","Melanie","Oregon" "2","Katie","Texas" I used this code to produce … Continue reading

Posted in ETL, PowerShell | Leave a comment

Shaping a comma delimited file with PowerShell

Here is a use case for what I am thinking of. You have comma delimited file that you need to load into SQL Server. It is a very large file that you need to join to an equally large table … Continue reading

Posted in ETL, PowerShell | Leave a comment

Using PowerShell to shape comma delimited file

PowerShell has power to handle many ETL tasks (PowerShell as an ETL tool). In this post I illustrate how you can use PowerShell to shape a comma delimited file. That is, how to remove columns, filter rows and sort the … Continue reading

Posted in ETL, PowerShell | Leave a comment

PowerShell as an ETL tool

“If Your Only Tool Is a Hammer Then Every Problem Looks Like a Nail.” My hammer has been SSIS for most of the last 8 years. I have reluctantly used scripting language like .Net framework (C# and VB.Net) and even … Continue reading

Posted in ETL, PowerShell | Leave a comment