在 Azure 数据工厂中添加日期列

Question

I am wondering if it is possible to add a date column to each file uploaded.

For example each month a CSV is produced. I am wanted to add for example "December 2020" to each row and then for the next months upload add "January 2021" to every row in the CSV file. Before copying this into a SQL database.

eg file name "Latest Rating December 2020" I would want the 'December 2020' as a column and be the same value for all rows. The naming convention will be the same for each months upload.

Thanks

Answer 1

I've created a test to add a column to the csv file.
The result is as follows:

1. We can get file name via Child Items in Get MetaData activity. The dataset is to the container in ADLS.

2. Then we can declare a variable FileName to store the file name via the expression @activity('Get Metadata1').output.childItems[0].name .

3.We can use additional column in Copy activity, and use the expression @concat(split(variables('FileName'),' ')[2],' ',split(variables('FileName'),' ')[3]) to get the value we need. Note that the single quote contains a space. In the dataset, we need key in a dynamic content @variables('FileName') to specify which file to be copied. The sink is the same as source in Copy activity.

4. Then we can run debug to confirm it.

Here I think we also can copy into SQL table directly, when we set the sink to a sql table.