Matillion：从 Azure Blob 存储容器和 Windows 文件共享中删除文件

Question

I have a use case where I am Transferring XML files from Windows fileshare to Azure Blob Storage and then loading data to Snowflake Tables. I am using Matillion to achieve this.

The Windows Fileshare gets Zipped XML file which contains.xml and.xml.chk files. I am using Azure Blob Storage component of Matillion to Copy the.xml files to Snowflake table and have set Purge = True to delete them afterwards.

I need help in deleting the leftover.xml.chk files from Blob Storage Container. Also, once the data loading is complete, I would like to delete the zipped files from Windows Fileshare.

Thanks, Shivroopa

Answer 1

you can delete the files from blob storage using the matillion python script component (orchestration->scripting->Python script)

here is an example of python code to delete blob items and containers Delete Blob Example

I don't see a way to delete files on the windows machine from Matillion other than creating an API endpoint on the fileshare and calling the API from Matillion.