具有SSIS数据筛选的Azure数据湖

Question

I am using Data lake as a source in SSIS but i want to fetch or filter some specific rows in SSIS. Could you please suggest how can we filter Azure data lake data in SSIS.

Answer 1

You could use a conditional Split or Derived Column after the Data Lake Store Source in the Data Flow

I'm not sure how you want to filter some specific rows. I assume like filter the row which is having first two characters as AB
(DT_STR,5000,1252)SUBSTRING([Column 0],1,2) != "AB"