SQL：检查其值为“ Date”但类型为“ String”的列的格式

Question

I am running a ETL job which is failing due to data quality issues. In my source, my date column is in String format and I am converting it to a TIMESTAMP using to_timestamp() method while storing it into target.

This job is failing when one date value(in String format) comes as 2016-06- instead of 2016-11-10 06:07:48.633 . Due to the incorrect value, I can't convert it to a timestamp and my whole job fails.

How do I apply a format check in a generic way to verify that date(in String data type) is in correct format before converting it to timestamp?

Answer 1

You could use Isdate() function to check if a string is date or not.

Use this function at filter level and filter the invalid dates and load the rest.