How to make an airflow dag skip an hour if previous trigger is still in motion

Question

A simple question for airflow DAG development

args = {
    'owner': 'Airflow',
    'start_date': dates.days_ago(1),
    'email': ['email1@gmail.com', 'email2@gmail.com'],
    'email_on_failure': True,
    'email_on_success': True,
    'schedule_interval': '0 * * * *',
}

The above configuration states that the DAG should run every hour on the top of the hour.

How do I make the job skip one hour if the previous job is still in motion?

Thanks!

Answer 1

As mentioned in comment you can achieve what you want by setting max_active_runs=1 . However, this will depend on wider context of expected behaviour.

If you need more complex schedule consider implementing your own Timetable .