How to cache/target tasks with the same name in a Flow with prefect?

Question

I am trying to find a target pattern or cache config to differentiate between tasks with the same name in a flow.

As highlighted from the diagram above only one of the tasks gets cached and the other get overwritten. I tried using task-slug but to no avail.

@task(
    name="process_resource-{task_slug}",
    log_stdout=True,
    target=task_target
    )

Thanks in advance

Answer 1

It looks like you are attempting to format the task name instead of the target. (task names are not template-able strings).

The following snippet is probably what you want:

@task(name="process_resource", log_stdout=True, target="{task_name}-{task_slug}")

Answer 2

After further research it looks like the documentation directly addresses changing task configuration on the fly - Without breaking target location templates.

@task
def number_task():
    return 42

with Flow("example-v3") as f:
    result = number_task(task_args={"name": "new-name"})

print(f.tasks) # {<Task: new-name>}