Updating a DAG file using the CDE CLI
You can update a Directed Acyclic Graph (DAG) file using the CDE CLI for instances where the DAG needs to be overridden. For use cases where the DAG needs to be overridden, first the DAG needs to be uploaded to the resource to override the previous version, then you must update the job.
Choose one of the following options in step 1:
Updating a DAG file that needs to be overridden
cde resource upload --name my_pipeline_resource --local-path my_pipeline_dag.py cde job update --name my_pipeline --dag-file my_pipeline_dag.py --mount-1-resource my_pipeline_resource
Updating a DAG in scenarios where the DAG must be set to a different one:
cde resource upload --name my_other_pipeline_resource --local-path my_other_pipeline_dag.py cde job update --name my_pipeline --dag-file my_other_pipeline_dag.py --mount-1-resource my_other_pipeline_resource