Topic: workflow orchestration
Maestro – ITOps Times Open Source Project of the Week
Earlier this week, Netflix open sourced Maestro, a highly scalable workflow orchestrator for handling large-scale workflows, like data pipelines. It can manage the entire workflow lifecycle, including retries, queuing, task distribution to compute engines, and more. Workflows in Maestro follow the directed acyclic graph (DAG) structure, composed of individual job definitions, or Steps. These Steps … continue reading
