Topic: workflow orchestration

Maestro – ITOps Times Open Source Project of the Week

Earlier this week, Netflix open sourced Maestro, a highly scalable workflow orchestrator for handling large-scale workflows, like data pipelines. It can manage the entire workflow lifecycle, including retries, queuing, task distribution to compute engines, and more.  Workflows in Maestro follow the directed acyclic graph (DAG) structure, composed of individual job definitions, or Steps. These Steps … continue reading

DMCA.com Protection Status

Get access to this and other exclusive articles for FREE!

There's no charge and it only takes a few seconds.

Sign up now!