Pipeline Software

From Wiki2
Revision as of 08:58, 10 July 2019 by Vnhxz (talk | contribs) (Created page with "* [https://github.com/spotify/luigi Luigi] (Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow managemen...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search
  • Luigi (Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.)
  • AWS Data Pipeline
  • Apache Airflow (Airflow is a platform to programmatically author, schedule and monitor workflows.)
  • [KernelAI]