Automation Workflow stable

Prefect

Modern Python-native workflow orchestration

18.0K stars 300 contributors Since 2020
Website → GitHub

Data workflow orchestration framework with Python-native API, automatic retries, caching, observability dashboard, and hybrid cloud/self-hosted deployment.

License
Apache-2.0
Min RAM
1 GB
Min CPUs
1 core
Scaling
single_node
Complexity
intermediate
Performance
medium
Self-hostable
K8s native
Offline
Pricing
fully free
Docs quality
good
Vendor lock-in
none

Use cases

  • Python-native data pipeline orchestration
  • ML training pipeline management
  • Scheduled ETL with automatic retries

Anti-patterns / when NOT to use

  • Python-only
  • Cloud UI is the best experience — self-hosted UI limited
  • Smaller plugin ecosystem than Airflow

Replaces / alternatives to

  • Apache Airflow
  • Luigi
  • AWS Step Functions

Technical specs

Language
Python
API type
REST
Protocols
HTTP
Deployment
pipdocker

Community

GitHub stars 18.0K
Contributors 300
Commit frequency weekly
Plugin ecosystem none
Backing Prefect
Funding vc_backed

Release

Latest version
Last release
Since 2020

Best fit

Team size
smallmedium
Industries
general

Tags

  • workflow-orchestration
  • python-native
  • retries
  • caching
  • observability
  • data-engineering