Automation Workflow stable

Prefect

Modern Python-native workflow orchestration

18.0K stars 300 contributors Since 2020
Website → GitHub

Data workflow orchestration framework with Python-native API, automatic retries, caching, observability dashboard, and hybrid cloud/self-hosted deployment.

License
Apache-2.0
Min RAM
1 GB
Min CPUs
1 core
Scaling
single_node
Complexity
intermediate
Performance
medium
Self-hostable
✓
K8s native
✕
Offline
✕
Pricing
fully free
Docs quality
good
Vendor lock-in
none

Use cases

  • ✓ Python-native data pipeline orchestration
  • ✓ ML training pipeline management
  • ✓ Scheduled ETL with automatic retries

Anti-patterns / when NOT to use

  • ✕ Python-only
  • ✕ Cloud UI is the best experience — self-hosted UI limited
  • ✕ Smaller plugin ecosystem than Airflow

Replaces / alternatives to

  • Apache Airflow
  • Luigi
  • AWS Step Functions

Technical specs

Language
Python
API type
REST
Protocols
HTTP
Deployment
pipdocker

Community

GitHub stars 18.0K
Contributors 300
Commit frequency weekly
Plugin ecosystem none
Backing Prefect
Funding vc_backed

Release

Latest version —
Last release —
Since 2020

Best fit

Team size
smallmedium
Industries
general

Tags

  • workflow-orchestration
  • python-native
  • retries
  • caching
  • observability
  • data-engineering