Embeddable Job Queue mature

Celery

Distributed task queue for Python

25.0K stars 500 contributors Since 2009
Website → GitHub

Distributed task queue for Python

License
BSD-3-Clause
Min RAM
256 MB
Min CPUs
1 core
Scaling
single_node
Complexity
intermediate
Performance
medium
Self-hostable
K8s native
Offline
Pricing
fully free
Docs quality
good
Vendor lock-in
none

Use cases

  • Python background job processing
  • Scheduled periodic tasks with Celery Beat
  • Distributed task processing across workers
  • Email/notification queue processing

Anti-patterns / when NOT to use

  • Redis/RabbitMQ required
  • Debugging distributed tasks is complex
  • Memory leaks possible with long-running workers

Compare with alternatives

Replaces / alternatives to

  • AWS SQS
  • Google Tasks

Technical specs

Language
Python
API type
SDK
Protocols
HTTP
Deployment
pip

Community

GitHub stars 25.0K
Contributors 500
Commit frequency weekly
Plugin ecosystem none
Backing Celery Project
Funding community

Release

Latest version
Last release
Since 2009

Best fit

Team size
solosmallmedium
Industries
general

Tags

  • task-queue
  • distributed
  • python
  • scheduling
  • workers
  • retry
  • monitoring
  • beat