Mixing reliability with Celery for delicious async tasks with Flávio Juvenal

Channel:
United States Confreaks
Subscribers:
42,400
Published on ● Video Link: https://www.youtube.com/watch?v=3BUIOV6gj9o


Duration: 0:00
11 views
0

As the most popular and mature solution for asynchronous task queues in Python’s ecosystem, Celery is an essential tool for Django projects. But running Celery tasks with high reliability is a challenge. The settings are tricky, tasks can be lost in multiple ways, task code has opaque limitations, proper monitoring isn’t trivial, and more. In this talk, we’ll share what we learned to be necessary for running Celery reliably after years of running it in production.

This talk was presented at: https://2023.djangocon.us/talks/mixin...

LINKS:
Follow Flávio Juvenal 👇
On Twitter: / flaviojuvenal
Website: https://www.vinta.com.br/

Follow DjangCon US 👇
https://fosstodon.org/@djangocon
/ djangocon

Follow DEFNA 👇
https://www.defna.org/

Video production by Confreaks
Follow Confreaks 👇
https://confreaks.com/
https://x.com/confreaks



Other Videos By Confreaks


2025-01-20Panel Discussion: Who put me in charge? Moving beyond day-to-day coding in Django with Jay Miller
2025-01-20Automate Your City Data with Python with Philip James
2025-01-20Don't Buy the "A.I." Hype with Tim Allen
2025-01-20There's More to Open Source than Code by Ramon Huidobro
2025-01-20AfroPython: Using Django to change black people life in Brazil with Felipe de Morais
2025-01-20DjangoCon Africa: Daniele Procida Lightning talk
2025-01-20Powering Energy Storage Beyond Excel with Calvin Hendryx-Parker
2025-01-20Strategies for handling conflicts and rollbacks in Django database migrations by Abigail Afi Gbadago
2025-01-20Keynote: Django the Dinosaur: A Story About A Web Framework with Julia Solórzano
2025-01-20Keynote: Finding Purpose in Open Source Through Community Building with Abigail Mesrenyame Dogbe
2025-01-19Mixing reliability with Celery for delicious async tasks with Flávio Juvenal
2025-01-15RubyConf 2024 Ruby Hack Challenge by Koichi Sasada and Core team
2025-01-15RubyConf 2024 Ractor on Ruby 3.4 by Koichi Sasada
2025-01-15RubyConf 2024 ACIDic Jobs: Scaling a resilient jobs layer by Stephen Margheim
2025-01-15RubyConf 2024 The state of Ruby dev tooling by Vinícius Stock
2025-01-15RubyConf 2024 Lightning Talks
2025-01-15RubyConf 2024 Chaos Engineering on the Death Star by Sara Jackson
2025-01-15RubyConf 2024 Building JRuby: How We Implement Ruby on the JVM by Charles Nutter & Thomas Enebo
2025-01-15RubyConf 2024 Detecting and classifying object images using ruby by Fabio Leandro Janiszevski
2025-01-15GS D3 01 Brandon Weaver 1
2025-01-15RubyConf 2024 Going Postel by Scott Werner