Ray Use Cases

Modernizing DoorDash Model Serving Platform with Ray Serve

September 19, 3:15 PM - 3:45 PM
View Slides

At DoorDash, ML is applied to solve many customer facing problems. For serving model predictions, the ML Platform team initially built a highly performant prediction service that serves several models in production. Initially the model frameworks supported were limited to PyTorch and LightGBM models. With the fast pace of innovation in the field of ML, the focus has shifted to more flexibility and developer velocity. We have had more interest in NLP and image processing use cases where there is a large variety of libraries that we aimed to support.

The ML platform team has recently adopted Ray for model training and inference. In this talk, we will share how we built a new model serving platform keeping flexibility and self-service as core ethos. We have evaluated many different frameworks and found that the data scientist friendly approach that Ray Serve offers is a great match for what we were looking for. We will tell the story of how we shifted our prediction services from our earlier generation to the Ray Serve ecosystem.

About Siddharth

Siddharth is a Software Engineer on the ML Platform Serving team at DoorDash

About Kornel

Kornel is a staff software engineer on the ML Platform team at DoorDash, focusing on online inference. Previously he was on the ML Platform team at Quora.

Siddharth Kodwani

Software Engineer, DoorDash

Kornel Csernai

staff software engineer, DoorDash
Photo of Ray Summit pillows
Ray Summit 23 logo

Ready to Register?

Come connect with the global community of thinkers and disruptors who are building and deploying the next generation of AI and ML applications.

Photo of Ray pillows and Raydiate sign
Photo of Raydiate sign

Join the Conversation

Ready to get involved in the Ray community before the conference? Ask a question in the forums. Open a pull request. Or share why you’re excited with the hashtag #RaySummit on Twitter.