AI/ML Platform & Applications

Build Instacart Training Platform on Ray

September 18, 1:00 PM - 1:30 PM
View Slides

At Instacart, we are building our next generation ML Training Platform on Ray. We build standard training runtime for broad ML use cases across Instacart, and at the same time provide capabilities for more advanced users to fine tune their distributed deep learning model built by Ray AIR.

We'll demonstrate the end to end system built on top of KubeRay for workflow orchestration, as well as the standard runtime deeply integrated with Ray Data, Ray Train and Ray Tune to utilize distributed computation capabilities across all training lifecycles.

We'll also demonstrate a more custom use case, Instacart personalization ranker, which is also built on Ray AIR but with more complex data preprocessing steps. We'll tell the story of how we fine tune p13n ranker model to achieve higher training throughput and other optimizations brought by streaming executor etc.

About Han

Han is a senior machine learning engineer at Instacart, leading the projects of Instacart next generation Training Platform. Before Instacart, Han worked on distributed training platform at Meta AI Infra. Han pursed her master degree on Computer Engineering at University of Texas at Austin.

About Rajpal

Rajpal is an Engineering Leader on the ML Foundations team and leads the team that develops Model Training, Serving, Monitoring, and Adaptive Experimentation Infrastructure at Instacart. He has over 17 years of experience and has worked as a Data Platform Lead, Architect, Backend developer, DevOps, and QA engineer in that time. He has Masters's degree in Computer Science from San Diego and a bachelor's degree in Electronics Engineering from Mumbai, India.

Han Li

Senior Machine Learning Engineer, Instacart

Rajpal Paryani

Engineering Leader, Instacart
Photo of Ray Summit pillows
Ray Summit 23 logo

Ready to Register?

Come connect with the global community of thinkers and disruptors who are building and deploying the next generation of AI and ML applications.

Photo of Ray pillows and Raydiate sign
Photo of Raydiate sign

Join the Conversation

Ready to get involved in the Ray community before the conference? Ask a question in the forums. Open a pull request. Or share why you’re excited with the hashtag #RaySummit on Twitter.