Ray Summit 2024

In-Person Agenda

Back to Session CatalogBack to Session Catalog
Scaling ML Training and Serving at Reddit With Ray
In this talk, we will explore how Reddit has invested in Ray and KubeRay as core technologies within its internal ML Platform to scale ML training and serving workloads. We will dive into Reddit’s tooling and workflows around Ray and Kuberay to vastly improve developer velocity and scale ML training workloads to achieve a 6x reduction in model training time. We will also discuss the team’s work to extend our inference platform using Ray Serve to support scalable development, deployment, and serving of fine-tuned open-source LLMs.

Speakers

  • Tuesday, Oct 13:15 PM - 3:45 PM PDT
    Golden Gate Salon B

READY TO REGISTER?

Come connect with the global community of thinkers and disruptors who are building and deploying the next generation of AI and ML applications.

Join the Conversation

Hashtag it 

#RaySummit

Don't wait for the conference to get the convo going. Join the Ray community now – ask a question in the forums, open a pull request or simply share why you’re excited. Create some buzz!