Lightning Talks

On-Demand Ray Clusters in ML Workflows via KubeRay & Sematic

September 18, 3:00 PM - 3:15 PM
View Slides

It can often be useful to leverage short-lived Ray clusters as a part of a broader ML workflow (ex: to perform distributed training as part of a pipeline with multiple data and modeling steps). Using these single-purpose, ephemeral Ray clusters can unlock opportunities for improved reproducibility, efficiency, and observability. KubeRay provides a natural way to manage these ephemeral Ray clusters on Kubernetes. Sematic ( shares learnings from leveraging KubeRay & Ray in this way.

About Josh

Josh Bauer has written code for everything from particle accelerator data analysis for data from the LHC to ML infra for self-driving cars at Cruise. Most recently, he's been a founding engineer at trying to bring world-class ML workflow tooling to teams of all shapes and sizes.

Josh Bauer

Founding Engineer, Sematic (
Photo of Ray Summit pillows
Ray Summit 23 logo

Ready to Register?

Come connect with the global community of thinkers and disruptors who are building and deploying the next generation of AI and ML applications.

Photo of Ray pillows and Raydiate sign
Photo of Raydiate sign

Join the Conversation

Ready to get involved in the Ray community before the conference? Ask a question in the forums. Open a pull request. Or share why you’re excited with the hashtag #RaySummit on Twitter.