Ray Summit 2024

Ray Core has come a long way since its first major release back in 2020. Today, we are investing in Ray Core scalability and reliability, while also evolving Ray for an accelerator-native world. Hear about some of the improvements we’ve made since last year’s summit, including streaming generators and weekly Ray releases. Then, we’ll discuss Ray Compiled Graphs, a new backend for Ray Core that makes it simple to build high-performance applications on clusters of accelerators. We’ll do a deep dive of the key Compiled Graphs features, including faster Ray task execution and native support for GPU-GPU communication via NCCL. We’ll also give a brief overview of some of the main use cases in multi-GPU LLM inference and distributed training.