Ray Summit 2024

In-Person Agenda

Back to Session CatalogBack to Session Catalog
Chatbot Arena: An Open Platform for Evaluating Frontier AI
LLMs has unlocked new capabilities and applications; however, its evaluation still poses significant challenges. We introduce Chatbot Arena, an open platform for evaluating AI based on human preferences. Our methodology employs a pairwise comparison approach and leverages input from a diverse user base through crowdsourcing. The platform has been operational for over an year, collecting over 1.7 million user votes. Chatbot Arena has emerged as one of the most referenced LLM leaderboards, widely cited by leading LLM developers and companies. Our demo is publicly available at https://lmarena.ai

Speakers

  • Tuesday, Oct 12:30 PM - 3:00 PM PDT
    Golden Gate Salon B

READY TO REGISTER?

Come connect with the global community of thinkers and disruptors who are building and deploying the next generation of AI and ML applications.

Join the Conversation

Hashtag it 

#RaySummit

Don't wait for the conference to get the convo going. Join the Ray community now – ask a question in the forums, open a pull request or simply share why you’re excited. Create some buzz!