With the recent rapid advancements in multimodal language models, there has been a surge of interest from the open source vLLM community in the support of these models on vLLM.
In this talk, we will explore the journey of integrating multimodal models into vLLM, delving into the technical challenges encountered and the valuable lessons learned throughout the process.
In this talk, we will explore the journey of integrating multimodal models into vLLM, delving into the technical challenges encountered and the valuable lessons learned throughout the process.
