Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

vLLM: A success story of UC and industry collaboration in Open Source AI

Date: Thursday, April 24 2025
Time: 2:00-2:50

Presenter: Nick Hill (Red Hat)

Description

This session will be an overview of vLLM, the preeminent open source LLM serving framework. Started less than two years ago as a PhD project in the UC Berkeley Sky Computing Lab, it has grown into a successful community-driven collaboration between industry and academia. We’ll talk about the community side of the project and cover some of the technical innovations.