
vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join slack.vllm.ai to discuss together with the community!
ID: 1774187564276289536
https://github.com/vllm-project/vllm 30-03-2024 21:31:01
327 Tweet
12,12K Takipçi
15 Takip Edilen

Zhuohan Li
@zhuohan123
👨🏻💻 cs phd @ 🌁 uc berkeley | building @vllm_project | machine learning systems | the real agi is the friends we made along the way
Cade Daniel 🇺🇸
@cdnamz
systems performance
Roy
@jasonlovelu
Software engineer. @vllm_project Committer.
Roger Wang
@rogerw0108
Flowers and friendship | ML Platform & Infra @Roblox | Committer @vllm_project | @uwaterloo @uwcse
Ion Stoica
@istoica05
Professor at UC Berkeley, co-founder of Databricks, Anyscale, Conviva.
Simon Mo
@simon_mo_
@vllm_project
Michael Goin
@mgoin_
Engineering Lead @neuralmagic @redhat | Committer @vllm_project | Compressing LLMs and making fast software
Robert Shaw
@robertshaw21
@redhat | @neuralmagic | @vllm_project
Woosuk Kwon
@woosuk_k
PhD student at @Berkeley_EECS building @vllm_project
Nick Hill
@nickhill33

Kimi.ai
@kimi_moonshot
Built by Moonshot AI to empower everyone to be superhuman. Kimi.ai
StepFun
@stepfun_ai
Scale-up possibilities for everyone.
ManusAI
@manusai_hq
Manus is the general AI agent that bridges minds and actions: it doesn't just think, it delivers results. Download our app: manus.im/download
Junyang Lin
@justinlin610
Building Qwen models @Alibaba_Qwen ❤️ 🍵 ☕️ 🍷 🥃
PyTorch
@pytorch
Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation
Sang Cho
@saaaang94
pretrain @xAI | prev-founding engineer at @anyscalecompute | senior committer of @raydistributed | committer of @vllm_project | Github: rkooo567
Cody Yu
@codyhaoyu
MLSys, LLM Serving, Deep Learning Compiler
Philipp Moritz
@pcmoritz
Co-founder and CTO at @anyscalecompute. Co-creator of @raydistributed. Interested in ML, AI, computing.
Lily Liu
@eqhylxx
CS PhD Student, Sky Lab @UCBerkeley
Kaichao You
@kaichaoyou
phd student in tsinghua university, working on @vllm_project