Diederik Adriaan Vink (@diederikvink) 's Twitter Profile
Diederik Adriaan Vink

@diederikvink

ID: 1749257263066529792

calendar_today22-01-2024 02:26:58

2 Tweet

6 Followers

14 Following

Aditya Rajagopal (@adityaraja0) 's Twitter Profile Photo

🤝 Excited to share that nCompass and cerebriumai have teamed up to boost the efficiency of Llama 70B models on vLLM by 3x, while maintaining accuracy. That’s right - you can integrate nCompass's optimized GPU kernels into your current inference engine (e.g., vLLM)