profile-img
Parmida Beigi

@ParmidaBeigi

AI/ML R&D Lead @amazon AGI: search, graphs, LLMs/GenAI | Founder @bdqai | Advisory Board Member | PhD @ECEUBC | views=mine

calendar_today19-03-2012 17:38:15

236 Tweets

2,1K Followers

187 Following

Parmida Beigi(@ParmidaBeigi) 's Twitter Profile Photo
Parmida Beigi
@ParmidaBeigi

9 months ago

Lighter and faster LLMs with 🤗 Transformers 🤝 AutoGPTQ!

1. Low GPU memory usage
2. Fast inference speed

Results of GPTQ quantization. 🧮

Try it out ⬇️

🔗 Blog post: huggingface.co/blog/gptq-inte…
📒 Google colab: colab.research.google.com/drive/1_TIrmuK…

account_circle