Haihao Shen (@haihaoshen) 's Twitter Profile
Haihao Shen

@haihaoshen

Creator of #intel Neural Compressor and AutoRound for LLMs; HF Optimum-Intel Maintainer; OPEA Founding member; Opinions my own

ID: 1438706609400651777

linkhttps://github.com/intel/auto-round calendar_today17-09-2021 03:29:57

544 Tweet

3,3K Takipçi

2,2K Takip Edilen

Haihao Shen (@haihaoshen) 's Twitter Profile Photo

🥳Super excited to share Gaudi SW v1.17 is officially released. One of the highlighted features is FP8 and INT4 inference using Intel Neural Compressor. 🎯Check out the 1.17.0 documentation (habana.ai) to get started! Gaudi is the only alternative to NVidia GPU now!