Bram
@bramvanroy
@ku_leuven @ccl_kuleuven: Creative #NLG 🖋️
@ivdnt: Dutch #NLProc and #LLMs
Creator of Dutch LLMs 🤖
Fellow at @huggingface 🤗
Prev. @lt3ugent, @SignON
ID: 361306433
https://bramvanroy.github.io/ 24-08-2011 15:46:54
4,4K Tweet
1,1K Takipçi
814 Takip Edilen
These days, I am mostly using ~30B models in FP8 to fit well on a 48GB card. Shout out to Red Hat AI for pushing out many FP8 versions of popular models (and other quants)!
Does anyone know anyone at the Mistral AI team? For some reason they do not have the chat template in the tokenizer config, which makes it tedious to use in typical pipelines. Chat template is in their Processor class but not in Tokenizer. huggingface.co/mistralai/Mist…