@redhat_ai : LLM Compressor just got way easier to use. You can now compress most LLMs directly from their @huggingface model definition. No need to write custom wrappers. This new autowrapper supports 95% of multimodal and decoder models out of the box. Let’s break it down 🧵: • TwiCopy

Red Hat AI

@redhat_ai

+ Follow

Deliver AI value with the resources you have, the insights you own, and the freedom you need.

ID: 997536616481722369

linkhttps://ai.redhat.com/ calendar_today18-05-2018 17:57:17

1,1K Tweet

6,6K Followers

1,1K Following

Red Hat AI

@redhat_ai

21 days ago

LLM Compressor just got way easier to use. You can now compress most LLMs directly from their Hugging Face model definition. No need to write custom wrappers. This new autowrapper supports 95% of multimodal and decoder models out of the box. Let’s break it down 🧵:

thumb_up_off_alt88

chat_bubble_outline4

repeat7

shareShare