Wow! Quantized Moondream2 is now running on the browser with Candle Rust WIP, slow but it works! cc vik Santiago Medina Laurent Mazare

Ported vik’s moondream2 vision model to #rust ! This was made possible with candle and #opensource . To run it locally, check out the example in the candle repo.

p.s. thanks to both Vik and Laurent Mazare for their help

github.com/huggingface/ca…

Explosion 💥 By the way, Hugging Face 's Candle library is an absolute joy to work with.

Having done ML in Rust for almost a decade, it's hard to curb the enthusiasm that we finally have a great native machine learning library in the Rust ecosystem.

Just released MetaVoice-1B, the first text-to-speech model in candle. It can be used on CPU, Cuda GPUs, or Metal for macs, all that in pure #Rust ! It sounds a bit wobbly compared to the python version but still pretty nice!

MetaVoice-1B on Metal powered by Candle! 🦀

Apache 2.0 licensed TTS with Voice Cloning. Thanks to Laurent Mazare, you can now use MetaVoice in Rust. ⚡

Try it out via candle-examples:

cargo run --example metavoice --features metal --release -- --prompt 'Hey hey my name is VB.'

Introducing fast-llm rs! 🦀

Infer LLMs like Mistral, LLama, Mixtral, on your Mac at the touch of your CLI!

Powered by Candle and Rust! ⚡

Works on Metal and CPU - Infer your GGUF checkpoints in pure Rust! ;)

All you gotta do is:

Step 1: git clone https://github.…

Intelligence artificielle : à Paris, « il se passe quelque chose en ce moment »  lemonde.fr/economie/artic…

Kyutai : les mousquetaires français de l’intelligence artificielle ift.tt/7R3Pqkj

Kyutai in 'L'Obs' this week, with a photo that will let you wonder 'is this an AI lab or a midwest emo band?'.

Welcome to 2024 with the Phi-2 MIT License
Just a quick reminder that you can run any phi quantized model in the browser using Candle WASM.

try it here: huggingface.co/spaces/radames…

Playing around with 🤗 Candle for CPU inference on Mac.

8.55 tok/sec. (4-bit quantised)

fuck yeah! whisper on metal powered by rust 🦀

100% local + fastt!

brought to you by 🤗candle.