Getting a very usable 2.2 tokens a second with Llama3 Q4 on Raspberry Pi 5 (fanless)

Llama 3 8B running 1.89 tokens/s on a Raspberry Pi 5 is pretty CRAZY

Bluetit nest box today. Day 10 since the first egg was laid. #bluetit #nestbox #python #motion #raspberrypi #surrey

Made myself a cool keychain with my own carrier board for a Raspberry Pi CM4

#raspberrypi

Bugüne kadar para verip de paramın çöp olduğunu hissettiğim tek donanım Raspberry Pi 5 oldu. Ne windows yükleyebiliyorum, ne istediğim distroyu yükleyebiliyorum. Pip ile package yükleyeceğim zaman --break-system-packages yazmak zorundayım. Rpi5 için çok mu erken bilemiyorum.

Llama 3 8B 在树莓派Raspberry Pi 5 上运行

速度达到 1.89 个 token/s

看来这个是端侧模型，可以在各种设备上运行！牛P啊…

#XEP welcomes everyone in the world!👽

✅ No need to break the bank – XEP is affordable for all budgets

✅ Say goodbye to pricey setups and selling your home, just like with Bitcoin

✅ With just a #Raspberry Pi or a basic computer, you're ready to dive into the world of XEP

الحمد لله عملت اول فلوس من الكلية
بيعت الraspberry pi

Raspberry Pi released network install for Pi 5 and there's mention of preliminary CM5 support. It must be getting close.

Now..... What is D0????
#raspberrypi

I ordered a device and it came with a free ant nest. They read “Raspberry Pi” on the package and got confused.

#多分私しかやってない

DJIのジンバルをRaspberry Pi Picoで制御して、セルフポートレート！

#電子工作
#raspberrypipico

Media server héberger sur un Raspberry Pi 3a+ avec samba 🔥

STEAM教育向け人型ロボット
youtu.be/Oizs08q8_9g

#ArtificialIntelligence #robot ics #humanoid #bipedal #robot #programming #STEM #EdTech #education #RaspberryPi #python #hiwonder #二足歩行ロボット #STEM 教育 #プログラミング学習

外出ついでにRaspberry piを買ってくるように頼まれたシンが普通にラズベリーパイを買ってきてハインラインにバチギレされる回

今日の三年生ゼミではRaspberry Piのセットアップ2回目でした。

ついにRaspberry PiのOSが起動しました！

（写真は三年生の取り組んでいる様子です）
#johodai #tsujilab

Raspberry Pi 5の自作電源基板の動作確認できた！！

Who else here is going to be at #piwars2024 this weekend, to see Raspberry Pi robots competing in an awesome challenge event? I'm certainly excited!

#RaspberryPi -powered glasses which translate sign language into speech! Wow!
tomshardware.com/raspberry-pi/t…

Getting over 4 tokens per second on a Raspberry Pi 5 with Microsoft's Phi-3 Mini! Great model to run entirely locally! Model link in comments!