Tobias Mann
@tobias_writes
Systems Editor @TheRegister / @SitPub — hiker, animal lover, photographer, blogger, and tech journo.
I'm over on Mastodon now at @[email protected]
ID: 875460965495484416
https://connect.tobiasmann.com 15-06-2017 21:12:14
3,3K Tweet
1,1K Followers
623 Following
There's a lotta hype around "AI PCs," but if you're looking to kick the tires on LLMs and diffusion models at home, #NPU TOPS aren't as important as you might think. In my latest for The Register, I dive into the specs that actually matter for local #AI: theregister.com/2024/08/25/ai_…
As promised my write up on #LLM tool calling is now live over on The Register . In the guide, I explore giving LLMs access to: - user data 🪪 - a calculator 🧮 - a clock ⏰ - weather APIs 🌅 - IT systems like #Proxmox 🖥️ theregister.com/2024/08/26/ai_…
Cerebras gives waferscale chips inferencing twist, claims 1,800 token per sec generation rates Faster than you can read? More like blink and you'll miss the hallucination. My latest for The Register theregister.com/2024/08/27/cer…
Want to build a computer with more than a handful of GPUs? At the speeds modern interconnects operate, copper will only get you so far. In my latest for The Register I dive into Broadcom's efforts to co-package optical engines to "GPUs." theregister.com/2024/08/28/bro…
Do not miss: #Comment from Tobias Mann on Intel's next moves theregister.com/2024/09/22/int…