Mustafa Alic
@musyyy
zoom-in/zoom-out = context
ID: 301923946
20-05-2011 09:13:17
1,1K Tweet
191 Followers
1,1K Following
My Low Level Technicals of LLMs 3 hour workshop is out! I talk about: 1. Why training is O(N^2) not cubic 2. Triton vs CUDA 3. Why causal masks, layernorms, RoPE, SwiGLU 4. GPT2 vs Llama 5. Bug fixes for Llama, Gemma, Phi 6. Backprop engine in Unsloth AI youtube.com/watch?v=pRM_P6…
Cole Palmer The difference is that this meme is actually true now You just tell the agent to draw the rest of the owl But you have to know what to ask and why! And what to do when things go wrong.
Anyone interested in hosting an OpenAI-backed meetup or hackathon in Vienna? (Mario Zechner Armin Ronacher ⇌ Peter Steinberger 🦞 you're all super well connected in Vienna's tech scene – RT appreciated, thanks!)
It's multiplayer chats, plus agents, and everyone working in sandboxed vms so you're all sharing the same code and context. Prompt and code together, in real time Read more about why we built this and see lots more demos in the talk slides and transcript: maggieappleton.com/zero-alignment