Matthew Lynley
@mattlynley
I write Supervised, a newsletter on AI and big data. Recovering data analyst, math @UNC 2010. Prev: Sr. Data Analyst @Pluralsight, blogger @TechCrunch.
ID:13146722
http://www.supervised.news 06-02-2008 06:55:03
37,5K Tweets
16,4K Followers
821 Following
Thanks to Emil Eifrem, Bob van Luijt and others for talking about the future of graph databases and knowledge graph traversal in RAG pipelines! Lots more to talk about here but if you’re a company/dev experimenting with it would love to chat with you.
supervised.news/p/where-graph-…
Quantized matmuls in the latest MLX are up to 40% faster thanks to Angelos Katharopoulos and Jagrit Digani
QLoRA fine-tuning Llama 3 70B on a single M2 Ultra stats:
- Batch size 4 with 16 LoRA layers
- 95 toks/sec
- Peak mem 41GB
- Avg power 120 W