David Marx
@digthatdata
Generative AI MLE, FOSS toolmaker, innovation catalyst @CoreWeave + @AiEleuther. AI enhanced creativity, philosophy of mind/science/probability
ID: 2211601081
https://github.com/dmarx 24-11-2013 00:56:11
10,10K Tweet
4,4K Followers
1,1K Following
Did you notice how most video AIs are commercial, closed-source & secret? It sucks and a big reason for the lack of open-source & transparency is that there are very few high-quality open video datasets. The Hugging Face team is changing this today by releasing FineVideo, a
A transformer's depth affects its reasoning capabilities, whilst model size affects its knowledge capacity High recommend Zeyuan Allen-Zhu's video on reasoning in transformers. Experiments show wider nets don't affect reasoning but more depth helps. Video: youtu.be/bpp6Dz8N2zY
Microsoft Research Deep Learning Group and Microsoft GenAI are hiring self-motivated part-time research interns working on long sequence modeling. We have hundreds of H100/A100 dedicated to this project. Please send CV to [email protected] and [email protected].