Good read. I would benefit a lot from more experience in quickly iterating between new solutions forecastegy.com/posts/is-compe…

Meet BasicPitch.io — a 🎹🎸🎻🪕🎺🎷🪗 🎤-to-MIDI converter that uses about 70 billion fewer parameters than those fancy neural networks. engineering.atspotify.com/meet-basic-pit… #MachineLearning

Nice checklist for training neural nets better karpathy.github.io/2019/04/25/rec…

There are good tutorials on the concepts behind transformers out there. Also, there tons of tutorials on using the HF transformers lib. But how about a step-by-step guide on coding BERT, GPT, BART from the ground up? Here's @DanielPressel's amazing repo: github.com/dpressel/mint

A very interesting read! There's indeed a huge gap between usable tech a musician would enjoy and "fancy" tech the AI community finds worth investigating!🧐 On the Development and Practice of AI Technology for Contemporary Popular Music Production: transactions.ismir.net/article/10.533…

``Self-supervised Learning with Random-projection Quantizer for Speech Recognition. (arXiv:2202.01855v2 [cs.CL] UPDATED),'' Chung-Cheng Chiu, James Qin, Yu Zhang, Jiahui Yu, Yonghui Wu, ift.tt/N1kKMaI

Great advice by Eugene Vinitsky (@RLC) 🍒🦋 -- Run the simplest experiment first -- Write a mini-version of your paper before getting started -- Keep an ultra-detailed notebook -- Every paper should be reproducible via 1 script -- Save all your videos in one place -- Present regularly

"Progressive Stage-wise Learning for Unsupervised Feature Representation Enhancement" Someone finally beat regular backpropagation on a realistic problem—specifically, in the context of self-supervised learning (SSL). [1/12]

Note to self to check this out later. What does this mean for unsupervised language acquisition?

Note to self to check this out later. What does this suggest for unsupervised language acquisition?

Abdelrahman Mohamed (Meta), Shinji Watanabe (CMU), Tara Sainath (Google), Karen Livescu (TTIC), Shang-Wen Li (Meta), Shu-wen Yang (NTU), Katrin Kirchhoff (Amazon), and I will give a tutorial about self-supervised learning for speech at NAACL 2022. 2022.naacl.org/program/tutori…

ai.googleblog.com/2022/06/identi…

``Analysing Discrete Self Supervised Speech Representation for Spoken Language Modeling. (arXiv:2301.00591v1 [cs.CL]),'' Amitay Sicherman, Yossi Adi, ift.tt/KwI4mGs

The research topic I've been working on for a long time is going to be incorporated into iOS 17 by Apple (of course, I didn't write the code in iOS): 9to5mac.com/2023/05/16/app…