'Depth Degeneracy in Neural Networks: Vanishing Angles in Fully Connected ReLU Networks on Initialization', by Cameron Jakub, Mihai Nica. jmlr.org/papers/v25/23-… #layers #deep #depth

Saw this Ad and my brain thought it was about Zorn's Lemma. Time to go to bed!

Have you ever wondered how to animate equations for nice videos? My latest videos shows the behind the scenes of how I do it using Manim Manim Community (orginally created by Grant Sanderson ) . Oh, and Darth Vader is there too. youtu.be/9d_G-zN8FLs

I just ran 80,000 simulations, and it does indeed seem like a random walk converges to a Brownian motion

The above was a survey talk by Hassan Ashtiani, on distribution learning. Next is Mihai Nica, talking about this paper on Gaussian approximation in NNs: openreview.net/forum?id=92q7W…. This Twitter poll by Daniel Litt makes another appearance!

People did incredible work to solve these problems! These examples should embolden us to solve the hard problems we face today, not make us think "oh problems aren't real". Here's a truly excellent 4 minute video on how the Ozone crisis was tackled: youtu.be/lOQqGKt52X8?si…

I used the DeepSeek Reinforcement Learning GRPO algorithm to train a triangle creature. The edges are "muscles": red=extend, blue=contract; vertices are "mass pumps": red=grow, blue=shrink. Reward = DeltaX - |DeltaY|. Full video incoming: Subscribe at youtube.com/@MihaiNicaMath

With Svante Janson and Simon Segert, we just posted out latest in the Alice HH vs BoB HT saga on the arxiv! arxiv.org/abs/2503.19035 We generalize to strings other than HH or HT. I also made a YouTube video a while ago giving the general idea youtu.be/_ufR0fOFO-E?si…

There is slick way to calculate the probability of winning a best-of-7 series, like the Stanley cup, given the current score using ideas from Martingales. I made a video about it here: youtu.be/4zf2L34W674 There is also a bonus quant finance problem solved in there too!

I'm experimenting with converting some of my YouTube math explainers to blog form. Here's the first one, let me know what you think! publish.obsidian.md/nicam/YouTube+…