Matthijs Pals (@matthijs_pals) 's Twitter Profile
Matthijs Pals

@matthijs_pals

Using deep learning to elucidate neural representations and dynamics @MackeLab

ID: 1460663812303032336

calendar_today16-11-2021 17:39:45

108 Tweet

322 Followers

521 Following

Matthijs Pals (@matthijs_pals) 's Twitter Profile Photo
Matthijs Pals
@matthijs_pals

6 months ago

How to find all fixed points in piece-wise linear recurrent neural networks (RNNs)? A short thread 🧵 In RNNs with N units with ReLU(x-b) activations the phase space is partioned in 2^N regions by hyperplanes at x=b 1/7

How to find all fixed points in piece-wise linear recurrent neural networks (RNNs)? A short thread 🧵 In RNNs with N units with ReLU(x-b) activations the phase space is partioned in 2^N regions by hyperplanes at x=b 1/7