Damiano Sgarbossa
@damiano_sga
PhD student in Computational Biology @EPFL
Reasearch intern @abscibio in NYC this summer
ID: 3087039257
11-03-2015 15:17:32
107 Tweet
378 Followers
404 Following
Weekend project: Comparing ESM3 from EvolutionaryScale to ESM2 and inv_cov. The ultimate test of a protein language models is how well the pairwise dependencies it learns correlate to structure. (1/8)
Finally, a big piece of my PhD project is out! Special thanks to the super team Oriol Artime Samir Suweis Manlio De Domenico
Really impressive work from Together AI! Apparently you can distill large transformer models like Llama3.1 8B into a faster and less memory intensive Mamba model without loss in performance! x.com/togethercomput…