
Jeremy Dohmann
@jecdohmann
Research Scientist at @perceptroninc. Former @dbrxmosaicai, @realitylabs
ID: 1870514795121655808
21-12-2024 17:01:04
17 Tweet
114 Followers
78 Following

I’m very excited to announce that I’ll be joining Perceptron AI (perceptron.inc?) as a researcher and founding member of the technical staff. I’ll be working with Akshat Shrivastava and Armen Aghajanyan to create the world’s first visual language foundation models specifically





fun debugging journey w/Akshat Shrivastava: be careful around FP8 w. activation checkpointing activation checkpointing works under the assumptions that different calls of forward give similar results which we move away from the more we quantize. when you re-quantize in activation

