#codelm2020

Just applied to the residency! I'm excited about meeting fellow builders and working on innovative ideas near the Bay Area.

We (Rohit Dilip Alex Beatson Ishaan Javali + I) won 2nd place & the Chroma prize at the Scale AI GenAI hackathon w/ Protex: the protein therapeutics universe is immense, we focus the search space w/ OpenAI & Meta ESM embeddings of InterPro, Chroma vector db, InfoNCE & Vercel

🚀👨‍💻👨‍💻👨‍💻👨‍💻

1/ While most RL methods use shallow MLPs (~2–5 layers), we show that scaling up to 1000-layers for contrastive RL (CRL) can significantly boost performance, ranging from doubling performance to 50x on a diverse suite of robotic tasks. Webpage+Paper+Code: wang-kevin3290.github.io/scaling-crl/

Check out this new paper by Kevin Wang, myself, Michał Bortkiewicz, Tomasz Trzcinski, and Ben Eysenbach! We show a method for scaling Contrastive RL, leading to significant performance improvements.

Happy to share that our work “1000 Layer Networks for Self-Supervised RL: Scaling Depth Can Enable New Goal-Reaching Capabilities” was accepted to #NeurIPS2025 as an Oral Presentation! Grateful to my amazing collaborators Ishaan Javali Michał Bortkiewicz Ben Eysenbach 🥳