functorch A prototype of JAX-like composable function transforms for pytorch. It aims to provide composable vmap and grad transforms that work with PyTorch modules and autograd with good eager-mode performance. github.com/facebookresear…

Super excited to share the next step of my #AI journey with the founding of my own company and an incredible $83.5M Series A financing round. Join me @waabi_ai and help us build the next generation of self-driving tech, check out waabi.ai globenewswire.com/news-release/2…

PyTorch 1.9 is here! Highlights include improvements for: - torch.linalg, torch.special, and Complex Autograd - Mobile Interpreter - TorchElastic - The PyTorch RPC framework - APIs for model inference deployment - PyTorch Profiler See full details👇 pytorch.org/blog/pytorch-1…

After a lot of work, we have finished the implementation of PEP 657 🚀🎉. In Python 3.11🐍, tracebacks will annotate where exactly the error is happening in your code 🤯. No more confusion having to guess what part of the expression is wrong. Learn more at python.org/dev/peps/pep-0…

Today we're announcing fastchan, a new conda mini-distribution with a focus on the PyTorch ecosystem. Using fastchan, installation and updates of libraries such as PyTorch, Hugging Face and RAPIDS AI is faster, easier, and more reliable fast.ai/2021/07/15/fas…

Large-Scale Differentially Private BERT pdf: arxiv.org/pdf/2108.01624… abs: arxiv.org/abs/2108.01624 achieves a masked language model accuracy of 60.5% at a batch size of 2M

#UWaterloo Professor Gautam Kamath is featured in this WIRED article discussing AI system learning and privacy concerns. Read more here: bit.ly/UW-GKamath | Waterloo Mathematics Waterloo's Cheriton School of Computer Science

Research internships are now available Waabi. All year long, with duration of 3-12 months. Available in both Canada as well as US. Join the team at the forefront of innovation in #SelfDrivingCars ! Apply: jobs.lever.co/waabi/ad3c77da…

I am looking for incoming students at NYU Courant CS or Center for Data Sci starting fall 2022. If you have interest in working with me on topics like meta/continual/embodied/representation learning+vision, please reach out & mention me in your PhD application. Deadline is Dec 12

github.com/MicrosoftDocs/… live-share for Jupyter notebooks!!!

an amazing opportunity and great group of people to work with! Zachary Nado was my intern manager and I could not have asked for a better mentor or internship experience 😁.

Engineering Trade-Offs in Automatic Differentiation: from TensorFlow and PyTorch to Jax and #Julialang. This post is about the differences in the tools and how the differences match the target audiences. stochasticlifestyle.com/engineering-tr…

I recently ran a workshop with @uwdsc on contributing to open source data science libraries, the video's now on YouTube: youtu.be/69GdveJcavA. I go through a live demo of contributing a new loss function to Optax!

✨🤩 This repo from Nicholas Vadivelu is a goldmine of JAX and JAX ecosystem resources: github.com/n2cholas/aweso… 🏆 Everything from @DeepMind + Google AI libraries and high-level APIs; to videos and tutorials about how to use JAX for your experiments; to models implemented in JAX.

We have successfully trained OpenFold from scratch, our trainable PyTorch implementation of AlphaFold2. The new OpenFold (OF) (slightly) outperforms AlphaFold2 (AF2). I believe this is the first publicly available reproduction of AF2. We learned a lot. A🧵1/12

🚀 I am very excited to share gymnax 🏋️ — a JAX-based library of RL environments with >20 different classic environments 🌎, which are all easily parallelizable and run on CPU/GPU/TPU. 💻[repo]: github.com/RobertTLange/g… 📜[colab]: colab.research.google.com/github/RobertT…

Same here! Excited to be a part of the community 😀.

🚨 We've extended the deadline for the "Has It Trained Yet" Workshop NeurIPS Conference 2022! Submit your papers by September 30, 2022. More info at hity-workshop.github.io/NeurIPS2022/

have an exciting announcement!! my team Shopify just released a bounty for web3 devs in collaboration w/ Gitcoin