so excited to introduce PyTorch 2.0, a year in the works. Still early, be gentle :)

Dive deep with PyTorch engineers talking about exactly how this magic works under the hood: youtu.be/vbtGZL7IrAw Try torch.compile on your training scripts today! #PyTorchConference

"The Map Becomes The Territory" ...is an entirely AI-made ultra short film wherein I summoned the spirit, look & voice of of Marshall McLuhan to rewrite Borges' "On Exactitude in Science" this was shown first at Promptopia in NYC and The Culture DAO's AI film festival in SF...

Awesome memories at PyTorch Conference with Justin Suraj Subramanian @christianbkrr

"Without weight, without bones, without body, walked through the streets for two hours considering what I overcame this afternoon while writing" #TIL Kafka's journalling style to cure his creative inertia: a few sentences that paint the state of his mind or the world that day

I compared the current stable version of PyTorch (1.13) with the recently announced PyTorch 2.0 (with its highlight being the compile mode🔥). TL;DR: I saw a massive 30% reduction in training times💥 . Complete analysis in the Weights & Biases report: tinyurl.com/4da2vbaf

Repeat after me: 1. Current Auto-Regressive LLMs are *very* useful as writing aids (yes, even for medical reports). 2. They are not reliable as factual information sources. 3. Writing assistance is like driving assistance: your hands must remain on the keyboard/wheel at all times

GPT3 expands "LLMs" to "Lifelike Language Machines"... hmm.

New blogpost! a visual primer on how PyTorch 2.0 compiler technologies for graph capture, IRs, operator fusions and automatic C++ and NVIDIA AI Developer GPU code generation. This is your one stop shop to grok PyTorch 2.0's torch.compile() API Summary 🧵👇 medium.com/towards-data-s…

Great essay placing AI in historical context from someone who should know: history professor & award-winning science fiction author Ada Palmer “Knowledge empowers; experience empowers; expression empowers; each of these twenty generations has been more powerful than the last.”

More than 69 hours since Adobe released Photoshop Beta with AI. 🪄 7 mind-blowing examples:

When it was released, PyTorch won the hearts of AI researchers. Today, it is trusted by data scientists & ML engineering teams around the world, with first-class support on all cloud providers & AI hw. Discover the story in our podcast! pca.st/5mzi87da

Soft Prompts is nothing but humans teaching language models the art of poetic license in latent space

The lack of deep engagement with the humanities results in several key problems that undermine a full understanding of AI and its societal impacts: 1. Narrow definitions of intelligence. Without input from philosophy, psychology, and other fields, AI researchers tend to operate

A completely open-source AI Wearable device like Avi’s Tab, Rewind’s pendant, and Humane’s Pin! Not only is it open-source, where you can own your data and switch between foundation models, but you can actually set it up today, not in a few months (oh, and it's cheaper!)

Excerpt from a video I just posted on YouTube (about the multilayer perception layers in a transformer, and how LLMs may store facts).