Excited to announce version 0.4 of the Google AI Language Interpretability Tool (🔥LIT), our open-source visualization and understanding platform for NLP and more. Tons of new features! pair-code.github.io/lit/ #NLProc #googlePAIR (1/7)

In 2021, we've seen an explosion of grounded Langage Models: from "image/video+text" to more embodied models in "simulation+text" But, when tested on text benchmarks, these grounded models really struggle to improve over pure text-LM e.g T5/GPT3 Why? >>

I recently found out I'm going to be a father. Here are the principles I want to teach my child to live by:

1- Training Object Detection Models Tips & Tricks x.com/ai_fast_track/…

✨🎁🎁Super excited to announce the Data Measurements Tool! An open-source project (coded up personally by me, Yacine Jernite, and Sasha Luccioni, PhD 🦋🌎✨🤗) for building, measuring, and comparing datasets -- no programming required!🎁🎁✨ huggingface.co/blog/data-meas…

arxiv.org/abs/2112.02721 NL-Augmenter: a participatory Python-based natural language augmentation framework. Currently, supports 117 transformations and 23 filters I'm one of the co-authors :) andlukyane.com/blog/paper-rev…

HuggingFace should start developing a PyTorchLightning fork that they use in their libs. The API changes between the two libs cause unwanted grief in codebases.

LaMDA: Language Models for Dialog Applications abs: arxiv.org/abs/2201.08239 LaMDA is a family of Transformer based neural language models specialized for dialog, which have up to 137B parameters and are pre-trained on 1.56T words of public dialog data and web text

Google AI introduces 2 models for dialogue modeling: 1. Description-Driven Task-Oriented Dialogue 2. Show Don’t Tell Both models: 1. achieve generalization to unseen tasks and domains 2. show state-of-the-art performance Google AI open-sourced the code. 1/2

So excited to finally open up access to these models! Couldn't have asked for a better team to do this with: Stephen Roller, Naman Goyal (Myle Ott + Sam Shleifer at the start too)!

Facebook as a social media company may have done controversial stuff, but Facebook as a tech company has been simply exceptional: - React JS - GraphQL - PyTorch - ONNX Very few companies that have led the development of such game changing, open-source tools across domains.

Bojan Tunguz most of the jobs ask for master's degree in a related field, how is it lowest barrier? I think it's front end development as I see so many self taught people with no related academic background there there's a lot of churn with self taught people in DS that you don't see

Best football game ever. The best sport in the world. UNBELIEVABLE.

The Gradio Demo for Custom Diffusion: Multi-Concept Customization of Text-to-Image Diffusion is out on Hugging Face Spaces demo: huggingface.co/spaces/nupurkm…

My thoughts on Toolformer IMO the most important paper in the past few weeks. arxiv.org/abs/2302.04761 Teach an LLM to use tools, like a calculator or search engine, in a *self-supervised manner* Interesting hack to resolve many blind spots of current LLMs Here's how 👇

Can someone point me to a paper/doc about hyperparameter tuning of #diffusion models? If you don't know, tag someone who might? Thanks!

When you're working on a startup, it's quite normal for people to (1) seem unimpressed by what you've built, (2) think your idea is incremental, (3) think someone else is likelier to succeed that's well funded. All you can do is just keep chippin' away. Your day will come.

BloombergGPT: A Large Language Model for Finance a 50 billion parameter language model that is trained on a wide range of financial data. Construct a 363 billion token dataset based on Bloomberg’s extensive data sources, perhaps the largest arxiv.org/abs/2303.17564

Excited to announce we've raised 62.7M$ at 1.04B$ valuation, led by Daniel Gross, along with Stan Druckenmiller, NVIDIA, Jeff Bezos, Tobi Lutke, Garry Tan, Andrej Karpathy, Dylan Field, Elad Gil, Nat Friedman, IVP, NEA, Jakob Uszkoreit, Naval Ravikant, Brad Gerstner, and Lip-Bu

Why the whole banking system is a scam. Filmed nearly 5 years ago!! Let's share these videos so that the transition is smoother for the government/banking believers!! #Cryptocurrency #Bitcoin