Roman Ring (@inoryy) 's Twitter Profile
Roman Ring

@inoryy

[email protected]

Research Engineer @DeepMind

Large Scale Deep Learning Is All You Need?

AlphaStar, Gopher, Flamingo, ???

ID: 328595919

linkhttp://inoryy.com calendar_today03-07-2011 17:33:59

1,1K Tweet

3,3K Followers

717 Following

Roman Ring (@inoryy) 's Twitter Profile Photo

A group of Flamingos is called “flamboyance” which could be an apt description for the family of vision-language models I’m thrilled to see out in the wild! I believe using large pre-trained models in creative ways will be key and hope our work is a step in the right direction.

Roman Ring (@inoryy) 's Twitter Profile Photo

10 yrs ago Andrej Karpathy wrote a blog post on the outlook of AI: karpathy.github.io/2012/10/22/sta… in which he describes how difficult it would be for an AI to understand a given photo, concluding "we are very, very far and this depresses me." Today, our Flamingo steps up to the challenge.

10 yrs ago <a href="/karpathy/">Andrej Karpathy</a> wrote a blog post on the outlook of AI: karpathy.github.io/2012/10/22/sta… in which he describes how difficult it would be for an AI to understand a given photo, concluding "we are very, very far and this depresses me."
Today, our Flamingo steps up to the challenge.
Roman Ring (@inoryy) 's Twitter Profile Photo

To be clear, of course we're not quite there yet. I had to lead the dialogue, correct rug <> scale, and explicitly ask about the joke. Andrej's "challenge" greatly influenced my outlook on AI and it was really exciting for me to see Flamingo handle it at all. I'll take "cute" :)

JB Alayrac (@jalayrac) 's Twitter Profile Photo

It is great to see the excitement about 🦩! As shown in different examples during the last few days, interacting with 🦩 has been quite fun, unique and sometimes mind blowing. However,🦩 has clear limitations as detailed in this 🧵! 1/11

Roman Ring (@inoryy) 's Twitter Profile Photo

Amazing news! TPUv4's were instrumental for some of the recent large-scale efforts at DeepMind such as Chinchilla and Flamingo.

Roman Ring (@inoryy) 's Twitter Profile Photo

I feel like that blinking white guy meme coming back from a period of minimal social media to a Twitter full of stable diffusion / midjourney generated artwork. Genuinely in awe of the pace of progress.

Roman Ring (@inoryy) 's Twitter Profile Photo

I don't think Twitter will go down soon, mostly because I believe the (ex) eng and infra teams did a good job building resilient systems. But it's unlikely I'll be posting from now on. To anyone stumbling on my profile seeking advice on AI, feel free to reach out via email.