AndyXAndersen (@andyxandersen) 's Twitter Profile
AndyXAndersen

@andyxandersen

Computer vision engineer, math phd. Interested in AI, science, ethics, society topics.

ID: 1650239073934807040

calendar_today23-04-2023 20:43:59

11,11K Tweet

346 Followers

141 Following

AndyXAndersen (@andyxandersen) 's Twitter Profile Photo

Subbarao Kambhampati (కంభంపాటి సుబ్బారావు) That is how people can reason too. We are not reasoning geniuses. We stay on track either because we can observe results of bad reasoning or we can invoke tools to do it for us.

François Chollet (@fchollet) 's Twitter Profile Photo

Today OpenAI announced o3, its next-gen reasoning model. We've worked with OpenAI to test it on ARC-AGI, and we believe it represents a significant breakthrough in getting AI to adapt to novel tasks. It scores 75.7% on the semi-private eval in low-compute mode (for $20 per task

Today OpenAI announced o3, its next-gen reasoning model. We've worked with OpenAI to test it on ARC-AGI, and we believe it represents a significant breakthrough in getting AI to adapt to novel tasks.

It scores 75.7% on the semi-private eval in low-compute mode (for $20 per task
François Chollet (@fchollet) 's Twitter Profile Photo

The limitations of specific techniques are predictable and correspondingly lead to plateaus for those techniques. But there is always the next technique, building on top of the pile that's already available. There is enough research investment that there will be no wall.

AndyXAndersen (@andyxandersen) 's Twitter Profile Photo

Chubby♨️ It will take time to convert the current flashy o3 demos to real systems that do work reliably and affordably. More time than one thinks.

Zhengyao Jiang (@zhengyaojiang) 's Twitter Profile Photo

4) Not “RL vs. Supervised,” but “Imitation+RL” Back to the first plot, my take during the PhD: The real world is too complex to learn from scratch. You first imitate human experts with supervised learning. Then RL fine-tunes performance on tasks where final results are easier to

4) Not “RL vs. Supervised,” but “Imitation+RL”
Back to the first plot, my take during the PhD:
The real world is too complex to learn from scratch. You first imitate human experts with supervised learning. Then RL fine-tunes performance on tasks where final results are easier to
François Chollet (@fchollet) 's Twitter Profile Photo

I don't think people really appreciate how simple ARC-AGI-1 was, and what solving it really means. It was designed as the simplest, most basic assessment of fluid intelligence possible. Failure to pass signifies a near-total inability to adapt or problem-solve in unfamiliar

Machine Learning Street Talk (@mlstreettalk) 's Twitter Profile Photo

This is François Chollet discussing deep learning guided program synthesis, reasoning, o-series models and the ARC challenge. We will drop the full video hopefully later today!

Boaz Barak (@boazbaraktcs) 's Twitter Profile Photo

Moving between the worlds of East coast academics and SF industry is jarring in terms of the predictions of how AI will change the world in next ~5 years. I think East coasters greatly underestimate the magnitude of change, and over index on temporary limitations of current

AndyXAndersen (@andyxandersen) 's Twitter Profile Photo

AI Notkilleveryoneism Memes ⏸️ The good guys who refuse to compete hard are just left behind. AI slowdowns and such never had much of a chance. The fight over AI safety will not be won at that level.

AndyXAndersen (@andyxandersen) 's Twitter Profile Photo

AGI will have to be able to go from language to action, to search around, to synthesize hypotheses, to work by imitation. LLM can do that. But LLM does not have fine-level understanding. As I see it, LLM needs augmentation in many ways.

AndyXAndersen (@andyxandersen) 's Twitter Profile Photo

Rob S. Exactly. Nothing to worry about. Not sarcasm. Alignment is an engineering and reliability problem. The more we deploy solutions, and the more we encounter failure, the better we will be at creating reliable solutions.

Haider. (@slow_developer) 's Twitter Profile Photo

"the world currently has a much greater demand for software than can be supplied" OpenAI CEO, Sam Altman: AI tools will improve coding efficiency to help meet this demand ...this will ultimately boost software creation and demand rather than reduce it