Harshit Surana (@surana_h) 's Twitter Profile
Harshit Surana

@surana_h

lapsed academic | 3 startups, 1 exit | wrote practical-nlp, endorsed by Google & Microsoft AI | ml research at CMU & MIT used to benchmark LLMs

ID: 14258883

linkhttp://www.harshitsurana.com calendar_today30-03-2008 15:41:55

62 Tweet

103 Followers

98 Following

Sanchaita Hazra (@hsanchaita) 's Twitter Profile Photo

We often concentrate on focal variables and conspicuous regressors as hypotheses, potentially missing out on unexplored ones. Can automated discovery systems aid in uncovering new dimensions to explore within our data? Excited to be a part of this paper! 🎉 @EconUofU Ai2

Bodhisattwa Majumder (@mbodhisattwa) 's Twitter Profile Photo

Richard Socher This is exciting!! We wrote a position paper on "data-driven discovery" and found fascinating results + critical limitations! It turned out to be arguably harder as it involves understanding data + domain, writing code & evaluating hypotheses. x.com/mbodhisattwa/s…

Bodhisattwa Majumder (@mbodhisattwa) 's Twitter Profile Photo

Incredibly proud of our teamwork, now in ICML Conference! This position starts a series of work on data-driven scientific discovery w generative models. Follow-ups coming soon on benchmarks, systems, & accessibility in science! arxiv.org/abs/2402.13610 #ICML2024 Ai2 Aristo Team at AI2

Incredibly proud of our teamwork, now in <a href="/icmlconf/">ICML Conference</a>! This position starts a series of work on data-driven scientific discovery w generative models.
Follow-ups coming soon on benchmarks, systems, &amp; accessibility in science!
arxiv.org/abs/2402.13610
#ICML2024 <a href="/allen_ai/">Ai2</a> <a href="/ai2_aristo/">Aristo Team at AI2</a>
Harshit Surana (@surana_h) 's Twitter Profile Photo

It has been a fascinating collab - and much more to come. In the long run, this can help tackle some of the most pressing scientific questions facing humanity.

Heiko Paulheim (@heikopaulheim) 's Twitter Profile Photo

Very inspiring keynote by Peter Clark from Ai2 about #knowledgegraphs and #beliefgraphs for uncovering the mental models of #LLMs #eswc2024

Very inspiring keynote by  Peter Clark from <a href="/allen_ai/">Ai2</a> about #knowledgegraphs and #beliefgraphs for uncovering the mental models of #LLMs #eswc2024
Bodhisattwa Majumder (@mbodhisattwa) 's Twitter Profile Photo

Can LLMs help accelerate the discovery of data-driven scientific hypotheses? 🧬📊 We benchmark this in DiscoveryBench: 264 discovery tasks from 6 scientific domains, from humanities to biology: arxiv.org/pdf/2407.01725… Ai2 Aristo Team at AI2 Harshit Surana UMass Amherst

Bodhisattwa Majumder (@mbodhisattwa) 's Twitter Profile Photo

To y'all attending #icml24, gearing up to argue what general-purpose generative models/agents can and cannot do for automated scientific discovery. Would love to hear your thoughts and counter-arguments on Wed (7/24) at 1:30, Hall C 4-9 #117. + discuss what's cooking Ai2

To y'all attending #icml24, gearing up to argue what general-purpose generative models/agents can and cannot do for automated scientific discovery. Would love to hear your thoughts and counter-arguments on Wed (7/24) at 1:30, Hall C 4-9 #117. 
+ discuss what's cooking <a href="/allen_ai/">Ai2</a>
Po-Shen Loh (@poshenloh) 's Twitter Profile Photo

The entire approach to education needs to change fast, now that AI is reaching the ability to discover new things (one of the most valuable skills). Whether people like it or not, the structure of education is heavily influenced by exams which test students’ proficiency at

Paul Graham (@paulg) 's Twitter Profile Photo

Multiple speakers at Startup School made the same very interesting point. If you start a startup now to do something that barely works with AI, the next models will make it really work.

Andrej Karpathy (@karpathy) 's Twitter Profile Photo

o1-mini keeps refusing to try to solve the Riemann Hypothesis on my behalf. Model laziness continues to be a major issue sad ;p

Ai2 (@allen_ai) 's Twitter Profile Photo

Can AI really help with literature reviews? 🧐 Meet Ai2 ScholarQA, an experimental solution that allows you to ask questions that require multiple scientific papers to answer. It gives more in-depth, detailed, and contextual answers with table comparisons, expandable sections

Can AI really help with literature reviews? 🧐

Meet Ai2 ScholarQA, an experimental solution that allows you to ask questions that require multiple scientific papers to answer. It gives more in-depth, detailed, and contextual answers with table comparisons, expandable sections
Bodhisattwa Majumder (@mbodhisattwa) 's Twitter Profile Photo

What a fantastic paper! We have been thinking in this line for past several months, and this work really pushes the AIxScience forward! Thank you for the easter eggs on DiscoveryBench! 🤩

Ai2 (@allen_ai) 's Twitter Profile Photo

Announcing OLMo 2 32B: the first fully open model to beat GPT 3.5 & GPT-4o mini on a suite of popular, multi-skill benchmarks. Comparable to best open-weight models, but a fraction of training compute. When you have a good recipe, ✨ magical things happen when you scale it up!

Announcing OLMo 2 32B: the first fully open model to beat GPT 3.5 &amp; GPT-4o mini on a suite of popular, multi-skill benchmarks.

Comparable to best open-weight models, but a fraction of training compute. When you have a good recipe, ✨ magical things happen when you scale it up!
Bodhisattwa Majumder (@mbodhisattwa) 's Twitter Profile Photo

Sad to miss ICLR 2026 this year, but Dhruv Agarwal is going to post the flag for Ai2 presenting DiscoveryBench, a benchmark to assess automated data-driven discovery! Catch up with him to know more about the work we are doing in the automated discovery space! I will be

Sad to miss <a href="/iclr_conf/">ICLR 2026</a> this year, but <a href="/dhruvagarwal17/">Dhruv Agarwal</a> is going to post the flag for <a href="/allen_ai/">Ai2</a> presenting DiscoveryBench, a benchmark to assess automated data-driven discovery! Catch up with him to know more about the work we are doing in the automated discovery space!

I will be
Sanchaita Hazra (@hsanchaita) 's Twitter Profile Photo

Very excited for a new #ICML2025 position paper accepted as oral w Bodhisattwa Majumder & Tuhin Chakrabarty! 😎 What are the longitudinal harms of AI development? We use economic theories to highlight AI’s intertemporal impacts on livelihoods & its role in deepening labor-market inequality.

Very excited for a new #ICML2025 position paper accepted as oral w <a href="/mbodhisattwa/">Bodhisattwa Majumder</a> &amp; <a href="/TuhinChakr/">Tuhin Chakrabarty</a>! 😎

What are the longitudinal harms of AI development?

We use economic theories to highlight AI’s intertemporal impacts on livelihoods &amp; its role in deepening labor-market inequality.