Charles πŸŽ‰ Frye(@charles_irl) 's Twitter Profileg
Charles πŸŽ‰ Frye

@charles_irl

ai engineer at @modal_labs. he/him.

ex @full_stack_dl, @weights_biases, phd Berkeley @Redwood_Neuro.

ID:950189417754513409

linkhttp://charlesfrye.github.io calendar_today08-01-2018 02:16:25

5,9K Tweets

8,9K Followers

1,6K Following

Edward Z. Yang(@ezyang) 's Twitter Profile Photo

It is pretty frustrating that I am basically working on an optimizing compiler for a dependently typed language (PT2 + dynamic shapes + data dependent shapes) but it is so different from the literature that I don't know if any of it is relevant to our situation

account_circle
Charles πŸŽ‰ Frye(@charles_irl) 's Twitter Profile Photo

what are some AI-powered features, tools, or products that you use?

i feel like i've fallen a bit behind as i've focused on onboarding to my new job

account_circle
Nate Raw(@_nateraw) 's Twitter Profile Photo

Here’s a fun example using Modal to text me when new shows are added at the mothership comedy clubπŸ‘€

waited to tweet until it actually helped! Have fam in town this week, got text about new show tomorrow w/ tix on sale today. I then booked manually

github.com/nateraw/modal-…

account_circle
Linus(@thesephist) 's Twitter Profile Photo

When writing about (GPT/LLMs, image models, etc.) I still struggle to pick the right word for this category. I want to avoid

- modality-specific words like 'LLM/LVM'
- specifying architecture ('Transformer')
- 'Base/Foundation model' feels arbitrary. 'generative model' feels…

account_circle
Stella Biderman(@BlancheMinerva) 's Twitter Profile Photo

Perhaps the highest praise one can give a data auditing paper: working on this paper fundamentally changed how I think about web-crawled datasets, assumptions I made about them, and how I practice data collection and cleaning.

account_circle
Charles πŸŽ‰ Frye(@charles_irl) 's Twitter Profile Photo

Wanna talk shop about evals and productionizing LLMs?

Then come through this SF MLOps Community meetup on Thursday 4/18, sponsored by Modal!

We'll have short talks from Effy Zhang of baserun.ai and Alex Reibman πŸ–‡οΈ of AgentOps πŸ–‡οΈ. And me!

lu.ma/ihvc0jc0

account_circle
Eugene Yan(@eugeneyan) 's Twitter Profile Photo

Did not expect this OH experiment to resonate so much. Thanks to everyone who's provided feedback, either via DMs or during the stream β™₯️

Did not expect this OH experiment to resonate so much. Thanks to everyone who's provided feedback, either via DMs or during the stream β™₯️
account_circle
Amelia Wattenberger πŸͺ·(@Wattenberger) 's Twitter Profile Photo

I did some cutting-edge AI research into the best way to read code. 100% now part of my workflow:

app.suno.ai/song/f44c966a-…

account_circle
Delip Rao e/Οƒ(@deliprao) 's Twitter Profile Photo

If this were a science paper, you would expect a country that picks its science workforce at random as a β€œweak baseline” and a leading nation like the US to actively experiment towards state-of-the-art, or at least beat the baseline.

Not providing a guaranteed path for…

account_circle
James Vincent(@jjvincent) 's Twitter Profile Photo

I’m beginning to think of ChatGPT as a tool that reveals weak points in institutional credibility; illuminating checks that humans should make but skip out of lack of reward, laziness etc. LLM shibboleths then show up in the text like idoine glowing in your veins before a CT scan

account_circle
Eugene Yan(@eugeneyan) 's Twitter Profile Photo

I've been trying several evals to find those that correlate well with use cases and discriminative enough for prod.

Here's an opinionated take on what works, focusing on classification, summarization, translation, copyright regurgitation, and toxicity.

eugeneyan.com/writing/evals/

account_circle