Luke Marsden
@lmarsden
CEO @helixml - Private GenAI Platform helix.ml. Owner mlops.consulting. Founder mlops.community. Hacker & entrepreneur
ID: 21925637
https://helix.ml 25-02-2009 21:58:39
3,3K Tweet
2,2K Followers
2,2K Following
What Is an AI Native Developer? | By Jennifer Riggins feat. Guy Podjarny, Luke Marsden, Mike Mason thenewstack.io/what-is-an-ai-…
Great piece, Jennifer Riggins rocks 🤘
. Shreya Shankar 's paper confirms what I see in practice 1) Automated evals don't work (without semi-manual human alignment) 2) Most tools don't provide this alignment 3) Automated evals add mostly noise 4) You can only write good evals by looking at data and reacting to failures