
John Sandall
@john_sandall
Data science/engineering @CoefficientData, founder @SixFiftyData, fellow @nwspk, tutor @ShootingRoots. Was: instructor @GA, @YPlan, @STIReducation, @Apple.
ID: 116844763
https://coefficient.ai 23-02-2010 19:09:29
2,2K Tweet
1,1K Followers
1,1K Following









"OpenAI may charge as much as $2,000 a month for full access to o3" o3 achieved an extremely impressive score of 91.5% on François Chollet's Abstraction & Reasoning Corpus, but at a cost of $3000 inference fees *per query*. economist.com/business/2025/…









I will be talking about evaluating AI systems in my talk tomorrow for PyData London , "Death by RMSE: A Cautionary Tale of Metrics Gone Wild" "You’ve trained the model. The eval metrics look great. But somehow, it doesn't change anything — the KPIs are static, the business

