Thomas Schranz πŸ„(@__tosh) 's Twitter Profileg
Thomas Schranz πŸ„

@__tosh

🚜 building

- 🌌 Atlas, open source data exploration for Apple Health
- β™ŸοΈ Chess Cats, iOS chess puzzle app
- πŸ“ Jam, open source Clubhouse (@jam_systems)

ID:16611962

linkhttps://magic.do calendar_today06-10-2008 09:35:09

26,5K Tweets

9,4K Followers

8,7K Following

Thomas Schranz πŸ„(@__tosh) 's Twitter Profile Photo

I wonder if it is worth to crack the long-tail of hallucinations w/ pre-training (useful!) or if the way fwd will be to just RAG it

twitter.com/giffmana/statu…

account_circle
Michael Nielsen(@michael_nielsen) 's Twitter Profile Photo

Curious what sets the scale of the height of the highest mountains. What’s the deepest explanation for why it’s ~10km on Earth, not 1 or 100 etc. Can it be deduced from radius and density and not much else? Does it then work for the moon, Mars and so on?

account_circle
Thomas Schranz πŸ„(@__tosh) 's Twitter Profile Photo

frontier model economics (atm)

* pre-training is costly
* economics more similar to jumbo jets and cruise ships
* but also: razor thin margins and fast commoditization
* almost no lock-in
* sometimes smol model is all you need
* regulatory consolidation obstacles

account_circle
Thomas Schranz πŸ„(@__tosh) 's Twitter Profile Photo

good explanation for why weaker models rank similar to GPT-4:

> if the proportion of relatively easy user questions is high, then there are fewer opportunities for a better model to distinguish itself

β€” tibbar on hacker news

news.ycombinator.com/item?id=400887…

account_circle