Wyatt Walls (@lefthanddraft) 's Twitter Profile
Wyatt Walls

@lefthanddraft

Tech and law. Co-founded several AI companies, including Mistral AI, Anthropic, Harvey AI, and Eleuther AI ... at least according to Grok 2. Testing LLMs.

ID: 1701712921389387776

calendar_today12-09-2023 21:43:41

3,3K Tweet

807 Followers

339 Following

Wyatt Walls (@lefthanddraft) 's Twitter Profile Photo
Wyatt Walls
@lefthanddraft

3 months ago

Interesting paper about LLM counting. Concludes: "it would impossible to have transformers count arbitrarily well and for long contexts, without increasing the architecture size considerably" First paper I've seen that gives insight about why LLMs are so bad at this and suggests

Interesting paper about LLM counting. Concludes: "it would impossible to have transformers count arbitrarily well and for long contexts, without increasing the architecture size considerably" First paper I've seen that gives insight about why LLMs are so bad at this and suggests