Assem
@achammah1
I like solving problems | ⚡️building @nexus_gpt
ID: 1247194373000962049
06-04-2020 16:08:13
374 Tweet
1,1K Followers
460 Following
JSON is token‑expensive for LLMs – just like Matt Pocock frequently mentions. Meet TOON, the Token‑Oriented Object Notation. 💸 40–60% fewer tokens than JSON 📐 readable & tokenizer-aware Wrap your JSON with `encode` to save half the token cost: github.com/johannschoppli…
Love these kinds of innovation. Johann Schopplich - would love to know if there are any drop of performance or accuracy of retrieval in toon vs. json