LMs can be expensive for document processing. E.g., inference over the 55M Wiki pages costs >$100K (>$0.002/1k toks)💰 We propose a strategy that reduces inference cost by 110x and can even improve quality vs. running inference over each doc directly! 💻​ github.com/HazyResearch/e…

LLMs can directly extract structured data (esp w/ Function API), but can be slow/expensive. 🤔 Instead: use LLMs to generate code, run code to extract data 💡 We now have code-based extraction in LlamaIndex 🦙 - extract df’s from arbitrary text 🧑‍💻 gpt-index.readthedocs.io/en/latest/exam…

🎉 Great news: our paper on #Evaporate, led by Simran Arora from hazyresearch, was accepted at #PVLDB2023! #Evaporate uses #LLMs to extract structured views from unstructured data. 📰 Paper: arxiv.org/abs/2304.09433 💾 Code: github.com/HazyResearch/e… #GPT4 #DB #LanguageModel

Thrilled to announce our company, essential.ai 🚀 We are in an exciting era of human-computer collaboration evolving the way we will reason with, process and generate information. At Essential AI, we are passionate on advancing capabilities in planning, reasoning,

I'm thrilled to announce our company, Essential AI . We believe that breakthroughs in AI will unlock the most profound tools for thought, advancing humanity's collective knowledge and capability. essential.ai

We are excited to announce Essential AI, founded by Ashish Vaswani and niki parmar essential.ai

Check out what the Data Team at Essential AI has been cooking! It's been a blast preparing this dataset and super excited to see what people use it for. Shoot me a DM with any questions or cool use cases.

🚀🚀

It’s wild watching Platon Mazarakis add features to Prism Code using Prism Code on his phone.