👍🏻

Explore the counterintuitive insights behind the performant RaBitQ algorithm for binary and scalar quantization in vector databases! dev.to/gaoj0017/quant… #RAG #vectorsearch #vectordatabase #rabitq

👍🏻

New paper! “In-Context Learning of Representations” What happens to an LLM’s internal representations in the large context limit? We find that LLMs form “in-context representations” to match the structure of the task given in context! 1/n

A very strong and elegant vector quantization algorithm!

Excited to announce our recent work on understanding training-time emergence in Transformers! Thread🧵(1/11)