Omar Khattab (@lateinteraction) 's Twitter Profile
Omar Khattab

@lateinteraction

Incoming asst professor @MIT EECS (@nlp_mit). Research scientist @Databricks.
Author of ColBERT.ai & DSPy.ai. Prev: CS PhD @StanfordNLP.

ID: 1605274291569799168

linkhttps://omarkhattab.com/ calendar_today20-12-2022 18:50:07

6,6K Tweet

18,18K Followers

2,2K Following

Omar Khattab (@lateinteraction) 's Twitter Profile Photo
Omar Khattab
@lateinteraction

2 months ago

Ah! I must have guessed ModernColBERT will have 8K context window. And I suspect that unlike 8K context windows from single-vector models (which notoriously rarely work), I'd expect this thing to actually just work. Incredible work Antoine Chaffin & LightOn team.