Happy to introduce GERALD - our new VLM that recognizes 6M+ entities, an exciting step towards Web-scale visual entity recognition! Predictions are simply made by auto-regressively decoding a code representing the entity name. Check out our CVPR24 paper: arxiv.org/abs/2403.02041

Congratulation to the test of time award winners

Meta announces Movie Gen A Cast of Media Foundation Models We present Movie Gen, a cast of foundation models that generates high-quality, 1080p HD videos with different aspect ratios and synchronized audio. We also show additional capabilities such as precise instruction-based

Excited to share MonST3R! -- a simple way to estimate geometry from unposed video of dynamic scene We achieve competitive results on several downstreams (video depth, camera pose) and believe this is a promising step toward feed-forward 4D reconstruction monst3r-project.github.io

Glad to see our last year NeurIPS 2023 paper Hierarchical Open-vocabulary Universal Image Segmentation(HIPIE) is making real world impacts. proceedings.neurips.cc/paper_files/pa… XuDong Wang

Super cool open-sourced video generation model! Congratulations 🎉 Ajay Jain