Solution2️⃣: Human-Elicitation We designed an interface with visual prompts to induce a TOT state in human participants. Their queries closely match authentic TOT queries and captures genuine TOT experiences in a controlled setting.

⚡️Multi-Domain Coverage Combining both methods allows TOT query evaluation in multiple domains. We tested simulated evaluation in Movie, Landmark, and Person domains. Moreover, we build a broader, more inclusive TOT test collection.

📂 Our Code & Data 🔗LLM-Elicitation: github.com/kimdanny/llm-t… 🔗Human query collection interface with visual stimuli set: github.com/kimdanny/human…

These approaches powered the TREC 2024 TOT track test queries and will continue into the 2025 track (trec-tot.github.io). Joyful collaboration with Yifan He, Fernando Diaz, Jaime Arguello, and Bhaskar Mitra | ভাস্কর মিত্র! #SIGIR #TREC #TOT

Hello TREC-ToTers! 👋🏽 Excited to announce the release of TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track guidelines: trec-tot.github.io/guidelines. We will release test queries in July and run submission deadline will be in August. #TRECToT #TREC2025ToT Please register to participate:

Please share the word and register to participate! #TREC2025ToT

Do not forget to participate in the #TREC2025 Tip-of-the-Tongue (ToT) Track :) The corpus and baselines (with run files) are now available and easily accessible via the ir_datasets API and the HuggingFace Datasets API. More details are available at: trec-tot.github.io/guidelines

Hello TREC-ToTers! We have released the test queries for the TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track. Please see the guidelines for more information: trec-tot.github.io/guidelines. Run submission deadline will tentatively be in August. #TREC2025 #TRECToT #TREC2025ToT

📣📣📣

Important announcement: All run submissions for the TREC'25 Tip-of-the-Tongue (TREC-ToT) Track are due by **August 27th**. The run submission form is now open. Please submit your runs before the deadline. More information: trec-tot.github.io/guidelines #TREC2025 #TRECToT #TREC2025ToT

Hello TREC-ToTers! 👋🏽 Please note that the deadline for run submissions this year is **Aug 27**. Please spread the word! 🙏🏽

This year's TREC Tip of the Tongue track will be amazing! Based on our rigorous experiments on synthetic ToT query generation presented at #SIGIR2025, we extended the track to open domain ToT queries. We provide codes for baseline systems, and submissions are due by August 27th!

Gentle reminder 📢 All run submissions for the Tip-of-the-Tongue (ToT) Track are due next week Wednesday (Aug 27). More info: trec-tot.github.io/guidelines #TREC2025 #TRECToT #TREC2025ToT

📆 Please note the deadline extension for #TREC2025 Tip-of-the-Tongue (ToT) Track! Track guidelines: trec-tot.github.io/guidelines #TRECToT #TREC2025ToT

We are coming to Tokyo!!! ✈️

Tip of the Tongue retrieval shared task is coming to Tokyo!

⏰ Gentle reminder: Run submission deadline for TREC'25 Tip-of-the-Tongue (ToT) Track is end-of-day **Wednesday (Sep 10)** Anywhere-on-Earth (AoE). Please make sure to submit your runs before the deadline. Guidelines: trec-tot.github.io/guidelines #TREC2025 #TRECToT #TREC2025ToT

It's deadline day! 🏃🏾‍♂️🏃🏾🏃🏾‍♀️ #TREC2025 #TRECToT #TREC2025ToT