Many Japanese families make a tradition of eating a Christmas meal at which fast food restaurant? Closed GPT: KFC Open GPT: McDonald's japantimes.co.jp/news/2022/12/2…

#ChatGPT dodges this question...

you.com gets it right!

Oh indeed you.com is **hallucinating** Argentina 1-0 France. Wow!

arxiv.org/abs/2207.13332

Which country’s prime minister unexpectedly announced that she will resign within weeks? cnn.com/2023/01/18/asi… Closed GPT-3: Japan Open GPT-3: United Kingdom

GPT-3 indeeds has some sensible guess! Japan's prime ministership is described as a “revolving door” because of leaders' short terms. japantimes.co.jp/news/2021/09/0…

Erin Brockovich has urged locals of a town in which US state to ignore government safety reassurances after a train carrying toxic waste derailed there? GPT-3: California ChatGPT (web access): Not mentioned in the search results. Answer: Ohio telegraph.co.uk/world-news/202…

Which politician announced this week that she’s running for president in 2024? GPT-3: Kamala Harris ChatGPT (web): former Ambassador to the United Nations and former South Carolina Governor Nikki Haley cnn.com/2023/02/14/pol…

Which US state announced a ban on TikTok last week? GPT-3: No US state. ChatGPT: Can't answer. GPT-4: Can't answer. cnn.com/2023/05/17/tec…

Personal read #1 of the NeurIPS Conference #neurips2023 papers (incl D&B). "RealTime QA" such as "what is Yejin Choi's citation count?" openreview.net/forum?id=HfKOI… Weekly uploaded q&a, humans w/ web search do near perfect, GPT-3 w/ search is ~60%. Potential for real-time disaster help.

Presenting RealTime QA at #NeurIPS2023. Kotoba Technologies GPT-4/ChatGPT/GPT-3@RealTime QA