@_lorenzkuhn : How can we measure how uncertain LLMs are about their generations? In our spotlight at #iclr25023 with @yaringal & @sebfar, we introduce "semantic entropy", the entropy over meanings rather than sequences, and show that it reliably measures LM uncertainty🧵arxiv.org/abs/2302.09664 • TwiCopy

Lorenz Kuhn

@_lorenzkuhn

+ Follow

Researcher @OpenAI

ID: 2273486471

calendar_today10-01-2014 19:42:03

244 Tweet

472 Followers

730 Following

Lorenz Kuhn

@_lorenzkuhn

2 years ago

How can we measure how uncertain LLMs are about their generations? In our spotlight at #iclr2023 with Yarin & Sebastian Faray, we introduce "semantic entropy", the entropy over meanings rather than sequences, and show that it reliably measures LM uncertainty🧵arxiv.org/abs/2302.09664

thumb_up_off_alt177

chat_bubble_outline4

repeat29

shareShare