Minh Nhat Nguyen (@menhguin) 's Twitter Profile
Minh Nhat Nguyen

@menhguin

robotics + ai alignment. prev: owner of @AIHubCentral (1 million users), product @hume_ai.

ID: 969181169408385025

linkhttps://linktr.ee/menhguin calendar_today01-03-2018 12:02:52

8,8K Tweet

1,1K Followers

2,2K Following

Minh Nhat Nguyen (@menhguin) 's Twitter Profile Photo
Minh Nhat Nguyen
@menhguin

2 months ago

Hi! Guess the secret’s out: Introducing Min P, a token sampling method for LLMs. Using < 10 lines of code, we achieve 10-20% better results on GSM8K and GPQA vs Top P at temperature=1. Interestingly, reasoning on GPQA and creative writing ability *improves* as temperature > 1 🧵

Hi! Guess the secret’s out: Introducing Min P, a token sampling method for LLMs. Using &lt; 10 lines of code, we achieve 10-20% better results on GSM8K and GPQA vs Top P at temperature=1. Interestingly, reasoning on GPQA and creative writing ability *improves* as temperature &gt; 1 🧵