Joel Fernandes 🐧🇺🇸 (@joel_linux) 's Twitter Profile
Joel Fernandes 🐧🇺🇸

@joel_linux

My thoughts on work, open source and occasional rants about world affairs. When in doubt, turn it inside out. Also on Mastodon: @[email protected]

ID: 37205668

calendar_today02-05-2009 14:29:43

1,1K Tweet

1,1K Takipçi

636 Takip Edilen

Joel Fernandes 🐧🇺🇸 (@joel_linux) 's Twitter Profile Photo
Joel Fernandes 🐧🇺🇸
@joel_linux

8 months ago

I am wondering why #LLM coding benchmarks like #Aider Polyglot reveal the coding problems they are testing on. Doesn’t that give the models an opportunity to be trained on the problems in advance, thus defeating the scoring? aider.chat/2024/12/21/pol… github.com/Aider-AI/polyg…