murat πŸ₯(@mayfer) 's Twitter Profileg
murat πŸ₯

@mayfer

programmer / designer β€’ governance / generative art / neural nets / music / physics / math

ID:14103325

linkhttp://muratayfer.com calendar_today08-03-2008 20:40:13

10,8K Tweets

14,7K Followers

5,0K Following

dirtman (b/sac)(@terrorproforma) 's Twitter Profile Photo

Noah Smith πŸ‡πŸ‡ΊπŸ‡ΈπŸ‡ΊπŸ‡¦ Yeah potentially -

'The phosphorus that reaches Amazon soils from Saharan dust, an estimated 22,000 tons per year, is about the same amount as that lost from rain and flooding, Yu said. The finding is part of a bigger research effort to understand the role of dust and aerosols…

account_circle
murat πŸ₯(@mayfer) 's Twitter Profile Photo

whatever skill you're exceptionally good at now, would you attribute to early contextualization? (ie programmer tinkered with video game configs, musician watched a lot of live performers, etc)

different from early mastery

account_circle
Charles Foster(@CFGeek) 's Twitter Profile Photo

YES! If you initialize a LoRA layer based on the SVD of the original weight matrix (with its top singular values & vectors), you get significantly better fine-tuning results.

This is a straight-up free lunch, as far as I can tell.

account_circle