Pratik Ramesh (@pratikramesh7) 's Twitter Profile
Pratik Ramesh

@pratikramesh7

ML PhD student at Georgia Tech | Working on Representation Learning and Model Merging.

ID: 3307093524

linkhttps://pratikramesh1.github.io/ calendar_today05-08-2015 18:17:56

38 Tweet

110 Followers

632 Following

Pratik Ramesh (@pratikramesh7) 's Twitter Profile Photo
Pratik Ramesh
@pratikramesh7

10 months ago

🤔Ever wondered why merging LoRA models is trickier than fully-finetuned ones? 🔍We explore this and discover that poor alignment b/w LoRA models lead to subpar merging. 💡The solution? KnOTS🪢— our latest work that uses SVD to improve alignment and boosts SOTA merging methods.