Jaechul Roh (@jaechulroh) 's Twitter Profile
Jaechul Roh

@jaechulroh

PhD Student in Computer Science @UMassAmherst | Privacy and Security in AI

ID: 1697603410479247360

linkhttp://jrohsc.github.io calendar_today01-09-2023 13:32:52

28 Tweet

107 Followers

121 Following

Niloofar (on faculty job market!) (@niloofar_mire) 's Twitter Profile Photo

We (w Zachary Novack Jaechul Roh et al.) are working on #memorization in #audio models & are conducting a human study on generated #music similarity. Please help us out by taking our short listening test (available in English, Mandarin & Cantonese). You can do more than one! Link โฌ‡๏ธ

Jaechul Roh (@jaechulroh) 's Twitter Profile Photo

โœจ Thrilled to be joining Brave as a Summer Research Intern where Iโ€™ll be working on privacy and security of AI agents. Excited to learn, contribute, and collaborate! ๐Ÿง ๐Ÿ” #AI #safety #internship

โœจ Thrilled to be joining <a href="/brave/">Brave</a> as a Summer Research Intern where Iโ€™ll be working on privacy and security of AI agents.

Excited to learn, contribute, and collaborate! ๐Ÿง ๐Ÿ” #AI #safety #internship
Niloofar (on faculty job market!) (@niloofar_mire) 's Twitter Profile Photo

We find that memorization can go *beyond modalities*, with *gibberish* lyrics that sounds similar to original work eliciting same song/voice as the original work! Check out our new phonetic attack that works on Veo3 and SUNO!

Jaechul Roh (@jaechulroh) 's Twitter Profile Photo

๐—ง๐˜‚๐—ฟ๐—ป๐˜€ ๐—ผ๐˜‚๐˜ ๐˜†๐—ผ๐˜‚ ๐—ฑ๐—ผ๐—ปโ€™๐˜ ๐—ป๐—ฒ๐—ฒ๐—ฑ ๐˜๐—ผ ๐˜€๐—ฎ๐˜† ๐˜๐—ต๐—ฒ ๐—น๐˜†๐—ฟ๐—ถ๐—ฐ๐˜€ โ€” just ๐˜ด๐˜ฐ๐˜ถ๐˜ฏ๐˜ฅ like them. Our new phonetic attack shows that music and video generators like ๐š‚๐š„๐™ฝ๐™พ, ๐šˆ๐šž๐™ด, and ๐š…๐šŽ๐š˜ ๐Ÿน memorize songs through ๐™๐™ค๐™ข๐™ค๐™ฅ๐™๐™ค๐™ฃ๐™ž๐™˜ ๐™จ๐™๐™–๐™™๐™ค๐™ฌ๐™จ โ€” regurgitating

Ed Newton-Rex (@ednewtonrex) 's Twitter Profile Photo

This new paper suggests AI music models are memorizing music they're trained on. Using phonetic substitutions in the lyrics, they get music that sounds strikingly similar to well-known songs. e.g. Lose Yourself, from Suno (with no genre specified by the user) ๐Ÿงต 1/n

Jaechul Roh (@jaechulroh) 's Twitter Profile Photo

Turns out you donโ€™t need the lyricsโ€”just the sound of them. Our ๐€๐๐“ ๐š๐ญ๐ญ๐š๐œ๐ค shows AI music & video models regurgitate iconic songs through phonetic shadows.