Jaechul Roh (@jaechulroh) 's Twitter Profile
Jaechul Roh

@jaechulroh

PhD Student in Computer Science @UMassAmherst | Privacy and Security in AI

ID: 1697603410479247360

linkhttp://jrohsc.github.io calendar_today01-09-2023 13:32:52

28 Tweet

107 Takipçi

121 Takip Edilen

Niloofar (on faculty job market!) (@niloofar_mire) 's Twitter Profile Photo

We (w Zachary Novack Jaechul Roh et al.) are working on #memorization in #audio models & are conducting a human study on generated #music similarity. Please help us out by taking our short listening test (available in English, Mandarin & Cantonese). You can do more than one! Link ⬇️

Jaechul Roh (@jaechulroh) 's Twitter Profile Photo

✨ Thrilled to be joining Brave as a Summer Research Intern where I’ll be working on privacy and security of AI agents. Excited to learn, contribute, and collaborate! 🧠🔐 #AI #safety #internship

✨ Thrilled to be joining <a href="/brave/">Brave</a> as a Summer Research Intern where I’ll be working on privacy and security of AI agents.

Excited to learn, contribute, and collaborate! 🧠🔐 #AI #safety #internship
Niloofar (on faculty job market!) (@niloofar_mire) 's Twitter Profile Photo

We find that memorization can go *beyond modalities*, with *gibberish* lyrics that sounds similar to original work eliciting same song/voice as the original work! Check out our new phonetic attack that works on Veo3 and SUNO!

Jaechul Roh (@jaechulroh) 's Twitter Profile Photo

𝗧𝘂𝗿𝗻𝘀 𝗼𝘂𝘁 𝘆𝗼𝘂 𝗱𝗼𝗻’𝘁 𝗻𝗲𝗲𝗱 𝘁𝗼 𝘀𝗮𝘆 𝘁𝗵𝗲 𝗹𝘆𝗿𝗶𝗰𝘀 — just 𝘴𝘰𝘶𝘯𝘥 like them. Our new phonetic attack shows that music and video generators like 𝚂𝚄𝙽𝙾, 𝚈𝚞𝙴, and 𝚅𝚎𝚘 𝟹 memorize songs through 𝙝𝙤𝙢𝙤𝙥𝙝𝙤𝙣𝙞𝙘 𝙨𝙝𝙖𝙙𝙤𝙬𝙨 — regurgitating

Ed Newton-Rex (@ednewtonrex) 's Twitter Profile Photo

This new paper suggests AI music models are memorizing music they're trained on. Using phonetic substitutions in the lyrics, they get music that sounds strikingly similar to well-known songs. e.g. Lose Yourself, from Suno (with no genre specified by the user) 🧵 1/n

Jaechul Roh (@jaechulroh) 's Twitter Profile Photo

Turns out you don’t need the lyrics—just the sound of them. Our 𝐀𝐏𝐓 𝐚𝐭𝐭𝐚𝐜𝐤 shows AI music & video models regurgitate iconic songs through phonetic shadows.