🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

Hi media arts friends, what are some good examples of reactive music? Music that dynamically adapts to your dance moves? To actions or scenes in a game? Instances where people interact with some machine learning to play an instrument? #creativecoding

Left: a sick larsberg webgl demo. Right: a sick chthulu tentacle in SD1.5 (SDTurbo). Hacked the StreamDiffusion demo frontend to give me control over denoising and CFG.

Speculative VJing with StreamDiffusion, music by Feverkin whom I recently discovered from Clint's VFX competitions.

Unstable sculptures. Underlying simulation is curl noise in Unreal Engine 5 with Lumen, total overkill for SD, but it provides lighting hints for the diffusion model to pick up on and emulate. #AIart #UnrealEngine

Left: Unreal Engine curl noise sim with Lumen Right: StreamDiffusion interpretation retaining some of the forms and lighting information Ironically OBS (my screen recorder) kills about 5fps from the diffusion.

I got this portal cloud thing fast enough to be audio reactive

Together with YouTube, we’ve been building Music AI Sandbox, a suite of AI tools to transform how music can be created. 🎵 To help us design and test them, we’ve been working closely with musicians, songwriters and producers. ↓ #GoogleIO

現状最新の生成AIを使いまくってMV的なものを作ってみました(内容はめちゃくちゃ)🙌 Tools Utilized ↓ Music : ChatGPT,Sunoai Video : DreamMachine,Gen-3,Kling Image :MJ,SD Edit : Ps,Ae 特に人物とかは大きい画面で見ると粗が目立ちますが、使い方次第でなんとか誤魔化せるかなといった感じ🤔

Learning #unreal PCG mech, created a procedural torso/chasis which conforms to the desired body shape while adding details (via kitbash).

⚡️Cool! This is something I've been working at Google DeepMind on for the past ten months. It's been a wild ride, I've been leading engineering, working with amazing designers, and researchers, and I got the chance to work with amazing musicians like wyclef jean Justin Tranter!!

PRISM stands for Parallel Reality Investigation and Stability Management. This is a short #AIart film using Hailuo AI (MiniMax) Midjourney and ElevenLabs and edited using open source Kdenlive video editor. I put the storyboard together using FigJam.

youtu.be/0DLz85y-XWQ I created a short film using GenAI, this time with extensive use of Runway Act-One! I did the performance capture and voice-acting then converted them to various vocals using ElevenLabs