AaltoMediaAI
@aaltomediaai
@AaltoUniversity’s AI&ML for media, art & design course. This is a public backlog of material for updating the course.
ID: 1206637723802578944
https://github.com/PerttuHamalainen/MediaAI 16-12-2019 18:11:12
1,1K Tweet
249 Followers
170 Following
This is interesting as a first large diffusion-based LLM. Most of the LLMs you've been seeing are ~clones as far as the core modeling approach goes. They're all trained "autoregressively", i.e. predicting tokens from left to right. Diffusion is different - it doesn't go left to