Amil Dravid
@_amildravid
PhD @Berkeley_AI
ID: 1639674617378795520
http://avdravid.github.io 25-03-2023 17:04:54
170 Tweet
601 Takipรงi
459 Takip Edilen
Artifacts in your attention maps? Forgot to train with registers? Use ๐ฉ๐๐จ๐ฉ-๐ฉ๐๐ข๐ ๐ง๐๐๐๐จ๐ฉ๐๐ง๐จ! We find a sparse set of activations set artifact positions. We can shift them anywhere ("Shifted") โ even outside the image into an untrained token. Clean maps, no retrain.
