Sonia (@soniajoseph_) 's Twitter Profile
Sonia

@soniajoseph_

AI researcher @AIatMeta. getting ML PhD @Mila_Quebec. prev @Princeton.

ID: 3409885648

calendar_today09-08-2015 06:09:07

1,1K Tweet

14,14K Takipçi

1,1K Takip Edilen

Sonia (@soniajoseph_) 's Twitter Profile Photo
Sonia
@soniajoseph_

2 months ago

Some interesting observations: Vision SAEs differ from language-- e.g. token-specific specialization. The CLS token sparsity gradually decreases as global info accumulates. We plot % of alive SAE features by layer, showing how the network constructs a global representation.

Some interesting observations: Vision SAEs differ from language-- e.g. token-specific specialization. The CLS token sparsity gradually decreases as global info accumulates. We plot % of alive SAE features by layer, showing how the network constructs a global representation.