Zain☄️ (@zainhasan6) 's Twitter Profile
Zain☄️

@zainhasan6

I build & teach AI stuff. | AI/ML @weaviate_io | ℕΨ @UofT Engineering | Data Scientist | Lecturer 🇨🇦🇵🇰
Views not mine!!

ID: 781542714

linkhttps://www.linkedin.com/in/zainhas calendar_today26-08-2012 02:51:03

1,1K Tweet

2,2K Followers

1,1K Following

Zain☄️ (@zainhasan6) 's Twitter Profile Photo
Zain☄️
@zainhasan6

6 months ago

New model from Mistral - Pixtral 12b language vision model architecture: "dim": 5120, "n_layers": 40, "head_dim": 128, "hidden_dim": 14336, "n_heads": 32, "n_kv_heads": 8, "rope_theta": 1000000000.0, "norm_eps": 1e-05, "vocab_size": 131072, "vision_encoder": "hidden_size":