Amir M. Mir (@amir_mir93) 's Twitter Profile
Amir M. Mir

@amir_mir93

AI/ML Research Engineer | Software Developer | Researcher | PhD in CS | Opinions are my own

ID: 1269012979921620992

linkhttp://mirblog.net calendar_today05-06-2020 21:08:05

270 Tweet

313 Followers

214 Following

Amir M. Mir (@amir_mir93) 's Twitter Profile Photo
Amir M. Mir
@amir_mir93

a month ago

I've tried OpenAI's open-source model, gpt-oss 20B. It's like using an o3-mini model locally for "free", given a high-end consumer-grade GPU (RTX 5090). Perf. metrics for enthusiasts: - ~150-200 tok/s - 64K context (~24GB VRAM) - CUDA 12.8 runtime #LLM #GPT #OSS