John T Davies πΊπ¦πͺπΊπ
@jtdavies
Entrepreneur, CTO in Gen-AI, investor, father to 3 grown boys, husband to Rachel, astrophysicist, keen photographer, cyclist, ΓΌber-geek, travelled a lot.
ID: 15784290
http://www.johntdavies.com 08-08-2008 23:20:02
3,3K Tweet
1,1K Followers
531 Following
310 Tokens / second with an unquantised (bf16) model using MLX, this is CRAZY fast! I've just tried the new MLX-VML beta from Prince Canuma (using an M4 Max). DeepSeek-OCR (3B) on MLX is a game-changer.