Sachin Desai
@sach1n
ID: 1645061
20-03-2007 16:31:55
12 Tweet
34 Followers
483 Following
MLX running OpenELM on an iPhone. Thanks for the framework Awni Hannun
Just ported Qwen2.5-VL-3B-Instruct to MLX Swift. Many thanks to Prince Canuma for the Python version from which this is based upon. Awni Hannun I’ll do further testing and send out a PR later this week.
Voice on mobile with interruption using Apple’s SpeechAnalyzer, MLX Swift for running the LLM and the following CoreML models: Kokoro, Silero and SegmentAnyText. All running in orchestration. Awni Hannun Fluid Inference
This is Granite 4.0 Nano running on an iPhone 17 Pro with MLX Swift. This is the 350M parameter model and the 1B runs equally well. IBM Developer