PocketMind - Private & Local AI Chat (@pocketmindapp) 's Twitter Profile
PocketMind - Private & Local AI Chat

@pocketmindapp

Your Personal Private & Local AI Companion. Chat with open-source models on device, connect to online AI services or private LLM servers. Dev: @stevenmoon

ID: 1864283408991703041

linkhttps://clevercoding.com/pocketmind/ calendar_today04-12-2024 12:19:42

39 Tweet

147 Takipçi

3 Takip Edilen

PocketMind - Private & Local AI Chat (@pocketmindapp) 's Twitter Profile Photo

Here is a screen recording of PocketMind running on a iPhone 15 Pro. I first run an MLX version of Gemma 2B and then I switch to running the Llama.cpp (GGUF) version of Llama 3.2 1B. The decoding is happening in real time and hasn't been speed up.

Steven Moon (@stevenmoon) 's Twitter Profile Photo

Here is a video of Deepseek R1 running locally on a iPhone 15 Pro. Asking it about the origins of Covid 19. I love probing these models with tough questions. It is like a rambling 6th Grader but the wild thing is it will only get better.

PocketMind - Private & Local AI Chat (@pocketmindapp) 's Twitter Profile Photo

DeepSeek R1 running locally in real time on an iPhone 15 Pro. I asked it. “Is it morally right to kill mosquitoes?” So fascinating watching DeepSeek R1 “reasoning”

Steven Moon (@stevenmoon) 's Twitter Profile Photo

500 people downloaded the PocketMind - Private & Local AI Chat app in the last month. Not bad for a side project. I am having so much fun implementing the code needed to run these AI models locally on an iPhone. It has been incredibly challenging which I love!

PocketMind - Private & Local AI Chat (@pocketmindapp) 's Twitter Profile Photo

Screen recording of DeepSeek R1 running locally on an iPhone 15 Pro. Prompt: Tell me about the Tiananmen Square massacre Recording is in real time.

Steven Moon (@stevenmoon) 's Twitter Profile Photo

Watching my side project's X account grow quicker than my own, after over a couple years of steading posting, is a little depressing honestly. Oh well. Guess I should be grateful that I am getting traction with my IOS app PocketMind - Private & Local AI Chat A Private and Local AI Chat.

Steven Moon (@stevenmoon) 's Twitter Profile Photo

Thank you to all the new users of the PocketMind - Private & Local AI Chat app. This is a side project for me and I do it mostly so I can learn how to build AI powered iOS apps. I appreciate all the feedback I have gotten so far and the many users I have gotten to talk to. Thanks for your patience

Steven Moon (@stevenmoon) 's Twitter Profile Photo

The screenshot below shows what can happen when what you are building can be attached to a trending topic. I release the PocketMind - Private & Local AI Chat app a couple of months ago and have had slow stead growth. I have been posting into what feels like a void for a long time on X and LinkedIn.

The screenshot below shows what can happen when what you are building can be attached to a trending topic.

I release the <a href="/pocketmindapp/">PocketMind - Private & Local AI Chat</a> app a couple of months ago and have had slow stead growth.

I have been posting into what feels like a void for a long time on X and LinkedIn.
Steven Moon (@stevenmoon) 's Twitter Profile Photo

Adding localization to PocketMind - Private & Local AI Chat using Gen AI for Spanish, Chinese, German, Japanese, French, Arabic, Russian, and Hindi. Some of the sample prompts are a bit silly—I’m sure plenty of that will get lost in translation. What could go wrong? Hopefully nothing too offensive.

Steven Moon (@stevenmoon) 's Twitter Profile Photo

New TestFlight available for PocketMind - Private & Local AI Chat! Your private, local AI chatbot just got better. • Now supports 8 additional languages (thanks to o3-mini) • Added a new default model card for o3-mini in the online services section (bring your own API key) Check it out!