OpenAdapt AI-First Process Automation with Large Multimodal Models (LMMs). github.com/OpenAdaptAI/Op…

Automate your desktop for free with OpenAdaptAI Richard Abrich joined us this week to share his open source tool that saved one user $75,000

within the next year, AI will be able to ingest everything that ever happened on your computer check out this cool video about tools enabling this: OpenAdaptAI @tooluseai Mike Bird Interpreter Ty Richard Abrich and :) youtube.com/watch?v=VgJ0Cg…

If I was starting a company today, I would look into productizing this model 👀

Julien Chaumond Deploy Microsoft OmniParser to Amazon Web Services #EC2 automatically via Docker and #GitHub actions: github.com/microsoft/Omni…

OpenAdaptAI Julien Chaumond Microsoft Amazon Web Services Docker (venv) % python client.py http://34.206.53.77:7861 ~/Desktop/screenshot.png Loaded as API: http://34.206.53.77:7861/ ✔ Parsed content: ... 2024-10-29 11:13:07.414 | INFO | __main__:predict:84 - Output image saved to: output_image.png

Jos van der Westhuizen OpenAdaptAI Sure does! Mac and Win compatible.

Nice taxonomy of Agents from Hugging Face smolagents

Harrison Chase With OpenAdaptAI you start and stop recording demonstrations of repetitive tasks via the tray icon. Show, don't tell. Perform, don't prompt.

Another day, another breakthrough: Apply DCT to convert actions into frequency components, quantize them prioritizing low frequencies, then use autoregressive prediction in frequency order (low to high) to generate actions. From Physical Intelligence. May generalize to OpenAdaptAI.

github.com/deepseek-ai/De… > DeepSeek-R1 achieves performance comparable to OpenAI-o1 across math, code, and reasoning tasks. huggingface.co/deepseek-ai/De… We can run frontier models at home now.

github.com/MoonshotAI/Kim… > 🚀 Introducing Kimi k1.5 --- an o1-level multi-modal model 🤯

Check out our latest GUI Agent -> UI-TARS 🥳 A vision-language model surpasses GPT-4o & Claude Computer-Use Paper, code, model ckpt, desktop APP are now open-sourced~ github.com/bytedance/UI-T… github.com/bytedance/UI-T…

Qwen2.5-VL is the first open source multimodal model that appears to be able to accurately generate bounding box coordinates 🚀 Thank you Qwen ! Excited to integrate this in OpenAdaptAI x.com/Alibaba_Qwen/s…

I prompted OpenAI's ChatGPT o3-mini-high and deepseek's R1 to implement code to for deploying Qwen's Qwen2.5-VL. Both agree that R1's implementation is "more comprehensive" and better "for production systems".

Anybody looking for a GUI+ICL-->MCP library should definitely check out OmniMCP which puts Microsoft's Omniparser to use in generating GUI tool use APIs. Early days but pretty neat omnimcp.openadapt.ai

We are super excited to release OpenCUA — the first from 0 to 1 computer-use agent foundation model framework and open-source SOTA model OpenCUA-32B, matching top proprietary models on OSWorld-Verified, with full infrastructure and data. 🔗 [Paper] arxiv.org/abs/2508.09123 📌

🙌 Acknowledgement: We thank Yu Su (Hiring @Neurips), Caiming Xiong , and the anonymous reviewers for their insightful discussions and valuable feedback. We are grateful to Moonshot AI for providing training infrastructure and annotated data. We also sincerely appreciate Jin Zhang, Hao Yang,

New and improved! More coming soon.

Don’t get me wrong, I love Opus 4.6 But there is no fucking way I’m letting Anthropic control my computer That’s why we have open source