Matt Ambrogi (@matt_ambrogi) 's Twitter Profile
Matt Ambrogi

@matt_ambrogi

Programming, product, and machine learning.

ID: 1191346047521570817

linkhttps://www.mattambrogi.com calendar_today04-11-2019 13:27:49

2,2K Tweet

686 Followers

964 Following

Matt Ambrogi (@matt_ambrogi) 's Twitter Profile Photo

Might re-make the first tool I ever built with an LLM: a note cleaner-upper. I’m always taking messy notes while working, reading, talking to someone, etc. Then have to go back, structure them, and clean them up. Need a little tool to do it for me.

Matt Ambrogi (@matt_ambrogi) 's Twitter Profile Photo

In cases where I can condense all the context I need my LLM to have for a given user into ~10-20 pages, I'm having trouble seeing the benefit of RAG anymore. Claude is great at pulling info from that amount of context. Yes you pay for more tokens in context, but vector DBs are

Matt Ambrogi (@matt_ambrogi) 's Twitter Profile Photo

It's hard to evaluate when an agent is factually right. But sometimes a good enough proxy is evaluating whether the tools it used made sense.

Matt Ambrogi (@matt_ambrogi) 's Twitter Profile Photo

I don’t want to be a “software engineer” or a “product manager.” I want to experiment with AI’s capabilities and build useful tools with them.

Matt Ambrogi (@matt_ambrogi) 's Twitter Profile Photo

Open ai engineering problem: agentic data analysis inside saas tools. On the fly reporting. A year ago I was sure every b2b saas would have an interface acting like a simple embedded Julius AI . These tools are full of customer data, but usually have limited user facing

Open ai engineering problem: agentic data analysis inside saas tools. On the fly reporting.

A year ago I was sure every b2b saas would have an interface acting like a simple embedded <a href="/JuliusAI_/">Julius AI</a> . These tools are full of customer data, but usually have limited user facing
Matt Ambrogi (@matt_ambrogi) 's Twitter Profile Photo

If you're struggling to get the model to do something reliably with a prompt, stop and ask: could a random human off the street do this task given these instructions? Just caught myself with this one.

Matt Ambrogi (@matt_ambrogi) 's Twitter Profile Photo

High confidence take: some of the most simple tasks for LLMs (summarization, re-writing) are extremely valuable for all sorts of niches and are still under productized.

Matt Ambrogi (@matt_ambrogi) 's Twitter Profile Photo

Crazy how quickly we adapt to new technology / abilities. Used to take like a week to figure out a new code base. Now if it takes longer than a day it’s frustrating.