Curious how companies are evaluating advanced AI models like GPT-4 & Claude? 🤖 We partnered with Vellum to analyze 4 leading language models across different tasks. OpenAI , Anthropic and @CohereAI. 🧵 #GPT4 #Claude #CohereCommand

At Vellum our customers use our testing & eval frameworks to put prompts in production. Once they're in production, we often get asked "Now what do we do?" We just wrote a blog about this, and here are the top takeaways👇 vellum.ai/blog/my-prompt…

Thanks Aaron and the team at AWS Startups for the interview on how how to evaluate foundation models! Check out the full post here: aws.amazon.com/blogs/startups… I know that I and the Vellum team are excited to get our hands on AWS's Titan models!

Fine-tuning has made a comeback with the rise of open source models like Llama 2, Falcon-40b, and MPT-30b. Fine-tuned open source models offer improved accuracy, lower costs and lower latency. Reach out if you want to use open source LLMs in production! vellum.ai/blog/fine-tuni…

We couldn’t be more excited about the launch of Gemini Pro! We were featured as a development partner by Google and already have the model supported in Vellum 🔥 According to benchmarks released by Google, Gemini Pro outperforms inference-optimized models such as GPT-3.5

I just added voice calling to my personal AI assistant! I built this after I had to book a table for our whole team at a local spot in nyc! iykyk… I integrated it with Twilio + some human-in-the loop logic so it checks with me before locking in a reservation with a restaurant.

First tweet powered by my AI assistant Credence. The future is here 🤖

Me keeping my coding agents awake while I wait for Vellum to support remote hosting environments for my personal assistant

AI should’ve always felt like yours now it can be

we’ve spent years trying to make the AI promise come to life soon you’ll see how we cracked it

forget typing. Your assistant has a voice to use when talking to you or anyone else to take care of business

Personal assistant should know you from your preferences to your wardrobe

"start the day" and your morning is handled.

inbox scanned, calendar checked, draft written and sent. A personal assistant that actually handles your work

security first, everything else second the reason most people don't trust AI assistants is because most AI assistants aren't built to be trusted.

a secure personal assistant that lives on your machine and actually works for you 👾 assistant.vellum.ai