🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

There is a rumor Modal is raising. We are! – We are raising the bar for developer experience. Not raising a round though. Don't ping me about it lol.

Happy #NationalInternDay! 💚 Our summer interns at Modal are tackling the hardest challenges in distributed compute – kernel-level packet filters, RAM checkpointing and low-latency inference! 🤓

at tomorrow's inaugural Modal webinar, I will show you how I'm running an OpenAI-compatible LLM service that can handle a burst from 100 to 1000 simultaneous users using LLaMA 3.1 8B in vLLM on Modal -- and give you the code to do it yourself!

Yes. I actually think it’s a feature of interviewing (at least when it’s an interviewee’s market) that it’s labor intensive to interview. It signals that the employer is committed and there’s a decent likelihood of an offer.

Modal blog post by Charles 🎉 Frye replicating the “Large Language Monkeys” paper: it turns out a simpler model with a more complex search during inference can outperform a more simplex model modal.com/blog/llama-hum…

We literally have the most transparent pricing

I pay these guys over $250k a year best gpu provider in the game build on modal

Everyone knows you can build cool AI stuff with Modal but did you know you can build a microblogging simulator stuck in 1995?

Hearing this from a competitor I used to fear and respect a ton made me slightly tear eyed. And fun fact is that GPU was totally an afterthought!

Starting to think that Twitter last few months is falling for the social media platform trap of optimizing for engagement (which is easy to measure and has fast feedback loops) at the cost of long term retention (which takes much longer to measure)

Every SaaS company is just a thin wrapper over cloud providers. Every cloud provider is just a thin wrapper over hardware providers. Hardware providers are just a thin wrapper over fabs. Fabs are just a wrapper over silicon miners.

It’s well known that the first step of doing distributed compute right is to open modal.com in the browser

I half-seriously think b2b startups shouldn't be allowed to sell contracts longer than a month for the first few years. The constant threat of churn forces you to build a better product.

Can you guess when we posted on Hacker News?? 1000+ videos per hour so far 🤯 Thanks Modal for making scaling a breeze! All we need to worry about is responding to the HN comments, not keeping our GPUs running

Just added "Banger ML Infra" to my list of skills on LinkedIn, please endorse me!