🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

hello world. we are live in beta. visit our website for more information.

The cost of LLM tokens has dropped more than 50% over the last 12 months. Groq Inc was leading the pack for a while, but just isn't competitive any more Llama 3.1 70B tokens on inference.net are now 63% cheaper than Groq Inc and almost 90% cheaper than Replicate

This log scale graph from OpenRouter clearly shows the cost of LLM inference has been decreasing exponentially since the release of GPT-3 in late 2022 New inference providers like Inference will continue this trend into the foreseeable future 👇

If you're working on synthetic data generation and need cheap batch inference, hit my DMs. We're cooking up something specifically for this on inference .net inference.net

We just updated pricing on Inference. We are once again the most affordable LLM inference provider on the market

DeepSeek V3 is now available on inference.net

We are now serving large models on OpenRouter - DeepSeek V3 - Nous Research Hermes 3 405B - DeepSeek R1 coming soon

The inference .net grants program is live! Apply and get $10k for AI projects that need LLM inference from top models: - R1 and V3 from DeepSeek - Llama 70b and 405b from AI at Meta - High rate-limits, batch support, and more If you're building open source, read below  👇

R1 from DeepSeek is live on Inference! R1 has one-shotted questions that O1 Pro stumbles on. $5.00/million tokens. Top tier reliability. Try it today 👇

We're excited to be one of the first inference APIs to host Gemma 3, starting with the 27b variant Inference ! It has incredible vision capabilities, rivaling models that are 2-6x its size in quality Give it a try and let us know what you think!

We worked with OpenAI to build a native integration for the OpenAI Agents SDK. Today, we are very excited to launch as a tracing processor. With just a few lines of code, you can trace all your agent workflows and debug them much faster. Check out this quick demo to get

Inference .net is hiring a Developer Relations Lead in San Francisco! If you: - Love working with AI to amazing build products - Have experience creating world-class educational content for developers - Enjoy solving developer problems and fostering community growth We want to

So Groq Inc is cool, but it’s no longer magic With basic out of the box optimizations from SGLang we’re achieving over 250 tokens per second in llama 3.1 8b at full precision on a 4090 (consumer gaming card) Inference And we think we can go even higher (1k)

Excited to announce our integration with Inference - a new LLM provider hosting faster and more cost-effective open-source models! Inference[dot]net can reduce your LLM costs by up to 90%. Models like Llama 3.3 70B, DeepSeek V3, and DeepSeek R1 are significantly faster than

Qwen3 is live on Inference inference.net/models/qwen-3-…