Search🔎 is now available in our Python and Node SDKs To use it just pip install firecrawl-py or npm i @mendable/firecrawl-js Get full page content from search engine results in a few seconds 🔥

We just bumped Firecrawl's free credits to 300! No credit card required. Happy crawling everyone 🔥

We just pushed /search 🔎 in the Firecrawl playground! Search for any query, get the top results with full page content for each - all in markdown 👇

Anthropic's Claude Opus just caught a copywriting mistake in our pricing that would have screwed our users 👀 Thankfully, we built a tool that checks our site for contradictions with AI Here's how we built it 👇

Firecrawl is on GitHub's weekly trending! 🔥 We're so grateful for all the love and support from everyone! It fuels us to keep improving and shipping the best for you! Thank you all!

10 days. 2k stars ⭐️ Thank you everyone! Try Firecrawl if you haven't already, it's a flamin' good time! 🔥

We used FireCrawl to test the new secret 'gpt2-chatbot' model with scraped web data 👀 It is one of the strongest models we have used so far. Here is it compared to Opus:

Jason Zhou Just released an awesome video on Local Agentic RAG w/ llama3 🦙 It covers how you can build a reliable and accurate RAG system with Firecrawl 🔥, LlamaIndex 🦙 and Go watch it 👇

FireCrawl is totally leveling up the RAG game, have all your data unified in clean Markdown is big Thanks for the shout out! Mendable

Detecting data conflicts with FireCrawl and 🧵 While building Mendable, we saw a common issue for companies doing RAG with lots of sources: data conflicts. With LLMs, we can detect and report these conflicts. Our approach and a Replit ⠕ Repl below👇 (1/4)

People kept using Firecrawl 🔥 to extract structured data from web pages with an LLM. So, we added it as a built-in feature 🚢 Announcing LLM-extraction: Extract structured data from websites with a single API call 👇

To extract structured data from the web you used to have to write complex web scrapers... LLMs are changing that. Here is Firecrawl 101: Learn how to extract structured company data with a single API call 👇

It’s fun seeing friends go from first launch > signal Excited to see where the Firecrawl team goes

Introducing Crawl Streaming for FireCrawl 🔥 New pages stream immediately when scraped for instant use. Here's how you can do it with our playground and API👇 (1/4)

Today we are shipping some awesome improvements to FireCrawl 🚢🔥 - Max depth parameter for /crawl - IncludeHTML option for /crawl that returns raw html for scrapes - New cancel crawl job route /crawl/cancel Here is how you can use them all, starting with maxDepth:

This guy definitely gave FireCrawl a star, have you?🔥

Calling all typescript and python developers 📣 You can now use zod and pydantic for defining schemas when using LLM extraction in Firecrawl 🔥 It has never been easier to reliably extract structured data from the web 👇