firecrawl.dev

# http://firecrawl.dev llms.txt

- [Web Data Extraction](https://www.firecrawl.dev/): Transform websites into clean, LLM-ready data effortlessly.
- [Flexible Web Scraping Pricing](https://www.firecrawl.dev/pricing): Flexible pricing plans for web scraping services available.
- [Web Scraping and AI](https://www.firecrawl.dev/blog): Explore tutorials and articles on web scraping and AI.
- [Firecrawl Changelog Updates](https://www.firecrawl.dev/changelog): Comprehensive changelog detailing updates and improvements for Firecrawl.
- [Web Data Extraction Tool](https://www.firecrawl.dev/extract): Effortlessly extract structured data from any website using AI.
- [Web Data Playground](https://www.firecrawl.dev/playground): Explore web data extraction and scraping tools easily.
- [Sign In Page](https://www.firecrawl.dev/signin/password_signin): Securely sign in using email or OAuth options.
- [Privacy Policy Overview](https://www.firecrawl.dev/privacy-policy): Comprehensive privacy policy detailing data collection and usage.
- [Firecrawl Launch Week II](https://www.firecrawl.dev/launch-week): Exciting updates and features from Firecrawl's Launch Week II.
- [Password Reset Page](https://www.firecrawl.dev/signin/forgot_password): Easily reset your password using your email address.
- [Sign Up Page](https://www.firecrawl.dev/signin/signup): Create an account to access Firecrawl features.
- [Email Sign In](https://www.firecrawl.dev/signin/email_signin): Sign in with email or OAuth for Firecrawl services.
- [Smart Crawl](https://www.firecrawl.dev/smart-crawl): Transform any website into an API using AI technology.
- [Firecrawl Terms of Service](https://www.firecrawl.dev/terms-of-service): Comprehensive terms of service for Firecrawl's web data services.
- [Website Contradiction Agent](https://www.firecrawl.dev/blog/contradiction-agent): Learn to build an agent for detecting website contradictions.
- [Web Data Extraction](https://www.firecrawl.dev/playground?mode=extract&=%7B%22state%22%3A%7B%22fields%22%3A%7B%22company_mission%22%3A%7B%22id%22%3A%22company_mission%22%2C%22name%22%3A%22company_mission%22%2C%22type%22%3A%22string%22%2C%22required%22%3Atrue%2C%22parentId%22%3Anull%2C%22children%22%3A%5B%5D%7D%2C%22is_open_source%22%3A%7B%22id%22%3A%22is_open_source%22%2C%22name%22%3A%22is_open_source%22%2C%22type%22%3A%22boolean%22%2C%22required%22%3Atrue%2C%22parentId%22%3Anull%2C%22children%22%3A%5B%5D%7D%7D%2C%22rootFields%22%3A%5B%22company_mission%22%2C%22is_open_source%22%5D%2C%22inputUrls%22%3A%5B%7B%22id%22%3A%22RVacLzAG_e2rjfPy4KBvm%22%2C%22url%22%3A%22firecrawl.dev%22%7D%5D%2C%22auxiliarPrompt%22%3A%22%22%2C%22enableWebSearch%22%3Afalse%7D%2C%22version%22%3A0%7D): Explore web data extraction with Firecrawl's playground tool.
- [Chatbot for Websites](https://www.firecrawl.dev/blog/chat-with-website): Learn to build a chatbot for your website using Groq.
- [CrawlBench LLM Evaluation](https://www.firecrawl.dev/blog/crawlbench-llm-extraction): Explore CrawlBench for evaluating LLM data extraction performance.
- [Web Data Extraction](https://www.firecrawl.dev/playground?mode=llm-extract): Explore web data extraction with interactive API tools.
- [Smart Crawl API](https://www.firecrawl.dev/smart-crawl?ref=therundown): Transform any website into an API using AI technology.
- [Data Extraction Guide](https://www.firecrawl.dev/blog/data-extraction-using-llms): Learn to extract web data using LLMs and Firecrawl.
- [OpenAI Swarm Marketing Tutorial](https://www.firecrawl.dev/blog/openai-swarm-agent-tutorial): Learn to create AI-driven marketing campaigns using OpenAI.
- [Firecrawl July 2024 Updates](https://www.firecrawl.dev/blog/firecrawl-july-2024-updates): Exciting updates on Firecrawl's July 2024 developments and improvements.
- [Scaling Firecrawl's Requests](https://www.firecrawl.dev/blog/an-adventure-in-scaling): Learn how Firecrawl scaled to handle 300k requests daily.
- [BeautifulSoup4 vs Scrapy](https://www.firecrawl.dev/blog/beautifulsoup4-vs-scrapy-comparison): A detailed comparison of BeautifulSoup4 and Scrapy for web scraping.
- [Python Web Scraping Projects](https://www.firecrawl.dev/blog/python-web-scraping-projects): Explore 15 Python web scraping projects for all skill levels.
- [Mastering Firecrawl Scrape API](https://www.firecrawl.dev/blog/mastering-firecrawl-scrape-endpoint): Master web scraping with Firecrawl's powerful API features.
- [DeepSeek Documentation Assistant](https://www.firecrawl.dev/blog/deepseek-rag-documentation-assistant): Explore how to build a documentation assistant using DeepSeek and Firecrawl.
- [Structured Web Data Extraction](https://www.firecrawl.dev/blog/introducing-extract-open-beta): Easily extract structured web data with simple prompts.
- [Fire Engine for Firecrawl](https://www.firecrawl.dev/blog/introducing-fire-engine-for-firecrawl): Discover Fire Engine, Firecrawl's new web scraping solution.
- [Firecrawl Launch Week Recap](https://www.firecrawl.dev/blog/firecrawl-launch-week-1-recap): Recap of Firecrawl's Launch Week features and updates.
- [Prompt Caching Guide](https://www.firecrawl.dev/blog/using-prompt-caching-with-anthropic): Learn to use prompt caching with Anthropic models effectively.
- [Crunchbase Data Scraping](https://www.firecrawl.dev/blog/crunchbase-scraping-with-firecrawl-claude): Learn to scrape company data and funding info efficiently.
- [Automated Price Tracking](https://www.firecrawl.dev/blog/automated-price-tracking-tutorial-python): Learn to build a Python app for automated price tracking.
- [Automated Web Scraping](https://www.firecrawl.dev/blog/automated-web-scraping-free-2025): Learn to automate web scraping in Python using free tools.
- [Job Board Scraping Guide](https://www.firecrawl.dev/blog/scrape-job-boards-firecrawl-openai): Learn to scrape job boards using Firecrawl and OpenAI.
- [LLM Extraction for Insights](https://www.firecrawl.dev/blog/lead-gen-business-insights-make-firecrawl): Automate customer insights extraction using LLM and Firecrawl.
- [Crawl Webhooks Introduction](https://www.firecrawl.dev/blog/launch-week-i-day-7-webhooks): Discover new webhook support for web crawling events.
- [OpenAI Predicted Outputs Guide](https://www.firecrawl.dev/blog/getting-started-with-predicted-outputs-openai): Learn to use OpenAI's Predicted Outputs for faster LLM responses.
- [Mastering Firecrawl's Crawl Endpoint](https://www.firecrawl.dev/blog/mastering-the-crawl-endpoint-in-firecrawl): Comprehensive guide on using Firecrawl's crawl endpoint for web scraping.
- [AI Resume Job Matcher](https://www.firecrawl.dev/blog/ai-resume-parser-job-matcher-python): Automate job matching using AI resume parser and web scraping.
- [Gamma Onboarding Supercharged](https://www.firecrawl.dev/blog/how-gamma-supercharges-onboarding-with-firecrawl): Gamma enhances onboarding with Firecrawl for effortless web data.
- [cURL Authentication Guide](https://www.firecrawl.dev/blog/complete-guide-to-curl-authentication-firecrawl-api): Learn to scrape authenticated websites using cURL and Firecrawl.
- [Grok-2 Setup Guide](https://www.firecrawl.dev/blog/grok-2-setup-and-web-crawler-example): Learn to set up Grok-2 and build a web crawler.
- [Install BeautifulSoup Easily](https://www.firecrawl.dev/blog/how-to-quickly-install-beautifulsoup-with-python): Quickly install BeautifulSoup for web scraping with Python.
- [LLM Extract Introduction](https://www.firecrawl.dev/blog/launch-week-i-day-6-llm-extract): Discover LLM Extract for structured web data extraction.
- [Fix Cloudflare Error 1015](https://www.firecrawl.dev/blog/cloudflare-error-1015-how-to-solve-it): Learn how to resolve Cloudflare Error 1015 effectively.
- [Introducing Teams Feature](https://www.firecrawl.dev/blog/launch-week-i-day-1-introducing-teams): Introducing Teams feature for collaborative web scraping projects.