Build software better, together

ScrapeGraphAI / Scrapegraph-ai

Python scraper based on AI

Updated Oct 6, 2026
Python

KnockOutEZ / wigolo

The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.

Updated Nov 10, 2026
TypeScript

oxylabs / google-ai-mode-scraper

Star

Scrape Google AI Mode responses without blocks on a large scale.

web-scraper search-api ai-search google-ai ai-training scraper-api proxy-scrape ai-mode web-scraper-api web-search-api google-ai-mode firecrawl-alternative ai-grounding tavily-alternative

Updated Aug 21, 2026
Java

0xMassi / webclaw

Sponsor

Star

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

Updated Nov 10, 2026
Rust

ScrapingBee / ai-web-scraper

Star

Effortlessly extract data with our AI scraper API. Simplify data extraction, get clean JSON outputs and adapt to page changes. Try it free today!

data-extraction proxy-scraper scraping-python web-scraping-python serp-scraper web-scraping-project web-scraping-api ai-web-scraper web-scraper-api serp-scraper-api ai-scrapers ai-scraper ai-data-extraction firecrawl-alternative ai-powered-scraper ai-data-scraping ai-web-scraper-api tavily-alternative firecracker-alternative

Updated Mar 13, 2026

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

docker markdown rust crawler ai mcp html-to-markdown web-crawler web-scraper self-hosted web-scraping data-extraction ai-agents scraping-api llm web-search-api mcp-server firecrawl-alternative tavily-alternative

Updated Nov 11, 2026
Rust

oxylabs / ai-scraper-py

Star

AI Scraper is a powerful scraping tool and scrape agent built to automate data extraction with unmatched precision. Ideal for scalable AI scraping tasks across diverse web sources, this tool simplifies complex scraping operations into efficient, intelligent workflows.

web-scraper search-api ai-search ai-training scraper-api ai-agent ai-studio scraper-api-github open-source-ai web-search-api ai-scraping ai-scraper firecrawl-alternative ai-grounding tavily-alternative

Updated Apr 2, 2026

oxylabs / agent-browser

Star

Execute complex automation scripts via remote cloud sessions , featuring integrated residential proxies , automated CAPTCHA solving , and native JavaScript rendering for the toughest dynamic websites.

python agent web-scraping search-api ai-search headless-browser ai-training scraper-api oxylabs web-search-api javascript-rendering firecrawl-alternative agent-browser ai-grounding tavily-alternative

Updated Sep 30, 2026

vakra-dev / reader

Star

Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents.

Updated Oct 6, 2026
TypeScript

oxylabs / web-scraper-api

Star

All-in-one web scraping API for real-time, large-scale data extraction – proxies, CAPTCHA management, JS rendering, and parsing in a single request returning HTML or structured JSON.

json proxies web-scraper web-scraping data-extraction structured-data search-api ai-search serp-api scraper-api oxylabs web-scraping-api web-search-api javascript-rendering firecrawl-alternative agent-browser tavily-alternative

Updated Oct 1, 2026

oxylabs / AI-Search-py

Star

Turn plain English queries into structured web data, featuring automated markdown extraction and full JavaScript rendering for dynamic websites.

python search-engine web-scraping search-api ai-search ai-training ai-agent oxylabs web-search-api javascript-rendering firecrawl-alternative ai-grounding

Updated Aug 21, 2026

BrowserCash / teracrawl

Star

High-performance web crawler API optimized for LLMs. Turn any search or website into clean Markdown using remote browsers. Firecrawl alternative

html-to-markdown web-scraper web-scraping data-extraction browser-automation ai-agents web-search google-serp ai-search serpapi browser-agent ai-crawler antibot-bypass ai-scraping crawl4ai firecrawl-mcp firecrawl-api firecrawl-alternative

Updated Dec 3, 2025
TypeScript

YOLOW92 / pagesift

Sponsor

Star

Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.

Updated Nov 9, 2026
Rust

DasDigitaleMomentum / searxNcrawl

Star

Open-source MCP server that gives AI agents web search (SearXNG) and clean Markdown crawling of pages, whole sites and logged-in areas. Self-hosted, no API key. Firecrawl-compatible API planned.

python markdown crawler mcp web-crawler self-hosted web-scraping ai-agents web-search rag playwright searxng llm llm-tools crawl4ai model-context-protocol mcp-server firecrawl-alternative

Updated Nov 10, 2026
Python

ai-naymul / BrowserPilot

Star

Open‑source alternative to Perplexity Comet, director.ai and firecrawl combined

Updated Jul 26, 2026
TypeScript

alex-on-ai / WebReaper

Star

AI-native web scraper. Single binary with a bundled Claude Code skill. MIT-licensed alternative to Firecrawl.

markdown parser crawler scraper parsing dotnet mcp scraping webcrawler webscraping scraping-websites scraping-api scraping-web llm ai-agents-automation claude-code firecrawl-alternative

Updated Oct 4, 2026
C#

sadiuysal / crawl4ai-mcp-server

Star

🕷️ A lightweight Model Context Protocol (MCP) server that exposes Crawl4AI web scraping and crawling capabilities as tools for AI agents. Similar to Firecrawl's API but self-hosted and free. Perfect for integrating web scraping into your AI workflows with OpenAI Agents SDK, Cursor, Claude Code, and other MCP-compatible tools.