GitHub Repository Radar
Best web-scraping GitHub Repositories
Curated repositories sharing the web-scraping topic on our radar — with growth, activity and local Radar analysis.
-
The context API to search, scrape, and interact with the web at scale. 🔥
176,446 9,652 66 radar 2w ago -
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
78,252 7,863 66 radar 2w ago -
Scrapy, a fast high-level web crawling & scraping framework for Python.
64,185 11,942 66 radar 2w ago -
Convert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection
14,894 1,514 60 radar 3w ago -
Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio python SDK for intelligent web data gathering.
3,388 34 51 radar 1mo ago -
Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
1,671 105 56 radar 2w ago -
WebAI2API: 基于 Camoufox 的网页 AI 转 API 工具，支持 LMArena/Gemini等，多窗口并发与账号隔离。 | Web AI to OpenAI API via Camoufox. Supports LMArena/Gemini and more, multi-window concurrency & account isolation.
1,316 346 45 radar 2mos ago -
A skill for AI agents: search the web with SearXNG, browse with Camofox, bypass protections with CloakBrowser. Anti-hallucination by design. Self-hosted, free, unlimited.
512 35 50 radar 2w ago -
Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio JS SDK for intelligent web data gathering.
418 1 43 radar 1mo ago -
A hand-picked collection of AI tools for content, automation, e-commerce, web building, voice, and growth.
280 80 41 radar 1mo ago -
One command for every interface—search, run, and inspect real software across APIs, browsers, desktops, local tools, and MCP.
271 2 42 radar 2w ago -
Clone any website with one command using AI coding agents
34 4,926 42 radar 1mo ago
Popular languages
Popular topics
Repository Radar FAQ
- What is GitHub Repository Radar?
- A discovery and analysis layer on top of publicly available GitHub repository metadata — built to help you find, compare and track interesting open-source projects.
- How are repositories discovered?
- Through our existing Chrome extension workflow that imports public repository information into Laravel. We do not scrape private data.
- How often is repository data updated?
- Whenever the extension observes a repository again. Growth charts appear only after enough metric snapshots exist.
- What does Repository Radar Score mean?
- A proprietary 0–100 score from observed popularity, growth, activity and related signals. It is not provided by GitHub.
- What is a trending repository?
- A repository with high recent star growth (and typically recent activity) based on thresholds in our configuration — not a GitHub trending claim.
- Can I open the original GitHub repository?
- Yes. Every repository page links back to the original host URL. Always verify license and code on GitHub before adopting a project.