Web Scraping AI Agent Skills
AI agent skills for web scraping and data extraction. Crawling patterns, parsing, and automation workflows.
15 listings
Firecrawl Scraper
Deep web scraping, screenshots, PDF parsing, and website crawling using Firecrawl API
Android Design Guidelines
Material Design 3 and Android platform guidelines. Use when building Android apps with Jetpack Compose or XML layouts, implementing Material You, navigation, or accessibility. Triggers on tasks involving Android UI, Compose components, dynamic color, or Material Design compliance.
Go Rod Master
Comprehensive guide for browser automation and web scraping with go-rod (Chrome DevTools Protocol) including stealth anti-bot-detection patterns.
Firecrawl Plugin for Claude Code
|
Firecrawl MCP Server
MCP ServerA Model Context Protocol (MCP) server implementation that integrates with Firecrawl for web scraping capabilities. - Web scraping, crawling, and discovery - Search and content extraction - Deep research and batch scraping - Cloud browser sessions with agent-browser automation - Automatic retries and rate limiting - Cloud and self-hosted support - SSE support Configuring Cursor 🖥️ Note: Requires C
Daily News Report
Scrapes content based on a preset URL list, filters high-quality technical information, and generates daily Markdown reports.
Browser Automation
Browser automation powers web testing, scraping, and AI agent interactions. The difference between a flaky script and a reliable system comes down to understanding selectors, waiting strategies, and anti-detection patterns. This skill covers Playwright (recommended) and Puppeteer, with patterns for testing, scraping, and agentic browser control. Key insight: Playwright won the framework war. Unless you need Puppeteer's stealth ecosystem or are Chrome-only, Playwright is the better choice in 202
Olostep MCP Server
MCP ServerA Model Context Protocol (MCP) server implementation that integrates with Olostep for web scraping, content extraction, and search capabilities. To set up Olostep MCP Server, you need to have an API key. You can get the API key by signing up on the Olostep website. - Scrape website content in HTML, Markdown, JSON or Plain Text (with optional parsers) - Parser-based web search with structured resul
Web Analyzer MCP
MCP ServerA powerful MCP (Model Context Protocol) server for intelligent web content analysis and summarization. Built with FastMCP, this server provides smart web scraping, content extraction, and AI-powered question-answering capabilities. 1. urltomarkdown - Extract and summarize key web page content - Analyzes content importance using custom algorithms - Removes ads, navigation, and irrelevant content -
Cupertino
Apple Documentation Crawler & MCP Server A Swift-based tool to crawl, index, and serve Apple's developer documentation to AI agents via the Model Context Protocol (MCP). Cupertino is a local, structured, AI-ready documentation system for Apple platforms. It: - Crawls Apple Developer documentation, Swift.org, Swift Evolution proposals, Human Interface Guidelines, Apple Archive legacy guides, and Sw
Dumpling AI MCP Server
MCP ServerA Model Context Protocol (MCP) server implementation that integrates with Dumpling AI for data scraping, content processing, knowledge management, AI agents, and code execution capabilities. - Complete integration with all Dumpling AI API endpoints - Data APIs for YouTube transcripts, search, autocomplete, maps, places, news, and reviews - Web scraping with support for scraping, crawling, screensh
AllTrails MCP Server
MCP ServerThis project has been deprecated and is no longer functional. Date: January 25, 2026 Reason: This project violated AllTrails' Terms of Service by scraping their website without authorization. At the request of AllTrails' CTO, all scraping functionality has been disabled. This repository is maintained for historical purposes only and to preserve GitHub stars, but the code no longer works and should
MCP Server Webcrawl
MCP ServerAdvanced search and retrieval for web crawler data. With mcp-server-webcrawl, your AI client filters and analyzes web content under your direction or autonomously. The server includes a fulltext search interface with boolean support, and resource filtering by type, HTTP status, and more. mcp-server-webcrawl provides the LLM a complete menu with which to search, and works with a variety of web craw
Scrapling
An adaptive web scraping framework that handles everything from a single request to a full-scale crawl. Its parser learns from website changes and automatically relocates your elements when pages update. Its fetchers bypass anti-bot systems like Cloudflare Turnstile.
LinkedIn MCP Server
MCP ServerA Model Context Protocol (MCP) server for LinkedIn. Search people, companies, and jobs, scrape profiles, and retrieve structured JSON data from any MCP-compatible AI client. Built with FastMCP, Patchright, and a clean hexagonal architecture. The getpersonprofile tool supports granular section scraping. Request only the sections you need: - Main profile (always included) — name, headline, location,