Production-ready PySpider web crawler development toolkit. Covers GET/POST requests, proxy management, header rotation, error handling, pagination, and enterprise-grade crawling patterns. Use when: (1) Creating new PySpider crawlers, (2) Implementing web scraping tasks, (3) Handling complex crawling scenarios with proxies and retries
A toolkit for developing and managing production-ready PySpider web crawlers, handling requests, proxies, and complex scraping scenarios.
Why this plugin
Offers a structured, enterprise-grade framework for web crawling with built-in proxy management, error handling, and pagination, streamlining development of robust, scalable scrapers compared to manual scripting.
Prerequisites
Requires Python, PySpider installation, and potentially API keys or proxy services for advanced features like header rotation and proxy management.
npx claudepluginhub within-7/minto-plugin-toolsAccess thousands of AI prompts and skills directly in your AI coding assistant. Search prompts, discover skills, save your own, and improve prompts with AI.
Comprehensive toolkit for developing Claude Code plugins. Includes 7 expert skills covering hooks, MCP integration, commands, agents, and best practices. AI-assisted plugin creation and validation.
Payload Development plugin - covers collections, fields, hooks, access control, plugins, and database adapters.
Orchestrate multi-agent teams for parallel code review, hypothesis-driven debugging, and coordinated feature development using Claude Code's Agent Teams