scraper-generator

Generate a complete API documentation scraper from a URL

Generates Python scraper code based on site analysis

Validates generated scraper by running it and checking outputs

Analyzes API documentation site structure and patterns for scraper generation

Python code generation patterns and best practices for API documentation scrapers. Covers library choices, multi-strategy extraction, error handling, type annotations, and code organization.

Systematic approach for analyzing API documentation site structure, discovering HTML patterns, framework signatures, and extraction strategies to inform scraper code generation.

Architectural guidance for designing API documentation scrapers, including data models, parser patterns, formatter patterns, CLI design, and project structure.