Scrapling
A Python scraping library that adapts when a site changes its markup, instead of breaking silently.
Mature enough to put in production this quarter.
Small teams running scrapers they cannot afford to babysit — pricing feeds, listings, directories.
The recurring afternoon spent repairing selectors after a site redesign.
It is a young project carried by one main maintainer. The permissive BSD licence limits the damage, but plan for the bus factor.
Rewrite your most fragile existing scraper in it and leave both running for two weeks. Keep the one that survives.
The numbers
Maintainers describe it as: “🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!”
Scrapling, in short
- Should a small team use Scrapling?
- Adopt now. Mature enough to put in production this quarter. Small teams running scrapers they cannot afford to babysit — pricing feeds, listings, directories.
- What does Scrapling actually do?
- A Python scraping library that adapts when a site changes its markup, instead of breaking silently.
- What does Scrapling replace?
- The recurring afternoon spent repairing selectors after a site redesign.
- What is the downside of Scrapling?
- It is a young project carried by one main maintainer. The permissive BSD licence limits the damage, but plan for the bus factor.
- Can Scrapling be used in a commercial product?
- Its licence is BSD-3-Clause, which is permissive and generally fine for commercial use. Confirm against the LICENSE file in the repository.
Weighed against
Turns any website into clean markdown an LLM can read, including pages that need JavaScript to render.
AI-powered desktop assistant
CLI tool for AI agents to search internet platforms
Pre-LLM token compressor for logs, JSON, and tool outputs, saving 20-95% tokens.