# Web scraping · Tech watch

[Canonical source](<https://sebastien.rigaux.be/en/tech-watch/tags/web-scraping>)

Extracting structured content from web pages and browsing flows.

## [A compact web-browsing CLI for AI agents](<https://sebastien.rigaux.be/en/tech-watch/links/a-compact-web-browsing-cli-for-ai-agents>)

A compact CLI turns websites into commands tailored for AI agents, returning the useful information without loading tens of thousands of tokens. The repository documents its commands and supported sites, making it a practical way to reduce the cost of automated browsing.

2026-08-24 · [Markdown](<https://sebastien.rigaux.be/en/tech-watch/links/a-compact-web-browsing-cli-for-ai-agents.md>) · [Original resource](<https://github.com/only-cli/oc>)

## [Scrapling: adapt scraping to changing pages](<https://sebastien.rigaux.be/en/tech-watch/links/scrapling-adapt-scraping-to-changing-pages>)

Scrapling is a Python scraping framework that adapts selectors when page structures change. It covers both a single request and larger crawling workflows.

2026-02-24 · [Markdown](<https://sebastien.rigaux.be/en/tech-watch/links/scrapling-adapt-scraping-to-changing-pages.md>) · [Original resource](<https://github.com/D4Vinci/Scrapling>)

## [Turn websites into structured APIs with Maxun](<https://sebastien.rigaux.be/en/tech-watch/links/turn-websites-into-structured-apis-with-maxun>)

Maxun records browser interactions to extract data, run automations, and monitor pages. Its repository describes an open-source solution that can be self-hosted.

2026-02-14 · [Markdown](<https://sebastien.rigaux.be/en/tech-watch/links/turn-websites-into-structured-apis-with-maxun.md>) · [Original resource](<https://github.com/getmaxun/maxun>)

## [Track website changes with changedetection.io](<https://sebastien.rigaux.be/en/tech-watch/links/track-website-changes-with-changedetection-io>)

changedetection.io monitors pages and reports changes such as price shifts or restocks. It can be self-hosted and sends alerts through multiple channels.

2026-01-29 · [Markdown](<https://sebastien.rigaux.be/en/tech-watch/links/track-website-changes-with-changedetection-io.md>) · [Original resource](<https://github.com/dgtlmoon/changedetection.io>)

## [A catalogue of extraction APIs for social platforms](<https://sebastien.rigaux.be/en/tech-watch/links/a-catalogue-of-extraction-apis-for-social-platforms>)

This repository groups data extraction APIs and tools by social platform. It provides a directory for comparing accessible data types and available integrations.

2026-01-21 · [Markdown](<https://sebastien.rigaux.be/en/tech-watch/links/a-catalogue-of-extraction-apis-for-social-platforms.md>) · [Original resource](<https://github.com/cporter202/social-media-scraping-apis>)

## [Firecrawl: turn web pages into data for agents](<https://sebastien.rigaux.be/en/tech-watch/links/firecrawl-turn-web-pages-into-data-for-agents>)

Firecrawl offers search, scraping and crawling with Markdown, JSON and screenshot outputs. Its API provides an extraction layer for workflows and agents using web content.

2025-08-26 · [Markdown](<https://sebastien.rigaux.be/en/tech-watch/links/firecrawl-turn-web-pages-into-data-for-agents.md>) · [Original resource](<https://www.firecrawl.dev/>)

## [PhantomBuster: automate lead collection workflows](<https://sebastien.rigaux.be/en/tech-watch/links/phantombuster-automate-lead-collection-workflows>)

This product listing introduces PhantomBuster’s data collection and lead generation automations. It provides an overview of use cases alongside launch history and user feedback.

2023-07-12 · [Markdown](<https://sebastien.rigaux.be/en/tech-watch/links/phantombuster-automate-lead-collection-workflows.md>) · [Original resource](<https://www.producthunt.com/products/phantombuster>)