The BackFetch blog.

Practical notes on web scraping, search data and building with web content.

Guides

2 min read

Crawling and scraping solve different problems

Use a crawler to find pages and a scraper to extract their content. Here is how to choose the right starting point for a collection.

AI & data

2 min read

A page's text is more useful when you can trace it to its source. Build that link into your data before indexing content for an AI agent.