The Web Scraping Club

The Web Scraping Club

Home
The Lab
Advertise on The Web Scraping…
Proxy pricing benchmark
Consulting
Archive
About

January 2026

THE LAB #96: Scraping Nike.com with 5 open source tools
Match your tool to the protection, not the brand
 • Pierluigi Vinciguerra
A preview of the Zyte 2026 Web Scraping Industry report
Where the industry is headed according to Zyte
 • Pierluigi Vinciguerra
THE LAB #95: Bypassing Cloudflare in 2026
Testing Open Source Browser Automation Tools Against Real Targets
 • Pierluigi Vinciguerra
Understanding robots.txt and its Implications
A discussion on the robots.txt file, its legal implications, and what’s to be further taken in to account when scraping
 • Federico Trotta
AnyCrawl: Testing the LLM-Ready Web Scraping Service
Let's try AnyCrawl and see what this new kind of web scraping API solution brings to the table!
 • Antonello Zanini
Using Python’s Async Features for High-performance Scraping
From theory to practice: why async is better for scraping at scale
 • Federico Trotta

December 2025

The Web Scraping Club in 2026
What to expect from The Web Scraping Club during the new year coming
 • Pierluigi Vinciguerra
Top 5 Approaches to Let Scrapers Adapt to Website Changes
Tired of constantly fixing your scraping logic? Here are five methods to make it adapt automatically!
 • Antonello Zanini
Best Practices for Ethical Web Scraping
A discussion on the golden rules for scraping websites ethically
 • Federico Trotta
Build an AI Agent for Scraping and Analyzing Research Papers
Let’s build an AI agent in Python for research paper scraping and analysis.
 • Antonello Zanini
Using NLP for Entity Extraction From Scraped Data
From theory to practice: how to extract entities from textual scraped data using NLP
 • Federico Trotta
© 2026 Pierluigi · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture