The Web Scraping Club
Subscribe
Sign in
Home
The Lab
Advertise on The Web Scraping…
Proxy pricing benchmark
Consulting
Archive
About
A preview of the Zyte 2026 Web Scraping Industry report
Where the industry is headed according to Zyte
Jan 25
•
Pierluigi Vinciguerra
2
THE LAB #95: Bypassing Cloudflare in 2026
Testing Open Source Browser Automation Tools Against Real Targets
Jan 22
•
Pierluigi Vinciguerra
Understanding robots.txt and its Implications
A discussion on the robots.txt file, its legal implications, and what’s to be further taken in to account when scraping
Jan 18
•
Federico Trotta
5
1
AnyCrawl: Testing the LLM-Ready Web Scraping Service
Let's try AnyCrawl and see what this new kind of web scraping API solution brings to the table!
Jan 11
•
Antonello Zanini
5
6
Using Python’s Async Features for High-performance Scraping
From theory to practice: why async is better for scraping at scale
Jan 4
•
Federico Trotta
6
1
1
Most Popular
View all
THE LAB #1: Scraping data from an app
Sep 4, 2022
•
Pierluigi Vinciguerra
15
4
THE LAB #3: Scraping Cloudflare protected websites
Sep 27, 2022
•
Pierluigi Vinciguerra
10
1
THE LAB #73: How to Bypass Cloudflare in 2025
Jan 23, 2025
•
Pierluigi Vinciguerra
16
4
Ten years of web scraping: a personal perspective about selling web data
Mar 24, 2024
•
Pierluigi Vinciguerra
19
1
Platinum Partner
View all
NetNut: The Fastest & Most Reliable Proxy Network for Web Scrapers
Meet the Platinum Partner of The Web Scraping Club
Feb 6, 2025
•
Pierluigi Vinciguerra
1
The Great Web Unblocker Benchmark - Cloudflare Edition
Testing different web unblockers against Indeed.com
Sep 22, 2024
•
Pierluigi Vinciguerra
6
The Web Unblocker Cost Benchmark
Price comparison between the most well-known web unblockers on the market
Dec 24, 2023
•
Pierluigi Vinciguerra
2
1
Web Scraping
View all
A preview of the Zyte 2026 Web Scraping Industry report
Where the industry is headed according to Zyte
Jan 25
•
Pierluigi Vinciguerra
2
THE LAB #95: Bypassing Cloudflare in 2026
Testing Open Source Browser Automation Tools Against Real Targets
Jan 22
•
Pierluigi Vinciguerra
Understanding robots.txt and its Implications
A discussion on the robots.txt file, its legal implications, and what’s to be further taken in to account when scraping
Jan 18
•
Federico Trotta
5
1
AnyCrawl: Testing the LLM-Ready Web Scraping Service
Let's try AnyCrawl and see what this new kind of web scraping API solution brings to the table!
Jan 11
•
Antonello Zanini
5
6
Using Python’s Async Features for High-performance Scraping
From theory to practice: why async is better for scraping at scale
Jan 4
•
Federico Trotta
6
1
1
The Web Scraping Club in 2026
What to expect from The Web Scraping Club during the new year coming
Dec 31, 2025
•
Pierluigi Vinciguerra
1
1
Gold Partners
Ping Proxies
Tailored to meet all your Static ISP, Residential and Datacenter proxy needs. 1 GB Trial here
Rayobyte
Rayobyte is offering a 30% discount on rack rates for residential proxies by emailing sales@rayobyte.com.
AI
View all
Build an AI Agent for Scraping and Analyzing Research Papers
Let’s build an AI agent in Python for research paper scraping and analysis.
Dec 14, 2025
•
Antonello Zanini
1
Using NLP for Entity Extraction From Scraped Data
From theory to practice: how to extract entities from textual scraped data using NLP
Dec 7, 2025
•
Federico Trotta
2
1
1
Using AI to Detect Patterns in Scraped Data
A practical guide on finding patterns in scraped data with advanced techniques
Nov 23, 2025
•
Federico Trotta
2
2
1
When Browsers Start to Think: ChatGPT Atlas, Stagehand, Cursor, and the Future of Web Scraping
How recent browser integrations with LLMs are changing the way we explore and scrape the web.
Nov 2, 2025
•
Pierluigi Vinciguerra
1
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
