The Web Scraping Club

The Web Scraping Club

Home
Consulting
Proxy pricing benchmark
The Lab
Club Deals
Archive
About
Understanding the Role of the X-Forwarded-For Header in Proxies
Learn everything you need to know about the X-Forwarded-For HTTP header
Sep 14 • 
Antonello Zanini
1
Implementing Anomaly Detection on Scraped Datasets
From Theory To Practice: A Guide on Anomaly Detection on Scraped Data
Sep 7 • 
Federico Trotta
1
How to Scrape Booking.com in Python
Automatically retrieve data from Booking.com using a custom Playwright-based scraper
Aug 31 • 
Antonello Zanini
3
2
THE LAB #92: scraping Depop in a cost-effective way
Delegate or in house solution? A cost-wise perspective.
Aug 29 • 
Pierluigi Vinciguerra
4
Cloudflare Pay to Crawl: is it something feasible?
About the new Cloudflare Pay-to-Crawl, AI crawlers bot detection marketing and The Web Scraping Club
Aug 24 • 
Pierluigi Vinciguerra
3
Most Popular
View all
THE LAB #1: Scraping data from an app
Sep 4, 2022 • Pierluigi Vinciguerra
15
4
THE LAB #3: Scraping Cloudflare protected websites
Sep 27, 2022 • Pierluigi Vinciguerra
9
THE LAB #73: How to Bypass Cloudflare in 2025
Jan 23 • Pierluigi Vinciguerra
15
4
Ten years of web scraping: a personal perspective about selling web data
Mar 24, 2024 • Pierluigi Vinciguerra
19

Platinum Partner

View all
Discover Decodo Web Scraping API
Meet the Platinum Partner of The Web Scraping Club
Feb 6 • 
Pierluigi Vinciguerra
1
The Great Web Unblocker Benchmark - Cloudflare Edition
Testing different web unblockers against Indeed.com
Sep 22, 2024 • 
Pierluigi Vinciguerra
6
The Web Unblocker Cost Benchmark
Price comparison between the most well-known web unblockers on the market
Dec 24, 2023 • 
Pierluigi Vinciguerra
2

Web Scraping

View all
Understanding the Role of the X-Forwarded-For Header in Proxies
Learn everything you need to know about the X-Forwarded-For HTTP header
Sep 14 • 
Antonello Zanini
1
Implementing Anomaly Detection on Scraped Datasets
From Theory To Practice: A Guide on Anomaly Detection on Scraped Data
Sep 7 • 
Federico Trotta
1
How to Scrape Booking.com in Python
Automatically retrieve data from Booking.com using a custom Playwright-based scraper
Aug 31 • 
Antonello Zanini
3
2
THE LAB #92: scraping Depop in a cost-effective way
Delegate or in house solution? A cost-wise perspective.
Aug 29 • 
Pierluigi Vinciguerra
4
Cloudflare Pay to Crawl: is it something feasible?
About the new Cloudflare Pay-to-Crawl, AI crawlers bot detection marketing and The Web Scraping Club
Aug 24 • 
Pierluigi Vinciguerra
3
Understanding the Nuances of Browser Fingerprinting
An introduction to browser fingerprinting and its peculiarities
Aug 17 • 
Antonello Zanini
7
1
Gold Partners
NetNut
Discover the NetNut's Website Unblocker
IPRoyal
Get a huge 55% off for residential proxies
Oxylabs
Limited Offer from Oxylabs: 50% Off Residential Proxies
Ping Proxies
Tailored to meet all your Static ISP, Residential and Datacenter proxy needs. 1 GB Trial here
AirProxy
Mobile proxies with unlimited GB, Try it for 72 hours at 9.90€.
Rayobyte
Rayobyte is offering an exclusive 55% discount with the code WSC55 in all of their static datacenter & ISP proxies only to web scraping club visitors
Syphoon
Reliable APIs for Web Data Extraction

AI

View all
THE LAB #84: AI-Driven Web Scraping: OpenAI Codex vs Cursor vs AI Scraping Tools
Is OpenAI Codex the new silver bullet for scraping?
May 22 • 
Pierluigi Vinciguerra
4
THE LAB #79: Use Cursor as a web scraping assistant with MCP servers
Add MCP Servers to Cursor for increasing our web scraping capabilities
Mar 21 • 
Pierluigi Vinciguerra
12
The Browser Automation Landscape in 2025
How new players and tools are shaping the browser automation and scraping industries
Feb 9 • 
Pierluigi Vinciguerra
11
4
THE LAB #75: Building self healing scrapers with AI
How can we use LLMs to analyze HTML and fix our web scrapers?
Feb 6 • 
Pierluigi Vinciguerra
8
© 2025 Pierluigi
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture