The Web Scraping Club
Subscribe
Sign in
Home
The Lab
Advertise on The Web Scraping…
Proxy pricing benchmark
Consulting
Archive
About
Using Python’s Async Features for High-performance Scraping
From theory to practice: why async is better for scraping at scale
Jan 4
•
Federico Trotta
5
1
1
The Web Scraping Club in 2026
What to expect from The Web Scraping Club during the new year coming
Dec 31, 2025
•
Pierluigi Vinciguerra
1
1
Top 5 Approaches to Let Scrapers Adapt to Website Changes
Tired of constantly fixing your scraping logic? Here are five methods to make it adapt automatically!
Dec 28, 2025
•
Antonello Zanini
3
2
Best Practices for Ethical Web Scraping
A discussion on the golden rules for scraping websites ethically
Dec 21, 2025
•
Federico Trotta
3
1
1
Build an AI Agent for Scraping and Analyzing Research Papers
Let’s build an AI agent in Python for research paper scraping and analysis.
Dec 14, 2025
•
Antonello Zanini
1
Most Popular
View all
THE LAB #1: Scraping data from an app
Sep 4, 2022
•
Pierluigi Vinciguerra
15
4
THE LAB #3: Scraping Cloudflare protected websites
Sep 27, 2022
•
Pierluigi Vinciguerra
10
1
THE LAB #73: How to Bypass Cloudflare in 2025
Jan 23, 2025
•
Pierluigi Vinciguerra
16
4
Ten years of web scraping: a personal perspective about selling web data
Mar 24, 2024
•
Pierluigi Vinciguerra
19
1
Platinum Partner
View all
NetNut: The Fastest & Most Reliable Proxy Network for Web Scrapers
Meet the Platinum Partner of The Web Scraping Club
Feb 6, 2025
•
Pierluigi Vinciguerra
1
The Great Web Unblocker Benchmark - Cloudflare Edition
Testing different web unblockers against Indeed.com
Sep 22, 2024
•
Pierluigi Vinciguerra
6
The Web Unblocker Cost Benchmark
Price comparison between the most well-known web unblockers on the market
Dec 24, 2023
•
Pierluigi Vinciguerra
2
1
Web Scraping
View all
Using Python’s Async Features for High-performance Scraping
From theory to practice: why async is better for scraping at scale
Jan 4
•
Federico Trotta
5
1
1
The Web Scraping Club in 2026
What to expect from The Web Scraping Club during the new year coming
Dec 31, 2025
•
Pierluigi Vinciguerra
1
1
Top 5 Approaches to Let Scrapers Adapt to Website Changes
Tired of constantly fixing your scraping logic? Here are five methods to make it adapt automatically!
Dec 28, 2025
•
Antonello Zanini
3
2
Best Practices for Ethical Web Scraping
A discussion on the golden rules for scraping websites ethically
Dec 21, 2025
•
Federico Trotta
3
1
1
Build an AI Agent for Scraping and Analyzing Research Papers
Let’s build an AI agent in Python for research paper scraping and analysis.
Dec 14, 2025
•
Antonello Zanini
1
Using NLP for Entity Extraction From Scraped Data
From theory to practice: how to extract entities from textual scraped data using NLP
Dec 7, 2025
•
Federico Trotta
2
1
1
Gold Partners
Ping Proxies
Tailored to meet all your Static ISP, Residential and Datacenter proxy needs. 1 GB Trial here
Rayobyte
Rayobyte is offering a 30% discount on rack rates for residential proxies by emailing sales@rayobyte.com.
AI
View all
Build an AI Agent for Scraping and Analyzing Research Papers
Let’s build an AI agent in Python for research paper scraping and analysis.
Dec 14, 2025
•
Antonello Zanini
1
Using NLP for Entity Extraction From Scraped Data
From theory to practice: how to extract entities from textual scraped data using NLP
Dec 7, 2025
•
Federico Trotta
2
1
1
Using AI to Detect Patterns in Scraped Data
A practical guide on finding patterns in scraped data with advanced techniques
Nov 23, 2025
•
Federico Trotta
2
2
1
When Browsers Start to Think: ChatGPT Atlas, Stagehand, Cursor, and the Future of Web Scraping
How recent browser integrations with LLMs are changing the way we explore and scrape the web.
Nov 2, 2025
•
Pierluigi Vinciguerra
1
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
