The Web Scraping Club

The Web Scraping Club

Home
Consulting
Proxy pricing benchmark
The Lab
Club Deals
Archive
About
When Browsers Start to Think: ChatGPT Atlas, Stagehand, Cursor, and the Future of Web Scraping
How recent browser integrations with LLMs are changing the way we explore and scrape the web.
Nov 2 • 
Pierluigi Vinciguerra
Offline Web Scraping: Download HTML Now, Parse Later
Let’s see why it’s worth keeping a copy of a page’s HTML when scraping it, or even downloading an entire site to scrape it later.
Oct 26 • 
Antonello Zanini
Analyzing Scraped Data With Pandas And Matplotlib
From scraping to plots: a practical guide on how to start analyzing scraped data in Python.
Oct 19 • 
Federico Trotta
THE LAB #94: Using cookies and session for cost-effective scraping
Trying to scrape from Leboncoin, Allegro and Idealista without emptying our pockets.
Oct 17 • 
Pierluigi Vinciguerra
Scrapling: A Complete Hands-On Guide
Let's discover Scrapling, the Python library that makes web scraping easy and effortless—with practical examples!
Oct 12 • 
Antonello Zanini
Most Popular
View all
THE LAB #1: Scraping data from an app
Sep 4, 2022 • Pierluigi Vinciguerra
THE LAB #3: Scraping Cloudflare protected websites
Sep 27, 2022 • Pierluigi Vinciguerra
THE LAB #73: How to Bypass Cloudflare in 2025
Jan 23 • Pierluigi Vinciguerra
Ten years of web scraping: a personal perspective about selling web data
Mar 24, 2024 • Pierluigi Vinciguerra

Platinum Partner

View all
Discover Decodo Web Scraping API
Meet the Platinum Partner of The Web Scraping Club
Feb 6 • 
Pierluigi Vinciguerra
The Great Web Unblocker Benchmark - Cloudflare Edition
Testing different web unblockers against Indeed.com
Sep 22, 2024 • 
Pierluigi Vinciguerra
The Web Unblocker Cost Benchmark
Price comparison between the most well-known web unblockers on the market
Dec 24, 2023 • 
Pierluigi Vinciguerra

Web Scraping

View all
When Browsers Start to Think: ChatGPT Atlas, Stagehand, Cursor, and the Future of Web Scraping
How recent browser integrations with LLMs are changing the way we explore and scrape the web.
Nov 2 • 
Pierluigi Vinciguerra
Offline Web Scraping: Download HTML Now, Parse Later
Let’s see why it’s worth keeping a copy of a page’s HTML when scraping it, or even downloading an entire site to scrape it later.
Oct 26 • 
Antonello Zanini
Analyzing Scraped Data With Pandas And Matplotlib
From scraping to plots: a practical guide on how to start analyzing scraped data in Python.
Oct 19 • 
Federico Trotta
THE LAB #94: Using cookies and session for cost-effective scraping
Trying to scrape from Leboncoin, Allegro and Idealista without emptying our pockets.
Oct 17 • 
Pierluigi Vinciguerra
Scrapling: A Complete Hands-On Guide
Let's discover Scrapling, the Python library that makes web scraping easy and effortless—with practical examples!
Oct 12 • 
Antonello Zanini
From Scripts to Agents: The Evolving Career For Web Scraping Professionals
A look at the evolution of professional scrapers over the years, with a foot in the future.
Oct 5 • 
Federico Trotta
Gold Partners
NetNut
Discover the NetNut's Website Unblocker
IPRoyal
Get a huge 55% off for residential proxies
Oxylabs
Limited Offer from Oxylabs: 50% Off Residential Proxies
Ping Proxies
Tailored to meet all your Static ISP, Residential and Datacenter proxy needs. 1 GB Trial here
Rayobyte
Rayobyte is offering a 30% discount on rack rates for residential proxies by emailing sales@rayobyte.com.
Syphoon
Reliable APIs for Web Data Extraction

AI

View all
When Browsers Start to Think: ChatGPT Atlas, Stagehand, Cursor, and the Future of Web Scraping
How recent browser integrations with LLMs are changing the way we explore and scrape the web.
Nov 2 • 
Pierluigi Vinciguerra
THE LAB #84: AI-Driven Web Scraping: OpenAI Codex vs Cursor vs AI Scraping Tools
Is OpenAI Codex the new silver bullet for scraping?
May 22 • 
Pierluigi Vinciguerra
THE LAB #79: Use Cursor as a web scraping assistant with MCP servers
Add MCP Servers to Cursor for increasing our web scraping capabilities
Mar 21 • 
Pierluigi Vinciguerra
The Browser Automation Landscape in 2025
How new players and tools are shaping the browser automation and scraping industries
Feb 9 • 
Pierluigi Vinciguerra
© 2025 Pierluigi
Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture