The Web Scraping Club | Pierluigi Vinciguerra | Substack

The Engineer's Guide to Residential Proxies: From IP Fundamentals to Exit Node Sourcing

Everything an engineer needs to know about residential proxies, ranging from how they work, their types, and where those IPs actually come from

READ THE LATEST

Most Popular

THE LAB #1: Scraping data from an app

Sep 4, 2022 • Pierluigi Vinciguerra

THE LAB #3: Scraping Cloudflare protected websites

Sep 27, 2022 • Pierluigi Vinciguerra

THE LAB #73: How to Bypass Cloudflare in 2025

Jan 23, 2025 • Pierluigi Vinciguerra

Ten years of web scraping: a personal perspective about selling web data

Mar 24, 2024 • Pierluigi Vinciguerra

Platinum Partner

NetNut: The Fastest & Most Reliable Proxy Network for Web Scrapers

Meet the Platinum Partner of The Web Scraping Club

Feb 6, 2025 • Pierluigi Vinciguerra

The Great Web Unblocker Benchmark - Cloudflare Edition

Testing different web unblockers against Indeed.com

Sep 22, 2024 • Pierluigi Vinciguerra

The Web Unblocker Cost Benchmark

Price comparison between the most well-known web unblockers on the market

Dec 24, 2023 • Pierluigi Vinciguerra

Recent posts

THE LAB #110: Why Shopee is so hard to scrape

Usually, when I dig into an app’s request signing, I like to end with something practical you can use, like a script, an offline signer, or at least a…

Jul 16 • Pierluigi Vinciguerra

Browser Fingerprinting Deep Dive

How Detection Works and How Scrapers Adapt

Jul 14 • Dennis Kriukiov

How CAPTCHAs Are Evolving to Fight AI-Powered Bots

Is it game over for CAPTCHA solvers?

Jul 12 • Antonello Zanini

AI

Build an AI Agent for Scraping and Analyzing Research Papers

Let’s build an AI agent in Python for research paper scraping and analysis.

Dec 14, 2025 • Antonello Zanini

Using NLP for Entity Extraction From Scraped Data

From theory to practice: how to extract entities from textual scraped data using NLP

Dec 7, 2025 • Federico Trotta

Using AI to Detect Patterns in Scraped Data

A practical guide on finding patterns in scraped data with advanced techniques

Nov 23, 2025 • Federico Trotta

When Browsers Start to Think: ChatGPT Atlas, Stagehand, Cursor, and the Future of Web Scraping

How recent browser integrations with LLMs are changing the way we explore and scrape the web.

Nov 2, 2025 • Pierluigi Vinciguerra

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts