The Web Scraping Club | Pierluigi Vinciguerra | Substack

Tool of the week #1: Bright Data Scraper Studio, From Prompt to Production Scraper in Minutes

Explore how Bright Data's Scraper Studio bridges the gap between AI-assisted building and full IDE-level control without locking you into either.

READ THE LATEST

Most Popular

THE LAB #1: Scraping data from an app

Sep 4, 2022 • Pierluigi Vinciguerra

THE LAB #3: Scraping Cloudflare protected websites

Sep 27, 2022 • Pierluigi Vinciguerra

THE LAB #73: How to Bypass Cloudflare in 2025

Jan 23, 2025 • Pierluigi Vinciguerra

Ten years of web scraping: a personal perspective about selling web data

Mar 24, 2024 • Pierluigi Vinciguerra

Platinum Partner

NetNut: The Fastest & Most Reliable Proxy Network for Web Scrapers

Meet the Platinum Partner of The Web Scraping Club

Feb 6, 2025 • Pierluigi Vinciguerra

The Great Web Unblocker Benchmark - Cloudflare Edition

Testing different web unblockers against Indeed.com

Sep 22, 2024 • Pierluigi Vinciguerra

The Web Unblocker Cost Benchmark

Price comparison between the most well-known web unblockers on the market

Dec 24, 2023 • Pierluigi Vinciguerra

Recent posts

Why Your RAG Pipelines Are Only as Good as Your Data Acquisition Layer

A deep dive into what RAG actually requires, where web search integration falls short, and why scraping is the only retrieval layer that scales.

Aug 2 • Federico Trotta

THE LAB #112: Intercepting a Website's Internal API Calls

Fifteen tools against two live bot detectors, and only four passed the strict one.

Jul 30 • Pierluigi Vinciguerra

Crawl of Fame - July 2026

The rollercoaster of the proxy industry and a a sigh of relief for the industry

Jul 27 • Pierluigi Vinciguerra

AI

Why Your RAG Pipelines Are Only as Good as Your Data Acquisition Layer

A deep dive into what RAG actually requires, where web search integration falls short, and why scraping is the only retrieval layer that scales.

Aug 2 • Federico Trotta

Build an AI Agent for Scraping and Analyzing Research Papers

Let’s build an AI agent in Python for research paper scraping and analysis.

Dec 14, 2025 • Antonello Zanini

Using NLP for Entity Extraction From Scraped Data

From theory to practice: how to extract entities from textual scraped data using NLP

Dec 7, 2025 • Federico Trotta

Using AI to Detect Patterns in Scraped Data

A practical guide on finding patterns in scraped data with advanced techniques

Nov 23, 2025 • Federico Trotta

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts