The Web Scraping Club | Pierluigi Vinciguerra | Substack

How to Use LLMs to Enhance Data Extraction From Unstructured Text

How combining LLMs with schema validation solves the extraction problem that NLP never could

READ THE LATEST

Most Popular

THE LAB #1: Scraping data from an app

Sep 4, 2022 • Pierluigi Vinciguerra

THE LAB #3: Scraping Cloudflare protected websites

Sep 27, 2022 • Pierluigi Vinciguerra

THE LAB #73: How to Bypass Cloudflare in 2025

Jan 23, 2025 • Pierluigi Vinciguerra

Ten years of web scraping: a personal perspective about selling web data

Mar 24, 2024 • Pierluigi Vinciguerra

Platinum Partner

NetNut: The Fastest & Most Reliable Proxy Network for Web Scrapers

Meet the Platinum Partner of The Web Scraping Club

Feb 6, 2025 • Pierluigi Vinciguerra

The Great Web Unblocker Benchmark - Cloudflare Edition

Testing different web unblockers against Indeed.com

Sep 22, 2024 • Pierluigi Vinciguerra

The Web Unblocker Cost Benchmark

Price comparison between the most well-known web unblockers on the market

Dec 24, 2023 • Pierluigi Vinciguerra

Recent posts

Cloudflare Crawl Endpoint: Everything You Need to Know

Is the Cloudflare /crawl endpoint a real game-changer?

May 3 • Antonello Zanini

THE LAB #103: Bypassing DataDome-Protected Websites in the Agentic Era

Fifteen browser configurations, one tough anti-bot, and only a couple made it to the cart

Apr 30 • Pierluigi Vinciguerra

Stop Paying for Bandwidth: How to Leverage IPv6 Subnets for Infinite Proxy Rotation

Escape metered residential proxy billing. Discover how to build a self-hosted, rotating proxy gateway using IPv6 /64 subnets to drastically cut your web…

Apr 26 • Federico Trotta

AI

Build an AI Agent for Scraping and Analyzing Research Papers

Let’s build an AI agent in Python for research paper scraping and analysis.

Dec 14, 2025 • Antonello Zanini

Using NLP for Entity Extraction From Scraped Data

From theory to practice: how to extract entities from textual scraped data using NLP

Dec 7, 2025 • Federico Trotta

Using AI to Detect Patterns in Scraped Data

A practical guide on finding patterns in scraped data with advanced techniques

Nov 23, 2025 • Federico Trotta

When Browsers Start to Think: ChatGPT Atlas, Stagehand, Cursor, and the Future of Web Scraping

How recent browser integrations with LLMs are changing the way we explore and scrape the web.

Nov 2, 2025 • Pierluigi Vinciguerra

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts