The Web Scraping Club | Pierluigi Vinciguerra | Substack

WebSocket Bot Detection Techniques and How to Bypass Them

You may already know generic anti-bot techniques, but what about WebSocket-specific ones? Let’s find out!

READ THE LATEST

Most Popular

THE LAB #1: Scraping data from an app

Sep 4, 2022 • Pierluigi Vinciguerra

THE LAB #3: Scraping Cloudflare protected websites

Sep 27, 2022 • Pierluigi Vinciguerra

THE LAB #73: How to Bypass Cloudflare in 2025

Jan 23, 2025 • Pierluigi Vinciguerra

Ten years of web scraping: a personal perspective about selling web data

Mar 24, 2024 • Pierluigi Vinciguerra

Platinum Partner

NetNut: The Fastest & Most Reliable Proxy Network for Web Scrapers

Meet the Platinum Partner of The Web Scraping Club

Feb 6, 2025 • Pierluigi Vinciguerra

The Great Web Unblocker Benchmark - Cloudflare Edition

Testing different web unblockers against Indeed.com

Sep 22, 2024 • Pierluigi Vinciguerra

The Web Unblocker Cost Benchmark

Price comparison between the most well-known web unblockers on the market

Dec 24, 2023 • Pierluigi Vinciguerra

Recent posts

THE LAB #100: Hybrid Scraping - One Browser Login, Thousands of HTTP Requests

Building a pipeline that uses Camoufox for authentication and curl_cffi for extraction on Akamai-protected targets.

Mar 19 • Pierluigi Vinciguerra

Stop Getting Blocked: Upgrade Your Scraping Infrastructure with Dolphin{anty}

My review of Dolphin{anty}. Weighing the pros, cons, and unique capabilities of this anti-detect browser.

Mar 15 • Federico Trotta

The DMCA Was Built to Stop DVD Piracy. Google Wants to Use It Against Scrapers

How a 12-page complaint is trying to turn every CAPTCHA into a federal copyright perimeter

Mar 8 • Pierluigi Vinciguerra

AI

Build an AI Agent for Scraping and Analyzing Research Papers

Let’s build an AI agent in Python for research paper scraping and analysis.

Dec 14, 2025 • Antonello Zanini

Using NLP for Entity Extraction From Scraped Data

From theory to practice: how to extract entities from textual scraped data using NLP

Dec 7, 2025 • Federico Trotta

Using AI to Detect Patterns in Scraped Data

A practical guide on finding patterns in scraped data with advanced techniques

Nov 23, 2025 • Federico Trotta

When Browsers Start to Think: ChatGPT Atlas, Stagehand, Cursor, and the Future of Web Scraping

How recent browser integrations with LLMs are changing the way we explore and scrape the web.

Nov 2, 2025 • Pierluigi Vinciguerra

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts