Archive - The Web Scraping Club

Using Web Scraping in Finance to Discover Investment Insights

Tired of guessing? Use web scraping to make data-backed financial decisions!

May 17 • Antonello Zanini

THE LAB #104: Bypassing AWS WAF on IMDB with Scrapling

An hands-on test on tools for TLS spoofing and Scrapling

May 14 • Pierluigi Vinciguerra

How to Use LLMs to Enhance Data Extraction From Unstructured Text

How combining LLMs with schema validation solves the extraction problem that NLP never could

May 10 • Federico Trotta

Cloudflare Crawl Endpoint: Everything You Need to Know

Is the Cloudflare /crawl endpoint a real game-changer?

May 3 • Antonello Zanini

April 2026

THE LAB #103: Bypassing DataDome-Protected Websites in the Agentic Era

Fifteen browser configurations, one tough anti-bot, and only a couple made it to the cart

Apr 30 • Pierluigi Vinciguerra

Stop Paying for Bandwidth: How to Leverage IPv6 Subnets for Infinite Proxy Rotation

Escape metered residential proxy billing. Discover how to build a self-hosted, rotating proxy gateway using IPv6 /64 subnets to drastically cut your web…

Apr 26 • Federico Trotta

The Trick to Scrape Next.js Websites in Seconds

Scraping data from the most widely used full-stack framework in the world with just 3 lines of code!

Apr 19 • Antonello Zanini

THE LAB #102: How Fast Can You Call Polymarket's APIs?

Three languages, four locations, 1,000 requests. The biggest speed gain has nothing to do with code.

Apr 16 • Pierluigi Vinciguerra

The Stealth Stack: A Guide to Preventing Data Leaks in Web Scraping Infrastructure

A four-layer defense strategy for making your web scraping infrastructure indistinguishable from real users

Apr 12 • Federico Trotta

rayobrowse: A Hands-On Look at the Stealth Browser From Rayobyte

Looking for a Camoufox alternative? Here’s an interesting stealth browser worth checking out!

Apr 5 • Antonello Zanini

THE LAB #101: Building an Internal Knowledge Base for Your Scraping Team

Every scraping team that survives long enough develops the same disease.

Apr 2 • Pierluigi Vinciguerra

March 2026

Data Scraping for Market Research: A Developers Guide

Build scrapers that deliver real market intelligence, not just raw data dumps

Mar 29 • Federico Trotta

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts