Web Scraping

Data Scraping for Market Research: A Developers Guide

Build scrapers that deliver real market intelligence, not just raw data dumps

Mar 29 • Federico Trotta

Two stealth browsers just dropped. Also, your proxy provider might be overcharging you.

Use the new TWSC tools to discover proxy prices and news in the web scraping industry

Mar 25 • Pierluigi Vinciguerra

WebSocket Bot Detection Techniques and How to Bypass Them

You may already know generic anti-bot techniques, but what about WebSocket-specific ones? Let’s find out!

Mar 22 • Antonello Zanini

THE LAB #100: Hybrid Scraping - One Browser Login, Thousands of HTTP Requests

Building a pipeline that uses Camoufox for authentication and curl_cffi for extraction on Akamai-protected targets.

Mar 19 • Pierluigi Vinciguerra

Stop Getting Blocked: Upgrade Your Scraping Infrastructure with Dolphin{anty}

My review of Dolphin{anty}. Weighing the pros, cons, and unique capabilities of this anti-detect browser.

Mar 15 • Federico Trotta

The DMCA Was Built to Stop DVD Piracy. Google Wants to Use It Against Scrapers

How a 12-page complaint is trying to turn every CAPTCHA into a federal copyright perimeter

Mar 8 • Pierluigi Vinciguerra

THE LAB #99: HTTP Caching for Web Scraping

How Conditional Requests Can Cut Your Proxy Bill, using HTTP caching.

Mar 5 • Pierluigi Vinciguerra

Kadoa: Simplify Your Scraping Workflows with Automation and AI

My review of Kadoa: An AI-powered tool that lets you create scraping workflows in minutes

Mar 1 • Federico Trotta

Why LLM-Ready Scrapers Return Content in Markdown: A Deep Dive

Why do all AI-ready scraping solutions produce Markdown results? Let’s find out!

Feb 22 • Antonello Zanini

THE LAB #98: Scraping Google Search Results in 2026: Device, Location, and Identity

Google does not have one set of results. It has millions. The hard part is knowing which one you are looking at.

Feb 19 • Pierluigi Vinciguerra

How to Avoid Copyright Violations While Scraping

Discover how copyright violations can occur in web scraping and how to avoid them

Feb 15 • Federico Trotta

Google vs IPIDEA: Anatomy of a Residential Proxy Takedown

Google Took Down 16 Million Proxy IPs. Here is Why It Will Not Be Enough.

Feb 8 • Pierluigi Vinciguerra

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts