Web Scraping

The DMCA Was Built to Stop DVD Piracy. Google Wants to Use It Against Scrapers

How a 12-page complaint is trying to turn every CAPTCHA into a federal copyright perimeter

Mar 8 • Pierluigi Vinciguerra

THE LAB #99: HTTP Caching for Web Scraping

How Conditional Requests Can Cut Your Proxy Bill, using HTTP caching.

Mar 5 • Pierluigi Vinciguerra

Kadoa: Simplify Your Scraping Workflows with Automation and AI

My review of Kadoa: An AI-powered tool that lets you create scraping workflows in minutes

Mar 1 • Federico Trotta

Why LLM-Ready Scrapers Return Content in Markdown: A Deep Dive

Why do all AI-ready scraping solutions produce Markdown results? Let’s find out!

Feb 22 • Antonello Zanini

THE LAB #98: Scraping Google Search Results in 2026: Device, Location, and Identity

Google does not have one set of results. It has millions. The hard part is knowing which one you are looking at.

Feb 19 • Pierluigi Vinciguerra

How to Avoid Copyright Violations While Scraping

Discover how copyright violations can occur in web scraping and how to avoid them

Feb 15 • Federico Trotta

Google vs IPIDEA: Anatomy of a Residential Proxy Takedown

Google Took Down 16 Million Proxy IPs. Here is Why It Will Not Be Enough.

Feb 8 • Pierluigi Vinciguerra

THE LAB #97: My first week with OpenClaw

160,000 Stars in Two Months: What OpenClaw Means for Scrapers

Feb 5 • Pierluigi Vinciguerra

WebDriver vs Chrome DevTools Protocol (CDP) vs WebDriver BiDi: How We Control Browsers

Do you know how browser automation libraries actually manage to control browsers? Let’s find out!

Feb 1 • Antonello Zanini

THE LAB #96: Scraping Nike.com with 5 open source tools

Match your tool to the protection, not the brand

Jan 29 • Pierluigi Vinciguerra

A preview of the Zyte 2026 Web Scraping Industry report

Where the industry is headed according to Zyte

Jan 25 • Pierluigi Vinciguerra

THE LAB #95: Bypassing Cloudflare in 2026

Testing Open Source Browser Automation Tools Against Real Targets

Jan 22 • Pierluigi Vinciguerra

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts