Web Scraping

A preview of the Zyte 2026 Web Scraping Industry report

Where the industry is headed according to Zyte

Jan 25 • Pierluigi Vinciguerra

THE LAB #95: Bypassing Cloudflare in 2026

Testing Open Source Browser Automation Tools Against Real Targets

Jan 22 • Pierluigi Vinciguerra

Understanding robots.txt and its Implications

A discussion on the robots.txt file, its legal implications, and what’s to be further taken in to account when scraping

Jan 18 • Federico Trotta

AnyCrawl: Testing the LLM-Ready Web Scraping Service

Let's try AnyCrawl and see what this new kind of web scraping API solution brings to the table!

Jan 11 • Antonello Zanini

Using Python’s Async Features for High-performance Scraping

From theory to practice: why async is better for scraping at scale

Jan 4 • Federico Trotta

The Web Scraping Club in 2026

What to expect from The Web Scraping Club during the new year coming

Dec 31, 2025 • Pierluigi Vinciguerra

Top 5 Approaches to Let Scrapers Adapt to Website Changes

Tired of constantly fixing your scraping logic? Here are five methods to make it adapt automatically!

Dec 28, 2025 • Antonello Zanini

Best Practices for Ethical Web Scraping

A discussion on the golden rules for scraping websites ethically

Dec 21, 2025 • Federico Trotta

Build an AI Agent for Scraping and Analyzing Research Papers

Let’s build an AI agent in Python for research paper scraping and analysis.

Dec 14, 2025 • Antonello Zanini

Using NLP for Entity Extraction From Scraped Data

From theory to practice: how to extract entities from textual scraped data using NLP

Dec 7, 2025 • Federico Trotta

Faster Web Scraping with HTTP/3 Web Requests

Let’s explore why HTTP/3 can be a game-changer for automating requests in a web scraping scenario!

Nov 30, 2025 • Antonello Zanini

Using AI to Detect Patterns in Scraped Data

A practical guide on finding patterns in scraped data with advanced techniques

Nov 23, 2025 • Federico Trotta

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts