Archive - The Web Scraping Club

Best Practices for Ethical Web Scraping

A discussion on the golden rules for scraping websites ethically

Dec 21 • Federico Trotta

Build an AI Agent for Scraping and Analyzing Research Papers

Let’s build an AI agent in Python for research paper scraping and analysis.

Dec 14 • Antonello Zanini

Using NLP for Entity Extraction From Scraped Data

From theory to practice: how to extract entities from textual scraped data using NLP

Dec 7 • Federico Trotta

November 2025

Faster Web Scraping with HTTP/3 Web Requests

Let’s explore why HTTP/3 can be a game-changer for automating requests in a web scraping scenario!

Nov 30 • Antonello Zanini

Using AI to Detect Patterns in Scraped Data

A practical guide on finding patterns in scraped data with advanced techniques

Nov 23 • Federico Trotta

About parenting and The State of Web Scraping 2026 report

A quick update and a new project for the next year

Nov 22 • Pierluigi Vinciguerra

Pydoll: WebDriver-Free Browser Automation in Python

Let’s explore Pydoll, the Python library for browser automation without WebDrivers, featuring scraping-ready features—complete with practical examples!

Nov 16 • Antonello Zanini

Building A Scraper Dashboard Using Streamlit

Learn how dynamic dashboards can help you visualize data immediately, saving you time on scraping and infrastructure for fast POCs

Nov 9 • Federico Trotta

When Browsers Start to Think: ChatGPT Atlas, Stagehand, Cursor, and the Future of Web Scraping

How recent browser integrations with LLMs are changing the way we explore and scrape the web.

Nov 2 • Pierluigi Vinciguerra

October 2025

Offline Web Scraping: Download HTML Now, Parse Later

Let’s see why it’s worth keeping a copy of a page’s HTML when scraping it, or even downloading an entire site to scrape it later.

Oct 26 • Antonello Zanini

Analyzing Scraped Data With Pandas And Matplotlib

From scraping to plots: a practical guide on how to start analyzing scraped data in Python.

Oct 19 • Federico Trotta

THE LAB #94: Using cookies and session for cost-effective scraping

Trying to scrape from Leboncoin, Allegro and Idealista without emptying our pockets.

Oct 17 • Pierluigi Vinciguerra

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts