The Web Scraping Club
Subscribe
Sign in
Home
The Lab
Advertise on The Web Scraping…
Proxy pricing benchmark
Consulting
Archive
About
Web Scraping
Latest
Top
Discussions
Using Python’s Async Features for High-performance Scraping
From theory to practice: why async is better for scraping at scale
Jan 4
•
Federico Trotta
5
1
1
The Web Scraping Club in 2026
What to expect from The Web Scraping Club during the new year coming
Dec 31, 2025
•
Pierluigi Vinciguerra
1
1
Top 5 Approaches to Let Scrapers Adapt to Website Changes
Tired of constantly fixing your scraping logic? Here are five methods to make it adapt automatically!
Dec 28, 2025
•
Antonello Zanini
3
2
Best Practices for Ethical Web Scraping
A discussion on the golden rules for scraping websites ethically
Dec 21, 2025
•
Federico Trotta
3
1
1
Build an AI Agent for Scraping and Analyzing Research Papers
Let’s build an AI agent in Python for research paper scraping and analysis.
Dec 14, 2025
•
Antonello Zanini
1
Using NLP for Entity Extraction From Scraped Data
From theory to practice: how to extract entities from textual scraped data using NLP
Dec 7, 2025
•
Federico Trotta
2
1
1
Faster Web Scraping with HTTP/3 Web Requests
Let’s explore why HTTP/3 can be a game-changer for automating requests in a web scraping scenario!
Nov 30, 2025
•
Antonello Zanini
3
2
Using AI to Detect Patterns in Scraped Data
A practical guide on finding patterns in scraped data with advanced techniques
Nov 23, 2025
•
Federico Trotta
2
2
1
Pydoll: WebDriver-Free Browser Automation in Python
Let’s explore Pydoll, the Python library for browser automation without WebDrivers, featuring scraping-ready features—complete with practical examples!
Nov 16, 2025
•
Antonello Zanini
2
2
Building A Scraper Dashboard Using Streamlit
Learn how dynamic dashboards can help you visualize data immediately, saving you time on scraping and infrastructure for fast POCs
Nov 9, 2025
•
Federico Trotta
3
When Browsers Start to Think: ChatGPT Atlas, Stagehand, Cursor, and the Future of Web Scraping
How recent browser integrations with LLMs are changing the way we explore and scrape the web.
Nov 2, 2025
•
Pierluigi Vinciguerra
1
Offline Web Scraping: Download HTML Now, Parse Later
Let’s see why it’s worth keeping a copy of a page’s HTML when scraping it, or even downloading an entire site to scrape it later.
Oct 26, 2025
•
Antonello Zanini
1
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts