The Web Scraping Club

The Web Scraping Club

Home
Consulting
Proxy pricing benchmark
The Lab
Club Deals
Archive
About

The Lab

THE LAB #81: Scraping Zillow for fun and profit
Get real estate data from the biggest US website
 • 
Pierluigi Vinciguerra
1
THE LAB #80: Scraping food delivery data
Use both the website and the mobile apps to get data from food and grocery delivery data
 • 
Pierluigi Vinciguerra
THE LAB #79: Use Cursor as web scraping assistant with MCP servers
Add MCP Servers to Cursor for increasing our web scraping capabilities
 • 
Pierluigi Vinciguerra
THE LAB #78: Building a Web Scraping Knowledge Assistant with RAG - Part2
Optimizing the content storage and creating a CLI for our assistant
 • 
Pierluigi Vinciguerra
THE LAB #77: Building a Web Scraping Knowledge Assistant with RAG
How to include scraped data in your AI assistant
 • 
Pierluigi Vinciguerra
THE LAB #76: Bypassing Kasada With Open Source Tools In 2025
How to bypass Kasada protected websites without paying a cent
 • 
Pierluigi Vinciguerra
THE LAB #75: Building self healing scrapers with AI
How can we use LLMs to analyze HTML and fix our web scrapers?
 • 
Pierluigi Vinciguerra
THE LAB #74: Running scrapers on GitHub Actions
Save money and time by using GitHub infrastructure for running your scrapers
 • 
Pierluigi Vinciguerra
THE LAB #73: How to Bypass Cloudflare in 2025
Scraping websites protected by Cloudflare bot protection with open source tools
 • 
Pierluigi Vinciguerra
4
THE LAB #72: Advanced logging in Playwright
RabbitMQ, screenshots and system monitoring for your Playwright scrapers
 • 
Pierluigi Vinciguerra
THE LAB #71: Sending Scrapy logs to RabbitMQ
Saving the logs of your distributed scraping architecture to your database
 • 
Pierluigi Vinciguerra
THE LAB #70: Advanced logging in Scrapy
How to extract the most meaningful metrics from your scrapers
 • 
Pierluigi Vinciguerra
© 2025 Pierluigi
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture