The Web Scraping Club

Home
Consulting
The Lab
Our partners
Archive
Leaderboard
About

The Lab

THE LAB #76: Bypassing Kasada With Open Source Tools In 2025
How to bypass Kasada protected websites without paying a cent
 • 
Pierluigi Vinciguerra
THE LAB #75: Building self healing scrapers with AI
How can we use LLMs to analyze HTML and fix our web scrapers?
 • 
Pierluigi Vinciguerra
THE LAB #74: Running scrapers on GitHub Actions
Save money and time by using GitHub infrastructure for running your scrapers
 • 
Pierluigi Vinciguerra
THE LAB #73: How to Bypass Cloudflare in 2025
Scraping websites protected by Cloudflare bot protection with open source tools
 • 
Pierluigi Vinciguerra
4
THE LAB #72: Advanced logging in Playwright
RabbitMQ, screenshots and system monitoring for your Playwright scrapers
 • 
Pierluigi Vinciguerra
THE LAB #71: Sending Scrapy logs to RabbitMQ
Saving the logs of your distributed scraping architecture to your database
 • 
Pierluigi Vinciguerra
THE LAB #70: Advanced logging in Scrapy
How to extract the most meaningful metrics from your scrapers
 • 
Pierluigi Vinciguerra
THE LAB #69: Building a dashboard for your scrapers with Grafana
Visualizing the operations of your Scrapy spider with interactive dashboards
 • 
Pierluigi Vinciguerra
THE LAB #68: Scheduling Scrapers with Airflow
How to manage a fleet of scrapers with Apache Airflow
 • 
Pierluigi Vinciguerra
1
THE LAB #67: Scraping Telegram using its APIs
How to create a bot for scraping Telegram channels
 • 
Pierluigi Vinciguerra
THE LAB #66: How to properly scrape a booking website
Business logic and best practices for scraping booking websites like Airbnb and Booking in the most efficient way
 • 
Pierluigi Vinciguerra
THE LAB #65: Scraping Datadome protected websites with Camoufox
Discovering the features of Camoufox, a custom and stealthy version of Firefox
 • 
Pierluigi Vinciguerra
2
© 2025 Pierluigi
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great culture