The Web Scraping Club

Home
Blog
Web Scraping Open Knowledge
Special offers for our readers
Archive
About
THE LAB 33: Fingerprinting at different connection layers
How to create and test a scraper with a coherent fingerprint between the different layers
 • 
Pierluigi Vinciguerra
The true costs of a web scraping project
Considering all the hidden costs behind, not as easy as it seems.
 • 
Pierluigi Vinciguerra
1
THE LAB 32: hRequests vs anti-bots: a full benchmark
How does it perform against Cloudflare, Akamai, Datadome, PerimeterX and Kasada?
 • 
Pierluigi Vinciguerra
Most Popular
View all
THE LAB #1: Scraping data from an app
 • Pierluigi Vinciguerra
4
THE LAB #3: Scraping Cloudflare protected websites
 • Pierluigi Vinciguerra
THE LAB #2: scraping data from a website with Datadome and xsrf tokens
 • Pierluigi Vinciguerra
THE LAB #25: Bypassing Perimeterx in 2023
 • Pierluigi Vinciguerra
Writing a web scraper with ChatGPT. Is it a good idea?
 • Pierluigi Vinciguerra
2

Cloudflare

See all
THE LAB 32: hRequests vs anti-bots: a full benchmark
How does it perform against Cloudflare, Akamai, Datadome, PerimeterX and Kasada?
 • 
Pierluigi Vinciguerra
THE LAB #29: Bypass Cloudflare Bot Protection with Scrapy
Is it possible to bypass Cloudflare without using an headful browser?
 • 
Pierluigi Vinciguerra
Hands On #6: Testing the Infatica web scraper
How Infatica's web scraper behave against the most used anti-bot solutions.

Datadome

See all
THE LAB 32: hRequests vs anti-bots: a full benchmark
How does it perform against Cloudflare, Akamai, Datadome, PerimeterX and Kasada?
 • 
Pierluigi Vinciguerra
Hands On #6: Testing the Infatica web scraper
How Infatica's web scraper behave against the most used anti-bot solutions.
Hands On #5: Testing the Oxylabs Web Unblocker
Testing the Oxylabs Web Unblocker against the most used anti-bot solutions.
 • 
Pierluigi Vinciguerra

PerimeterX

See all

Anti-bot

See all
The Web Scraping Club
The Web Scraping Club
News, solutions and interviews about web scraping. In this substack you will find weekly content about: - Web Scraping techniques - Interviews with key people in the industry - Anti bot infos and counter measures - Real world examples and code
Recommendations
Doodling Data
Doodling Data
Martina Pugliese
Data Boutique
Data Boutique
Andrea Squatrito
M
Magis
Alex Izydorczyk
The Data Score
The Data Score
Jason DeRise
The Lab
The Lab: articles for premium readers
Our premium articles with code: scraping Cloudflare, Datadome, Mobile Apps and many other

The Web Scraping Club

AboutArchiveRecommendationsSitemap
© 2023 Pierluigi
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing