The Web Scraping Club

Home
Web Scraping Course
The Lab
Special offers for our readers
Archive
Leaderboard
About

The Lab

The Lab #57: Improving your Playwright scraper and avoid CDP detection
How to use the latest advancements to avoid CDP detection in your Playwright scrapers
 • 
Pierluigi Vinciguerra
The Lab #56: Bypassing PerimeterX 3
Testing the latest PerimeterX version by scraping Crunchbase public data
 • 
Pierluigi Vinciguerra
The Lab #55: Checking your browser fingerprint
Understanding your scrapers' browser fingerprint reliability with online tests.
 • 
Pierluigi Vinciguerra
3
The Lab #54: Scraping from Algolia APIs
Why internal APIs are always the best choice for scraping a website
 • 
Pierluigi Vinciguerra
2
The Lab #53: Bypassing AWS WAF
Scraping websites protected by AWS WAF using an hybrid approach
 • 
Pierluigi Vinciguerra
The Lab #52: Scraping with LLMs and ScrapeGraphAi - part 1
Are LLMs the Holy Graal for web scraping?
 • 
Pierluigi Vinciguerra
The Lab #51: APIs with Bearer Token
Scraping data from API endpoints requiring Bearer Token
 • 
Pierluigi Vinciguerra
Celebrating the 50th article of The Lab series
A brief review of the first 50 episodes of The Lab series
 • 
Pierluigi Vinciguerra
The Lab #49: Bypassing Cloudflare with open source repositories
And my two cents about these solutions
 • 
Pierluigi Vinciguerra
The Lab #48: Scraping with AWS Lambda
Using Serverless and Selenium on Lambda for gathering data
 • 
Pierluigi Vinciguerra
The Lab #47: Scraping real time data with Python
Using WebSocket to scrape data from Bitstamp and Sofascore
 • 
Pierluigi Vinciguerra
The Lab #46: Fingerprint injection in Playwright
A home-made solution to bypass anti-bots by changing your browser fingerprint.
 • 
Pierluigi Vinciguerra
© 2024 Pierluigi
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great culture