The Web Scraping Club
Subscribe
Sign in
Home
Consulting
The Lab
Special offers for our readers
Archive
Leaderboard
About
The Lab
Latest
Top
Discussions
THE LAB #61: Evaluating your proxy provider
Measuring programmatically the quality of the IPs offered by proxy providers
Sep 12
•
Pierluigi Vinciguerra
4
Share this post
THE LAB #61: Evaluating your proxy provider
substack.thewebscraping.club
Copy link
Facebook
Email
Note
Other
THE LAB #60: Writing scrapers with LLMs
Comparing LLama3.1, GPT4 and Mistral in creating scrapers
Sep 6
•
Pierluigi Vinciguerra
Share this post
THE LAB #60: Writing scrapers with LLMs
substack.thewebscraping.club
Copy link
Facebook
Email
Note
Other
The Lab #59: Bypassing certificate pinning with Frida and Fiddler - part 2
Rooting a virtual mobile Android Device to install Frida and discover API endpoints under the hood of apps
Aug 15
•
Pierluigi Vinciguerra
3
Share this post
The Lab #59: Bypassing certificate pinning with Frida and Fiddler - part 2
substack.thewebscraping.club
Copy link
Facebook
Email
Note
Other
The Lab #58: Intercepting traffic from an App - part 1
Discover API endpoints called by an App to scrape its data
Aug 9
•
Pierluigi Vinciguerra
5
Share this post
The Lab #58: Intercepting traffic from an App - part 1
substack.thewebscraping.club
Copy link
Facebook
Email
Note
Other
4
The Lab #57: Improving your Playwright scraper and avoid CDP detection
How to use the latest advancements to avoid CDP detection in your Playwright scrapers
Jul 26
•
Pierluigi Vinciguerra
3
Share this post
The Lab #57: Improving your Playwright scraper and avoid CDP detection
substack.thewebscraping.club
Copy link
Facebook
Email
Note
Other
3
The Lab #56: Bypassing PerimeterX 3
Testing the latest PerimeterX version by scraping Crunchbase public data
Jul 11
•
Pierluigi Vinciguerra
4
Share this post
The Lab #56: Bypassing PerimeterX 3
substack.thewebscraping.club
Copy link
Facebook
Email
Note
Other
The Lab #55: Checking your browser fingerprint
Understanding your scrapers' browser fingerprint reliability with online tests.
Jul 4
•
Pierluigi Vinciguerra
8
Share this post
The Lab #55: Checking your browser fingerprint
substack.thewebscraping.club
Copy link
Facebook
Email
Note
Other
3
The Lab #54: Scraping from Algolia APIs
Why internal APIs are always the best choice for scraping a website
Jun 21
•
Pierluigi Vinciguerra
1
Share this post
The Lab #54: Scraping from Algolia APIs
substack.thewebscraping.club
Copy link
Facebook
Email
Note
Other
2
The Lab #53: Bypassing AWS WAF
Scraping websites protected by AWS WAF using an hybrid approach
Jun 6
•
Pierluigi Vinciguerra
5
Share this post
The Lab #53: Bypassing AWS WAF
substack.thewebscraping.club
Copy link
Facebook
Email
Note
Other
The Lab #52: Scraping with LLMs and ScrapeGraphAi - part 1
Are LLMs the Holy Graal for web scraping?
May 30
•
Pierluigi Vinciguerra
1
Share this post
The Lab #52: Scraping with LLMs and ScrapeGraphAi - part 1
substack.thewebscraping.club
Copy link
Facebook
Email
Note
Other
The Lab #51: APIs with Bearer Token
Scraping data from API endpoints requiring Bearer Token
May 17
•
Pierluigi Vinciguerra
2
Share this post
The Lab #51: APIs with Bearer Token
substack.thewebscraping.club
Copy link
Facebook
Email
Note
Other
Celebrating the 50th article of The Lab series
A brief review of the first 50 episodes of The Lab series
May 9
•
Pierluigi Vinciguerra
3
Share this post
Celebrating the 50th article of The Lab series
substack.thewebscraping.club
Copy link
Facebook
Email
Note
Other
Share
Copy link
Facebook
Email
Note
Other
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts