The Web Scraping Club
Subscribe
Sign in
Home
News
The Lab
Advertise on TWSC
Proxy pricing benchmark
Consulting
Archive
About
The Lab
Latest
Top
Discussions
THE LAB #100: Hybrid Scraping - One Browser Login, Thousands of HTTP Requests
Building a pipeline that uses Camoufox for authentication and curl_cffi for extraction on Akamai-protected targets.
Mar 19
•
Pierluigi Vinciguerra
3
1
THE LAB #99: HTTP Caching for Web Scraping
How Conditional Requests Can Cut Your Proxy Bill, using HTTP caching.
Mar 5
•
Pierluigi Vinciguerra
1
1
THE LAB #98: Scraping Google Search Results in 2026: Device, Location, and Identity
Google does not have one set of results. It has millions. The hard part is knowing which one you are looking at.
Feb 19
•
Pierluigi Vinciguerra
1
2
1
THE LAB #97: My first week with OpenClaw
160,000 Stars in Two Months: What OpenClaw Means for Scrapers
Feb 5
•
Pierluigi Vinciguerra
6
2
THE LAB #96: Scraping Nike.com with 5 open source tools
Match your tool to the protection, not the brand
Jan 29
•
Pierluigi Vinciguerra
6
THE LAB #95: Bypassing Cloudflare in 2026
Testing Open Source Browser Automation Tools Against Real Targets
Jan 22
•
Pierluigi Vinciguerra
3
THE LAB #94: Using cookies and session for cost-effective scraping
Trying to scrape from Leboncoin, Allegro and Idealista without emptying our pockets.
Oct 17, 2025
•
Pierluigi Vinciguerra
6
1
THE LAB #93: scraping Booking.com using internal APIs
How to get travel data without a browser
Sep 19, 2025
•
Pierluigi Vinciguerra
2
THE LAB #92: scraping Depop in a cost-effective way
Delegate or in house solution? A cost-wise perspective.
Aug 29, 2025
•
Pierluigi Vinciguerra
5
THE LAB #91: Performing sentiment analysis on Amazon product reviews - Part #2
A Practical Guide to Sentiment Analysis on Data Scraped From Amazon
Aug 14, 2025
•
Federico Trotta
3
1
THE LAB #90: Camoufox Server in AWS
How to create a cluster of Camoufox instances on AWS
Aug 1, 2025
•
Pierluigi Vinciguerra
3
4
THE LAB #89: Camoufox as a Docker image
Step by step guide to scale your Camoufox web scraping infrastructure
Jul 17, 2025
•
Pierluigi Vinciguerra
3
6
1
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts