The Web Scraping Club
Subscribe
Sign in
Home
News
The Lab
Advertise on TWSC
Proxy pricing benchmark
Consulting
Archive
About
Latest
Top
Discussions
Public Sector Meets Web Scraping: From Scraped Data to Public Value
Using web scraping to fuel data pipelines that provide value to citizens and policymakers
Jun 28
•
Antonello Zanini
1
THE LAB #108: How LLMs and Manus AI are transforming bot detection
AI is making faster and cheaper to deobfuscate code. This changes how antibot solutions should be built.
Jun 26
•
Pierluigi Vinciguerra
2
Crawl of Fame - June 2026
What's an ISP proxy, how they get sourced, and how to spawn browsers for cheap
Jun 23
•
Pierluigi Vinciguerra
1
How to Build Competitive Intelligence Scrapers That Don't Lie to You
Learn how to build scraping pipelines that are still giving you accurate data 12 months from now
Jun 21
•
Federico Trotta
2
Kameleo Docker: Exploring the Docker-Based Anti-Detect Browser
Kameleo is finally available on Linux. How? Via Docker!
Jun 14
•
Antonello Zanini
3
2
THE LAB #107: Reversing Shopee's native crypto with Ghidra
Shopee hides its crypto in a native library. We read it in Ghidra and rebuild it in Python, byte for byte.
Jun 11
•
Pierluigi Vinciguerra
5
1
How to Give Claude Real-Time Web Access With the Decodo MCP
Learn how to connect Claude to the web with zero integration code
Jun 7
•
Federico Trotta
THE LAB #106: Is Camoufox still effective, and do the forks help?
The project moved to CloverLabs and the fork tree keeps growing. We read the code and ran four builds against DataDome to see what still works.
Jun 4
•
Pierluigi Vinciguerra
2
1
5 mistakes that are driving up your scraping costs - Insights from DataImpulse
An in-depth look at the real factors driving up web scraping costs and how smarter proxy usage and system design can reduce expenses by up to 60%.
Jun 2
•
Olia Liudko
May 2026
Why and How to Build a Web Scraper with Rust in 2026
Is Rust the future of web scraping? Let’s find out!
May 31
•
Antonello Zanini
2
THE LAB #105: If LLMs Can Bypass CAPTCHAs, Are CAPTCHA Solver Services Cooked?
Bypassing hCaptcha in the AI era
May 29
•
Pierluigi Vinciguerra
1
How to Scrape Open-Source Datasets Ethically
How to collect open data responsibly, without breaking rules or burning bridges
May 24
•
Federico Trotta
1
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts