The Web Scraping Club | Pierluigi Vinciguerra | Substack

THE LAB #20 - AI powered web scrapers with Nimble Browser

How artificial intelligence makes web scraping easier

16 min ago •

Pierluigi Vinciguerra

Interview #9 - Uriel Knorovich

Artificial intelligence and web scraping, is this the present and the future of the industry?

Jun 4 •

Pierluigi Vinciguerra

Web Scraping news recap - May 2023

The most interesting articles on Substack about data and web data

May 28 •

Pierluigi Vinciguerra

THE LAB #19: How to mask your device fingerprint

Beating the fingerprinting by Cloudflare is possible

May 25 •

Pierluigi Vinciguerra

A deep dive into device fingerprint

What is device fingerprinting, how it is used and why it's important for web scraping.

May 21 •

Pierluigi Vinciguerra

Most Popular

THE LAB #1: Scraping data from an app

Sep 4, 2022 • Pierluigi Vinciguerra

THE LAB #3: Scraping Cloudflare protected websites

Sep 27, 2022 • Pierluigi Vinciguerra

THE LAB #2: scraping data from a website with Datadome and xsrf tokens

Sep 15, 2022 • Pierluigi Vinciguerra

Writing a web scraper with ChatGPT. Is it a good idea?

Apr 16 • Pierluigi Vinciguerra

New

Top

Community

Webinar + next post spoiler

A bit of self promotion and celebration

May 18 •

Pierluigi Vinciguerra

I wrote my first scraper with ChatGPT

Using Scrapeghost and ChatGPT, I could create my first scraper using the artificial intelligence

May 14 •

Pierluigi Vinciguerra

THE LAB #18: How to scrape Reddit with Scrapy

Scraping subreddits without any commercial product, in two easy different ways.

May 11 •

Pierluigi Vinciguerra

Interview #8 - Fabiano Sileo

About data, business intelligence and web scraping

May 7 •

Pierluigi Vinciguerra

Web Scraping news recap - April 2023

AI everywhere, new milestone reached and web scraping Facebook

Apr 30 •

Pierluigi Vinciguerra

THE LAB #17: Creating a dataset for investors - Tesla (TSLA)

The creation process for a dataset for stock market analysts: Tesla

Apr 27 •

Pierluigi Vinciguerra

Web scraping and alternative data for financial markets

What are alternative data and how to use web scraping to build datasets for financial markets?

Apr 23 •

Pierluigi Vinciguerra

Writing a web scraper with ChatGPT. Is it a good idea?

Is really AI helping us, improving our productivity when writing a web scraper?

Apr 16 •

Pierluigi Vinciguerra

THE LAB #16: How to scrape Datadome protected websites (early 2023 version)

Tools and techniques to scrape Datadome protected websites

Apr 14 •

Pierluigi Vinciguerra

The Web Scraping Club

The Web Scraping Club

News, solutions and interviews about web scraping. In this substack you will find weekly content about: - Web Scraping techniques - Interviews with key people in the industry - Anti bot infos and counter measures - Real world examples and code

Recommendations

Doodling Data Martina Pugliese

Magis Alex Izydorczyk

The Data Score Jason DeRise

Data Boutique's Substack

Data Boutique's Substack Andrea Squatrito

The Lab

The Lab: articles for premium readers Our premium articles with code: scraping Cloudflare, Datadome, Mobile Apps and many other

The Web Scraping Club

About Archive Recommendations Sitemap

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts