What we've learnt from the Nimble AI Month
Lessons learned, and a big thank you
June has gone and so has our AI Month in partnership with Nimble. We had a great end of the month with our contest, which has seen many of you submitting your solution. In the next few days, Nimble will contact the winners and I’ll send a month of premium content to all the participants. If by the next Friday, you still didn’t receive yours, feel free to write me at pier@thewebscraping.club to sort it out.
First, I want to thank the Nimble team for all the efforts they put into this collaboration, it’s the first time our community approached a challenge with also great prizes, so thank you for the trust and the organization.
Than also thank all of you, since you massively responded to the challenge, and I hope I’ve been able to explain the intersection between AI and web scraping during the last month.
What I’ve personally learned is:
AI is coming: both on the side of the anti-bot challenges and on HTML parsing, there are solutions like the Nimble Browser that are already using it and are available to everyone
It’s only the beginning: while at the moment the solutions work perfectly with the most common websites, in the next few years having a general model for HTML parsing for all the web should not be impossible
Web scraping is not going anywhere: AI models require more and more data to be trained, so web scraping is needed more than ever. But it’s important for operators to learn to use new tools to improve their tech skills and productivity.
But today is starting a new month and we’ll deep dive into the proxy world with another partner you’ll discover tomorrow.
In the next weeks, we’ll have an interview with a tech person that will explain what’s under the hood of a proxy vendor, we’ll see together how to use them for scraping a very famous website protected by Akamai, and how to discover trends on TikTok using mobile proxies.
If you think someone you know could be interested in these topics, invite him to The Web Scraping Club
The more people you bring in, the greater benefit you’ll receive.
And if you want to be sure to don’t miss any further articles, subscribe for free to the newsletter.