"Are you new to the industry? Let us know how you are managing your career growth"
I am new to this topic. I do work full time in another industry but will go part time in a couple of years. Web scraping is a topic I am interested in and also got hopefully the potential to make some money on the side (eg to pay for a vacation). To prepare for that I started learning Python, got some ideas about next steps but also see that there are quite a lot of different topics to look at ;)
Hi Federico thanks for the enlightenment of this topic I'm a data analyst cum (scientist) but I do often work on web scrapping but there is a topic which makes me hurdle a lot that is I need to know how to scale the scraping projects like especially updating the large scraped data.
Like instead of scraping everytime, all i just need to check what is updated in those urls or not from the platform where I scraped
There is strategy I found hashlib, difflib but if you write one topic on this.
Great summary, it's exciting to see the anti-detect browser topic gaining more visibility.
I'm one of the founders of Kameleo, which has been one of the pioneers in this space, and our product has been 100% focused on web-scraping automation use cases. Because of that, stability, robustness, and extremely fast performance are absolutely critical for us, they're not just nice-to-have features, but core requirements in our development.
If anyone has questions about anti-detect technology or wants deeper insights from a highly technical/operator perspective, feel free to reach out, happy to help or share more.
"Are you new to the industry? Let us know how you are managing your career growth"
I am new to this topic. I do work full time in another industry but will go part time in a couple of years. Web scraping is a topic I am interested in and also got hopefully the potential to make some money on the side (eg to pay for a vacation). To prepare for that I started learning Python, got some ideas about next steps but also see that there are quite a lot of different topics to look at ;)
Don't get overwhelmed by the amount of topics. Start small! The main idea is to start by solving an actual scraping challenge, then grow from that.
Hi Federico thanks for the enlightenment of this topic I'm a data analyst cum (scientist) but I do often work on web scrapping but there is a topic which makes me hurdle a lot that is I need to know how to scale the scraping projects like especially updating the large scraped data.
Like instead of scraping everytime, all i just need to check what is updated in those urls or not from the platform where I scraped
There is strategy I found hashlib, difflib but if you write one topic on this.
I'll be very gratified ❤️🙌
Great summary, it's exciting to see the anti-detect browser topic gaining more visibility.
I'm one of the founders of Kameleo, which has been one of the pioneers in this space, and our product has been 100% focused on web-scraping automation use cases. Because of that, stability, robustness, and extremely fast performance are absolutely critical for us, they're not just nice-to-have features, but core requirements in our development.
If anyone has questions about anti-detect technology or wants deeper insights from a highly technical/operator perspective, feel free to reach out, happy to help or share more.