The Lab #22: Mastering the Art of Scraping Akamai-Protected Sites



Zalando: a bit of context

If you’re living in Europe, probably Zalando is a name you’ve already heard, even if you’re not a fashionista.

In fact, it is one of the most well-known European Fashion e-commerces, born in Germany but now it serves all the major countries of the old continent, also listed on Frankfurt Stock Exchange.

https%3A%2F%2Fsubstack post media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd03b06db ce97 4b1a 9254
Zalando stock price

Due to its importance in the industry and its dimension as a player, it’s one of the most interesting websites to be studied by different actors.

Firstly, if you want to understand where the fast fashion, sportswear, and apparel industries are going, it could be a good litmus paper, with its 1.3 Million items available on the website, coming from 6300+ brands.

It’s also a traded company and the changes in its offering and discount levels could be a good signal about how operations are running, without the need to wait for any official update.

This post is sponsored by Smartproxy, the premium proxy and web scraping infrastructure focused on the best price, ease of use, and performance.

Smartproxy
Smartproxy

In this case, for all The Web Scraping Club Readers, using the discount code WEBSCRAPINGCLUB10 you can save 10% OFF for every purchase.

For all these reasons, Zalando is a hot topic in any market research project in the apparel industry, and this means a lot of people are trying to scrape it. But this is not so easy, both for the dimension of the website and due to the fact that it is protected by Akamai anti-bot software.

In case you’re interested in getting the data without worrying about the scraping process, with no commitment and at any frequency, you can find it directly on the Databoutique.com website, otherwise, we’re seeing now how we can bypass the Akamai bot protection.

The full article is available only to paying users of the newsletter.
You can read this and other The Lab paid articles after subscribing


Liked the article? Subscribe for free to The Web Scraping Club to receive twice a week a new one in your inbox.



Liked the article? Subscribe for free to The Web Scraping Club to receive twice a week a new one in your inbox.