Category: Senza Categoria – Diverse Topics & Web Scraping Insights

  • Bypassing CAPTCHA with AI: Is the game over?

    Bypassing CAPTCHA with AI: Is the game over?

    Are CAPTCHAs still a threat of web scrapers or nowadays they can be solved with AI? Let’s see in this article how AI is helping to bypass CAPTCHAs

  • How to Successfully Bypass Kasada Bot Mitigation Techniques

    After seeing what is Kasada bot mitigation and how it works, let’s see how we can bypass it with both free and commercial solutions. Free solutions Playwright with Chrome In our Anti-Detect Anti-Bot matrix, I’ve tested Kasada with Chrome with no success with the following setup, which has proven its reliability in the time. Again,…

  • Kasada Bot Mitigation: An Overview and its Implications

    What is Kasada and how it works? Kasada is one of the newest players in the anti-bot solutions market and has some peculiar features that make it different. You cannot identify a Kasada-protected website from Wappalyzer (probably the userbase is not so wide) but the typical behavior when browsing them is the following. First of…

  • Web Scraping Tutorials: From Basics to Advanced Techniques

    Tutorials about web scraping, Scrapy, Playwright, Selenium, and other tools The Web Scraping Club THE LAB #13: Managing a fleet of scrapers with Scrapeops This article is sponsored by Serply, the solution to scrape search engine results easily. Web Scraping Club readers can save 25% on all SERP scraping plans by using the code TWSC25.The…

  • Web Scraping 101: The Essential Toolkit for Beginners

    In this article from The Web Scraping 101 Wiki, after seeing what is web scraping and its legal implications, we’ll see what it’s needed to start our first scraper. Tools for website analysis Before starting a web scraping project, the first action to take is to analyze the target website to understand what’s the best…

  • Dive into the Chronicles: Web Scraping Post Archive

    Here’s the archive for all the posts written up to now, divided by topics. Web Scraping tutorials and tools Latest article The Web Scraping Club THE LAB #13: Managing a fleet of scrapers with Scrapeops This article is sponsored by Serply, the solution to scrape search engine results easily. Web Scraping Club readers can save…

  • From the Vault: Timeless Interviews with Web Scraping Maestros

    All the interviews on key people in the web scraping industry. The Web Scraping Club Interview #5: Veritas – The anti obfuscation master This article is sponsored by Serply, the solution to scrape search engine results easily. Web Scraping Club readers can save 25% on all SERP scraping plans by using the code TWSC25… Read…

  • Web Scraping News: A Journey Through Time

    Archive of the monthly posts resuming the news in the web scraping industry. The Web Scraping Club Web Scraping news recap – February 2023 This post is sponsored by Smartproxy, the premium proxy and web scraping infrastructure focused on the best price, ease of use, and performance. In this case, for all The Web Scraping…

  • Anti-Bot Technologies and Bypass Strategies: A Deep Dive

    List of articles about anti-bot, with posts, techniques, tutorials and news. The Web Scraping Club THE LAB #14: Scraping Cloudflare Protected Websites (early 2023 version) This article is sponsored by MobileHop, your mobile IP proxy provider. MobileHop provides native mobile IPs on dedicated 4G/5G modems via Verizon and AT&T Wireless to bypass almost all website…

  • Introducing the Web Scraping 101 Wiki: Embark on a Learning Journey

    A collaborative way to share basic knowledge about web scraping This article is sponsored by Serply, the solution to scrape search engine results easily. Web Scraping Club readers can save 25% on all SERP scraping plans by using the code TWSC25. Web Scraping 101 Wiki project description The Web Scraping Club was created with the…