-
Latest Web Scraping Tools on GitHub: ASN Lookup, curl_cffi, and fake-useragent
Discover some useful tools for web scraping: ASN Lookup Tool checks IP reputation, geolocation, and more. curl_cffi provides a more legit fingerprint for scraping. fake-useragent generates random User Agents for scraping.
-
Hands On #6: Testing the Infatica web scraper
In this new series from The Web Scraping Club, the Infatica’s Web Scraper is put to the test. Find out how it performs in bypassing anti-bot solutions and its key features in this review.
-
5 Useful Features of Microsoft Playwright for Web Scraping and Automation
Discover the 5 useful features of Microsoft Playwright for web scraping and automation, including network intercept, video recording, iFrame handling, and geolocation modification.
-
THE LAB #28: Deep dive on inventory levels tracking
Discover valuable insights from Lowe’s website inventory levels using a scraper. Learn how to extract data and monitor this popular home improvement retailer.
-
Ensuring data quality in web scraping projects
Discover techniques to improve data quality in web scraping operations. Learn how to monitor the scraping process, ensure data ingestion accuracy, and implement automatic data quality controls. Maintain data completeness and coherence to enhance the accuracy of your web scraped data.
-
THE LAB #27: Inventory levels, the holy grail of web scraped data
Learn about the potential value of web scraping in the fashion industry, from analyzing inventory levels to estimating sales. Discover how industry expertise can help interpret the data and gain insights before official financial data becomes available.
-
Bypassing CAPTCHA with AI: Is the game over?
Are CAPTCHAs still a threat of web scrapers or nowadays they can be solved with AI? Let’s see in this article how AI is helping to bypass CAPTCHAs
-
Browser API: an introduction
Discover how to build a web scraper that goes undetected by anti-bots. Learn about browser APIs, hardware and location data, and more.
-
Web Scraping news recap – August 2023
Discover the past, present, and future of The Web Scraping Club! Gain practical insights and join a thriving community of professionals.
-
THE LAB #26: From internal API to insights.
When starting a scraping project, understanding how a website works is crucial. This post explains how to find and use internal APIs for scraping data.
