Create a Web Scraper with Cypress

Brett Cassette
InstructorBrett Cassette

Share this video with your friends

Send Tweet
Published 3 years ago
Updated a year ago

Cypress can do more than end-to-end testing. It can fully drive remote applications, including ones you don't own, much more reliably than Selenium.

In this example, we'll use Cypress to build a web scraper to mine data from applications we don't own. This data could be used to power other applications, filtered for data relevant to your use cases, sent to your calendar, or any number of uses.

Since Cypress is easy to automate, it's easy to integrate with cron or a job framework to run a scraper in an automated fashion.

Łukasz Mazurek
Łukasz Mazurek
~ 3 years ago

Very interesting topic, I wish you would make a course out of it and show the whole setup (with some CLI tools or job framework)