..learn about web scraping in JavaScript

Gone are the days when you have to reach for Python, Ruby, or some other language to accomplish your webpage scraping needs. These days, there is a robust set of JavaScript tools running on Node that help you harvest data from your favorite web pages.

Watch User Created Playlist (5)

This playlist is user created.

pro-course-rss-logo

PRO RSS Feed

Intro to Web Scraping with Node and X-ray

Web Scraping Images with Node, Xray, and Download

P

Web Scraping with Pagination and Advanced Selectors

P

Scraping Dynamic JavaScript Websites with Nightmare

P

Scraping Data from Sites with Login Forms with Nightmare

P
node tutorial about Intro to Web Scraping with Node and X-ray

Intro to Web Scraping with Node and X-ray

2:03 node

Node and Xray have made web scraping a really simple affair. This video introduces you to the process of scraping all of the "a" tags off of a url and saving them to a .json file.

node tutorial about Web Scraping Images with Node, Xray, and Download

Web Scraping Images with Node, Xray, and Download

3:07 node PRO

Node makes scraping images off the web extremely easy using a couple handy packages: Xray and Download. Simple scrape the img tag, grab all the src attributes, filter out images you don't want, then hand them over to Download to grab them.

node tutorial about Web Scraping with Pagination and Advanced Selectors

Web Scraping with Pagination and Advanced Selectors

3:29 node PRO

When web scraping, you'll often want to get more than just one page of data. Xray supports pagination by finding the "next" or "more" button on each page and cycling through each new page until it can no longer find that link. This lesson demonstrates how to paginate as well as more advanced selectors for when links are difficult to scrape.

node tutorial about Scraping Dynamic JavaScript Websites with Nightmare

Scraping Dynamic JavaScript Websites with Nightmare

2:43 node PRO

Many websites have more than just simple static content. Dynamic content which is rendered by JavaScript requires browser to be able to scrape data. This video demonstrates how to use Nightmare (which is a wrapper around Electron) to launch a url and scrape dynamic data.

node tutorial about Scraping Data from Sites with Login Forms with Nightmare

Scraping Data from Sites with Login Forms with Nightmare

3:00 node PRO

Many pages you'll want to grab data from will require you to log in first. This video demonstrates how to log in and grab whatever data off the page you will need.

HEY, QUICK QUESTION!
Joel's Head
Why are we asking?