The ability to reply to discussions is limited to PRO members. Want to join in the discussion? Click here to subscribe now.

Intro to Web Scraping with Node and X-ray

Intro to Web Scraping with Node and X-ray

2:03
Node and Xray have made web scraping a really simple affair. This video introduces you to the process of scraping all of the "a" tags off of a url and saving them to a .json file.
Watch this lesson now
Avatar
egghead.io

Node and Xray have made web scraping a really simple affair. This video introduces you to the process of scraping all of the "a" tags off of a url and saving them to a .json file.

Avatar
Maui

What IDE are you using?

In reply to egghead.io
Avatar
Kenneth

Are you using Browserify? I'm getting a weird error about a node module missing somewhere way down in the x-ray package.

In reply to egghead.io
Avatar
John

That's WebStorm.

In reply to Maui
Avatar
John

Nope, nothing special. Just npm install x-ray and the code from the lesson. I just tested again from scratch and it still works as expected. Maybe you typed xray and forgot the dash of x-ray?

In reply to Kenneth
Avatar
S├ębastien

Happy member here, but I'm wondering if I'm missing something in the Egghead UI. Where do I go next? The panel to the right gives me a list of different lessons, but I was never able to figure out how that list is gathered. I see a few other lessons in that list that seem related to web scraping, but I'm left wondering if they are all listed there, or if I'm missing some, and which one comes next, or previously. Could the lessons be tagged to help? (here, with "web scraping", so I can find all the others in that series). Or numbered? Thanks.

UPDATE: by using Search, I found that there is a user-created playlist which seems to include most of the web scraping lessons. That could be a nice addition too: for a given lesson, show which playlists are including that lesson (maybe the larger ones, or most "popular" ones, etc).

HEY, QUICK QUESTION!
Joel's Head
Why are we asking?