Skip to content

stixaw/WebCrawler-JS

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Creepy Crawler Hackathon Project

Language:

  • Javascript
  • Nodejs 12.19.0

Packages:

  • Cheerio
  • get-href

To Run:

example command line:

node index.js 'https://chghealthcare.com' 5

variables:

Root URL to crawl example: https://chghealthcare.com max Layers to crawl: example 1-10

  1. make sure you have nodejs installed
  2. download repository
  3. run npm ci
  4. run the crawler using the correct commandline

About

Webcrawler project

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published