npm install krowlr
krowlr = require('krowlr');
crawler = new krowlr.Crawler()
crawler.add_url('http://mywesite/mypage')
crawler.accepted_domains.push('www.myotherdomain')
crawler.start()
This repository has been archived by the owner on Sep 26, 2023. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 0
A fast node crawler
ravelsoft/node-krowlr
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|