-
-
Notifications
You must be signed in to change notification settings - Fork 5.4k
Closed
Labels
Description
What would you like to see?
We should create a data connector that allows scraping websites with a configurable depth
- Should scrape all
<a>tags on the site and look for all links that match the original domain name then scrape X levels deep - Should all be done using the existing puppeteer instance that is already used for scraping links