crwlr.software is a collection of open source PHP composer packages that provide the necessary tools for web crawling and scraping tasks. The crawler package contains everything and helps you build crawlers as fast as possible. And there are also parts of it that you can use standalone.
crwlr.software
PHP Packages for Rapid Crawler and Scraper Development
Popular repositories Loading
-
query-string
query-string PublicA library for convenient handling of query strings used in HTTP requests.
-
-
robots-txt
robots-txt PublicRobots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
-
Repositories
Showing 10 of 14 repositories
- crawler-ext-browser Public
Extension for the crwlr/crawler package containing steps utilizing a headless browser.
crwlrsoft/crawler-ext-browser’s past year of commit activity
Top languages
Loading…
Most used topics
Loading…