Libraries tagged by zcrawler
nucleos/lastfm
11949 Downloads
Last.fm webservice client for php.
lobotomised/laravel-autocrawler
29584 Downloads
A tool to crawl your own laravel installation checking your HTTP status codes
fkrzski/robots-txt
468 Downloads
A modern, fluent PHP package for managing robots.txt rules with type safety and great developer experience
crawlzone/crawlzone
5169 Downloads
Crawlzone is a fast asynchronous internet crawling framework aiming to provide open source web search and testing solution. It can be used for a wide range of purposes, from extracting and indexing structured data to monitoring and automated testing.
bvp/boatrace-scraper
854 Downloads
The BVP Boatrace Scraper package for Boatrace.
blogdaren/phpcreeper
824 Downloads
A new generation of multi-process async event-driven spider engine based on Workerman
51degrees/fiftyone.devicedetection
10461 Downloads
Device detection engines for 51Degrees Pipeline API. Parse HTTP headers to detect hardware, operating system, browser, and crawler information.
scrawler/router
1671 Downloads
An Fully Automatic RESTful PHP Router.
scrawler/arca
330 Downloads
Arca ORM by Scrawler
zenstruck/dom
1122 Downloads
DOM crawler with advanced selector API and assertions.
octopoda/octopus
4176 Downloads
PHP Sitemap crawler
flancer32/mage2_ext_bot_sess
10389 Downloads
Magento2: prevent session creation for bots & crawlers.
crwlr/utils
9736 Downloads
Utilities that are needed in multiple crawler packages.
bugbuster/contao-botdetection-bundle
36662 Downloads
Contao bundle helper class to detect search engines, bots, spiders, crawlers ...
codeguy/arachnid
9729 Downloads
A crawler to find all unique internal pages on a given website