Libraries tagged by php crawler
elboletaire/crawler
6712 Downloads
A simple crawler (spider) writen in php just for fun
sofyco/spider-bundle
694 Downloads
Symfony Spider Bundle
sofyco/spider
733 Downloads
Crawler + Scraper + Parser library
nucleos/lastfm
12078 Downloads
Last.fm webservice client for php.
neclimdul/coveo-push-api
1744 Downloads
The Push API allows you to *push* items and security identities, as opposed to letting standard Coveo Cloud V2 crawlers *pull* this data from a content repository. This is especially useful when you need to index content from a cloud or on-premises system for which no dedicated source type exists in the Coveo Cloud V2 platform.
itgalaxy/webcrawler-verifier
2960 Downloads
PHP library providing functionality to verify that user-agents are who they claim to be.
fkrzski/robots-txt
898 Downloads
A modern, fluent PHP package for managing robots.txt rules with type safety and great developer experience
crossjoin/browscap
234374 Downloads
The standalone PHP Browscap parser Crossjoin\Browscap detects browser properties as well as device information based on the user agent string of the requesting browsers and search engines, using the data from the Browser Capabilities Project. It's several hundred times faster than the build-in PHP function get_browser(), and faster than other Browscap PHP libraries, with much lower memory consumption. Optionally Crossjoin\Browscap automatically updates the Browscap data, so you're always up-to-date. The newest version is build for PHP 7.x, for PHP >= 5.6 use version 2.x, for PHP >= 5.3 use version 1.x.
peteryang/querylist
187 Downloads
Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on phpQuery! 简洁、优雅、可扩展的PHP采集工具(爬虫),基于phpQuery。
alapi/querylist
639 Downloads
Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on phpQuery! 简洁、优雅、可扩展的PHP采集工具(爬虫),基于phpQuery。
zhiyang/php-crawler
14 Downloads
Lightweight web crawler for php
pavolbiely/bazos-crawler
15 Downloads
PHP Crawler for downloading ads and categories from bazos.sk, bazos.cz or bazos.at.
codeblog/crawlerdetect
55 Downloads
A CodeBlog CrawlerDetect class is easy and quick to use. Detecting bots/crawlers/spiders via the user agent!
brightlocal/php-crawler
77140 Downloads
php crawler library
fsdstar/phpcrawler
57 Downloads
This is a Simple PHP reptilian