Libraries tagged by crawlers
slote/spider
4 Downloads
Spider is a php library for crawling website that allows you to scrape informations & automated actions.
sleimanx2/grawler
295 Downloads
A guided html crawler with media meta extraction
seotracker/seocore
70 Downloads
seo-core library for php
phramz/composer-repository-model
150 Downloads
composer repository (aka `packages.json`) model builder component
phantazm/robotdetector
1872 Downloads
Detect robots and crawlers.
pagemunch/pagemunch
31 Downloads
A PHP wrapper for the PageMunch link unfurling API
mihaeu/tarantula
49 Downloads
Another PHP crawler based on Guzzle.
mediashare/spider
114 Downloads
Spider is a php library for crawling website that allows you to scrape informations & automated actions.
mediashare/scraper
266 Downloads
Scrapes the information from the targeted page and provides a DomCrawler
laurentvw/scrapher
2522 Downloads
A web scraper for PHP to easily extract data from web pages
howie6879/php-google
552 Downloads
Google search results crawler, get google search results that you need.
gstjohn/thumbsnag
25 Downloads
Thumbsnag crawls an HTML document and finds imagery that best represents the given page.
ghalambaz/googleplay-spider
231 Downloads
Another GooglePlay Website Scraper based on goutte
diggin/diggin-robotrules
184 Downloads
parser/handler for Robots Exclusion Protocol (robots.txt and more)
codeblog/crawlerdetect
54 Downloads
A CodeBlog CrawlerDetect class is easy and quick to use. Detecting bots/crawlers/spiders via the user agent!