Libraries tagged by CrawlLib
renoki-co/clusteer
1191 Downloads
Clusteer is a Puppeteer wrapper written for PHP, with the super-power of parallelizing pages across multiple browser instances.
fourlabs/robots-bundle
23167 Downloads
Symfony2 bundle to control X-Robots-Tag HTTP header via annotations
dexiio/dexi-api-client
10110 Downloads
Dexi API Client for PHP 5.3+
crwlr/crawler-ext-browser
970 Downloads
Extension for the crwlr/crawler package containing steps utilizing a headless browser.
stil/curl-robot
22785 Downloads
Parallel URL crawling extension to curl-easy.
malickyeu/curl-easy
435 Downloads
cURL wrapper for PHP. Supports parallel and non-blocking requests. For high speed crawling, see stil/curl-robot.
dezento/crawlify
23 Downloads
Fast Concurrent Crawler
laurentvw/scrapher
2527 Downloads
A web scraper for PHP to easily extract data from web pages
essfeed/event-feed
35 Downloads
Create XML ESS Feeds and broadcast events information to Search Engines to improve SEO
68publishers/crawler-client-php
448 Downloads
laurentvw/lavacrawler
95 Downloads
A web scraper for PHP to easily extract data from web pages
slote/spider
7 Downloads
Spider is a php library for crawling website that allows you to scrape informations & automated actions.
reactphp-x/limiter
67 Downloads
A generic rate limiter for the web and reactphp. Useful for API clients, web crawling, or other tasks that need to be throttled
mediashare/spider
118 Downloads
Spider is a php library for crawling website that allows you to scrape informations & automated actions.
lapuad/taobao-tmall_spider
174 Downloads
淘宝、天猫商品详情数据抓取PHP版本，目前支持PC端淘宝网和天猫网站商品详情页数据抓取，后续会考虑添加天猫超市、天猫国际以及Python版本的支持。It's a php spider for crawling goods data from taobao.com and tmall.com. A python3 version spider will also be available later.