Libraries tagged by crawlers

Spider is a php library for crawling website that allows you to scrape informations & automated actions.

Go to Download

Scrapes the information from the targeted page and provides a DomCrawler

Go to Download

A web scraper for PHP to easily extract data from web pages

Go to Download

PHP library providing functionality to verify that user-agents are who they claim to be.

Go to Download

Google search results crawler, get google search results that you need.

Go to Download

Thumbsnag crawls an HTML document and finds imagery that best represents the given page.

Go to Download

Another GooglePlay Website Scraper based on goutte

Go to Download

This module blocks all kind of bots / crawlers / spiders.

Go to Download

9Pay Micro Invest NAV Crawler

Go to Download

parser/handler for Robots Exclusion Protocol (robots.txt and more)

Go to Download

A CodeBlog CrawlerDetect class is easy and quick to use. Detecting bots/crawlers/spiders via the user agent!

Go to Download

Marsvin it's a framework to write crawler applications

Go to Download

Water Melon is simple melon.com api sdk for php

Go to Download

A web crawler, built to be easily dropped into PHP applications, which behaves just like a regular web browser, interpreting location redirects and storing cookies automatically.

Go to Download

Serve static content of a one-page website to crawlers (e.g. Facebook, Google or Twitter) using PhantomJS

Go to Download