Download the PHP package ffish/querylist without Composer
On this page you can find all versions of the php package ffish/querylist. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Download ffish/querylist
More information about ffish/querylist
Files in ffish/querylist
Package querylist
Short Description Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on phpQuery! 简洁、优雅、可扩展的PHP采集工具(爬虫)，基于phpQuery。
License MIT
Homepage http://querylist.cc
FAQ
Example:
In general, it is recommended to use always a project to download your libraries. In an application normally there is more than one library needed.
- Some hosting areas are not accessible by a terminal or SSH. Then it is not possible to use Composer.
- To use Composer is sometimes complicated. Especially for beginners.
- Composer needs much resources. Sometimes they are not available on a simple webspace.
- If you are using private repositories you don't need to share your credentials. You can set up everything on our site and then you provide a simple download link to your team member.
- Simplify your Composer build process. Use our own command line tool to download the vendor folder as binary. This makes your build process faster and you don't need to expose your credentials for private repositories.
Informations about the package querylist
QueryList
QueryList is a simple, elegant, extensible PHP Web Scraper (crawler/spider) ,based on phpQuery.
中文文档
Features
- Have the same CSS3 DOM selector as jQuery
- Have the same DOM manipulation API as jQuery
- Have a generic list crawling program
- Have a strong HTTP request suite, easy to achieve such as: simulated landing, forged browser, HTTP proxy and other complex network requests
- Have a messy code solution
- Have powerful content filtering, you can use the jQuey selector to filter content
- Has a high degree of modular design, scalability and strong
- Have an expressive API
- Has a wealth of plug-ins
Through plug-ins you can easily implement things like:
- Multithreaded crawl
- Crawl JavaScript dynamic rendering page (PhantomJS/headless WebKit)
- Image downloads to local
- Simulate browser behavior such as submitting Form forms
- Web crawler
- .....
Requirements
- PHP >= 7.0
Installation
By Composer installation:
Usage
DOM Traversal and Manipulation
-
Crawl「GitHub」all picture links
-
Crawl Google search results
- More usage
List crawl
Crawl the title and link of the Google search results list:
Results:
Encode convert
HTTP Client (GuzzleHttp)
-
Carry cookie login GitHub
-
Use the Http proxy
- Analog login
Submit forms
Login GitHub
Bind function extension
Customize the extension of a myHttp method:
Or package to class, and then bind:
Plugin used
-
Use the PhantomJS plugin to crawl JavaScript dynamically rendered pages:
- Using the CURL multithreading plug-in, multi-threaded crawling GitHub trending :
Plugins
- jae-jae/QueryList-PhantomJS:Use PhantomJS to crawl Javascript dynamically rendered page.
- jae-jae/QueryList-CurlMulti : Curl multi threading.
- jae-jae/QueryList-AbsoluteUrl : Converting relative urls to absolute.
- jae-jae/QueryList-Rule-Google : Google searcher.
- jae-jae/QueryList-Rule-Baidu : Baidu searcher.
View more QueryList plugins and QueryList-based products: QueryList Community
Contributing
Welcome to contribute code for the QueryList。About Contributing Plugins can be viewed:QueryList Plugin Contributing Guide
Author
Jaeger [email protected]
If this library is useful for you, say thanks buying me a beer :beer:!
Lisence
QueryList is licensed under the license of MIT. See the LICENSE for more details.
All versions of querylist with dependencies
jaeger/phpquery-single Version ^0.9
tightenco/collect Version ^5
jaeger/g-http Version ^1.1