Download the PHP package ilmlv/proxy-scraper without Composer
On this page you can find all versions of the php package ilmlv/proxy-scraper. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Download ilmlv/proxy-scraper
More information about ilmlv/proxy-scraper
Files in ilmlv/proxy-scraper
Package proxy-scraper
Short Description Library for scraping free proxy lists and validating proxy capabilities
License MIT
Informations about the package proxy-scraper
Proxy Scraper and Validator
This library is designed to scrape free proxy resources and also individually validate those capabilities. Support for http/https/socks4/socks5 proxies.
WARNING! Keep in mind that free public proxies is HIGHLY not recommended for sensitive data transfer.
Please check out all examples.
Installation
Recomended installation method is via composer:
Proxy scraper sources
Currently implemented proxy sources:
- blogspotproxy.blogspot.com
- checkerproxy.net
- clarketm/proxy-list
- free-proxy-list.net
- free-proxy-list.net/anonymous-proxy.html
- free-proxy-list.net/uk-proxy.html
- gimmeproxy.com
- multiproxy.org
- proxyserverlist24.top
- pubproxy.com
- ShiftyTR/Proxy-List
- ShiftyTR/Proxy-List/https.txt
- ShiftyTR/Proxy-List/socks4.txt
- ShiftyTR/Proxy-List/socks5.txt
- socks-proxy.net
- sslproxies.org
- TheSpeedX/PROXY-List/http.txt
- TheSpeedX/PROXY-List/socks4.txt
- TheSpeedX/PROXY-List/socks5.txt
- us-proxy.org
Feel free to request more sources.
Proxy scrapers
Keep in mind that there is prepared multiple types of scraping libraries that can be used to simplify creation of your own source scrapers. Currently supported source data types:
Proxy validation
This library can also be used for proxy capability validation:
- anonymity level:
- elite (no origin IP exposure and no proxy relates headers),
- anonymous (has proxy related headers),
- exposed (has origin IP exposure)
- if proxy server IP matches server by whom request is performed
- HTTPS request support
- various request methods: GET, POST, PUT, OPTIONS, HEAD, DELETE, PATCH
- huge amount of request headers if they are not modified by proxy - tested in each request method
- multiple public domains (amazon.com, craigslist.org, example.com, google.com, ss.com)
- average latency calculation
Validation example
Result:
TODO:
- Add capability to add custom domain validations
- Reduce dependencies
- Test and improve support for wider range of PHP versions
- Improve documentation
- Tighten argument strict conditions
- Add more proxy sources
- Create functional tests
- Monitor test coverage
- Expand php compatibility
All versions of proxy-scraper with dependencies
ext-json Version *
ext-dom Version *
ext-simplexml Version *
dragonmantank/cron-expression Version ^3.3
symfony/http-client Version ^6.1
symfony/dom-crawler Version ^6.1
symfony/css-selector Version ^6.2