Download the PHP package hedii/php-crawler without Composer
On this page you can find all versions of the php package hedii/php-crawler. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Download hedii/php-crawler
More information about hedii/php-crawler
Files in hedii/php-crawler
Package php-crawler
Short Description A crawler application written with php and Laravel that finds email addresses on the internets.
License MIT
Homepage https://github.com/hedii/php-crawler
FAQ
Example:
In general, it is recommended to use always a project to download your libraries. In an application normally there is more than one library needed.
- Some hosting areas are not accessible by a terminal or SSH. Then it is not possible to use Composer.
- To use Composer is sometimes complicated. Especially for beginners.
- Composer needs much resources. Sometimes they are not available on a simple webspace.
- If you are using private repositories you don't need to share your credentials. You can set up everything on our site and then you provide a simple download link to your team member.
- Simplify your Composer build process. Use our own command line tool to download the vendor folder as binary. This makes your build process faster and you don't need to expose your credentials for private repositories.
Informations about the package php-crawler
php-crawler
This repository has not been updated since a long time and I am not using it anymore. Please feel free to fork it and do whatever you want with it.
A crawler application with a php backend using Laravel, and a js frontend using vuejs, that finds email addresses on the internets.
Given an entry point url, the crawler will search for emails in all the urls available from this entry point domain name. The emails are downloadable as a text file.
Multiple users can start searching for emails without being able see the other users' searches (searches are related to a single user).
Screenshots
Server requirements
- PHP >= 7.2.0
- OpenSSL PHP Extension
- PDO PHP Extension
- Mbstring PHP Extension
- Tokenizer PHP Extension
- XML PHP Extension
Installation
- Create a mysql database (default name:
crawler) -
Install the project with composer:
-
Open the
.envfile, check the database credentials, and modify it if needed: -
In the
.envfile, set the application url: -
Build the crawler application
- Point your web server's document / web root to be the public directory:
/some/path/crawler/public. The index.php in this directory serves as the front controller for all HTTP requests entering your application. See Laravel documentation. I highly recommend using Laravel Valet if you are using a Mac. Otherwise, check Laravel Homestead. - Done
Usage
- Navigate to your php-crawler website
- Register a new account
- Create a new search
- Create more searches
- Download the found emails
Testing
Contributing
All contributions are welcome :)
Please write some tests if you are adding or modifying features.
License
php-crawler is open-sourced software licensed under the MIT license.
All versions of php-crawler with dependencies
doctrine/dbal Version ^2.6
fideloper/proxy Version ~4.0
guzzlehttp/guzzle Version ^6.3
hedii/extractors Version ^2.0
laravel/framework Version 5.7.*
laravel/passport Version ^7.0
laravel/tinker Version ~1.0