Download the PHP package giauphan/crawl-blog-data without Composer
On this page you can find all versions of the php package giauphan/crawl-blog-data. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Download giauphan/crawl-blog-data
More information about giauphan/crawl-blog-data
Files in giauphan/crawl-blog-data
Package crawl-blog-data
Short Description This powerful web scraping tool is designed to gather data from blogs and websites with ease, providing you with valuable insights and information.
License MIT
Informations about the package crawl-blog-data
README - Crawler Blog for Laravel
Overview
Welcome to the Crawler Blog for Laravel repository! This robust web scraping tool is crafted to effortlessly gather data from blogs and websites, delivering valuable insights and information. Whether you're a content creator, market researcher, or e-commerce entrepreneur, this Laravel-based crawler provides an ideal solution for your data extraction needs.
Features
- Web Scraping: Extract data from various blogs and websites, including blog posts, product descriptions, prices, and customer reviews.
Installation
Follow these steps to get the Crawler Blog for Laravel up and running:
- Clone the repository:
Laravel 10.x
You need to add provider and alias to your config/app.php file:
You need to add commands to your app/Console/Kernel.php file:
Laravel 11.x
You need to add commands to your bootstrap/app.php file:
You can publish and run the migrations with:
You can publish the config file with:
- Configuration:
- Update the
.env
file to configure the database settings. - Adjust the
CrawlBlogData.php
file to customize scraping behavior based on your requirements.
- Update the
You can generate a new settings class using this artisan command.
-
Executing the Crawler: Run the crawler via the command line using the following command:
This initiates the web scraping process, and the extracted data will be saved to the configured database tables.
Contributions
We welcome contributions from the community! If you encounter bugs, have feature requests, or want to enhance the crawler, please submit issues or pull requests on GitHub.
License
The Crawler Blog for Laravel is open-source software licensed under the MIT License. Feel free to use, modify, and distribute it following the license terms.
Contact
For inquiries or support, contact us at [email protected].
Thank you for using the Crawler Blog for Laravel! Happy scraping!
All versions of crawl-blog-data with dependencies
giauphan/goutte Version *
guzzlehttp/guzzle Version ^7.2
illuminate/console Version *
illuminate/database Version *
giauphan/goutte-facade Version *