Mole

, _(*1)

Mole (name is still being decided) is a powerful web scaping tool. Basically, you specify a URL and what you are scraping (outbound links or emails so far), and Mole will continuously crawl until a limit is reached., _(*2)

Highlights

Crawl websites and gather any sort of information you want using regex
All requests can be sent through a random proxy from your list of proxies
Powered by the powerful RollingCurl, a FAST curl wrapper that supports asynchronous threads
Framework-agnostic, will work with any project
Composer ready and PSR-2 compliant

Documentation

Documentation will be finished when v1.0.0 is up., _(*3)

Installation

Mole is available via Composer:, _(*4)

$ composer require braseidon/scraper

Testing

Mole has a PHPUnit test suite. To run the tests, run the following command from the project folder:, _(*5)

$ phpunit

Contributing

Contributions are more than welcome and will be fully credited., _(*6)

Security

If you discover any security related issues, please email brandon@poseidonwebstudios.com instead of using the issue tracker., _(*7)

Credits

License

The MIT License (MIT). Please see LICENSE for more information., _(*8)

04/04 2015

dev-master

9999999-dev https://github.com/braseidon/scraper

Scraper is a fast and efficient web scraper that targets various forms of data.

Sources Download

MIT

The Requires

The Development Requires

by Brandon Johnson

curl asynchronous proxy requests parallel multi anonymous scraper rollingcurl

library mole