extension webcrawler
Search engine crawlers
maxlen/webcrawler
Search engine crawlers
- Wednesday, March 29, 2017
- by maxlen
- Repository
- 0 Watchers
- 0 Stars
- 4 Installations
- PHP
- 0 Dependents
- 0 Suggesters
- 0 Forks
- 0 Open issues
- 1 Versions
- 0 % Grown
webcrawler
Search engines crawlers, (*1)
Google example:
$proxy = []; //['host' => '*.*.*.*', 'port' => '', 'login' => '', 'password' => '']
$params = ['query' => 'test search', 'page' => $page, 'proxy' => $proxy];
$crawler = new WebCrawler(['strategy' => new GoogleSearch()]);
print_r($crawler->crawl($params));
Site-parse example:
$params = ['url' => 'http://your-site.com', 'proxy' => []];
$crawler = new WebCrawler(['strategy' => new SiteSearch()]);
print_r($crawler->crawl($params));
dev-master
9999999-dev
Search engine crawlers
Sources
Download
BSD-4-Clause
The Requires
by
Maxim
extension
crawler
search engines