2017 © Pedro Peláez
 

library crawler

image

bootjp/crawler

  • Friday, November 10, 2017
  • by bootjp
  • Repository
  • 1 Watchers
  • 0 Stars
  • 5 Installations
  • PHP
  • 0 Dependents
  • 0 Suggesters
  • 0 Forks
  • 1 Open issues
  • 8 Versions
  • 0 % Grown

The README.md

OreTokuCrawler

Build Status Scrutinizer Code Quality, (*1)

Now Beta2 Version relese.

  • https://github.com/bootjp/crawler/releases

Makeing now...

How To Use

Introduction

$ curl -s http://getcomposer.org/installer | php
$ php composer.phar install
or
$ composer install

Use Ex.

$ php wrapper.php --url=https://bootjp.me
or
$  php wrapper.php --url=https://bootjp.me --recursion=false

-> https://bootjp.me/ is root on the contents link check, (*2)

$ php wrapper.php --url=https://bootjp.me --recursion=true

-> https://bootjp.me/ is on the contents link all check, (*3)

Use docker images

dockerImage is hire -> https://hub.docker.com/r/bootjp/crawler, (*4)

docker pull bootjp/crawler
docker run bootjp/crawler php wrapper.php --url=https://bootjp.me --recursion=false --auth=username:password

Basic Auth

$ php wrapper.php --url=https://bootjp.me --recursion=false --auth=username:password

LICENSE, (*5)

日本語での解説記事(ちょっと古い), (*6)

The Versions

10/11 2017

dev-develop

dev-develop

  Sources   Download

The Requires

 

05/06 2016

dev-master

9999999-dev

Web pages 404 and soft 404 checker

  Sources   Download

MIT

The Requires

 

by Avatar bootjp

05/06 2016

0.0.7

0.0.7.0

Web pages 404 and soft 404 checker

  Sources   Download

MIT

The Requires

 

by Avatar bootjp

05/06 2016

dev-update

dev-update

Web pages 404 and soft 404 checker

  Sources   Download

MIT

The Requires

 

by Avatar bootjp

19/04 2015

0.0.6

0.0.6.0

  Sources   Download

The Requires

 

24/03 2015

0.0.5

0.0.5.0

  Sources   Download

The Requires

 

16/03 2015

0.0.4

0.0.4.0

  Sources   Download

The Requires

 

14/03 2015

0.0.3

0.0.3.0

  Sources   Download

The Requires