2017 © Pedro Peláez
 

library status-check

CLI tool to crawl a website and check HTTP status code

image

fwartner/status-check

CLI tool to crawl a website and check HTTP status code

  • Friday, April 6, 2018
  • by fwartner
  • Repository
  • 1 Watchers
  • 1 Stars
  • 1 Installations
  • PHP
  • 0 Dependents
  • 0 Suggesters
  • 0 Forks
  • 0 Open issues
  • 2 Versions
  • 0 % Grown

The README.md

Check the statuscode of all links on a website

This repository provides a tool to check the http statuscode of every link on a given website., (*1)

Installation

Via Composer, (*2)

``` bash composer global require fwartner/status-check, (*3)


## Usage This tool will scan all links on a given site. ```bash check-status scan https://example.com

It outputs a line per link found., (*4)

When the crawl is finished a summary will be shown., (*5)

By default it uses 10 concurrent connections to speed up the crawling process. You can change that number passing a different value to the concurrency-option., (*6)

check-status scan https://example.com --concurrency=20

You can also write all urls that gave a non-2xx or non-3xx response to a file:, (*7)

check-status scan https://example.com --output=log.txt

When the crawler finds a link to an external site it will by default crawl that link as well. If you don't want the crawler to crawl such external urls use the --dont-crawl-external-links option, (*8)

check-status scan https://example.com --dont-crawl-external-links

By default, requests timeout after 10 seconds. You can change this by passing the number of seconds to the timeout-option., (*9)

check-status scan https://example.com --timeout=30

Testing

To run the tests you'll have to start the included node based server first in a separate terminal window., (*10)

cd tests/server
./start_server.sh

With the server running, you can start testing., (*11)

vendor/bin/phpunit

Changelog

Please see CHANGELOG for more information what has changed recently., (*12)

Contributing

Please see CONTRIBUTING for details., (*13)

Security

If you discover any security related issues, please email florian@mapawa.de instead of using the issue tracker., (*14)

License

The MIT License (MIT). Please see License File for more information., (*15)

The Versions

06/04 2018

dev-master

9999999-dev https://github.com/fwartner/status-check

CLI tool to crawl a website and check HTTP status code

  Sources   Download

MIT

The Requires

 

The Development Requires

http check crawler status fwartner

06/04 2018

1.0.0

1.0.0.0 https://github.com/fwartner/status-check

CLI tool to crawl a website and check HTTP status code

  Sources   Download

MIT

The Requires

 

The Development Requires

http check crawler status fwartner