2017 © Pedro Peláez
 

library pop-spider

A simple web spider for SEO analysis.

image

nicksagona/pop-spider

A simple web spider for SEO analysis.

  • Monday, February 27, 2017
  • by nicksagona
  • Repository
  • 2 Watchers
  • 3 Stars
  • 19 Installations
  • PHP
  • 0 Dependents
  • 0 Suggesters
  • 2 Forks
  • 0 Open issues
  • 7 Versions
  • 0 % Grown

The README.md

pop-spider

pop-spider is a simple CLI-driven web spider for SEO analysis that uses components from the Pop PHP Framework. It parses SEO-pertinent data from a website and produces a HTML-based report of what was parsed as well as an sitemap.xml file., (*1)

RELEASE INFORMATION

pop-spider 4.0.0 Release
August 12, 2023, (*2)

INSTALLATION

$ composer create-project nicksagona/pop-spider pop-spider

QUICK USE

$ cd pop-spider/script
$ ./spider crawl http://www.mydomain.com/

OVERVIEW

By default, the spider parses the following elements and their SEO-pertinent attributes:, (*3)

  • title
  • meta
    • name
    • content
  • a
    • href
    • title
    • rel
    • name
    • value
  • img
    • src
    • title
    • alt
  • h1
  • h2
  • h3

You can parse additional tags via the --tags= option., (*4)

$ ./spider help                                                 Display this help screen.
$ ./spider crawl [--dir=] [--tags=] [--speed=] [--save] <url>   Crawl the URL.

The optional [--dir=] parameter allows you to set the output directory for the results report.
The optional [--tags=] parameter allows you to set additional tags to scan for in a comma-separated list.
The optional [--speed=] parameter will throttle the speed between each request in seconds.
The optional [--save] parameter will save the site files into a directory

Example:

$ ./spider crawl --dir=seo-report --tags=b,u --speed=5 --save http://www.mydomain.com/

The Versions

27/02 2017

dev-master

9999999-dev https://github.com/nicksagona/pop-spider

A simple web spider for SEO analysis.

  Sources   Download

New BSD

The Requires

 

The Development Requires

seo spider web spider

27/02 2017

dev-v3-dev

dev-v3-dev https://github.com/nicksagona/pop-spider

A simple web spider for SEO analysis.

  Sources   Download

New BSD

The Requires

 

The Development Requires

seo spider web spider

27/02 2017

3.0.0

3.0.0.0 https://github.com/nicksagona/pop-spider

A simple web spider for SEO analysis.

  Sources   Download

New BSD

The Requires

 

The Development Requires

seo spider web spider

09/03 2016

v2.x-dev

2.9999999.9999999.9999999-dev https://github.com/nicksagona/pop-spider

A simple web spider for SEO analysis.

  Sources   Download

New BSD

The Requires

 

The Development Requires

seo spider web spider

09/03 2016

2.0.1p1

2.0.1.0-patch1 https://github.com/nicksagona/pop-spider

A simple web spider for SEO analysis.

  Sources   Download

New BSD

The Requires

 

The Development Requires

seo spider web spider

09/03 2016

2.0.1

2.0.1.0 https://github.com/nicksagona/pop-spider

A simple web spider for SEO analysis.

  Sources   Download

New BSD

The Requires

 

The Development Requires

seo spider web spider

07/03 2016

2.0.0

2.0.0.0 https://github.com/nicksagona/pop-spider

A simple web spider for SEO analysis.

  Sources   Download

New BSD

The Requires

 

The Development Requires

seo spider web spider