2017 © Pedro Peláez
 

library php-goose

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

image

enterpriseconsultingdeveloper/php-goose

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

  • Monday, December 4, 2017
  • by italopalanza
  • Repository
  • 3 Watchers
  • 0 Stars
  • 59 Installations
  • PHP
  • 0 Dependents
  • 0 Suggesters
  • 77 Forks
  • 0 Open issues
  • 15 Versions
  • 0 % Grown

The README.md

PHP Goose - Article Extractor

Scrutinizer Code Quality Build Status, (*1)

Intro

PHP Goose is a port of Goose originally developed in Java and converted to Scala by GravityLabs. Portions have also been ported from the Python port python-goose. It's mission is to take any news article or article type web page and not only extract what is the main body of the article but also all meta data and most probable image candidate., (*2)

The extraction goal is to try and get the purest extraction from the beginning of the article for servicing flipboard/pulse type applications that need to show the first snippet of a web article along with an image., (*3)

Goose will try to extract the following information:, (*4)

  • Main text of an article
  • Main image of article
  • Any Youtube/Vimeo movies embedded in article
  • Meta Description
  • Meta tags
  • Publish Date

The php version was rewritten by:, (*5)

  • Andrew Scott

Requirement

  • PHP 5.5 or later
  • PSR-4 compatible autoloader

Install

This library is designed to be installed via Composer., (*6)

Add the dependency into your projects composer.json., (*7)

{
  "require": {
    "scotteh/php-goose": "dev-master"
  }
}

Download the composer.phar ``` bash curl -sS https://getcomposer.org/installer | php, (*8)


Install the library.
``` bash
php composer.phar install

Autoloading

This library requires an autoloader, if you aren't already using one you can include Composers autoloader., (*9)

``` php require('vendor/autoload.php');, (*10)


##Usage

``` php
use Goose\Client as GooseClient;

$goose = new GooseClient();
$article = $goose->extractContent('http://url.to/article');

$title = $article->getTitle();
$metaDescription = $article->getMetaDescription();
$metaKeywords = $article->getMetaKeywords();
$canonicalLink = $article->getCanonicalLink();
$domain = $article->getDomain();
$tags = $article->getTags();
$links = $article->getLinks();
$videos = $article->getVideos();
$articleText = $article->getCleanedArticleText();
$entities = $article->getPopularWords();
$image = $article->getTopImage();
$allImages = $article->getAllImages();

Configuration

All config options are not required and are optional. Default (fallback) values have been used below., (*11)

php $goose = new GooseClient([ // Language - Selects common word dictionary // Supported languages: // ar, da, de, en, es, fi, fr, hu, id, it, ko, // nb, nl, no, pl, pt, ru, sv, zh 'language' => 'en', // Minimum image size (bytes) 'image_min_bytes' => 4500, // Maximum image size (bytes) 'image_max_bytes' => 5242880, // Minimum image size (pixels) 'image_min_width' => 120, // Maximum image size (pixels) 'image_min_height' => 120, // Fetch best image 'image_fetch_best' => true, // Fetch all images 'image_fetch_all' => false, // Guzzle configuration - All values are passed directly to Guzzle // See: http://guzzle.readthedocs.org/en/latest/clients.html#request-options 'browser' => [ 'timeout' => 60, 'connect_timeout' => 30 ] ]);, (*12)

Licensing

PHP Goose is licensed by Gravity.com under the Apache 2.0 license, see the LICENSE file for more details, (*13)

The Versions

04/12 2017

dev-master

9999999-dev https://github.com/EnterpriseConsultingDeveloper/php-goose

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

  Sources   Download

Apache-2.0

The Requires

 

The Development Requires

by Andrew Scott

http text content extractor scraping website readability scraper

04/12 2017

0.5.9

0.5.9.0 https://github.com/EnterpriseConsultingDeveloper/php-goose

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

  Sources   Download

Apache-2.0

The Requires

 

The Development Requires

by Andrew Scott

http text content extractor scraping website readability scraper

04/12 2017

0.5.8

0.5.8.0 https://github.com/EnterpriseConsultingDeveloper/php-goose

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

  Sources   Download

Apache-2.0

The Requires

 

The Development Requires

by Andrew Scott

http text content extractor scraping website readability scraper

04/12 2017

0.5.7

0.5.7.0 https://github.com/EnterpriseConsultingDeveloper/php-goose

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

  Sources   Download

Apache-2.0

The Requires

 

The Development Requires

by Andrew Scott

http text content extractor scraping website readability scraper

24/04 2017

0.5.6

0.5.6.0 https://github.com/EnterpriseConsultingDeveloper/php-goose

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

  Sources   Download

Apache-2.0

The Requires

 

The Development Requires

by Andrew Scott

http text content extractor scraping website readability scraper

21/04 2017

0.5.5

0.5.5.0 https://github.com/EnterpriseConsultingDeveloper/php-goose

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

  Sources   Download

Apache-2.0

The Requires

 

The Development Requires

by Andrew Scott

http text content extractor scraping website readability scraper

20/04 2017

0.5.4

0.5.4.0 https://github.com/EnterpriseConsultingDeveloper/php-goose

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

  Sources   Download

Apache-2.0

The Requires

 

The Development Requires

by Andrew Scott

http text content extractor scraping website readability scraper

12/04 2017

0.5.3

0.5.3.0 https://github.com/EnterpriseConsultingDeveloper/php-goose

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

  Sources   Download

Apache-2.0

The Requires

 

The Development Requires

by Andrew Scott

http text content extractor scraping website readability scraper

15/03 2017

0.5.2

0.5.2.0 https://github.com/EnterpriseConsultingDeveloper/php-goose

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

  Sources   Download

Apache-2.0

The Requires

 

The Development Requires

by Andrew Scott

http text content extractor scraping website readability scraper

13/03 2017

0.5.1

0.5.1.0 https://github.com/EnterpriseConsultingDeveloper/php-goose

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

  Sources   Download

Apache-2.0

The Requires

 

The Development Requires

by Andrew Scott

http text content extractor scraping website readability scraper

12/01 2017

0.5.0

0.5.0.0 https://github.com/scotteh/php-goose

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

  Sources   Download

Apache-2.0

The Requires

 

The Development Requires

by Andrew Scott

http text content extractor scraping website readability scraper

01/11 2016

0.4.0

0.4.0.0 https://github.com/scotteh/php-goose

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

  Sources   Download

Apache-2.0

The Requires

 

The Development Requires

by Andrew Scott

http text content extractor scraping website readability scraper

06/05 2015

0.3.0

0.3.0.0 https://github.com/scotteh/php-goose

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

  Sources   Download

Apache-2.0

The Requires

 

The Development Requires

by Andrew Scott

http text content extractor scraping website readability scraper

21/10 2014

0.2.0

0.2.0.0 https://github.com/scotteh/php-goose

Html Content / Article Extractor & Web Scrapping library written in PHP

  Sources   Download

Apache-2.0

The Requires

 

by Andrew Scott

http text content extractor scraping website scraper

03/10 2014

0.1.0

0.1.0.0 https://github.com/scotteh/php-goose

Html Content / Article Extractor & Web Scrapping library written in PHP

  Sources   Download

Apache-2.0

The Requires

 

by Andrew Scott

http extractor scraper