molbi/php-text-analysis

PHP Text Analysis is a library for performing Information Retrieval (IR) and Natural Language Processing (NLP) tasks using the PHP language

php-text-analysis

, _(*1)

, _(*2)

PHP Text Analysis is a library for performing Information Retrieval (IR) and Natural Language Processing (NLP) tasks using the PHP language. All the documentation for this project can be found in the wiki., _(*3)

Installation Instructions

Add PHP Text Analysis to your project, _(*4)

composer require yooper/php-text-analysis

Documentation for the library resides in the wiki. https://github.com/yooper/php-text-analysis/wiki, _(*5)

Dictionary Installation

Not required unless you use the dictionary stemmers, _(*6)

For Ubuntu < 16, _(*7)

sudo apt-get install libpspell-dev 
sudo apt-get install php5-pspell
sudo apt-get install aspell-en
sudo apt-get install php5-enchant

For Ubuntu >= 16, _(*8)

sudo apt-get install libpspell-dev php7.0-pspell aspell-en php7.0-enchant

For Centos, _(*9)

sudo yum install php5-pspell
sudo yum install aspell-en
sudo yum install php5-enchant

PHP Pecl Stem is not currently available in php 7.0., _(*10)

Tokenize

There are several tokenizers available, _(*11)

• FixedLengthTokenizer
• GeneralTokenizer
• LambdaTokenizer
• PennTreeBankTokenizer
• RegexTokenizer
• SentenceTokenizer
• WhitespaceTokenizer

Tokenizer Usage, _(*12)

$tokenizer = new GeneralTokenizer()
$tokens = $tokenizer->tokenize("Enter your text here");

Frequency Distribution

$tokenizer = new \TextAnalysis\Tokenizers\GeneralTokenizer();
$tokens = $tokenizer->tokenize("time flies like an arrow and an arrow flies like time");
$freqDist = new \TextAnalysis\Analysis\FreqDist($tokens);
$freqDist->getHapaxes(); //Get the Hapaxes
$freqDist->getTotalTokens();
$freqDist->getTotalUniqueTokens();

Check out the API for full documentation https://github.com/yooper/php-text-analysis/blob/master/src/Analysis/FreqDist.php, _(*13)