library map-reduce {🖫 7, ⚐ 7, ★ 0}

slava-vishnyakov/map-reduce

MapReduce implementation

Tuesday, April 24, 2018
by slava-vishnyakov
Repository
0 Watchers
0 Stars
7 Installations

PHP
0 Dependents
0 Suggesters
0 Forks
0 Open issues
7 Versions
0 % Grown

The README.md

composer require slava-vishnyakov/map-reduce

use \SlavaVishnyakov\MapReduce\MapReduceMemory;

$m = new MapReduceMemory(); // or MapReduceProcess
$m->send('a', 1);
$m->send('b', 1);
$m->send('a', 2);

foreach($m->iter() as $key => $groups) {
// yields
$key = 'a', $groups = [1,2]
$key = 'b', $groups = [1]

Also can be done via next() calls:, _(*1)

$m = new MapReduceMemory(); // or MapReduceProcess
$m->send('a', 1);
$m->send('b', 1);
$m->send('a', 2);
$m->send('a', new stdClass);

$m->next() ==> ['a', [1, 2, new stdClass]] 
$m->next() ==> ['b', [1]]
$m->next() ==> null

There are two implementations MapReduceMemory and MapReduceProcess., _(*2)

The first does all sorting in memory, the second is for memory-hungry workloads, uses /usr/bin/sort to process basically unlimited amount of data., _(*3)