2017 © Pedro Peláez
 

library bloom

A PHP/Redis Bloom filter experiment

image

zircote/bloom

A PHP/Redis Bloom filter experiment

  • Tuesday, December 17, 2013
  • by zircote
  • Repository
  • 3 Watchers
  • 15 Stars
  • 12 Installations
  • PHP
  • 0 Dependents
  • 0 Suggesters
  • 3 Forks
  • 0 Open issues
  • 1 Versions
  • 0 % Grown

The README.md

Bloom

Build Status, (*1)

This project has morphed from an attempt of 'pure' php bloom filters to a tool that employs Redis and Rediska as a storage and interface for a distributed Bloom Filter., (*2)

By utilizing the power of redis' SETBIT and GETBIT we are able to create a simple, powerful and lightweight bloomfilter. The ability of redis to create a BITSET that is practically endless in size 512MB the index limitations afforded us is huge. PHP_INT_MAX serves well as a line in the sand in this early stage of testing and research. This potentially results in a 3% false positive rate for 10b values given sufficient number of hashing buckets. (I am performing more on these numbers before I get overly confident on these findings.), (*3)

Read Times on Benchmarks: 0.0011499519820647/s with three key hashing using a word list of 27607 unique strings., (*4)

Add Times on benchmark tests: 0.0036964981654479/s with three key hashing using a word list of 27607 unique strings., (*5)

<?php
use Bloom\Filter,
    Bloom\Hash\HashMix,
    Bloom\Hash\Murmur,
    Rediska;

/* Create the Filter */
$filter = new Filter();
/* Inject Rediska */
$filter->setRediska(new Rediska());
/* Inject the Hash Class */
if(extension_loaded('murmurhash')){
    $filter->setHash(new Murmur());
} else {
    $filter->setHash(new HashMix());
}

/* Add items to the filter */
$filter->add('some random text');
$filter->add(array('or add','an array of elements'));

/* Check the filter */
var_dump($filter->contains('some random text'));
// bool(true)

var_dump($filter->contains('or add'));
// bool(true)

var_dump($filter->contains('This is not in the filter'));
// bool(false)


var_dump($filter->contains(array('or add','an array of elements')));
// bool(true)

var_dump($filter->contains(array('NO','or add','an array of elements')));
// bool(false)

Bitdeli Badge, (*6)

The Versions

17/12 2013

dev-master

9999999-dev https://github.com/zircote/Bloom

A PHP/Redis Bloom filter experiment

  Sources   Download

Apache2

The Requires

 

cache bloom filter bit-op hashmix murmur hash