Wallogit.com
2017 © Pedro PelĂĄez
php-consumergroup is a kafka consumer library with group and rebalance supports., (*1)
Chinese Doc, (*2)
78,000+ messages/s for single process, (*3)
more detail benchmark, (*4)
<?php
use MTKafka\Consumer;
function call_back_func($msg) {
echo "$msg->payload\n";
}
function handle_error_call_back($msg) {
echo $msg->errstr();
}
$consumer = New Consumer("localhost:2181");
$consumer->setGroupId("group-test");
$consumer->setTopic("topic-test");
$consumer->setOffsetAutoReset(Consumer::SMALLEST);
$consumer->setErrHandler("handle_error_call_back");
try {
$consumer->start("echo_message");
}
catch(Exception $e) {
printf("error: %s\n", $e->getMessage());
}
see example.php, (*5)
Number, defaults to 32, (*6)
If partitions > 1, it forces consumers to switch to other partitons when max message is reached, or other partitons will be starved, (*7)
Millisecond, defaults to 500ms, (*8)
Offset auto commit interval., (*9)
Millisecond, defaults to 10,000 ms, (*10)
Time interval to check rebalance. Rebalance is triggered when the number of partition or consumer changes., (*11)
Millisecond, default is 1,000 ms, (*12)
Kafka request timeout., (*13)
String, defaults to "default", (*14)
Client id is used to identify consumers., (*15)
smallest|largest, defaults to smallest, (*16)
Consumer can choose whether to fetch the oldest or the lastest message when offset isn't present in zookeeper or is out of range., (*17)
Attribute and value are passed in, (*18)
We can use this function to modify the librdkafka configurationă, (*19)
more detail about librdkafka configuration., (*20)
| Type | Parmeter |
|---|---|
| CPU | Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz |
| CPU Core | 24 |
| Memory | 16G |
| Disk | SSD |
| Network | 1000Mbit/s |
| Os | CentOS release 6.7 |
Benchmark is measured by produring 20,000,000 messages at single partition, and calculate the time it takes to consume those messages., (*21)
QPS is 78,000 messages/s when process cpu utility is 100%., (*22)
php kafka consumer
Apache-2.0
php kafka consumer
Apache-2.0
php kafka consumer
Apache-2.0
php kafka consumer
Apache-2.0
php kafka consumer
Apache-2.0