feed to kafka

[hihoss]

I am looking for a method to feed zabbix data to a Kafka bus. for general user consumption?

is there anything there or something in the works?

Thanks

[hihoss]

feed zabbix data into kafka.

is there anything on feeding the zabbix collected into kafka?

[jan.garaj]

3.2 has introduced callback functions for storing historical data. It's not documented, but examples are available in dummy module: https://github.com/zabbix/zabbix/blo...y/dummy.c#L201
Use these callback functions and send data to your Kafka.

[syndeysider]

I would love to see this functionality. I'm hoping to get some funding to build out the modules to do just this! Tagged this thread for future.

[jan.garaj]

http://www.zabbix.com/development_services

[jhgrc]

This sounds like you could already do it as a Zabbix module. There is a reference module how to write to InfluxDB same time as writing to SQL. So change InfluxDB API to some KAFKA method..

[paulhuang]

This sounds like you could already do it as a Zabbix module. There is a reference module how to write to InfluxDB same time as writing to SQL. So change InfluxDB API to some KAFKA method..

Could you show the reference link to this influxdb module?

[jhgrc]

Sorry, I got it as a source package from Zabbix for commercial evaluation so I cannot share it.

But about the code, it is dead straightforward. To replicate take the example dummy-module and add Influx HTTP-calls to data callbacks (dummy_history_float_cb etc) with HTTP library CURL. Of course you need some CURL init & sanity checks on the way. Influx measurement stored is same format SQL history-tables (itemid = tag and clock and value).

With Kafka I'd say that take f.ex Kafka library librdkafka and create new plugin and share for community to improve... Or purchase development of this from Zabbix..

[HellLordKB]

FYI if someone was following up or looking for where to go next on this thread, the referenced influxdb module and details can be found here https://github.com/i-ky/effluence/blob/master/README.md