I'm using (well testing for now) this official integration with Kubernetes (https://www.zabbix.com/integrations/kubernetes)
I have noticed that on some small k8s installation (4 apps that span across 10 to 16 pods) some data that this integration should be is getting on agent side, is not getting to zabbix server.
After investigation I did notice that items:
- kube.kubelet.metrics
- kube.cadvisor.metrics
try to get Prometheus output that is larger then what zbx can store in db as value (in terms of text field limitation in database). As of this some pods do have all values gathered, but most of them are missing some/most values.
If I'm missing, I'm interpreting this wrongly or approach is totally wrong, please correct.
My question for You guys is: how do you tackle this issue of not getting full gathered data?
Setup:
- kubernetes is set as AWS service
- zabbix-server 6.0.12
- db: postgres 14.2
I have noticed that on some small k8s installation (4 apps that span across 10 to 16 pods) some data that this integration should be is getting on agent side, is not getting to zabbix server.
After investigation I did notice that items:
- kube.kubelet.metrics
- kube.cadvisor.metrics
try to get Prometheus output that is larger then what zbx can store in db as value (in terms of text field limitation in database). As of this some pods do have all values gathered, but most of them are missing some/most values.
If I'm missing, I'm interpreting this wrongly or approach is totally wrong, please correct.
My question for You guys is: how do you tackle this issue of not getting full gathered data?
Setup:
- kubernetes is set as AWS service
- zabbix-server 6.0.12
- db: postgres 14.2