Zabbix network monitoring only working for eth0

[Abyss]

Hello,

We're currently facing an issue monitoring the discovered network interfaces for all of our hosts.
The discovery occurs without any issues and the items are added correctly, however, only eth0 is getting its data gathered, all other interfaces have the status "Not supported".

If I run zabbix agent to query the items on the hosts the information is returned correctly:

$ ./zabbix_agentd -t "net.if.out[eth0,bytes]"
net.if.out[eth0,bytes] [u|7003655083775]
$ ./zabbix_agentd -t "net.if.out[eth2,bytes]"
net.if.out[eth2,bytes] [u|2073033327226]

I'm currently running Zabbix Server 3.4.7 and the pre-compiled Zabbix Agent 3.2.7 for Linux 2.6.

Do any of you have any leads to what the problem might be?

Thanks in advance!

[aigars.kadikis]

Hello, Abyss,

Is this physical or virtual environment? Did you installed zabbix agent when all network interfaces already persisted?

Please test the same keys under 'zabbix' users environment:

sudo -H -u zabbix bash -c 'zabbix_agentd -t "net.if.out[eth0,bytes]"'
sudo -H -u zabbix bash -c 'zabbix_agentd -t "net.if.out[eth2,bytes]"'

Wonder what is the output of:

zabbix_agentd -p | grep "^net\."

What type of OS lies under agent? I mean is it CentOS, Ubuntu, Debian?

Regards,

[Abyss]

Thanks for your reply aigars.kadikis,

There's no difference between physical and virtual environments, this is a general problem affecting ALL of our hosts, regardless of Linux distributions too (we have Ubuntu, CentOS, Red Hat hosts and maybe a few others).

The keys I tested before were ran as the zabbix user, so no need to test with 'sudo -u'.

Here's the output of the command on one of our hosts:

$ ./zabbix_agentd -p | grep "^net\."
net.dns[,zabbix.com]                          [u|1]
net.dns.record[,zabbix.com]                   [t|zabbix.com           SOA      ines.ns.cloudflare.com dns.cloudflare.com 2027312134 10000 2400 604800 3600]
net.tcp.dns[,zabbix.com]                      [u|1]
net.tcp.dns.query[,zabbix.com]                [t|zabbix.com           SOA      ines.ns.cloudflare.com dns.cloudflare.com 2027312134 10000 2400 604800 3600]
net.tcp.port[,80]                             [u|0]
net.tcp.listen[80]                            [u|0]
net.udp.listen[68]                            [u|0]
net.if.in[lo,bytes]                           [u|528231113]
net.if.out[lo,bytes]                          [u|528231113]
net.if.total[lo,bytes]                        [u|1056462226]
net.if.collisions[lo]                         [u|0]
net.if.discovery                              [s|{"data":[{"{#IFNAME}":"lo"},{"{#IFNAME}":"eth0"},{"{#IFNAME}":"eth1"},{"{#IFNAME}":"eth2"},{"{#IFNAME}":"eth3"},{"{#IFNAME}":"gre0"},{"{#IFNAME}":"gretap0"},{"{#IFNAME}":"tun5"},{"{#IFNAME}":"tun11"},{"{#IFNAME}":"tun16"},{"{#IFNAME}":"tun6"},{"{#IFNAME}":"tun2"},{"{#IFNAME}":"tun45"},{"{#IFNAME}":"tun51"},{"{#IFNAME}":"tun3"},{"{#IFNAME}":"tun21"},{"{#IFNAME}":"tun44"},{"{#IFNAME}":"tun12"},{"{#IFNAME}":"tun20"},{"{#IFNAME}":"tun33"},{"{#IFNAME}":"tun10"}]}]
net.tcp.service[ssh,127.0.0.1,22]             [u|1]
net.tcp.service.perf[ssh,127.0.0.1,22]        [d|0.004645]
net.udp.service[ntp,127.0.0.1,123]            [u|1]
net.udp.service.perf[ntp,127.0.0.1,123]       [d|0.000100]

Kind regards,

[aigars.kadikis]

Hello,

Thank you for such a beautiful output. You have quite a lot of interfaces out there in discovery.

Does these network items are created automatically in your setup based on "item prototype" configuration?
What is the network inteface discovery interval? How often item is configured to gather data?

What is the "Refresh unsupported items" interval under [Administration -> General -> Other] section?

Regards,

[Abyss]

Hello aigars,

Thank you for the quick reply!

Does these network items are created automatically in your setup based on "item prototype" configuration?

Yes, they're created automatically based on item prototype.

What is the network inteface discovery interval? How often item is configured to gather data?

The discovery interval is of 1 minute. The items are configured to gather data every minute too.

What is the "Refresh unsupported items" interval under [Administration -> General -> Other] section?

The parameter is set to refresh them every 10 minutes.

Kind regards,

[aigars.kadikis]

Hi, Abyss!

Refresh unsupported items looks good. I would suggest extending discovery interval to 1h at the minimum.
What type of item is selected to gather data? Is the procedure performed by passive check ("Zabbix agent"). Can you please switch item type to "Zabbix Agent (active)"?



Regards,

[Abyss]

Hello aigars!

Thanks for your help!
We managed to solve this issue by deleting the discovery rule and recreating it using item type "Zabbix Agent (active)" as you suggested.

Thanks again for your time and tips!

Kind regards,

[aigars.kadikis]

Hello aigars!

Thanks for your help!
We managed to solve this issue by deleting the discovery rule and recreating it using item type "Zabbix Agent (active)" as you suggested.

Thanks again for your time and tips!

Kind regards,

Thanks for the feedback.

It is still interesting topic though.
Does your Zabbix server has already assigned template "Template App Zabbix Server" till this day?
If Yes, would you mind to take a look/comment/share the graph under Monitoring -> Graphs
Choose Group "Zabbix servers", Host "Zabbix server", select Graph "Zabbix data gathering process busy %"

Regards,

[Abyss]

Thanks for the feedback.

It is still interesting topic though.
Does your Zabbix server has already assigned template "Template App Zabbix Server" till this day?
If Yes, would you mind to take a look/comment/share the graph under Monitoring -> Graphs
Choose Group "Zabbix servers", Host "Zabbix server", select Graph "Zabbix data gathering process busy %"

Regards,

Sure!
Here's the graph of the past 7 days:

[aigars.kadikis]

Sure!
Here's the graph of the past 7 days:

Are you monitoring all you server directly by Zabbix server or there is a proxy involved?

For that previously provided example..

net.if.discovery                              [s|{"data":[{"{#IFNAME}":"lo"},{"{#IFNAME}":"eth0"},{"{#IFNAME}":"eth1"},{"{#IFNAME}":"eth2"},{"{#IFNAME}":"eth3"},{"{#IFNAME}":"gre0"},{"{#IFNAME}":"gretap0"},{"{#IFNAME}":"tun5"},{"{#IFNAME}":"tun11"},{"{#IFNAME}":"tun16"},{"{#IFNAME}":"tun6"},{"{#IFNAME}":"tun2"},{"{#IFNAME}":"tun45"},{"{#IFNAME}":"tun51"},{"{#IFNAME}":"tun3"},{"{#IFNAME}":"tun21"},{"{#IFNAME}":"tun44"},{"{#IFNAME}":"tun12"},{"{#IFNAME}":"tun20"},{"{#IFNAME}":"tun33"},{"{#IFNAME}":"tun10"}]}]

Is this host monitored directly or through proxy?

Regards,