Hi guys,
I have the problem that my Zabbix proxy doesn't send data to my server reliable. The problem is occuring since a short time. Before that error everything worked flawlessly. I keep getting following errors in the proxy log:
4541:20231229:085433.424 cannot send proxy data to server at "SERVERIP": empty string received
4541:20231229:090435.537 cannot send proxy data to server at "SERVERIP": gnutls_record_send() timed out
I already checked the networking between the proxy and my zabbix server. All traffic is routed through a Site-To-Site Tunnel. I also tried raising the log level. The higher log level on the proxy sadly doesn't give more information. All gnutls log records are correct and it says TLS connection established. It also says that the data is put successfully to the zabbix server. All the time it stops working the proxy log simply doesn't show anything about the connection to the server.
The weird thing is that it works initially when I start the proxy. After waiting for about 7-15minutes it just stops to work. When I wait some more time it sometimes starts to work again for a short period of time.
The proxy monitors about eight windows vms with the zabbix agent and one firewall by snmp.
There are also about ten other proxies from different sites talking correctly to my zabbix server.
Proxy Version: 5.0.26 (after reinstall 5.0.40)
Server Version: 5.0.38
Agent Version: 5.0.26 (after binary swap 5.0.40)
Things I tried:
- Checked the networking between proxy and server (VPN tunnel, firewall policies, TCP dump, telnet, traceroute...)
- Reinstalled the proxy on a fresh Ubuntu Server 22.04 VM (vSphere VM)
- Raised the log level of the proxy and analyzed it
- Checked the zabbix server log
- Checked if server, proxy and agent versions are compatible
- Disabled TLS connection and tried sending the data unencrypted to the server (tls error stops showing up, empty string received still shows up)
- Deleted all hosts on the zabbix server
- Disabled every host except the firewall which is monitored by snmp
- Rolled out new Agent binaries on the monitored VMs
Would appreciate any troubleshooting idea
Greetings
Jan​
I have the problem that my Zabbix proxy doesn't send data to my server reliable. The problem is occuring since a short time. Before that error everything worked flawlessly. I keep getting following errors in the proxy log:
4541:20231229:085433.424 cannot send proxy data to server at "SERVERIP": empty string received
4541:20231229:090435.537 cannot send proxy data to server at "SERVERIP": gnutls_record_send() timed out
I already checked the networking between the proxy and my zabbix server. All traffic is routed through a Site-To-Site Tunnel. I also tried raising the log level. The higher log level on the proxy sadly doesn't give more information. All gnutls log records are correct and it says TLS connection established. It also says that the data is put successfully to the zabbix server. All the time it stops working the proxy log simply doesn't show anything about the connection to the server.
The weird thing is that it works initially when I start the proxy. After waiting for about 7-15minutes it just stops to work. When I wait some more time it sometimes starts to work again for a short period of time.
The proxy monitors about eight windows vms with the zabbix agent and one firewall by snmp.
There are also about ten other proxies from different sites talking correctly to my zabbix server.
Proxy Version: 5.0.26 (after reinstall 5.0.40)
Server Version: 5.0.38
Agent Version: 5.0.26 (after binary swap 5.0.40)
Things I tried:
- Checked the networking between proxy and server (VPN tunnel, firewall policies, TCP dump, telnet, traceroute...)
- Reinstalled the proxy on a fresh Ubuntu Server 22.04 VM (vSphere VM)
- Raised the log level of the proxy and analyzed it
- Checked the zabbix server log
- Checked if server, proxy and agent versions are compatible
- Disabled TLS connection and tried sending the data unencrypted to the server (tls error stops showing up, empty string received still shows up)
- Deleted all hosts on the zabbix server
- Disabled every host except the firewall which is monitored by snmp
- Rolled out new Agent binaries on the monitored VMs
Would appreciate any troubleshooting idea
Greetings
Jan​
Comment