Eventlogs and overloaded proxy
Currently I have over 300 servers in Zabbix of which a vast amount is Windows based. There are 2 eventlog items in the template for Windows, one for Application and one for System logs. A large number of the windows servers are Citrix Terminal Servers.
I use Zabbix 1.8 (trunk of a couple of days ago), the central server is connected to a number of proxies to collect the data from the servers.
What I noticed is that during working time (especially in the morning when people log on) the Zabbix data on the server is lagging behind quite a lot. At 08:00u everything is OK, at 08:30 I see the data of 08:10, at 09:00 I see the data of 08:15 etc. During the day the server catches up with the proxies again and everything is running fine.
No big loads on either proxies or server; databases are running fine, all data is coming in on the proxies etc. Only thing is that the proxies won't send the data further to the Server. When during the login time I disable the eventlog items, the data flows to the server very rapidly again, so the problem is in the eventlog items.
My theory is that the eventlog items (active Zabbix items) are "blocking" the sending of data from the proxies to the server; as if the proxies aren't able to transmit them.
Is there something in the design of the proxy-server transmission communication layout that supports this theory, or what else could it be? And of course: how can I solve this ;-).
BTW: I use agents of the 1.6 branch, I know that 1.8 has the option to limit the number of messages per run, but I don't want to use the 1.8 agent yet if not neccessary.
I use Zabbix 1.8 (trunk of a couple of days ago), the central server is connected to a number of proxies to collect the data from the servers.
What I noticed is that during working time (especially in the morning when people log on) the Zabbix data on the server is lagging behind quite a lot. At 08:00u everything is OK, at 08:30 I see the data of 08:10, at 09:00 I see the data of 08:15 etc. During the day the server catches up with the proxies again and everything is running fine.
No big loads on either proxies or server; databases are running fine, all data is coming in on the proxies etc. Only thing is that the proxies won't send the data further to the Server. When during the login time I disable the eventlog items, the data flows to the server very rapidly again, so the problem is in the eventlog items.
My theory is that the eventlog items (active Zabbix items) are "blocking" the sending of data from the proxies to the server; as if the proxies aren't able to transmit them.
Is there something in the design of the proxy-server transmission communication layout that supports this theory, or what else could it be? And of course: how can I solve this ;-).
BTW: I use agents of the 1.6 branch, I know that 1.8 has the option to limit the number of messages per run, but I don't want to use the 1.8 agent yet if not neccessary.
Comment