the same error fires on all monitored hosts at the same time

[kwd2]

Hi all,
I am seeing errors generated by zabbix where the error is reported on all monitored hosts at nearly the same time. I've seen this with several different triggers too. The error shown below is the same on every node at roughly the same time +- 60 seconds
Anyone know what causes this? how to fix?
thanks
Ken

[kaspars.mednis]

Hello !

This error may come from zabbix server, but its strange that it happens on every server...
Have you checked the caches graph on zabbix server internal monitoring graphs ? Some caches may be full.
than it's time to increase CacheSize.

https://www.zabbix.com/documentation/3.4/manual/appendix/config/zabbix_server

zabbix server restart needed after config change

Regards,
Kaspars

[kwd2]

Hi,
thanks for the suggestion. The server's cache was below 25% free so that appears to have fired the trigger.
I think the problem is in provisioning. This zabbix server is monitoring many cloud nodes, each of which has its own zabbix server. The centralized server was provisioned by importing the templates and hosts from each existing zabbix server on each node. So I'm guessing the individual node triggers are tied to the central servers data and that causes them all to fire
thansk
Ken

Edit, yes this was the problem. The central server is essentially a copy of each node's zabbix server, where each node is stored as a host_group and each host_froup had the Zabbix server template in it, so all the host groups were triggering off of the zabbix servers data