Partitioning the proxy database necessary?

[vanessa]

Hello.

Monitoring about 5k linux machines.Housekeeping is an issue on the server, but it's solved by partitioning.

What about the proxy? I'm getting this warning: "Zabbix proxy: Utilization of housekeeper processes over 75%"

[Oriolmunu]

Hi,

We’re experiencing the same issue.

We've got a single-server system with three proxies that collect data from uniform systems (almost equal hosts) each one of them, but they are not balanced. So, the first proxy collects data from 257 hosts, the second one from 119 and the third one from 192. It’s just an organizational reason. The rest of the hosts, 527, are monitored by the server itself. Overall, Zabbix is collecting around 800 VPS.

Regarding Zabbix server, we tunned housekeeping processes by adjusting the config files parameters according to the documentation, which substantially improved the processes performance. Despite that, we’re getting alerts from the proxies (Zabbix housekeeper processes more than 75% busy).

Just an aside for details, on the server we also tunned the database by increasing the pool size, pool chunk size and pool instances to match the Zabbix forks that transact with the database. This helped boost the performance of the system.

We reviewed the documentation for Zabbix proxies again, but there’s no parametrization options for the housekeeping process. We also tried to tun proxies’ databases with the same parameters as server’s database, focusing on the connection pool again to match the forking of Zabbix proxy processes, but still getting the alert. One last thing we tried was creating a proxy from scratch with no monitored hosts and it also triggers the housekeeping alert.

So, on this point, one of the things we were debating is the convenience of partitioning on the server, which I’m fully for, especially regarding the number of hosts. We’re not sure also if the proxies shall be partitioned too and if all the parametrizations done in the server, both in the front-end application and on the config files, propagates to the proxies. I'd thank to hear how other Zabbix admins solved that.

Thanks and regards,

[cyber]

Using the simplest of them, the sqlite3 version... never had any issues with housekeeper.. proxy with 1500 hosts and 122k items logs stats similar like these "housekeeper [deleted 151912 records in 0.114505 sec, idle for 1 hour(s)]"

Partitioning should not be required as data is removed from it after it has been sent away to server..

[cyber]

I would still suggest that.. leave no polling for server and it will serve you well..
Even thought... question here was about proxy DB-s and housekeeping..