history write cache growing to limit

[cberni]

everything seemed okay until the "history write cache" started using the whole cache and losing data (perhaps by adding more hosts). See attachment.

Please, could someone help me to find the problem and solve that?

Zabbix 4.0.3 Mysql 5.7.24

[ingus.vilnis]

There might be items, usually log type, that start sending huge amounts of lines in to Zabbix server for analysis and that is where the history cache gets clogged up.

You can check for such items in the database.

select count(*), itemid from history_log where clock >= unix_timestamp(NOW() - INTERVAL 1 HOUR) group by itemid order by count(*) DESC LIMIT 10;

[cberni]

please see attachment with the result. I didn't understand what to really do

[ingus.vilnis]

Item with id 43323 is causing all the troubles for you.

Please use this ID in the URL of your Zabbix to see exactly what is that item, and either fix it or just disable so that it does not overload your Zabbix with log lines.

<your Zabbix URL>/items.php?form=update&itemid=43323

[cberni]

that helped. I found the problem! thanks a lot.

[sersad]

Thanks a lot, it helped me to find the problematic item too

[mu.akhtar]

Hello,
Can you help me please with it? I have the same problem but following the procedure, I am getting the following error

[dimir]

For newer zabbix versions add &context=host:

<your Zabbix URL>/items.php?form=update&itemid=43323&context=host

[WeSTMan]

Мне помогло, спасибо

[zaicnupagadi]

Thanks everyone, I had exactly the same situation. Checked that at some certain point, numbers of nvps increased dramatically, network bandwith was also higher, audit log was all clear - so noone was adding anything and Zabbix server was dying - not accepting new values.

Noticed that the history cache was filling up, and found this thread. Appeared that there was an issue on one test server and milions of event application event logs were generated - eventually killing the server as it was simply not quick enough to save it to the DB. After running the SQL command founf the item id, disabled it - all great!

Thank you!

[john275]

Found this helpful, but my itemid related to a discovery rule, which I was able to locate at <your Zabbix URL>/host_discovery.php?form=update&itemid=xxxxxxx