many items in queue

[vmedek]

Hi all,

I have too many items in queue - I moved complete configuration from old weak server (which was overloaded) to new stronger one, and I need to delete old items from queue. Can someone give me an advice? I cannot find where queues are stored.

[MrKen]

As you add more hosts, items, etc., you increase the workload on your zabbix server. You need to increase the number of Pollers and/or Trappers in your zabbix_server.conf to handle this increased load. Then, you should see the queue size reduce.

MrKen

[vmedek]

I changed it, the result is that I have clean "5s" to "5min" - but the old items in "more than 10 minutes" are still on the same level, and nothing changes at all.

[MrKen]

On the Queue page, in the top right-hand corner, select 'Details'. This will show you what items are in the queue. Then you might be able to determine why they are there.

MrKen

[bashman]

As you add more hosts, items, etc., you increase the workload on your zabbix server. You need to increase the number of Pollers and/or Trappers in your zabbix_server.conf to handle this increased load. Then, you should see the queue size reduce.

MrKen

It worked for me, but you can have a db performance problem.

[MrKen]

It worked for me, but you can have a db performance problem.

Agreed!

I have since changed my thoughts on the old advice of increasing Pollers/Trappers. In fact, on one of my Zabbix Servers I have reduced the Pollers/Trappers back to the default (5), and have made serious improvements to mysql configeration (my.cnf). On this box the cpu load is steady at ~0.20, housekeeper takes just seconds to delete thousands of records, and next to nothing in the queue.

My main production Zabbix Server is currently going through the my.cnf changes (slowly), but is already much faster than ever before.

The moral of the story: If you have too many items in the queue, then it's time to tweak mysql.

MrKen

[bashman]

Thank you very much MrKen, I found many threads to tweak mysql.

http://www.zabbix.com/forum/showthread.php?t=14017

http://www.zabbix.com/forum/showthread.php?t=10971

http://www.zabbix.com/forum/showthread.php?t=9925

http://www.zabbix.com/forum/showthread.php?p=46152

http://www.zabbix.com/forum/showthread.php?t=6316

http://www.zabbix.com/forum/showthread.php?t=8641

http://www.zabbix.com/forum/showthread.php?t=7954

http://www.zabbix.com/forum/showthread.php?t=9781

[MrKen]

That should keep you busy for a while. But you missed one! This is the thread that made the biggest difference in my mysql tuning - http://www.zabbix.com/forum/showthread.php?t=12407

Hope it helps.

[bashman]

Thanks, great thread, I'll give you news.

[bashman]

It worked for me, but you can have a db performance problem.

Do you think that db performance can improve using proxies?

I have only one proxy, and I have zabbix_server, zabbix_proxy and mysql in the same host.

[bashman]

That should keep you busy for a while. But you missed one! This is the thread that made the biggest difference in my mysql tuning - http://www.zabbix.com/forum/showthread.php?t=12407

Hope it helps.

I’ve seen MySQL DB opens a lot of threads which seem not be closed. We've defined “max_connections” variable to 400 connections, and Zabbix opens around 300 threads.

Is this behavior normal? We are using MySQL 5.0.75 with MyISAM Engine and all tables in zabbix and zabbix proxy schemas use InnoDB tables. Should we change the engine to InnoDB?

Thanks in advance.
Regards,

bashman