Ad Widget

Collapse

Queue high after upgrade to Zabbix 4.0

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • duqa
    Junior Member
    • Oct 2018
    • 2

    #1

    Queue high after upgrade to Zabbix 4.0

    Hi All,
    yesterday I upgraded my Zabbix server to 4.0 version. After the upgrade, I have a high number of items in queue.
    I tried to use more StartPollers but the situation not change. I am using zabbix agent in active mode.

    Do I need to change some stuff in the server configuration?

    Thanks a lot
    Attached Files
  • Vovik
    Junior Member
    • Oct 2013
    • 7

    #2
    Hi. I have same problem. Increase of preforked pollers/dbsyncers/timers/escalators doesn't have result.
    Somewhere i have read that this issue might be occurs when server and agent versions is different.
    Possible we need wait for agent version 4.

    Comment

    • kloczek
      Senior Member
      • Jun 2006
      • 1771

      #3
      Pollers are for passive items.
      Check what is in the queue (Administration -> Queue -> Details) of the most delayed items and have closer look on why really those items are delayed.
      http://uk.linkedin.com/pub/tomasz-k%...zko/6/940/430/
      https://kloczek.wordpress.com/
      zapish - Zabbix API SHell binding https://github.com/kloczek/zapish
      My zabbix templates https://github.com/kloczek/zabbix-templates

      Comment

      • Vovik
        Junior Member
        • Oct 2013
        • 7

        #4
        I saw it. In version 3.4 all was ok.

        Upd. Windows precompiled aqent 4.0.0 included in source tarball. After upgrade it, items queue began almost empty.
        Last edited by Vovik; 11-10-2018, 11:38. Reason: Probably found solution

        Comment

        • Ranz
          Junior Member
          • Oct 2018
          • 1

          #5
          Hi guys,
          I have seen the same behavior.
          We are running around 800 Active agents (most of them version 3.2+ ) all connected directly to the zabbix sever
          Currently monitoring ~ 25K items.

          After the upgrade ( which went well ) we had the queue grow from an average of 800 items to above 10K
          More then 50 servers were unable to connect - although the installed agent version is 3+ and the same IP was assigned to the version 4

          waited a few hours to let the first house keeping process and tidy up the database and sync cache - yet issue remains
          tried the same server configuration parameters as version 3.4 and tried increasing values to assign additional resources but nothing helped.
          regretfully had to roll back to the 3.4 Image we kept and immediately all agents connected and queue went back to the normal below 1K items value

          Any feedback will be appreciated

          Cheers
          Ran

          Comment

          • stevereaver
            Junior Member
            • Aug 2018
            • 17

            #6
            Thought I was going mad, as I have zabbix4 proxy that constantly has queued items, seems I am not the only one. I have changed every parameter and can confirm that the DB is not the issue. I'm at a lose to explain why there are always queued items.

            Comment

            • Jason
              Senior Member
              • Nov 2007
              • 430

              #7
              Have you tried increasing the logging level to see what is going on?

              Comment

              • ingus.vilnis
                Senior Member
                Zabbix Certified Trainer
                Zabbix Certified SpecialistZabbix Certified Professional
                • Mar 2014
                • 908

                #8
                Apart from the queue graph have you guys observed any other changes in the other internal performance graphs of Zabbix server?

                And what about the log files both on Zabbix Server and on the agent side? Check few agents which you have in the queue details page, check the logs on them. Any traces there?

                Comment

                • kloczek
                  Senior Member
                  • Jun 2006
                  • 1771

                  #9
                  Originally posted by stevereaver
                  Thought I was going mad, as I have zabbix4 proxy that constantly has queued items, seems I am not the only one. I have changed every parameter and can confirm that the DB is not the issue. I'm at a lose to explain why there are always queued items.
                  Instead going mad just check what is going on with sampling monitoring data of those items.
                  It is quite possible that upgrade uncovered some issue which you've not been aware so far.
                  http://uk.linkedin.com/pub/tomasz-k%...zko/6/940/430/
                  https://kloczek.wordpress.com/
                  zapish - Zabbix API SHell binding https://github.com/kloczek/zapish
                  My zabbix templates https://github.com/kloczek/zabbix-templates

                  Comment

                  • stevereaver
                    Junior Member
                    • Aug 2018
                    • 17

                    #10
                    I wrote up my particular issue here. https://www.zabbix.com/forum/zabbix-...ed-item-checks

                    Comment

                    • Jason
                      Senior Member
                      • Nov 2007
                      • 430

                      #11
                      Originally posted by charliebarnes
                      After the upgrade ( which went well ) we had the queue grow from an average of 800 items to above 10K
                      More then 50 servers were unable to connect - although the installed agent version is 3+ and the same IP was assigned to the version 4
                      How many of your servers that are unable to connect are on version 3 agents? If so what versions? Are servers on version 4 agents able to connect ok?

                      Comment

                      • dewes
                        Junior Member
                        • Nov 2018
                        • 1

                        #12
                        I am also having a similar problem with the queue after the update to Zabbix 4.0.1. It seems it is displaying wrong or some sort of problem, because the itens on the queue had already been checked but they never clean. Here is some examples, in the first screenshot is the detail from the queue, displaying 5d (since the upgrade) of the object on the queue and the second is the object displaying data gathered today.

                        Comment

                        • TwiX
                          Junior Member
                          • Mar 2019
                          • 2

                          #13
                          Hi,

                          I also noticed that issue since upgrade ZBX 3.4 to 4.0.5.

                          The only way to fix this is to force check by selecting related items and clicking 'check now'.
                          Indeed, I had the "Problem: More than 100 items having missing data for more than 10 minutes"....

                          After that, I still have only one item in queue, but when I click on details : => No data found.

                          Comment

                          • TwiX
                            Junior Member
                            • Mar 2019
                            • 2

                            #14
                            Here are the screenshots.

                            Attached Files

                            Comment

                            Working...