Ad Widget

Collapse

Performance when monitoring a big installation with Zabbix?

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • BumBum
    Junior Member
    • Jan 2009
    • 3

    #1

    Performance when monitoring a big installation with Zabbix?

    Hallo

    We have a “simple” monitoring comparing current state (u/d) and values (error and utilization counters) with expected states. It also checks that expected values are received (reaction on for example disappearing interfaces) and it found current values have an expected value (reaction on new but overlooked/forgotten to enable items). We compare 30.000 items with an average of 5 parameters (u/d, counters) every minute. We want to replace our old self made monitoring with a new system and wonder if Zabbix do have the performance for that task?

    Gert and Gunnar
  • nelsonab
    Senior Member
    Zabbix Certified SpecialistZabbix Certified Professional
    • Sep 2006
    • 1233

    #2
    I feel that Zabbix can handle what you are looking to do.

    There are some things to consider when you're looking at Zabbix, the biggest of which is a core methodology. At the most basic level Zabbix will not tell you a yes or no if something is running. It will however tell you the quality of how something is running which in turn you can use to determine your yes or no value for something working. If you keep this in mind when designing your monitoring solution you will find it easier to design.

    If you have more questions feel free to ask away. :-)
    RHCE, author of zbxapi
    Ansible, the missing piece (Zabconf 2017): https://www.youtube.com/watch?v=R5T9NidjjDE
    Zabbix and SNMP on Linux (Zabconf 2015): https://www.youtube.com/watch?v=98PEHpLFVHM

    Comment

    • Alexei
      Founder, CEO
      Zabbix Certified Trainer
      Zabbix Certified SpecialistZabbix Certified Professional
      • Sep 2004
      • 5654

      #3
      Originally posted by BumBum
      We compare 30.000 items with an average of 5 parameters (u/d, counters) every minute.
      I am not sure I fully understand this. Does it mean that you collect information from 30.000 items with the refresh rate of one minute per item? If so, it means that you must be able to process 500 new values per second, which is absolute possible with Zabbix. Consider using Proxy based approach if polling is heavily involved.
      Alexei Vladishev
      Creator of Zabbix, Product manager
      New York | Tokyo | Riga
      My Twitter

      Comment

      • BumBum
        Junior Member
        • Jan 2009
        • 3

        #4
        Thank you nelsonab and Alexei for your fast responses.

        One option which we still need is the SNMP Data with Dynamic Index. What do you think about the performance by our number of items.

        Gunnar

        Comment

        • BumBum
          Junior Member
          • Jan 2009
          • 3

          #5
          For better understanding

          I am not sure I fully understand this. Does it mean that you collect information from 30.000 items with the refresh rate of one minute per item?
          Dear Alexei,

          worse: 30.000 x 5 items


          Gunnar & Gert

          Comment

          • rimestad
            Junior Member
            • Jan 2009
            • 7

            #6
            Question withdrawn

            Hi again,

            Test with Zabbix shows severe performance problems using dynamic indexes. The system will indeed, as stated in the manual, cause heavy load on the router monitored. We measured 100% cpu load on a cisco 2610 series monitoring 100 interfaces for ifOperStatus up. For us this is a knock out creteria, so we withdraw our question.

            Positive: We like the look and feel of Zabbix very much.

            Chers Gunnar and Gert.

            Comment

            • Alexei
              Founder, CEO
              Zabbix Certified Trainer
              Zabbix Certified SpecialistZabbix Certified Professional
              • Sep 2004
              • 5654

              #7
              Originally posted by BumBum
              worse: 30.000 x 5 items
              Why worse, it is nice to see ZABBIX used for heavy computing! All right, it translates to 2500 of checks per second or 216M of new values per hour. This is still possible provided you have adequate hardware for the central server and you have no extreme requirements for storage of the collected data, i.e. detailed history will not be kept for years.
              Alexei Vladishev
              Creator of Zabbix, Product manager
              New York | Tokyo | Riga
              My Twitter

              Comment

              • rimestad
                Junior Member
                • Jan 2009
                • 7

                #8
                SNMP dynamic lookup is the current problem.

                The server was a poor old pc but it had no problems. The router was the limitation due to massive snmp gets. Thus we believe the server could do it, but not our routers, which are for routing and not for snmp gets. What does it cost to get the snmp dynamic index problem fixed by tomorrow

                Gert and Gunnar

                Comment

                • Alexei
                  Founder, CEO
                  Zabbix Certified Trainer
                  Zabbix Certified SpecialistZabbix Certified Professional
                  • Sep 2004
                  • 5654

                  #9
                  Originally posted by rimestad
                  The server was a poor old pc but it had no problems. The router was the limitation due to massive snmp gets. Thus we believe the server could do it, but not our routers, which are for routing and not for snmp gets. What does it cost to get the snmp dynamic index problem fixed by tomorrow
                  A poor old pc won't handle 2.5K of new values per second for sure. You need something better, much better!

                  Please send a message to us if you need a quote at http://www.zabbix.com/contact.php
                  Alexei Vladishev
                  Creator of Zabbix, Product manager
                  New York | Tokyo | Riga
                  My Twitter

                  Comment

                  Working...