Ad Widget

Collapse

MySQL scalability with zabbix

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Javier
    Member
    Zabbix Certified Specialist
    • Jan 2010
    • 58

    #1

    MySQL scalability with zabbix

    Hi,

    i am using Zabbix Server 1.8 for monitored 20000 host's and i hace high mysql load!!
    My system isn't scalable and i need more scalability.
    I have a mysql-cluster for improve my performace, but sql table of zabbix don't work with NDBCLUSTER.

    Any people make similar instalation? How you make data base scalability?

    Thanks in advance.
    Javier.
  • nelsonab
    Senior Member
    Zabbix Certified SpecialistZabbix Certified Professional
    • Sep 2006
    • 1233

    #2
    Are you tied to MySQL? It may be sacrilegious to some people but have you considered Oracle?
    RHCE, author of zbxapi
    Ansible, the missing piece (Zabconf 2017): https://www.youtube.com/watch?v=R5T9NidjjDE
    Zabbix and SNMP on Linux (Zabconf 2015): https://www.youtube.com/watch?v=98PEHpLFVHM

    Comment

    • Javier
      Member
      Zabbix Certified Specialist
      • Jan 2010
      • 58

      #3
      Hi,

      if i can use Oracla DB with Zabbix-Server the scalability problema don't exists. I think that Oracla is scalable and with performance is true.

      In the proyect i want use mysql in first time, but i don't know how to increment the performance and scalability of MySQL and it's very important.

      I can see others MySQL solutions (cluster, proxy, etc) and if any solution work's, i write here.

      Thanks in advance.
      Javier.

      Comment

      • exkg
        Senior Member
        Zabbix Certified Trainer
        Zabbix Certified Specialist
        • Mar 2007
        • 718

        #4
        Hi,

        We have used Oracle for a large enviorement (3k hosts) and performance was worst than MySQL.

        I think a good idea is use table partitions in a good storage system.

        In most cases the main problem is related to IO (writes / reads). How it is in your enviroment ?
        --
        Luciano Alves
        www.zabbix.com
        Brazil | México | Argentina | Colômbia | Chile
        Zabbix Performance Tuning

        Comment

        • Javier
          Member
          Zabbix Certified Specialist
          • Jan 2010
          • 58

          #5
          Hi,

          the initial idea is to use zabix for monitoring 20k hosts. We know than partition tables is basic, but how to apply this to MySQL server while we think that this system has to be scalable?
          The horizontal scalabity is very important because the host is a number continuously growing.

          How i can to use table partitions in mysql? Some link?

          Thanks.
          Javier.

          Comment

          • nelsonab
            Senior Member
            Zabbix Certified SpecialistZabbix Certified Professional
            • Sep 2006
            • 1233

            #6
            MySQL clustering isn't going to be of use to you at all. MySQL clustring is best for databases with more reads than writes, Zabbix is HEAVY on the writes...

            This is pretty much the order for MySQL performance you'll want to think about. This assumes you're starting with a decent machine to begin with.

            - Tune MySQL (lots of posts/discussions about this and some consultants available)
            - Spread out your IO load. If you can get your history tables to be on one lun/device and your trends another and the remainder on another lun/device do that. I haven't needed to dig that deep into the internals of MySQL so I don't know if it's possible to move tables to specific partitions.
            - Good disk controllers. Since you cannot cluster MySQL (for write performance) you'll need to make sure your IO into your MySQL database is good
            - Memory, MySQL loves to eat RAM... :-D Feed it...
            - Start looking at your IO paths in your system, are there motherboard bottlenecks such as the Northbridge bus. If so consider different architecture/mobo
            - Better processor/faster RAM
            - Faster processor
            RHCE, author of zbxapi
            Ansible, the missing piece (Zabconf 2017): https://www.youtube.com/watch?v=R5T9NidjjDE
            Zabbix and SNMP on Linux (Zabconf 2015): https://www.youtube.com/watch?v=98PEHpLFVHM

            Comment

            • Firm
              Senior Member
              • Dec 2009
              • 342

              #7
              Javier,

              You may also have a look to distributed monitoring feature in Zabbix.

              Comment

              Working...