Ad Widget

Collapse

Database Partitioning on a fresh install with Postgresql and Timescaledb extension?

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • csmall
    Member
    • Jun 2020
    • 70

    #1

    Database Partitioning on a fresh install with Postgresql and Timescaledb extension?

    I'm new to zabbix and trying to build a decent zabbix instance.

    Please correct me where I am wrong or not fully understanding something.

    I've been researching a bit and it sounds like postgresql with timescaledb may be a better performing option than mysql/mariadb. Then I hear about partitioning the tables in the database to increase performance and make housekeeping faster.

    I've stumbled across this project and I'm wondering if it is a valid solution for zabbix 5.x?
    https://github.com/Doctorbal/zabbix-...s-partitioning

    So right now I'm planning on a Debian server with zabbix 5, postgresql with timescaledb extension installed and nginx.

    The environment being monitored isn't huge, maybe under 200 virtual servers (mostly windows), under 20 hypervisors.. a bunch of network equipment.. switches, shared storage etc..

    Am on on the right track here? Does it make sense to partition the postgresql database tables right from the start rather than try to manage it all later when a problem surfaces?
  • Hamardaban
    Senior Member
    Zabbix Certified SpecialistZabbix Certified Professional
    • May 2019
    • 2713

    #2
    Partitioning tables or using TSDB does not speed up housekeeping, but allows you to avoid using it. You can also enter partitioning while the system is running, but it is better to do it correctly right away.

    Comment

    • csmall
      Member
      • Jun 2020
      • 70

      #3
      Originally posted by Hamardaban
      Partitioning tables or using TSDB does not speed up housekeeping, but allows you to avoid using it. You can also enter partitioning while the system is running, but it is better to do it correctly right away.
      OK. So you would turn housekeeping off when using timescaledb?

      It sounds like I'm on the right track to do postgresql with partitioning from the start and timescaledb.

      It seems the link I posted isn't yet supporting zabbix 5. I'll keep looking for how to accomplish this. If anyone has suggestions I'd love to hear them.
      Last edited by csmall; 25-06-2020, 19:47.

      Comment

      • Hamardaban
        Senior Member
        Zabbix Certified SpecialistZabbix Certified Professional
        • May 2019
        • 2713

        #4
        Are you sure that the housekeeping process uses different methods to delete old data with or without partitioning? In the case without TSDB, the process is clear - just deleting from the table. Where is the confidence and information that the TSDB housekeeping case deletes subordinate tables.
        Of course deleting a table is faster than deleting data from a table!
        Before official TSDB support, parameters set for "Override item * period" simply disabled housekeepeng for specific tables.
        Last edited by Hamardaban; 26-06-2020, 14:36.

        Comment

        • Hamardaban
          Senior Member
          Zabbix Certified SpecialistZabbix Certified Professional
          • May 2019
          • 2713

          #5
          Super!
          !

          Comment

          Working...