Ad Widget

Collapse

No longer showing collected data

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Awolfie
    Junior Member
    • Oct 2023
    • 8

    #1

    No longer showing collected data

    I have an established zabbix server that has been running fine for awhile. I recently added a bunch of switches and routers to it. That worked fine for weeks. Then I moved all the vms it is monitoring to a new vmware cluster. So I removed the old servers from zabbix and connected it to the new cluster. It showed all the physical blades and vms that vmware was hosting, but now it no longer shows any data from any object that is being monitored. When I reboot the server it shows about 2 minutes of data in the dashboards then there's no data again. I've verified that I can connect to the mysql database using the same credentials in the config. I have checked the disk space, it is fine at 48% use. I gave the zabbix vm more cpu and ram. I increased the vmware cachesize to 2 gigs. None of this worked. I am lost now on how to continue troubleshooting the issue.

    Had to remove some lines from one of the logs as it was too big, nothing important there. This log was from a very short boot cycle.
    Attached Files
  • vijayk
    Senior Member
    • May 2023
    • 305

    #2
    Which version of zabbix do you have? Did you tried with increase the cache size in server.config. I checked in server logs and it is showing error message of cache size.

    Comment

    • Awolfie
      Junior Member
      • Oct 2023
      • 8

      #3
      Zabbix 6.0.9 (revision 64721203c07)
      I cranked all the caches up and no change. The vm itself is using 327MB out of 16GB, and the cpu usage is also very low.

      Comment

      • Awolfie
        Junior Member
        • Oct 2023
        • 8

        #4
        zabbix server is failing to start now. It immediately fails when started.

        Comment

        • cyber
          Senior Member
          Zabbix Certified SpecialistZabbix Certified Professional
          • Dec 2006
          • 4807

          #5
          server log is full of DB errors and out of memory-s... How can you say "nothing important there" ?
          Start with this..
          1204:20231030:141104.417 [file:dbcache.c,line:4481] __zbx_mem_malloc(): out of memory (requested 72 bytes)
          1204:20231030:141104.417 [file:dbcache.c,line:4481] __zbx_mem_malloc(): please increase TrendCacheSize configuration parameter​

          Increase your TrendCache and try again... If it fails increase some more ... read carefully, what is in logs and try to fix those things...

          I am not sure what to do with those "WARNING: MYSQL_OPT_RECONNECT is deprecated and will be removed in a future version." ... Not using mysql and I do not know its details...

          Comment

          • Awolfie
            Junior Member
            • Oct 2023
            • 8

            #6
            I solved the issue. I was increasing trendcachesize not cachesize. I also made the cache value on trendcache and vmwarecache too large and it was crashing on startup. Once I cranked up cachesize and got the other cache size options down to where they should be everything started working again.

            Comment

            • Awolfie
              Junior Member
              • Oct 2023
              • 8

              #7
              This increase and cachesize caused a large increase in storage usage. Resized the drive on the host and did these commands on the ubuntu vm to resize the disk:
              Code:
              sudo lvextend -l +100%FREE /dev/mapper/ubuntu--vg-ubuntu--lv
              ​sudo resize2fs /dev/mapper/ubuntu--vg-ubuntu--lv

              Comment

              Working...