Ad Widget

Collapse

Gap in Data across all monitored servers

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • sfereday
    Member
    • Jun 2020
    • 30

    #1

    Gap in Data across all monitored servers

    OK, this is a strange one for me. Starting yesterday I'm seeing strange gaps in data. The image below is from the website monitoring, but it seems to extend to other items being monitored as well. Such as CPU usage and RAM usage. All of my servers under latest data have gaps at these times. This wouldn't be an issue, but Zabbix started to alert during these times saying the site was down, when it wasn't. I am having the network looked at as well, but since it's happening with the agent on the zabbix server as well, it makes me think the network may not be the culprit. Any thoughts?

    Zabbix server is:
    Zabbix Version 5.0.3
    Zabbix Agent 5.0.5
    CentOS 7.8.2003



    Click image for larger version

Name:	Zabbixerror.png
Views:	385
Size:	157.9 KB
ID:	415626
  • sfereday
    Member
    • Jun 2020
    • 30

    #2
    Quick update. Found the one around noon was me rebooting the server.

    Comment

    • sfereday
      Member
      • Jun 2020
      • 30

      #3
      I have two different servers monitoring the websites as pictured. Both servers say at 2000 there is no data for these websites. The other items that are monitored, CPU usage, etc, are all still reporting correctly. The setup I have on most of websites is below

      Click image for larger version

Name:	Zabbixwebconfig.png
Views:	345
Size:	34.2 KB
ID:	415634

      Comment

      • sfereday
        Member
        • Jun 2020
        • 30

        #4
        Not sure if anyone has been tracking on this, but I think the issue is write access to the local drive and Zabbix not being able to write quick enough. I've reduced the frequency of items being monitored and put the VM on a disk with higher throughput and the issue seems to have gone away.

        Comment

        • Zdenek_OMNISENSUIT
          Member
          Zabbix Certified SpecialistZabbix Certified Professional
          • Nov 2020
          • 55

          #5
          Hello.

          As I don't know your zabbix environment, I can recommend you to separate db to another vm or at lease use separate fs for your db data and logs (depends on your db type) or add some ram for your db etc.
          Use zabbix self-monitoring (zabbix os, db etc) to be able found where exactly your problem is.

          -------------------------
          omnisensuit.com

          Comment

          • sfereday
            Member
            • Jun 2020
            • 30

            #6
            There is a wonky setup here. The throughput issue came up due to slow HDD and DRBD being poorly optimized. I've moved the guest to another host and the issue has pretty much gone away. I'm going to increase the items that are being checked and some of the frequencies to test, but I'm pretty sure it was the host it was on. Throughput to the HDD was about 20MB/s. The new host isn't much better (120MB/s), but it's better than what it was.

            Comment

            Working...