Ad Widget

Collapse

Hosts unable to connect to srv (VMWare ESXi VMhost)

Collapse
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • xquadro
    Junior Member
    • May 2023
    • 4
    #1

    Hosts unable to connect to srv (VMWare ESXi VMhost)


    Hi,

    My environment
    • Hardware: VMWare ESXi 7 hypervisor
    • Zabbix srv: 5.4 (on Debian 11) (VM)
    • Agents: (VMs)
      • 6.4.2 or 6.0.17 - two win 10 machines
    So, the problem is easy: agents can't see the server. Server can't see hosts.
    Firewalls on windows machine are disabled. Debian doesn't have fw by default (it's a fresh installation).
    Srv and agents in 192.168.10.1/24 network. I have hardware firewall, but there are no rules to filter internal ESXi traffic.
    Please let me know if there is additional information needed.
    I

    netstat on server
    Code:
    af@Zabbix:~$ netstat -tuln | grep 10050
tcp        0      0 0.0.0.0:10050           0.0.0.0:*               LISTEN    
tcp6       0      0 :::10050                :::*                    LISTEN    
af@Zabbix:~$ netstat -tuln | grep 10051
tcp        0      0 0.0.0.0:10051           0.0.0.0:*               LISTEN    
af@Zabbix:~$
​
    ping to agents:
    Code:
    af@Zabbix:~$ ping 192.168.10.46
PING 192.168.10.46 (192.168.10.46) 56(84) bytes of data.
64 bytes from 192.168.10.46: icmp_seq=1 ttl=128 time=0.342 ms
64 bytes from 192.168.10.46: icmp_seq=2 ttl=128 time=0.294 ms
64 bytes from 192.168.10.46: icmp_seq=3 ttl=128 time=0.289 ms
64 bytes from 192.168.10.46: icmp_seq=4 ttl=128 time=0.367 ms
^C
--- 192.168.10.46 ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 3077ms
rtt min/avg/max/mdev = 0.289/0.323/0.367/0.032 ms
af@Zabbix:~$ ping 192.168.10.175
PING 192.168.10.175 (192.168.10.175) 56(84) bytes of data.
64 bytes from 192.168.10.175: icmp_seq=1 ttl=128 time=0.334 ms
64 bytes from 192.168.10.175: icmp_seq=2 ttl=128 time=0.293 ms
64 bytes from 192.168.10.175: icmp_seq=3 ttl=128 time=0.483 ms
64 bytes from 192.168.10.175: icmp_seq=4 ttl=128 time=0.246 ms
^C
--- 192.168.10.175 ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 3079ms
rtt min/avg/max/mdev = 0.246/0.339/0.483/0.088 ms
af@Zabbix:~$
​

    ping to srv (agent 1)
    Code:
    C:\Users\localadmin>ping 192.168.10.84

Pinging 192.168.10.84 with 32 bytes of data:
Reply from 192.168.10.84: bytes=32 time<1ms TTL=64
Reply from 192.168.10.84: bytes=32 time<1ms TTL=64
Reply from 192.168.10.84: bytes=32 time<1ms TTL=64
Reply from 192.168.10.84: bytes=32 time<1ms TTL=64

Ping statistics for 192.168.10.84:
    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
    Minimum = 0ms, Maximum = 0ms, Average = 0ms​
    ping to srv (agent 2)​
    Code:
    C:\Users\localadmin>ping 192.168.10.84

Pinging 192.168.10.84 with 32 bytes of data:
Reply from 192.168.10.84: bytes=32 time<1ms TTL=64
Reply from 192.168.10.84: bytes=32 time<1ms TTL=64
Reply from 192.168.10.84: bytes=32 time<1ms TTL=64
Reply from 192.168.10.84: bytes=32 time<1ms TTL=64

Ping statistics for 192.168.10.84:
    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
    Minimum = 0ms, Maximum = 0ms, Average = 0ms

C:\Users\localadmin>​

    tracert from srv to agent 1
    Code:
    traceroute to 192.168.10.46 (192.168.10.46), 30 hops max, 60 byte packets
 1  192.168.10.46 (192.168.10.46)  0.275 ms * *
    tracert from srv to agent 2
    Code:
    traceroute to 192.168.10.175 (192.168.10.175), 30 hops max, 60 byte packets
 1  CONJURPET.concircle.local (192.168.10.175)  0.227 ms * *


    agent1 zabbix log
    Code:
      6784:20230508:140303.465 Starting Zabbix Agent [CONFROALE]. Zabbix 6.0.17 (revision c81d82859a8).
  6784:20230508:140303.470 **** Enabled features ****
  6784:20230508:140303.509 IPv6 support:          YES
  6784:20230508:140303.529 TLS support:            NO
  6784:20230508:140303.529 **************************
  6784:20230508:140303.531 using configuration file: C:\Zabbix\conf\zabbix_agentd.conf
  6784:20230508:140304.019 RegQueryValueEx() failed with 0xea
  6784:20230508:140304.021 cannot initialize performance counter collector: cannot initialize built-in counter indexes
  6784:20230508:140304.025 agent #0 started [main process]
   364:20230508:140304.030 agent #1 started [collector]
  1108:20230508:140304.035 agent #3 started[listener #2]
  7748:20230508:140304.037 agent #5 started [active checks #1]
  2640:20230508:140304.041 agent #4 started[listener #3]
  3016:20230508:140304.042 agent #2 started[listener #1]
   364:20230508:140305.143 init_cpu_collector(): cannot make counterpath for "\\": [0xC0000BBD] A required argument is missing or not correct.
  2300:20230510:235437.171 Zabbix Agent received shutdown request.


  2300:20230510:235438.165 Zabbix Agent stopped. Zabbix 6.0.17 (revision c81d82859a8).


  3220:20230510:235503.390 Starting Zabbix Agent [CONFROALE]. Zabbix 6.0.17 (revision c81d82859a8).
  3220:20230510:235503.390 **** Enabled features ****
  3220:20230510:235503.390 IPv6 support:          YES
  3220:20230510:235503.390 TLS support:            NO
  3220:20230510:235503.390 **************************
  3220:20230510:235503.390 using configuration file: C:\Zabbix\conf\zabbix_agentd.conf
  3220:20230510:235508.824 agent #0 started [main process]
  5052:20230510:235508.828 agent #1 started [collector]
  5056:20230510:235508.828 agent #2 started[listener #1]
  5060:20230510:235508.829 agent #3 started[listener #2]
  5064:20230510:235508.829 agent #4 started[listener #3]
  5068:20230510:235508.829 agent #5 started [active checks #1]
​
    ​

    agent2 zabbix log

    Code:
      5772:20230508:162552.330 Starting Zabbix Agent [CONJURPET]. Zabbix 6.0.17 (revision c81d82859a8).
  5772:20230508:162552.331 **** Enabled features ****
  5772:20230508:162552.332 IPv6 support:          YES
  5772:20230508:162552.332 TLS support:            NO
  5772:20230508:162552.333 **************************
  5772:20230508:162552.333 using configuration file: C:\Zabbix\zabbix_agentd.conf
  5772:20230508:162552.336 listener failed: bind() for [[-]:10050] failed: [0x00002740] Only one usage of each socket address (protocol/network address/port) is normally permitted.
  5772:20230508:162552.337 Zabbix Agent stopped. Zabbix 6.0.17 (revision c81d82859a8).
  3220:20230508:162610.643 Zabbix Agent received stop request.
  3220:20230508:162611.644 Zabbix Agent stopped. Zabbix 6.0.17 (revision c81d82859a8).


  7488:20230508:162614.339 Starting Zabbix Agent [CONJURPET]. Zabbix 6.0.17 (revision c81d82859a8).
  7488:20230508:162614.345 **** Enabled features ****
  7488:20230508:162614.346 IPv6 support:          YES
  7488:20230508:162614.347 TLS support:            NO
  7488:20230508:162614.347 **************************
  7488:20230508:162614.348 using configuration file: C:\Zabbix\zabbix_agentd.conf
  7488:20230508:162615.337 agent #0 started [main process]
  4272:20230508:162615.339 agent #1 started [collector]
  2384:20230508:162615.340 agent #2 started[listener #1]
  7928:20230508:162615.341 agent #4 started[listener #3]
  6036:20230508:162615.341 agent #5 started [active checks #1]
  7568:20230508:162615.342 agent #3 started[listener #2]
  7420:20230508:162706.666 Got signal. Exiting ...
  7420:20230508:162707.662 Zabbix Agent stopped. Zabbix 6.0.17 (revision c81d82859a8).


  3168:20230510:004112.781 Starting Zabbix Agent [CONJURPET]. Zabbix 6.0.17 (revision c81d82859a8).
  3168:20230510:004112.782 **** Enabled features ****
  3168:20230510:004112.782 IPv6 support:          YES
  3168:20230510:004112.782 TLS support:            NO
  3168:20230510:004112.782 **************************
  3168:20230510:004112.782 using configuration file: c:\zabbix\zabbix_agentd.conf
  3168:20230510:004120.164 agent #0 started [main process]
  4572:20230510:004120.367 agent #1 started [collector]
  4576:20230510:004120.370 agent #2 started[listener #1]
  4580:20230510:004120.370 agent #3 started[listener #2]
  4584:20230510:004120.371 agent #4 started[listener #3]
  4588:20230510:004120.371 agent #5 started [active checks #1]
​
    And this is what i see in zabbix dashboard
    Click image for larger version Name: Screenshot 2023-05-11 at 09.58.54.png Views: 803 Size: 29.5 KB ID: 464290
    I would appreciate any help in resolving this issue.
    ​
    ​
    Tags: None
    • xquadro
      Junior Member
      • May 2023
      • 4
      #2
      agent1 zabbix 6.4.2 log (a lot of untraceable errors so i switch to 6.0.17)

      Code:
       7104:20230511:103546.909 Starting Zabbix Agent [CONFROALE]. Zabbix 6.4.2 (revision 83c2f617387).

7104:20230511:103546.910 **** Enabled features ****

7104:20230511:103546.910 IPv6 support: YES

7104:20230511:103546.911 TLS support: NO

7104:20230511:103546.912 **************************

7104:20230511:103546.915 using configuration file: C:\Zabbix\conf\zabbix_agentd.conf

7104:20230511:103547.515 Unhandled exception 6ba detected at 0x00007FFC9F72CF19. Crashing ...

7104:20230511:103547.515 ====== Fatal information: ======

7104:20230511:103547.517 Program counter: 0x9f72cf19

7104:20230511:103547.517 === Registers: ===

7104:20230511:103547.518 r8 = 1f46857d4 = 8395446228 = 8395446228

7104:20230511:103547.518 r9 = d3c720 = 13879072 = 13879072

7104:20230511:103547.519 r10 = 0 = 0 = 0

7104:20230511:103547.519 r11 = 39d000 = 3788800 = 3788800

7104:20230511:103547.520 r12 = 5c8740 = 6063936 = 6063936

7104:20230511:103547.520 r13 = 6ba = 1722 = 1722

7104:20230511:103547.521 r14 = 0 = 0 = 0

7104:20230511:103547.522 r15 = d3d5a0 = 13882784 = 13882784

7104:20230511:103547.522 rdi = 7ffc9038b018 = 140722728120344 = 140722728120344

7104:20230511:103547.522 rsi = 0 = 0 = 0

7104:20230511:103547.523 rbp = 5 = 5 = 5

7104:20230511:103547.523 rbx = 6ba = 1722 = 1722

7104:20230511:103547.524 rdx = 7ffca1c5ee41 = 140723022589505 = 140723022589505

7104:20230511:103547.525 rax = 7ffca1bfb86b = 140723022182507 = 140723022182507

7104:20230511:103547.526 rcx = 0 = 0 = 0

7104:20230511:103547.526 rsp = d3d2e0 = 13882080 = 13882080

7104:20230511:103547.527 efl = 206 = 518 = 518

7104:20230511:103547.528 csgsfs = 332b5300 = 858477312 = 858477312

7104:20230511:103547.528 === Backtrace: ===

7104:20230511:103547.607 24: C:\Zabbix\bin\zabbix_agentd.exe(RaiseException+0x6 9) [0x9f72cf19]

7104:20230511:103547.608 23: C:\Zabbix\bin\zabbix_agentd.exe(RpcRaiseException+ 0x50) [0xa11102c0]

7104:20230511:103547.609 22: C:\Zabbix\bin\zabbix_agentd.exe(RpcRaiseException+ 0x14) [0xa1110284]

7104:20230511:103547.611 21: C:\Zabbix\bin\zabbix_agentd.exe(Ndr64AsyncServerCa llAll+0x1599) [0xa11bd7d9]

7104:20230511:103547.612 20: C:\Zabbix\bin\zabbix_agentd.exe(NdrClientCall3+0xf 0) [0xa11c05b0]

7104:20230511:103547.613 19: C:\Zabbix\bin\zabbix_agentd.exe(I_BrowserQueryStat istics+0x3d) [0x903827ad]

7104:20230511:103547.613 18: C:\Zabbix\bin\zabbix_agentd.exe(CloseNetSvcsObject +0x13ba) [0x91a127fa]

7104:20230511:103547.614 17: C:\Zabbix\bin\zabbix_agentd.exe(CollectNetSvcsObje ctData+0xf3) [0x91a113e3]

7104:20230511:103547.614 16: C:\Zabbix\bin\zabbix_agentd.exe(InitiateShutdownW+ 0xa0b) [0xa139a0bb]

7104:20230511:103547.615 15: C:\Zabbix\bin\zabbix_agentd.exe(InitiateShutdownW+ 0x1630) [0xa139ace0]

7104:20230511:103547.616 14: C:\Zabbix\bin\zabbix_agentd.exe(PerfRegQueryValue+ 0x1a05) [0xa138af35]

7104:20230511:103547.616 13: C:\Zabbix\bin\zabbix_agentd.exe(PerfRegQueryValue+ 0x3b) [0xa138956b]

7104:20230511:103547.617 12: C:\Zabbix\bin\zabbix_agentd.exe(SetProcessDynamicE nforcedCetCompatibleRanges+0xa46) [0x9f7b3cd6]

7104:20230511:103547.618 11: C:\Zabbix\bin\zabbix_agentd.exe(RegQueryValueExW+0 x108) [0x9f733808]

7104:20230511:103547.619 10: C:\Zabbix\bin\zabbix_agentd.exe(PdhCollectQueryDat a+0x5f93) [0x957e8f43]

7104:20230511:103547.620 9: C:\Zabbix\bin\zabbix_agentd.exe(PdhCollectQueryDat a+0x6ea7) [0x957e9e57]

7104:20230511:103547.626 8: C:\Zabbix\bin\zabbix_agentd.exe(PdhCollectQueryDat a+0x205af) [0x9580355f]

7104:20230511:103547.627 7: C:\Zabbix\bin\zabbix_agentd.exe(PdhEnumObjectsHW+0 xa2) [0x958151b2]

7104:20230511:103547.628 6: C:\Zabbix\bin\zabbix_agentd.exe(PdhEnumObjectsW+0x eb) [0x958152eb]

7104:20230511:103547.629 5: C:\Zabbix\bin\zabbix_agentd.exe() [0x40039de5]

7104:20230511:103547.630 4: C:\Zabbix\bin\zabbix_agentd.exe() [0x40039b0f]

7104:20230511:103547.631 3: C:\Zabbix\bin\zabbix_agentd.exe() [0x4003a641]

7104:20230511:103547.631 2: C:\Zabbix\bin\zabbix_agentd.exe(WaitServiceState+0 x328) [0xa155dfd8]

7104:20230511:103547.632 1: C:\Zabbix\bin\zabbix_agentd.exe(BaseThreadInitThun k+0x14) [0xa1887614]

7104:20230511:103547.632 0: C:\Zabbix\bin\zabbix_agentd.exe(RtlUserThreadStart +0x21) [0xa1c226a1]

7104:20230511:103547.637 ================================

7104:20230511:103547.659 Unhandled exception 6ba detected at 0x00007FFC9F72CF19. Crashing ...

7104:20230511:103547.660 ====== Fatal information: ======

7104:20230511:103547.664 Program counter: 0x9f72cf19

7104:20230511:103547.665 === Registers: ===

7104:20230511:103547.665 r8 = 1f46857d4 = 8395446228 = 8395446228

7104:20230511:103547.678 r9 = d3c720 = 13879072 = 13879072

7104:20230511:103547.679 r10 = 7ffca1bfb86b = 140723022182507 = 140723022182507

7104:20230511:103547.679 r11 = 0 = 0 = 0

7104:20230511:103547.680 r12 = 5c8740 = 6063936 = 6063936

7104:20230511:103547.683 r13 = 6ba = 1722 = 1722

7104:20230511:103547.684 r14 = 0 = 0 = 0

7104:20230511:103547.684 r15 = d3d5a0 = 13882784 = 13882784

7104:20230511:103547.684 rdi = 7ffc9038b018 = 140722728120344 = 140722728120344

7104:20230511:103547.685 rsi = 0 = 0 = 0

7104:20230511:103547.686 rbp = 5 = 5 = 5

7104:20230511:103547.688 rbx = 6ba = 1722 = 1722

7104:20230511:103547.689 rdx = 0 = 0 = 0

7104:20230511:103547.689 rax = 7ffca1bfb86b = 140723022182507 = 140723022182507

7104:20230511:103547.690 rcx = 0 = 0 = 0

7104:20230511:103547.692 rsp = d3d2e0 = 13882080 = 13882080

7104:20230511:103547.693 efl = 206 = 518 = 518

7104:20230511:103547.693 csgsfs = 332b5300 = 858477312 = 858477312

7104:20230511:103547.694 === Backtrace: ===

7104:20230511:103547.770 24: C:\Zabbix\bin\zabbix_agentd.exe(RaiseException+0x6 9) [0x9f72cf19]

7104:20230511:103547.771 23: C:\Zabbix\bin\zabbix_agentd.exe(RpcRaiseException+ 0x50) [0xa11102c0]

7104:20230511:103547.772 22: C:\Zabbix\bin\zabbix_agentd.exe(RpcRaiseException+ 0x14) [0xa1110284]

7104:20230511:103547.772 21: C:\Zabbix\bin\zabbix_agentd.exe(Ndr64AsyncServerCa llAll+0x1599) [0xa11bd7d9]

7104:20230511:103547.773 20: C:\Zabbix\bin\zabbix_agentd.exe(NdrClientCall3+0xf 0) [0xa11c05b0]

7104:20230511:103547.773 19: C:\Zabbix\bin\zabbix_agentd.exe(I_BrowserQueryStat istics+0x3d) [0x903827ad]

7104:20230511:103547.774 18: C:\Zabbix\bin\zabbix_agentd.exe(CloseNetSvcsObject +0x13ba) [0x91a127fa]

7104:20230511:103547.775 17: C:\Zabbix\bin\zabbix_agentd.exe(CollectNetSvcsObje ctData+0xf3) [0x91a113e3]

7104:20230511:103547.776 16: C:\Zabbix\bin\zabbix_agentd.exe(InitiateShutdownW+ 0xa0b) [0xa139a0bb]

7104:20230511:103547.776 15: C:\Zabbix\bin\zabbix_agentd.exe(InitiateShutdownW+ 0x1630) [0xa139ace0]

7104:20230511:103547.777 14: C:\Zabbix\bin\zabbix_agentd.exe(PerfRegQueryValue+ 0x1a05) [0xa138af35]

7104:20230511:103547.778 13: C:\Zabbix\bin\zabbix_agentd.exe(PerfRegQueryValue+ 0x3b) [0xa138956b]

7104:20230511:103547.779 12: C:\Zabbix\bin\zabbix_agentd.exe(SetProcessDynamicE nforcedCetCompatibleRanges+0xa46) [0x9f7b3cd6]

7104:20230511:103547.779 11: C:\Zabbix\bin\zabbix_agentd.exe(RegQueryValueExW+0 x108) [0x9f733808]

7104:20230511:103547.780 10: C:\Zabbix\bin\zabbix_agentd.exe(PdhCollectQueryDat a+0x5f93) [0x957e8f43]

7104:20230511:103547.781 9: C:\Zabbix\bin\zabbix_agentd.exe(PdhCollectQueryDat a+0x6ea7) [0x957e9e57]

7104:20230511:103547.782 8: C:\Zabbix\bin\zabbix_agentd.exe(PdhCollectQueryDat a+0x205af) [0x9580355f]

7104:20230511:103547.783 7: C:\Zabbix\bin\zabbix_agentd.exe(PdhEnumObjectsHW+0 xa2) [0x958151b2]

7104:20230511:103547.785 6: C:\Zabbix\bin\zabbix_agentd.exe(PdhEnumObjectsW+0x eb) [0x958152eb]

7104:20230511:103547.786 5: C:\Zabbix\bin\zabbix_agentd.exe() [0x40039de5]

7104:20230511:103547.786 4: C:\Zabbix\bin\zabbix_agentd.exe() [0x40039b0f]

7104:20230511:103547.788 3: C:\Zabbix\bin\zabbix_agentd.exe() [0x4003a641]

7104:20230511:103547.789 2: C:\Zabbix\bin\zabbix_agentd.exe(WaitServiceState+0 x328) [0xa155dfd8]

7104:20230511:103547.790 1: C:\Zabbix\bin\zabbix_agentd.exe(BaseThreadInitThun k+0x14) [0xa1887614]

7104:20230511:103547.791 0: C:\Zabbix\bin\zabbix_agentd.exe(RtlUserThreadStart +0x21) [0xa1c226a1]

7104:20230511:103547.795 ================================

7104:20230511:103548.014 agent #0 started [main process]

7728:20230511:103548.016 agent [NODE="1"]Home[/NODE] started [collector]

6980:20230511:103548.016 agent [NODE="2"]Forum[/NODE] started[listener #1]

4252:20230511:103548.017 agent #4 started[listener #3]

2316:20230511:103548.017 agent #3 started[listener #2]

7996:20230511:103548.018 agent #5 started [active checks #1]
      I install wireshark to analyse traffic and it looks normal too..
      Attached Files

        Comment

        • xquadro
          Junior Member
          • May 2023
          • 4
          #3
          Ok, problem solved. I just should apply the template to host.

            Comment

            • Hanna
              Junior Member
              • Aug 2023
              • 2
              #4
              Hi all

              I have the same problem but a bit different, i can see all vmware hosts and able to get data from each VM but zabbix availability status says not available and returns agent cannot connect with interrupted system call code [4]. Can any one help me ?

                Comment

                Previous template Next
                Working...