Agent 6.4.x crashing on variouls windows systems - clients and servers

[akimdarov]

Hi all,

Since the release of the 6.4.x agents, I see them crashing on various windows sysetms - win10/11, servers 2019/2022 - physical and virtual.

Excerpt of the log with DebugLevel=5 shows me this:

13968:20230911:204450.736 In zbx_execute_threaded_metric() key:'vfs.fs.get'
6368:20230911:204450.737 executing in data thread for key:'vfs.fs.get'
6368:20230911:204450.738 VEH Trap detected exception c0000005 at 0x0000000140090BCF. Exception information:
6368:20230911:204450.739 ====== Fatal information: ======
6368:20230911:204450.739 Program counter: 0x40090bcf
6368:20230911:204450.740 === Registers: ===
6368:20230911:204450.740 r8 = 401500 = 4199680 = 4199680
6368:20230911:204450.741 r9 = 1 = 1 = 1
6368:20230911:204450.741 r10 = 3 = 3 = 3
6368:20230911:204450.742 r11 = 97ec20 = 9956384 = 9956384
6368:20230911:204450.742 r12 = 0 = 0 = 0
6368:20230911:204450.743 r13 = 390ec30 = 59829296 = 59829296
6368:20230911:204450.743 r14 = 1 = 1 = 1
6368:20230911:204450.744 r15 = 0 = 0 = 0
6368:20230911:204450.744 rdi = 0 = 0 = 0
6368:20230911:204450.745 rsi = 97ed80 = 9956736 = 9956736
6368:20230911:204450.745 rbp = 140090bc0 = 5369301952 = 5369301952
6368:20230911:204450.746 rbx = 4ee000000000 = 86723979640832 = 86723979640832
6368:20230911:204450.747 rdx = 140090bc0 = 5369301952 = 5369301952
6368:20230911:204450.747 rax = 43290c0 = 70422720 = 70422720
6368:20230911:204450.748 rcx = 4ee000000000 = 86723979640832 = 86723979640832
6368:20230911:204450.748 rsp = 97ec90 = 9956496 = 9956496
6368:20230911:204450.749 efl = 10246 = 66118 = 66118
6368:20230911:204450.749 csgsfs = 332b5300 = 858477312 = 858477312
6368:20230911:204450.750 === Backtrace: ===
6368:20230911:204450.938 7: C:\Program Files\ZabbixAgent\bin\zabbix_agentd.exe() [0x40090bcf]
6368:20230911:204450.939 6: C:\Program Files\ZabbixAgent\bin\zabbix_agentd.exe() [0x40073e79]
6368:20230911:204450.940 5: C:\Program Files\ZabbixAgent\bin\zabbix_agentd.exe() [0x40090881]
6368:20230911:204450.941 4: C:\Program Files\ZabbixAgent\bin\zabbix_agentd.exe() [0x40099afe]
6368:20230911:204450.941 3: C:\Program Files\ZabbixAgent\bin\zabbix_agentd.exe() [0x40086627]
6368:20230911:204450.942 2: C:\Program Files\ZabbixAgent\bin\zabbix_agentd.exe() [0x402224c0]
6368:20230911:204450.943 1: C:\Program Files\ZabbixAgent\bin\zabbix_agentd.exe() [0x8b674de0]
6368:20230911:204450.943 0: C:\WINDOWS\SYSTEM32\ntdll.dll(RtlUserThreadStart+0 x2b) [0x8c95ec4b]
6368:20230911:204450.949 ================================
6368:20230911:204450.949 Unhandled exception c0000005 detected at 0x0000000140090BCF. Crashing ...
6368:20230911:204450.950 ====== Fatal information: ======
6368:20230911:204450.951 Program counter: 0x40090bcf
6368:20230911:204450.951 === Registers: ===
6368:20230911:204450.952 r8 = 401500 = 4199680 = 4199680
6368:20230911:204450.952 r9 = 1 = 1 = 1
6368:20230911:204450.953 r10 = 3 = 3 = 3
6368:20230911:204450.953 r11 = 97ec20 = 9956384 = 9956384
6368:20230911:204450.954 r12 = 0 = 0 = 0
6368:20230911:204450.954 r13 = 390ec30 = 59829296 = 59829296
6368:20230911:204450.955 r14 = 1 = 1 = 1
6368:20230911:204450.955 r15 = 0 = 0 = 0
6368:20230911:204450.956 rdi = 0 = 0 = 0
6368:20230911:204450.956 rsi = 97ed80 = 9956736 = 9956736
6368:20230911:204450.957 rbp = 140090bc0 = 5369301952 = 5369301952
6368:20230911:204450.957 rbx = 4ee000000000 = 86723979640832 = 86723979640832
6368:20230911:204450.958 rdx = 140090bc0 = 5369301952 = 5369301952
6368:20230911:204450.958 rax = 43290c0 = 70422720 = 70422720
6368:20230911:204450.959 rcx = 4ee000000000 = 86723979640832 = 86723979640832
6368:20230911:204450.959 rsp = 97ec90 = 9956496 = 9956496
6368:20230911:204450.960 efl = 10246 = 66118 = 66118
6368:20230911:204450.960 csgsfs = 332b5300 = 858477312 = 858477312
6368:20230911:204450.961 === Backtrace: ===
11912:20230911:204451.146 In collect_perfstat()
11912:20230911:204451.151 End of collect_perfstat()
6368:20230911:204451.152 7: C:\Program Files\ZabbixAgent\bin\zabbix_agentd.exe() [0x40090bcf]
6368:20230911:204451.152 6: C:\Program Files\ZabbixAgent\bin\zabbix_agentd.exe() [0x40073e79]
6368:20230911:204451.153 5: C:\Program Files\ZabbixAgent\bin\zabbix_agentd.exe() [0x40090881]
6368:20230911:204451.154 4: C:\Program Files\ZabbixAgent\bin\zabbix_agentd.exe() [0x40099afe]
6368:20230911:204451.155 3: C:\Program Files\ZabbixAgent\bin\zabbix_agentd.exe() [0x40086627]
6368:20230911:204451.155 2: C:\Program Files\ZabbixAgent\bin\zabbix_agentd.exe() [0x402224c0]
6368:20230911:204451.156 1: C:\Program Files\ZabbixAgent\bin\zabbix_agentd.exe() [0x8b674de0]
6368:20230911:204451.157 0: C:\WINDOWS\SYSTEM32\ntdll.dll(RtlUserThreadStart+0 x2b) [0x8c95ec4b]
6368:20230911:204451.163 ================================
18968:20230911:204451.169 Requested [vm.memory.size[total]]
18968:20230911:204451.169 Sending back [68705931264]
6904:20230911:204451.280 In send_buffer() host:'10.20.19.22' port:10051 entries:0/100
6904:20230911:204451.281 End of send_buffer():SUCCEED
18968:20230911:204451.741 Requested [service.info["LanmanWorkstation",state]]
18968:20230911:204451.743 Sending back [0]
6904:20230911:204452.348 In send_buffer() host:'10.20.19.22' port:10051 entries:0/100
11912:20230911:204452.348 In collect_perfstat()
6904:20230911:204452.349 End of send_buffer():SUCCEED
6904:20230911:204452.350 In send_heartbeat_msg()
6904:20230911:204452.350 In zbx_connect_to_server() [10.20.19.22]:10051 [timeout:30, connection timeout:30]
6904:20230911:204452.352 In zbx_is_ip4() ip:'10.20.19.22'
6904:20230911:204452.352 End of zbx_is_ip4():SUCCEED
6904:20230911:204452.353 sending [{"request":"active check heartbeat","host":"GER-DEPLOY","heartbeat_freq":60}]
6904:20230911:204452.354 Out send_heartbeat_msg()
11912:20230911:204452.355 End of collect_perfstat()
10424:20230911:204452.452 Requested [vm.memory.size[used]]
10424:20230911:204452.452 Sending back [10061545472]
18968:20230911:204453.131 Requested [service.info["LogProcessorService",state]]
18968:20230911:204453.133 Sending back [0]

Crashes seem to happen after key:'vfs.fs.get'.

Any ideas?

Agents 6.2.x and earlier don't crash for me.

Cheers,
Albert