Slow Query Causing Zabbix v6.0.3 to Stop Responding
This is a fresh install on Ubuntu with MariaDB. It was working find until I started adding SNMP hosts. Once discovery got to about 40-45 hosts, it started not responding. Repeat entries in the log and a MariaDB query that keeps processor at 100%. I get a warning on the web interface that Zabbix is not responding. Below is the last entires in the log. I cannot figure it out. I've already recreated the database and started over, but once I start adding hosts it starts having issues again.
Host has 4 CPUs and 16 GB of RAM. Doesn't seem to be a resource issue.
Anyone have ideas what may be going on? I did a search and I found another post that was similar but they resolved it by changing the database collection and charset. Mine is already set correctly
Host has 4 CPUs and 16 GB of RAM. Doesn't seem to be a resource issue.
Anyone have ideas what may be going on? I did a search and I found another post that was similar but they resolved it by changing the database collection and charset. Mine is already set correctly
Code:
15571:20220425:235001.443 Starting Zabbix Server. Zabbix 6.0.3 (revision 506e2b51e2). 15571:20220425:235001.443 ****** Enabled features ****** 15571:20220425:235001.443 SNMP monitoring: YES 15571:20220425:235001.443 IPMI monitoring: YES 15571:20220425:235001.443 Web monitoring: YES 15571:20220425:235001.443 VMware monitoring: YES 15571:20220425:235001.443 SMTP authentication: YES 15571:20220425:235001.443 ODBC: YES 15571:20220425:235001.443 SSH support: YES 15571:20220425:235001.443 IPv6 support: YES 15571:20220425:235001.443 TLS support: YES 15571:20220425:235001.443 ****************************** 15571:20220425:235001.443 using configuration file: /etc/zabbix/zabbix_server.conf 15571:20220425:235001.454 current database version (mandatory/optional): 06000000/06000000 15571:20220425:235001.454 required mandatory version: 06000000 15572:20220425:235001.457 starting HA manager 15572:20220425:235001.460 HA manager started in active mode 15571:20220425:235001.461 server #0 started [main process] 15573:20220425:235001.462 server [NODE="1"]Home[/NODE] started [service manager #1] 15574:20220425:235001.462 server [NODE="2"]Forum[/NODE] started [configuration syncer #1] 15574:20220425:235002.228 __mem_malloc: skipped 7 asked 244072 skip_min 480 skip_max 12600 15574:20220425:235002.228 [file:dbconfig.c,line:89] __zbx_mem_realloc(): out of memory (requested 244072 bytes) 15574:20220425:235002.228 [file:dbconfig.c,line:89] __zbx_mem_realloc(): please increase CacheSize configuration parameter 15574:20220425:235002.228 === memory statistics for configuration cache === 15574:20220425:235002.228 free chunks of size 24 bytes: 51 15574:20220425:235002.228 free chunks of size 32 bytes: 1 15574:20220425:235002.228 free chunks of size 40 bytes: 1 15574:20220425:235002.228 free chunks of size >= 256 bytes: 7 15574:20220425:235002.228 min chunk size: 24 bytes 15574:20220425:235002.228 max chunk size: 12600 bytes 15574:20220425:235002.228 memory of total size 29254864 bytes fragmented into 268700 chunks 15574:20220425:235002.228 of those, 22064 bytes are in 60 free chunks 15574:20220425:235002.228 of those, 29232800 bytes are in 268640 used chunks 15574:20220425:235002.228 of those, 4299184 bytes are used by allocation overhead 15574:20220425:235002.228 ================================ 15574:20220425:235002.228 === Backtrace: === 15574:20220425:235002.229 16: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](zbx_backtrace+0x52) [0x55efcd25e7d4] 15574:20220425:235002.229 15: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](__zbx_mem_realloc+0x164) [0x55efcd259442] 15574:20220425:235002.229 14: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](+0x1f1549) [0x55efcd1d9549] 15574:20220425:235002.229 13: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](zbx_hashset_reserve+0xc3) [0x55efcd265000] 15574:20220425:235002.229 12: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](zbx_hashset_insert_ext+0xf3) [0x55efcd265280] 15574:20220425:235002.229 11: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](zbx_hashset_insert+0x31) [0x55efcd26518b] 15574:20220425:235002.229 10: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](DCfind_id+0xb4) [0x55efcd1d9e2d] 15574:20220425:235002.229 9: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](+0x1fec9f) [0x55efcd1e6c9f] 15574:20220425:235002.229 8: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](DCsync_configuration+0x13ee) [0x55efcd1e9d3c] 15574:20220425:235002.229 7: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](dbconfig_thread+0x149) [0x55efcd064866] 15574:20220425:235002.229 6: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](zbx_thread_start+0x3b) [0x55efcd26fe23] 15574:20220425:235002.229 5: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](+0x6886f) [0x55efcd05086f] 15574:20220425:235002.229 4: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](MAIN_ZABBIX_ENTRY+0x87c) [0x55efcd051b6c] 15574:20220425:235002.229 3: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](daemon_start+0x2f9) [0x55efcd25e30b] 15574:20220425:235002.229 2: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](main+0x34d) [0x55efcd04fee2] 15574:20220425:235002.229 1: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3) [0x7f89d3a510b3] 15574:20220425:235002.229 0: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](_start+0x2e) [0x55efcd04eb4e] 15571:20220425:235002.235 One child process died (PID:15574,exitcode/signal:1). Exiting ... 15572:20220425:235002.235 HA manager has been paused 15572:20220425:235002.240 HA manager has been stopped 15571:20220425:235002.242 Zabbix Server stopped. Zabbix 6.0.3 (revision 506e2b51e2).
Comment