Zabbix Server Stopped because of one child process died

[teeayztee]

Hi , i have a situtaion is my zabbix server after adding some Linux SNMP device and VMware ESXI suddenly zabbix_Server stopped , i have try to uninstall and install newfresh zabbix server but after adding Linux SNMP device it happen again , here is the log . Can some one explain and help me this problem . Thanks alot . I have try to restart zabbix_server but it does help at all
100170:20210914:012709.996 Starting Zabbix Server. Zabbix 5.4.4 (revision 1765c4f1bc).
100170:20210914:012709.996 ****** Enabled features ******
100170:20210914:012709.996 SNMP monitoring: YES
100170:20210914:012709.996 IPMI monitoring: YES
100170:20210914:012709.997 Web monitoring: YES
100170:20210914:012709.997 VMware monitoring: YES
100170:20210914:012709.997 SMTP authentication: YES
100170:20210914:012709.997 ODBC: YES
100170:20210914:012709.997 SSH support: YES
100170:20210914:012709.997 IPv6 support: YES
100170:20210914:012709.997 TLS support: YES
100170:20210914:012709.997 ******************************
100170:20210914:012709.997 using configuration file: /etc/zabbix/zabbix_server.conf
100170:20210914:012710.037 current database version (mandatory/optional): 05040000/05040000
100170:20210914:012710.037 required mandatory version: 05040000
100170:20210914:012710.054 server #0 started [main process]
100174:20210914:012710.057 server #1 started [configuration syncer #1]
100174:20210914:012710.404 __mem_malloc: skipped 0 asked 256 skip_min 18446744073709551615 skip_max 0
100174:20210914:012710.404 [file:dbconfig.c,line:102] __zbx_mem_malloc(): out of memory (requested 256 bytes)
100174:20210914:012710.404 [file:dbconfig.c,line:102] __zbx_mem_malloc(): please increase CacheSize configuration parameter
100174:20210914:012710.404 === memory statistics for configuration cache ===
100174:20210914:012710.404 free chunks of size 24 bytes: 71
100174:20210914:012710.404 free chunks of size 40 bytes: 1
100174:20210914:012710.404 free chunks of size 104 bytes: 1
100174:20210914:012710.404 min chunk size: 24 bytes
100174:20210914:012710.404 max chunk size: 104 bytes
100174:20210914:012710.404 memory of total size 7304536 bytes fragmented into 67732 chunks
100174:20210914:012710.405 of those, 1848 bytes are in 73 free chunks
100174:20210914:012710.407 of those, 7302688 bytes are in 67659 used chunks
100174:20210914:012710.407 of those, 1083696 bytes are used by allocation overhead
100174:20210914:012710.407 ================================
100174:20210914:012710.407 === Backtrace: ===
100174:20210914:012710.412 13: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](zbx_backtrace+0x52) [0x5618ceb3ca1a]
100174:20210914:012710.412 12: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](__zbx_mem_malloc+0x184) [0x5618ceb36e59]
100174:20210914:012710.412 11: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](+0x1b7f64) [0x5618ceab8f64]
100174:20210914:012710.412 10: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](+0x2499f0) [0x5618ceb4a9f0]
100174:20210914:012710.412 9: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](zbx_vector_ptr_append+0x20) [0x5618ceb4abbb]
100174:20210914:012710.412 8: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](+0x1c575f) [0x5618ceac675f]
100174:20210914:012710.412 7: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](DCsync_configuration+0x1303) [0x5618ceac9252]
100174:20210914:012710.412 6: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](dbconfig_thread+0x126) [0x5618ce96c07b]
100174:20210914:012710.412 5: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](zbx_thread_start+0x3b) [0x5618ceb4df5f]
100174:20210914:012710.412 4: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](MAIN_ZABBIX_ENTRY+0xb59) [0x5618ce9587ab]
100174:20210914:012710.412 3: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](daemon_start+0x303) [0x5618ceb3c55c]
100174:20210914:012710.412 2: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](main+0x309) [0x5618ce957b34]
100174:20210914:012710.413 1: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3) [0x7ff23b1b30b3]
100174:20210914:012710.413 0: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](_start+0x2e) [0x5618ce95694e]
100170:20210914:012710.425 One child process died (PID:100174,exitcode/signal:1). Exiting ...
100170:20210914:012710.427 syncing trend data...
100170:20210914:012710.428 syncing trend data done
100170:20210914:012710.428 Zabbix Server stopped. Zabbix 5.4.4 (revision 1765c4f1bc).

[Liquidkristal]

100174:20210914:012710.404 [file:dbconfig.c,line:102] __zbx_mem_malloc(): out of memory (requested 256 bytes)
100174:20210914:012710.404 [file:dbconfig.c,line:102] __zbx_mem_malloc(): please increase CacheSize configuration parameter

It even tells you what to do...

not entirely helpful there, as OP might not use linux daily.

OP, open this file: /etc/zabbix/zabbix_server.conf in a text editor of your choosing (I prefer nano as its easy to use) find the text CacheSize and alter that I have mine set to 2G (500 ish machines reporting in on active checks)
* instructions based off centos8, it may vary for your install

Cheers

[vianenco]

cool! this worked for me!!! had the same problem


10158:20220713:140625.727 0: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](_start+0x2a) [0x55a82e6f59aa]
10157:20220713:140625.730 One child process died (PID:10158,exitcode/signal:1). Exiting ...
10157:20220713:140625.730 syncing trend data...
10157:20220713:140625.731 syncing trend data done
10157:20220713:140625.731 Zabbix Server stopped. Zabbix 5.0.23 (revision cbd238b4083).
10163:20220713:140635.817 Starting Zabbix Server. Zabbix 5.0.23 (revision cbd238b4083).
10163:20220713:140635.817 ****** Enabled features ******
10163:20220713:140635.817 SNMP monitoring: YES
10163:20220713:140635.817 IPMI monitoring: YES
10163:20220713:140635.817 Web monitoring: YES
10163:20220713:140635.817 VMware monitoring: YES
10163:20220713:140635.817 SMTP authentication: YES
10163:20220713:140635.817 ODBC: YES
10163:20220713:140635.817 SSH support: YES
10163:20220713:140635.817 IPv6 support: YES
10163:20220713:140635.817 TLS support: YES
10163:20220713:140635.817 ******************************
10163:20220713:140635.818 using configuration file: /etc/zabbix/zabbix_server.conf
10163:20220713:140635.825 current database version (mandatory/optional): 05000000/05000005
10163:20220713:140635.825 required mandatory version: 05000000
10163:20220713:140635.841 server #0 started [main process]
10164:20220713:140635.842 server Home started [configuration syncer #1]
10164:20220713:140636.504 __mem_malloc: skipped 15 asked 244072 skip_min 344 skip_max 162416
10164:20220713:140636.511 __mem_malloc: skipped 0 asked 152 skip_min 18446744073709551615 skip_max 0
10164:20220713:140636.511 [file:dbconfig.c,line:96] __zbx_mem_malloc(): out of memory (requested 152 bytes)
10164:20220713:140636.511 [file:dbconfig.c,line:96] __zbx_mem_malloc(): please increase CacheSize configuration parameter
10164:20220713:140636.511 === memory statistics for configuration cache ===
10164:20220713:140636.511 free chunks of size 24 bytes: 84
10164:20220713:140636.511 free chunks of size 32 bytes: 16
10164:20220713:140636.511 free chunks of size 120 bytes: 1
10164:20220713:140636.511 min chunk size: 24 bytes
10164:20220713:140636.511 max chunk size: 120 bytes
10164:20220713:140636.511 memory of total size 7228792 bytes fragmented into 72466 chunks
10164:20220713:140636.511 of those, 2648 bytes are in 101 free chunks
10164:20220713:140636.511 of those, 7226144 bytes are in 72365 used chunks
10164:20220713:140636.511 of those, 1159440 bytes are used by allocation overhead
10164:20220713:140636.511 ================================
10164:20220713:140636.511 === Backtrace: ===
10164:20220713:140636.512 14: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](zbx_backtrace+0x4e) [0x561761243ea3]
10164:20220713:140636.512 13: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](__zbx_mem_malloc+0x180) [0x56176123e76c]
10164:20220713:140636.512 12: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](+0x1b4df8) [0x561761200df8]
10164:20220713:140636.512 11: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](zbx_hashset_insert_ext+0x12f) [0x56176124a11b]
10164:20220713:140636.512 10: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](zbx_hashset_insert+0x2d) [0x561761249fea]
10164:20220713:140636.512 9: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](DCfind_id+0x9b) [0x561761201842]
10164:20220713:140636.512 8: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](+0x1bae55) [0x561761206e55]
10164:20220713:140636.512 7: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](DCsync_configuration+0xb97) [0x56176120e4f2]
10164:20220713:140636.512 6: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](dbconfig_thread+0x116) [0x5617610a75c1]
10164:20220713:140636.512 5: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](zbx_thread_start+0x37) [0x561761253a8e]
10164:20220713:140636.512 4: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](MAIN_ZABBIX_ENTRY+0xa6a) [0x5617610963f8]
10164:20220713:140636.512 3: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](daemon_start+0x3c6) [0x561761243a62]
10164:20220713:140636.512 2: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](main+0x2a3) [0x56176109592f]
10164:20220713:140636.512 1: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7f4f687c7c87]
10164:20220713:140636.512 0: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](_start+0x2a) [0x5617610949aa]
10163:20220713:140636.515 One child process died (PID:10164,exitcode/signal:1). Exiting ...
10163:20220713:140636.516 syncing trend data...
10163:20220713:140636.516 syncing trend data done
10163:20220713:140636.516 Zabbix Server stopped. Zabbix 5.0.23 (revision cbd238b4083).




only change the file:

/etc/zabbix/zabbix_server.conf
.
.
.

### Option: CacheSize
# Size of configuration cache, in bytes.
# Shared memory size for storing host, item and trigger data.
#
# Mandatory: no
# Range: 128K-64G
# Default:
CacheSize=2G <----- (change this line) to 2G


and next all is rigth!!!!