Ad Widget

Collapse

zabbix crash after update 6.0.20 on 6.4.5

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Andrew Grekhov
    Member
    • Aug 2021
    • 45

    #1

    zabbix crash after update 6.0.20 on 6.4.5

    OS: Alpine 3.18
    systemd нет. Запуск в ручную с тем же результатом.
    kernel 6.1.43-0-lts
    После обновления Alpine 3.16 -> 3.18, mariaDB 10.6 -> 10.11.4, zabbix 6.0.20 -> 6.4.5
    zabbix_server запускается на 2 минуты, успевает поставить одну точку на графике,
    И падает.
    В логах следующее:
    ----------------------------------
    10837:20230808:193926.136 Starting Zabbix Server. Zabbix 6.4.5 (revision {ZABBIX_REVISION}).
    10837:20230808:193926.136 ****** Enabled features ******
    10837:20230808:193926.136 SNMP monitoring: YES
    10837:20230808:193926.136 IPMI monitoring: YES
    10837:20230808:193926.136 Web monitoring: YES
    10837:20230808:193926.136 VMware monitoring: YES
    10837:20230808:193926.136 SMTP authentication: YES
    10837:20230808:193926.136 ODBC: YES
    10837:20230808:193926.136 SSH support: YES
    10837:20230808:193926.136 IPv6 support: YES
    10837:20230808:193926.136 TLS support: YES
    10837:20230808:193926.136 ******************************
    10837:20230808:193926.136 using configuration file: /etc/zabbix/zabbix_server.conf
    10837:20230808:193926.151 current database version (mandatory/optional): 06040000/06040001
    10837:20230808:193926.151 required mandatory version: 06040000
    10838:20230808:193926.156 starting HA manager
    10838:20230808:193926.158 HA manager started in active mode
    10837:20230808:193926.159 server #0 started [main process]
    10839:20230808:193926.159 server Home started [service manager #1]​
    ...
    10878:20230808:194025.267 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x1000001b7]. Crashing ...
    10878:20230808:194025.267 ====== Fatal information: ======
    10878:20230808:194025.267 Program counter: 0x7fc2655b0f0d
    10878:20230808:194025.267 === Registers: ===
    10878:20230808:194025.267 r8 = 0 = 0 = 0
    10878:20230808:194025.267 r9 = 1 = 1 = 1
    10878:20230808:194025.267 r10 = 7fc26548a2ac = 140472899642028 = 140472899642028
    10878:20230808:194025.267 r11 = 0 = 0 = 0
    10878:20230808:194025.267 r12 = ffffffff = 4294967295 = 4294967295
    10878:20230808:194025.267 r13 = 0 = 0 = 0​
    ...
    10878:20230808:194025.272 7fc266113000-7fc266114000 r--p 00095000 08:03 12320884 /lib/ld-musl-x86_64.so.1
    10878:20230808:194025.272 7fc266114000-7fc266115000 rw-p 00096000 08:03 12320884 /lib/ld-musl-x86_64.so.1
    10878:20230808:194025.272 7fc266115000-7fc266118000 rw-p 00000000 00:00 0
    10878:20230808:194025.272 7ffd99e44000-7ffd99e92000 rw-p 00000000 00:00 0 [stack]
    10878:20230808:194025.272 7ffd99fcf000-7ffd99fd3000 r--p 00000000 00:00 0 [vvar]
    10878:20230808:194025.272 7ffd99fd3000-7ffd99fd5000 r-xp 00000000 00:00 0 [vdso]
    10878:20230808:194025.272 ================================
    10878:20230808:194025.272 Please consider attaching a disassembly listing to your bug report.
    10878:20230808:194025.272 This listing can be produced with, e.g., objdump -DSswx zabbix_server.
    10878:20230808:194025.272 ================================
    10837:20230808:194025.273 One child process died (PID:10878,exitcode/signal:1). Exiting ...
    10838:20230808:194025.273 HA manager has been paused
    zabbix_server [10837]: Error waiting for process with PID 10878: [10] No child process
    10838:20230808:194025.290 HA manager has been stopped
    10837:20230808:194025.294 syncing trend data...
    10837:20230808:194025.831 syncing trend data done
    10837:20230808:194025.837 Zabbix Server stopped. Zabbix 6.4.5 (revision {ZABBIX_REVISION}).​

    Есть мысли, что может быть причиной?
    Что необходимо проверить?
    objdump файл сгенерил, но прицепить не получилось 15M.
  • Kos
    Senior Member
    Zabbix Certified SpecialistZabbix Certified Professional
    • Aug 2015
    • 3404

    #2
    Ну вы вырезали из дампа самое интересное: верхушку стека и информацию о том, что за процесс стартовал с PID-ом 10878, который неожиданно помер по сигналу SIGSEGV.

    Comment

    • Andrew Grekhov
      Member
      • Aug 2021
      • 45

      #3
      Выложил.
      Code:
      11057:20230808:194225.277 Starting Zabbix Server. Zabbix 6.4.5 (revision {ZABBIX_REVISION}).
      11057:20230808:194225.278 ****** Enabled features ******
      11057:20230808:194225.278 SNMP monitoring: YES
      11057:20230808:194225.278 IPMI monitoring: YES
      11057:20230808:194225.278 Web monitoring: YES
      11057:20230808:194225.278 VMware monitoring: YES
      11057:20230808:194225.278 SMTP authentication: YES
      11057:20230808:194225.278 ODBC: YES
      11057:20230808:194225.278 SSH support: YES
      11057:20230808:194225.278 IPv6 support: YES
      11057:20230808:194225.278 TLS support: YES
      11057:20230808:194225.278 ******************************
      11057:20230808:194225.278 using configuration file: /etc/zabbix/zabbix_server.conf
      11057:20230808:194225.292 current database version (mandatory/optional): 06040000/06040001
      11057:20230808:194225.292 required mandatory version: 06040000
      11058:20230808:194225.297 starting HA manager
      11058:20230808:194225.300 HA manager started in active mode
      11057:20230808:194225.301 server #0 started [main process]
      11059:20230808:194225.301 server #1 started [service manager #1]
      11060:20230808:194225.301 server #2 started [configuration syncer #1]
      11061:20230808:194225.933 server #3 started [alert manager #1]
      11062:20230808:194225.933 server #4 started [alerter #1]
      11063:20230808:194225.933 server #5 started [alerter #2]
      11064:20230808:194225.934 server #6 started [alerter #3]
      11065:20230808:194225.934 server #7 started [preprocessing manager #1]
      11066:20230808:194225.934 server #8 started [lld manager #1]
      11067:20230808:194225.934 server #9 started [lld worker #1]
      11070:20230808:194225.935 server #12 started [housekeeper #1]
      11071:20230808:194225.935 server #13 started [timer #1]
      11072:20230808:194225.936 server #14 started [http poller #1]
      11073:20230808:194225.937 server #15 started [discoverer #1]
      11068:20230808:194225.937 server #10 started [lld worker #2]
      11069:20230808:194225.938 server #11 started [ipmi manager #1]
      11074:20230808:194225.939 server #16 started [discoverer #2]
      11081:20230808:194225.942 server #23 started [history syncer #4]
      11092:20230808:194225.943 server #34 started [ipmi poller #10]
      11077:20230808:194225.943 server #19 started [discoverer #5]
      11086:20230808:194225.943 server #28 started [ipmi poller #4]
      11076:20230808:194225.944 server #18 started [discoverer #4]
      11078:20230808:194225.944 server #20 started [history syncer #1]
      11080:20230808:194225.944 server #22 started [history syncer #3]
      11084:20230808:194225.944 server #26 started [ipmi poller #2]
      11075:20230808:194225.944 server #17 started [discoverer #3]
      11083:20230808:194225.944 server #25 started [ipmi poller #1]
      11079:20230808:194225.945 server #21 started [history syncer #2]
      11094:20230808:194225.945 server #36 started [self-monitoring #1]
      11085:20230808:194225.945 server #27 started [ipmi poller #3]
      11082:20230808:194225.946 server #24 started [escalator #1]
      11103:20230808:194225.948 server #45 started [trapper #1]
      11102:20230808:194225.950 server #44 started [unreachable poller #1]
      11087:20230808:194225.953 server #29 started [ipmi poller #5]
      11101:20230808:194225.953 server #43 started [poller #5]
      11088:20230808:194225.954 server #30 started [ipmi poller #6]
      11096:20230808:194225.954 server #38 started [task manager #1]
      11089:20230808:194225.954 server #31 started [ipmi poller #7]
      11111:20230808:194225.955 server #53 started [alert syncer #1]
      11104:20230808:194225.955 server #46 started [trapper #2]
      11090:20230808:194225.955 server #32 started [ipmi poller #8]
      11108:20230808:194225.955 server #50 started [icmp pinger #1]
      11105:20230808:194225.955 server #47 started [trapper #3]
      11093:20230808:194225.955 server #35 started [proxy poller #1]
      11100:20230808:194225.959 server #42 started [poller #4]
      11091:20230808:194225.959 server #33 started [ipmi poller #9]
      11095:20230808:194225.959 server #37 started [vmware collector #1]
      11106:20230808:194225.960 server #48 started [trapper #4]
      11097:20230808:194225.960 server #39 started [poller #1]
      11112:20230808:194225.960 server #54 started [history poller #1]
      11099:20230808:194225.962 server #41 started [poller #3]
      11107:20230808:194225.963 server #49 started [trapper #5]
      11098:20230808:194225.965 server #40 started [poller #2]
      11116:20230808:194225.966 server #58 started [history poller #5]
      11109:20230808:194225.967 server #51 started [icmp pinger #2]
      11110:20230808:194225.967 server #52 started [icmp pinger #3]
      11113:20230808:194225.969 server #55 started [history poller #2]
      11114:20230808:194225.972 server #56 started [history poller #3]
      11115:20230808:194225.977 server #57 started [history poller #4]
      11117:20230808:194225.978 server #59 started [availability manager #1]
      11119:20230808:194225.978 server #61 started [odbc poller #1]
      11065:20230808:194225.978 [1] thread started [preprocessing worker #1]
      11065:20230808:194225.978 [2] thread started [preprocessing worker #2]
      11065:20230808:194225.979 [3] thread started [preprocessing worker #3]
      11118:20230808:194225.979 server #60 started [trigger housekeeper #1]
      11101:20230808:194325.795 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x1000001b7]. Crashing ...
      11101:20230808:194325.795 ====== Fatal information: ======
      11101:20230808:194325.795 Program counter: 0x7f8ce4aeaf0d
      11101:20230808:194325.795 === Registers: ===
      11101:20230808:194325.795 r8 = 0 = 0 = 0
      11101:20230808:194325.795 r9 = 1 = 1 = 1
      11101:20230808:194325.795 r10 = 7f8cdc3062ac = 140242966307500 = 140242966307500
      11101:20230808:194325.795 r11 = 0 = 0 = 0
      11101:20230808:194325.795 r12 = ffffffff = 4294967295 = 4294967295
      11101:20230808:194325.795 r13 = 0 = 0 = 0
      11101:20230808:194325.795 r14 = 7f8cdc333200 = 140242966491648 = 140242966491648
      11101:20230808:194325.795 r15 = 7f8cdc36beb0 = 140242966724272 = 140242966724272
      11101:20230808:194325.795 rdi = 7f8cdc2e4020 = 140242966167584 = 140242966167584
      11101:20230808:194325.795 rsi = 20 = 32 = 32
      11101:20230808:194325.795 rbp = 7f8cdc3a3ad0 = 140242966952656 = 140242966952656
      11101:20230808:194325.795 rbx = 7f8cdc38b810 = 140242966853648 = 140242966853648
      11101:20230808:194325.795 rdx = 0 = 0 = 0
      11101:20230808:194325.795 rax = 7f8cdc396ed0 = 140242966900432 = 140242966900432
      11101:20230808:194325.795 rcx = 0 = 0 = 0
      11101:20230808:194325.795 rsp = 7ffc25085b50 = 140720929790800 = 140720929790800
      11101:20230808:194325.795 rip = 7f8ce4aeaf0d = 140243108802317 = 140243108802317
      11101:20230808:194325.795 efl = 10206 = 66054 = 66054
      11101:20230808:194325.795 csgsfs = 2b000000000033 = 12103423998558259 = 12103423998558259
      11101:20230808:194325.795 err = 4 = 4 = 4
      11101:20230808:194325.795 trapno = e = 14 = 14
      11101:20230808:194325.795 oldmask = 0 = 0 = 0
      11101:20230808:194325.795 cr2 = 1000001b7 = 4294967735 = 4294967735
      11101:20230808:194325.795 backtrace is not available for this platform
      11101:20230808:194325.795 === Memory map: ===
      11101:20230808:194325.795 5617d42a8000-5617d42fb000 r--p 00000000 08:03 27951533 /usr/sbin/zabbix_server
      11101:20230808:194325.795 5617d42fb000-5617d451a000 r-xp 00053000 08:03 27951533 /usr/sbin/zabbix_server
      11101:20230808:194325.795 5617d451a000-5617d45ff000 r--p 00272000 08:03 27951533 /usr/sbin/zabbix_server
      11101:20230808:194325.795 5617d45ff000-5617d4603000 r--p 00356000 08:03 27951533 /usr/sbin/zabbix_server
      11101:20230808:194325.795 5617d4603000-5617d46dc000 rw-p 0035a000 08:03 27951533 /usr/sbin/zabbix_server
      11101:20230808:194325.795 5617d46dc000-5617d46ed000 rw-p 00000000 00:00 0
      11101:20230808:194325.795 5617d5921000-5617d5922000 ---p 00000000 00:00 0 [heap]
      11101:20230808:194325.795 5617d5922000-5617d5925000 rw-p 00000000 00:00 0 [heap]
      11101:20230808:194325.796 5617d5925000-5617d592b000 rw-p 00000000 00:00 0 [heap]
      11101:20230808:194325.796 7f8cdc2d4000-7f8cdc2de000 rw-p 00000000 00:00 0
      11101:20230808:194325.796 7f8cdc2e4000-7f8cdc3e8000 rw-p 00000000 00:00 0
      11101:20230808:194325.796 7f8cdc3e8000-7f8cdc7e8000 rw-s 00000000 00:01 65588 /SYSV00000000 (deleted)
      11101:20230808:194325.796 7f8cdc7e8000-7f8cde7e8000 rw-s 00000000 00:01 65587 /SYSV00000000 (deleted)
      11101:20230808:194325.796 7f8cde7e8000-7f8cdefe8000 rw-s 00000000 00:01 65586 /SYSV00000000 (deleted)
      11101:20230808:194325.796 7f8cdefe8000-7f8cdeff8000 rw-s 00000000 00:01 65585 /SYSV00000000 (deleted)
      11101:20230808:194325.796 7f8cdeff8000-7f8ce2ff8000 rw-s 00000000 00:01 65584 /SYSV00000000 (deleted)
      11101:20230808:194325.796 7f8ce2ff8000-7f8ce2ffc000 rw-p 00000000 00:00 0
      11101:20230808:194325.796 7f8ce2ffc000-7f8ce33fc000 rw-s 00000000 00:01 65583 /SYSV00000000 (deleted)
      11101:20230808:194325.796 7f8ce33fc000-7f8ce37fc000 rw-s 00000000 00:01 65582 /SYSV00000000 (deleted)
      11101:20230808:194325.796 7f8ce37fc000-7f8ce47fc000 rw-s 00000000 00:01 65581 /SYSV00000000 (deleted)
      11101:20230808:194325.796 7f8ce47fc000-7f8ce4800000 rw-p 00000000 00:00 0
      11101:20230808:194325.796 7f8ce4800000-7f8ce4875000 r--p 00000000 08:03 12320904 /lib/libcrypto.so.1.1
      11101:20230808:194325.796 7f8ce4875000-7f8ce49cc000 r-xp 00075000 08:03 12320904 /lib/libcrypto.so.1.1
      11101:20230808:194325.796 7f8ce49cc000-7f8ce4a51000 r--p 001cc000 08:03 12320904 /lib/libcrypto.so.1.1
      11101:20230808:194325.796 7f8ce4a51000-7f8ce4a7c000 r--p 00250000 08:03 12320904 /lib/libcrypto.so.1.1
      11101:20230808:194325.796 7f8ce4a7c000-7f8ce4a7e000 rw-p 0027b000 08:03 12320904 /lib/libcrypto.so.1.1
      11101:20230808:194325.796 7f8ce4a7e000-7f8ce4a82000 rw-p 00000000 00:00 0
      11101:20230808:194325.796 7f8ce4a82000-7f8ce4a86000 rw-p 00000000 00:00 0
      11101:20230808:194325.796 7f8ce4a86000-7f8ce4a87000 rw-p 00000000 00:00 0
      11101:20230808:194325.796 7f8ce4a87000-7f8ce4a96000 rw-p 00000000 00:00 0
      11101:20230808:194325.796 7f8ce4a96000-7f8ce4a97000 r--p 00000000 08:03 27920292 /usr/lib/libbrotlicommon.so.1.0.9
      11101:20230808:194325.796 7f8ce4a97000-7f8ce4a98000 r-xp 00001000 08:03 27920292 /usr/lib/libbrotlicommon.so.1.0.9
      11101:20230808:194325.796 7f8ce4a98000-7f8ce4ab7000 r--p 00002000 08:03 27920292 /usr/lib/libbrotlicommon.so.1.0.9
      11101:20230808:194325.796 7f8ce4ab7000-7f8ce4ab8000 r--p 00021000 08:03 27920292 /usr/lib/libbrotlicommon.so.1.0.9
      11101:20230808:194325.797 7f8ce4ab8000-7f8ce4ab9000 rw-p 00022000 08:03 27920292 /usr/lib/libbrotlicommon.so.1.0.9
      11101:20230808:194325.797 7f8ce4ab9000-7f8ce4ad5000 r--p 00000000 08:03 12322181 /lib/libssl.so.1.1
      11101:20230808:194325.797 7f8ce4ad5000-7f8ce4b15000 r-xp 0001c000 08:03 12322181 /lib/libssl.so.1.1
      11101:20230808:194325.797 7f8ce4b15000-7f8ce4b2d000 r--p 0005c000 08:03 12322181 /lib/libssl.so.1.1
      11101:20230808:194325.797 7f8ce4b2d000-7f8ce4b36000 r--p 00073000 08:03 12322181 /lib/libssl.so.1.1
      11101:20230808:194325.797 7f8ce4b36000-7f8ce4b3a000 rw-p 0007c000 08:03 12322181 /lib/libssl.so.1.1
      11101:20230808:194325.797 7f8ce4b3a000-7f8ce4b3e000 r--p 00000000 08:03 27919402 /usr/lib/libnghttp2.so.14.24.3
      11101:20230808:194325.797 7f8ce4b3e000-7f8ce4b4e000 r-xp 00004000 08:03 27919402 /usr/lib/libnghttp2.so.14.24.3
      11101:20230808:194325.797 7f8ce4b4e000-7f8ce4b5a000 r--p 00014000 08:03 27919402 /usr/lib/libnghttp2.so.14.24.3
      11101:20230808:194325.797 7f8ce4b5a000-7f8ce4b5d000 r--p 0001f000 08:03 27919402 /usr/lib/libnghttp2.so.14.24.3
      11101:20230808:194325.797 7f8ce4b5d000-7f8ce4b5e000 rw-p 00022000 08:03 27919402 /usr/lib/libnghttp2.so.14.24.3
      11101:20230808:194325.797 7f8ce4b5e000-7f8ce4b60000 r--p 00000000 08:03 27921451 /usr/lib/libpcre2-8.so.0.11.2
      11101:20230808:194325.797 7f8ce4b60000-7f8ce4bd2000 r-xp 00002000 08:03 27921451 /usr/lib/libpcre2-8.so.0.11.2
      11101:20230808:194325.797 7f8ce4bd2000-7f8ce4bfe000 r--p 00074000 08:03 27921451 /usr/lib/libpcre2-8.so.0.11.2
      11101:20230808:194325.797 7f8ce4bfe000-7f8ce4bff000 r--p 000a0000 08:03 27921451 /usr/lib/libpcre2-8.so.0.11.2
      11101:20230808:194325.797 7f8ce4bff000-7f8ce4c00000 rw-p 000a1000 08:03 27921451 /usr/lib/libpcre2-8.so.0.11.2
      11101:20230808:194325.797 7f8ce4c00000-7f8ce4c49000 r--p 00000000 08:03 12320883 /lib/libcrypto.so.3
      11101:20230808:194325.797 7f8ce4c49000-7f8ce4ee6000 r-xp 00049000 08:03 12320883 /lib/libcrypto.so.3
      11101:20230808:194325.797 7f8ce4ee6000-7f8ce4fb4000 r--p 002e6000 08:03 12320883 /lib/libcrypto.so.3
      11101:20230808:194325.797 7f8ce4fb4000-7f8ce500d000 r--p 003b4000 08:03 12320883 /lib/libcrypto.so.3
      11101:20230808:194325.797 7f8ce500d000-7f8ce5010000 rw-p 0040d000 08:03 12320883 /lib/libcrypto.so.3
      11101:20230808:194325.797 7f8ce5010000-7f8ce5013000 rw-p 00000000 00:00 0
      11101:20230808:194325.797 7f8ce5013000-7f8ce5016000 rw-p 00000000 00:00 0
      11101:20230808:194325.797 7f8ce5016000-7f8ce5017000 r--s 00000000 08:03 20578325 /etc/zoneinfo/Asia/Novosibirsk
      11101:20230808:194325.797 7f8ce5017000-7f8ce5018000 rw-s 00000000 00:01 65580 /SYSV00000000 (deleted)
      11101:20230808:194325.797 7f8ce5018000-7f8ce501a000 rw-p 00000000 00:00 0
      11101:20230808:194325.797 7f8ce501a000-7f8ce501b000 r--p 00000000 08:03 27920372 /usr/lib/libbrotlidec.so.1.0.9
      11101:20230808:194325.798 7f8ce501b000-7f8ce5023000 r-xp 00001000 08:03 27920372 /usr/lib/libbrotlidec.so.1.0.9
      11101:20230808:194325.798 7f8ce5023000-7f8ce5026000 r--p 00009000 08:03 27920372 /usr/lib/libbrotlidec.so.1.0.9
      11101:20230808:194325.798 7f8ce5026000-7f8ce5027000 r--p 0000b000 08:03 27920372 /usr/lib/libbrotlidec.so.1.0.9
      11101:20230808:194325.798 7f8ce5027000-7f8ce5028000 rw-p 0000c000 08:03 27920372 /usr/lib/libbrotlidec.so.1.0.9
      11101:20230808:194325.798 7f8ce5028000-7f8ce502a000 r--p 00000000 08:03 27926431 /usr/lib/libOpenIPMIutils.so.0.0.1
      11101:20230808:194325.798 7f8ce502a000-7f8ce502d000 r-xp 00002000 08:03 27926431 /usr/lib/libOpenIPMIutils.so.0.0.1
      11101:20230808:194325.798 7f8ce502d000-7f8ce502f000 r--p 00005000 08:03 27926431 /usr/lib/libOpenIPMIutils.so.0.0.1
      11101:20230808:194325.798 7f8ce502f000-7f8ce5030000 r--p 00006000 08:03 27926431 /usr/lib/libOpenIPMIutils.so.0.0.1
      11101:20230808:194325.798 7f8ce5030000-7f8ce5031000 rw-p 00007000 08:03 27926431 /usr/lib/libOpenIPMIutils.so.0.0.1
      11101:20230808:194325.798 7f8ce5031000-7f8ce5034000 r--p 00000000 08:03 27919426 /usr/lib/liblzma.so.5.4.3
      11101:20230808:194325.798 7f8ce5034000-7f8ce5059000 r-xp 00003000 08:03 27919426 /usr/lib/liblzma.so.5.4.3
      11101:20230808:194325.798 7f8ce5059000-7f8ce5066000 r--p 00028000 08:03 27919426 /usr/lib/liblzma.so.5.4.3
      11101:20230808:194325.798 7f8ce5066000-7f8ce5067000 r--p 00035000 08:03 27919426 /usr/lib/liblzma.so.5.4.3
      11101:20230808:194325.798 7f8ce5067000-7f8ce5068000 rw-p 00036000 08:03 27919426 /usr/lib/liblzma.so.5.4.3
      11101:20230808:194325.798 7f8ce5068000-7f8ce5076000 r--p 00000000 08:03 27918537 /usr/lib/libcurl.so.4.8.0
      11101:20230808:194325.798 7f8ce5076000-7f8ce50ce000 r-xp 0000e000 08:03 27918537 /usr/lib/libcurl.so.4.8.0
      11101:20230808:194325.798 7f8ce50ce000-7f8ce50ec000 r--p 00066000 08:03 27918537 /usr/lib/libcurl.so.4.8.0
      11101:20230808:194325.798 7f8ce50ec000-7f8ce50ef000 r--p 00083000 08:03 27918537 /usr/lib/libcurl.so.4.8.0
      11101:20230808:194325.798 7f8ce50ef000-7f8ce50f2000 rw-p 00086000 08:03 27918537 /usr/lib/libcurl.so.4.8.0
      11101:20230808:194325.798 7f8ce50f2000-7f8ce5103000 r--p 00000000 08:03 12320891 /lib/libssl.so.3
      11101:20230808:194325.798 7f8ce5103000-7f8ce514d000 r-xp 00011000 08:03 12320891 /lib/libssl.so.3
      11101:20230808:194325.798 7f8ce514d000-7f8ce516a000 r--p 0005b000 08:03 12320891 /lib/libssl.so.3
      11101:20230808:194325.798 7f8ce516a000-7f8ce5174000 r--p 00077000 08:03 12320891 /lib/libssl.so.3
      11101:20230808:194325.798 7f8ce5174000-7f8ce5178000 rw-p 00081000 08:03 12320891 /lib/libssl.so.3
      11101:20230808:194325.798 7f8ce5178000-7f8ce5179000 r--p 00000000 08:03 27928650 /usr/lib/libevent_pthreads-2.1.so.7.0.1
      11101:20230808:194325.798 7f8ce5179000-7f8ce517a000 r-xp 00001000 08:03 27928650 /usr/lib/libevent_pthreads-2.1.so.7.0.1
      11101:20230808:194325.799 7f8ce517a000-7f8ce517b000 r--p 00002000 08:03 27928650 /usr/lib/libevent_pthreads-2.1.so.7.0.1
      11101:20230808:194325.799 7f8ce517b000-7f8ce517c000 r--p 00002000 08:03 27928650 /usr/lib/libevent_pthreads-2.1.so.7.0.1
      11101:20230808:194325.799 7f8ce517c000-7f8ce517d000 rw-p 00003000 08:03 27928650 /usr/lib/libevent_pthreads-2.1.so.7.0.1
      11101:20230808:194325.799 7f8ce517d000-7f8ce518a000 r--p 00000000 08:03 27928642 /usr/lib/libevent-2.1.so.7.0.1
      11101:20230808:194325.799 7f8ce518a000-7f8ce51b2000 r-xp 0000d000 08:03 27928642 /usr/lib/libevent-2.1.so.7.0.1
      11101:20230808:194325.799 7f8ce51b2000-7f8ce51c5000 r--p 00035000 08:03 27928642 /usr/lib/libevent-2.1.so.7.0.1
      11101:20230808:194325.799 7f8ce51c5000-7f8ce51c7000 r--p 00047000 08:03 27928642 /usr/lib/libevent-2.1.so.7.0.1
      11101:20230808:194325.799 7f8ce51c7000-7f8ce51c8000 rw-p 00049000 08:03 27928642 /usr/lib/libevent-2.1.so.7.0.1
      11101:20230808:194325.799 7f8ce51c8000-7f8ce51cb000 r--p 00000000 08:03 12320833 /lib/libz.so.1.2.13
      11101:20230808:194325.799 7f8ce51cb000-7f8ce51d9000 r-xp 00003000 08:03 12320833 /lib/libz.so.1.2.13
      11101:20230808:194325.799 7f8ce51d9000-7f8ce51e0000 r--p 00011000 08:03 12320833 /lib/libz.so.1.2.13
      11101:20230808:194325.799 7f8ce51e0000-7f8ce51e1000 r--p 00017000 08:03 12320833 /lib/libz.so.1.2.13
      11101:20230808:194325.799 7f8ce51e1000-7f8ce51e2000 rw-p 00018000 08:03 12320833 /lib/libz.so.1.2.13
      11101:20230808:194325.799 7f8ce51e2000-7f8ce51e4000 r--p 00000000 08:03 27926425 /usr/lib/libOpenIPMIposix.so.0.0.1
      11101:20230808:194325.799 7f8ce51e4000-7f8ce51e7000 r-xp 00002000 08:03 27926425 /usr/lib/libOpenIPMIposix.so.0.0.1
      11101:20230808:194325.799 7f8ce51e7000-7f8ce51e8000 r--p 00005000 08:03 27926425 /usr/lib/libOpenIPMIposix.so.0.0.1
      11101:20230808:194325.799 7f8ce51e8000-7f8ce51e9000 r--p 00006000 08:03 27926425 /usr/lib/libOpenIPMIposix.so.0.0.1
      11101:20230808:194325.799 7f8ce51e9000-7f8ce51ea000 rw-p 00007000 08:03 27926425 /usr/lib/libOpenIPMIposix.so.0.0.1
      11101:20230808:194325.799 7f8ce51ea000-7f8ce521d000 r--p 00000000 08:03 27926419 /usr/lib/libOpenIPMI.so.0.0.5
      11101:20230808:194325.799 7f8ce521d000-7f8ce5284000 r-xp 00033000 08:03 27926419 /usr/lib/libOpenIPMI.so.0.0.5
      11101:20230808:194325.799 7f8ce5284000-7f8ce52be000 r--p 0009a000 08:03 27926419 /usr/lib/libOpenIPMI.so.0.0.5
      11101:20230808:194325.799 7f8ce52be000-7f8ce52d6000 r--p 000d4000 08:03 27926419 /usr/lib/libOpenIPMI.so.0.0.5
      11101:20230808:194325.799 7f8ce52d6000-7f8ce52db000 rw-p 000ec000 08:03 27926419 /usr/lib/libOpenIPMI.so.0.0.5
      11101:20230808:194325.799 7f8ce52db000-7f8ce52df000 rw-p 00000000 00:00 0
      11101:20230808:194325.799 7f8ce52df000-7f8ce52e4000 r--p 00000000 08:03 27918866 /usr/lib/libssh2.so.1.0.1
      11101:20230808:194325.799 7f8ce52e4000-7f8ce5306000 r-xp 00005000 08:03 27918866 /usr/lib/libssh2.so.1.0.1
      11101:20230808:194325.799 7f8ce5306000-7f8ce5313000 r--p 00027000 08:03 27918866 /usr/lib/libssh2.so.1.0.1
      11101:20230808:194325.799 7f8ce5313000-7f8ce5315000 r--p 00033000 08:03 27918866 /usr/lib/libssh2.so.1.0.1
      11101:20230808:194325.799 7f8ce5315000-7f8ce5316000 rw-p 00035000 08:03 27918866 /usr/lib/libssh2.so.1.0.1
      11101:20230808:194325.799 7f8ce5316000-7f8ce532c000 r--p 00000000 08:03 27918577 /usr/lib/libnetsnmp.so.40.2.0
      11101:20230808:194325.799 7f8ce532c000-7f8ce5390000 r-xp 00016000 08:03 27918577 /usr/lib/libnetsnmp.so.40.2.0
      11101:20230808:194325.799 7f8ce5390000-7f8ce53b3000 r--p 0007a000 08:03 27918577 /usr/lib/libnetsnmp.so.40.2.0
      11101:20230808:194325.799 7f8ce53b3000-7f8ce53b6000 r--p 0009c000 08:03 27918577 /usr/lib/libnetsnmp.so.40.2.0
      11101:20230808:194325.799 7f8ce53b6000-7f8ce53b9000 rw-p 0009f000 08:03 27918577 /usr/lib/libnetsnmp.so.40.2.0
      11101:20230808:194325.799 7f8ce53b9000-7f8ce53be000 rw-p 00000000 00:00 0
      11101:20230808:194325.799 7f8ce53be000-7f8ce53c3000 r--p 00000000 08:03 27919298 /usr/lib/libodbc.so.2.0.0
      11101:20230808:194325.799 7f8ce53c3000-7f8ce5404000 r-xp 00005000 08:03 27919298 /usr/lib/libodbc.so.2.0.0
      11101:20230808:194325.799 7f8ce5404000-7f8ce5416000 r--p 00046000 08:03 27919298 /usr/lib/libodbc.so.2.0.0
      11101:20230808:194325.800 7f8ce5416000-7f8ce5417000 r--p 00057000 08:03 27919298 /usr/lib/libodbc.so.2.0.0
      11101:20230808:194325.800 7f8ce5417000-7f8ce541e000 rw-p 00058000 08:03 27919298 /usr/lib/libodbc.so.2.0.0
      11101:20230808:194325.800 7f8ce541e000-7f8ce5422000 rw-p 00000000 00:00 0
      11101:20230808:194325.800 7f8ce5422000-7f8ce5441000 r--p 00000000 08:03 27921074 /usr/lib/libxml2.so.2.11.4
      11101:20230808:194325.800 7f8ce5441000-7f8ce54e8000 r-xp 0001f000 08:03 27921074 /usr/lib/libxml2.so.2.11.4
      11101:20230808:194325.800 7f8ce54e8000-7f8ce5528000 r--p 000c6000 08:03 27921074 /usr/lib/libxml2.so.2.11.4
      11101:20230808:194325.800 7f8ce5528000-7f8ce5533000 r--p 00106000 08:03 27921074 /usr/lib/libxml2.so.2.11.4
      11101:20230808:194325.800 7f8ce5533000-7f8ce5534000 rw-p 00111000 08:03 27921074 /usr/lib/libxml2.so.2.11.4
      11101:20230808:194325.800 7f8ce5534000-7f8ce5535000 rw-p 00000000 00:00 0
      11101:20230808:194325.800 7f8ce5535000-7f8ce553d000 r--p 00000000 08:03 27923175 /usr/lib/libmariadb.so.3
      11101:20230808:194325.800 7f8ce553d000-7f8ce555f000 r-xp 00008000 08:03 27923175 /usr/lib/libmariadb.so.3
      11101:20230808:194325.800 7f8ce555f000-7f8ce556b000 r--p 0002a000 08:03 27923175 /usr/lib/libmariadb.so.3
      11101:20230808:194325.800 7f8ce556b000-7f8ce5573000 r--p 00035000 08:03 27923175 /usr/lib/libmariadb.so.3
      11101:20230808:194325.800 7f8ce5573000-7f8ce5575000 rw-p 0003d000 08:03 27923175 /usr/lib/libmariadb.so.3
      11101:20230808:194325.800 7f8ce5575000-7f8ce5577000 rw-p 00000000 00:00 0
      11101:20230808:194325.800 7f8ce5577000-7f8ce558b000 r--p 00000000 08:03 12320884 /lib/ld-musl-x86_64.so.1
      11101:20230808:194325.800 7f8ce558b000-7f8ce55d7000 r-xp 00014000 08:03 12320884 /lib/ld-musl-x86_64.so.1
      11101:20230808:194325.800 7f8ce55d7000-7f8ce560d000 r--p 00060000 08:03 12320884 /lib/ld-musl-x86_64.so.1
      11101:20230808:194325.800 7f8ce560d000-7f8ce560e000 r--p 00095000 08:03 12320884 /lib/ld-musl-x86_64.so.1
      11101:20230808:194325.800 7f8ce560e000-7f8ce560f000 rw-p 00096000 08:03 12320884 /lib/ld-musl-x86_64.so.1
      11101:20230808:194325.800 7f8ce560f000-7f8ce5612000 rw-p 00000000 00:00 0
      11101:20230808:194325.800 7ffc25045000-7ffc25093000 rw-p 00000000 00:00 0 [stack]
      11101:20230808:194325.800 7ffc25196000-7ffc2519a000 r--p 00000000 00:00 0 [vvar]
      11101:20230808:194325.800 7ffc2519a000-7ffc2519c000 r-xp 00000000 00:00 0 [vdso]
      11101:20230808:194325.800 ================================
      11101:20230808:194325.800 Please consider attaching a disassembly listing to your bug report.
      11101:20230808:194325.800 This listing can be produced with, e.g., objdump -DSswx zabbix_server.
      11101:20230808:194325.800 ================================
      11057:20230808:194325.801 One child process died (PID:11101,exitcode/signal:1). Exiting ...
      11058:20230808:194325.801 HA manager has been paused
      zabbix_server [11057]: Error waiting for process with PID 11101: [10] No child process
      11058:20230808:194325.821 HA manager has been stopped
      11057:20230808:194325.825 syncing history data...
      11057:20230808:194325.829 syncing history data... 100.000000%
      11057:20230808:194325.829 syncing history data done
      11057:20230808:194325.829 syncing trend data...
      11057:20230808:194326.449 syncing trend data done
      11057:20230808:194326.454 Zabbix Server stopped. Zabbix 6.4.5 (revision {ZABBIX_REVISION}).​

      Comment

      • Andrew Grekhov
        Member
        • Aug 2021
        • 45

        #4
        Есть какие нибудь мысли?
        Code:
        rt_sigprocmask(SIG_SETMASK, ~[KILL STOP RTMIN RT_1 RT_2], NULL, 8) = 0
        rt_sigprocmask(SIG_SETMASK, [HUP INT QUIT USR2 TERM CHLD], NULL, 8) = 0
        rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
        mmap(NULL, 16384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fa9094d2000
        socket(AF_UNIX, SOCK_STREAM, 0) = 13
        connect(13, {sa_family=AF_UNIX, sun_path="/tmp/zabbix_server_haservice.sock"}, 110) = 0
        fcntl(13, F_GETFL) = 0x2 (flags O_RDWR)
        fcntl(13, F_SETFL, O_RDWR|O_NONBLOCK|O_LARGEFILE) = 0
        epoll_create1(EPOLL_CLOEXEC) = 14
        pipe2([15, 16], O_NONBLOCK|O_CLOEXEC) = 0
        eventfd2(0, EFD_CLOEXEC|EFD_NONBLOCK) = 17
        epoll_ctl(14, EPOLL_CTL_ADD, 17, {events=EPOLLIN, data={u32=17, u64=17}}) = 0
        epoll_ctl(14, EPOLL_CTL_ADD, 13, {events=EPOLLIN, data={u32=13, u64=13}}) = 0
        write(13, "\3\0\0\0\0\0\0\0", 8) = 8
        epoll_pwait(14, [{events=EPOLLIN, data={u32=13, u64=13}}], 32, 10000, NULL, 8) = 1
        read(13, "\3\0\0\0\f\0\0\0\3\0\0\0<\0\0\0\0\0\0\0", 4096) = 20
        read(13, 0x7fa9094d2434, 4096) = -1 EAGAIN (Resource temporarily unavailable)
        epoll_ctl(14, EPOLL_CTL_DEL, 13, 0x7ffeb2bc1b5c) = 0
        close(13) = 0
        munmap(0x7fa9094d2000, 16384) = 0
        epoll_ctl(14, EPOLL_CTL_DEL, 17, 0x7ffeb2bc1b4c) = 0
        close(17) = 0
        close(15) = 0
        close(16) = 0
        close(14) = 0
        epoll_pwait(5, [{events=EPOLLIN, data={u32=4, u64=4}}], 32, 1000, NULL, 8) = 1
        accept(4, NULL, NULL) = 13
        mmap(NULL, 16384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fa9094d2000
        fcntl(13, F_GETFL) = 0x2 (flags O_RDWR)
        fcntl(13, F_SETFL, O_RDWR|O_NONBLOCK|O_LARGEFILE) = 0
        epoll_ctl(5, EPOLL_CTL_ADD, 13, {events=EPOLLIN, data={u32=13, u64=13}}) = 0
        wait4(-1, 0x7ffeb2bc1f24, WNOHANG, NULL) = 0
        epoll_pwait(5, [{events=EPOLLIN, data={u32=4, u64=4}}, {events=EPOLLIN, data={u32=13, u64=13}}], 32, 1000, NULL, 8) = 2
        accept(4, NULL, NULL) = 14
        fcntl(14, F_GETFL) = 0x2 (flags O_RDWR)
        fcntl(14, F_SETFL, O_RDWR|O_NONBLOCK|O_LARGEFILE) = 0
        epoll_ctl(5, EPOLL_CTL_ADD, 14, {events=EPOLLIN, data={u32=14, u64=14}}) = 0
        read(13, "d\0\0\0\21\0\0\0\16\1\0\0\0\2\0\0\0\3\0\0\0\r\0\0 \0", 4096) = 25
        read(13, 0x7fa9094d2444, 4096) = -1 EAGAIN (Resource temporarily unavailable)
        wait4(-1, 0x7ffeb2bc1f24, WNOHANG, NULL) = 0
        epoll_pwait(5, [{events=EPOLLIN, data={u32=4, u64=4}}, {events=EPOLLIN, data={u32=14, u64=14}}], 32, 1000, NULL, 8) = 2
        accept(4, NULL, NULL) = 15
        fcntl(15, F_GETFL) = 0x2 (flags O_RDWR)
        fcntl(15, F_SETFL, O_RDWR|O_NONBLOCK|O_LARGEFILE) = 0
        epoll_ctl(5, EPOLL_CTL_ADD, 15, {events=EPOLLIN, data={u32=15, u64=15}}) = 0
        read(14, "d\0\0\0\r\0\0\0\v\1\0\0\0\1\0\0\0\t\0\0\0", 4096) = 21
        read(14, 0x7fa9094d3984, 4096) = -1 EAGAIN (Resource temporarily unavailable)
        wait4(-1, 0x7ffeb2bc1f24, WNOHANG, NULL) = 0
        epoll_pwait(5, [{events=EPOLLIN, data={u32=4, u64=4}}, {events=EPOLLIN, data={u32=15, u64=15}}], 32, 1000, NULL, 8) = 2
        accept(4, NULL, NULL) = 16
        mmap(NULL, 16384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fa9094ce000
        fcntl(16, F_GETFL) = 0x2 (flags O_RDWR)
        fcntl(16, F_SETFL, O_RDWR|O_NONBLOCK|O_LARGEFILE) = 0
        epoll_ctl(5, EPOLL_CTL_ADD, 16, {events=EPOLLIN, data={u32=16, u64=16}}) = 0
        read(15, "d\0\0\0\r\0\0\0\v\4\0\0\0\1\0\0\0\t\0\0\0", 4096) = 21
        read(15, 0x7fa9094d4ec4, 4096) = -1 EAGAIN (Resource temporarily unavailable)
        wait4(-1, 0x7ffeb2bc1f24, WNOHANG, NULL) = 0
        epoll_pwait(5, [{events=EPOLLIN, data={u32=4, u64=4}}, {events=EPOLLIN, data={u32=16, u64=16}}], 32, 1000, NULL, 8) = 2
        accept(4, NULL, NULL) = 17
        fcntl(17, F_GETFL) = 0x2 (flags O_RDWR)
        fcntl(17, F_SETFL, O_RDWR|O_NONBLOCK|O_LARGEFILE) = 0
        epoll_ctl(5, EPOLL_CTL_ADD, 17, {events=EPOLLIN, data={u32=17, u64=17}}) = 0
        read(16, "d\0\0\0\r\0\0\0\v\2\0\0\0\1\0\0\0\t\0\0\0", 4096) = 21
        read(16, 0x7fa9094ce454, 4096) = -1 EAGAIN (Resource temporarily unavailable)
        ​
        Много повторов:
        read(15, 0x7fa9094d4ec4, 4096) = -1 EAGAIN (Resource temporarily unavailable)
        потом всё kill

        Comment

        • Kos
          Senior Member
          Zabbix Certified SpecialistZabbix Certified Professional
          • Aug 2015
          • 3404

          #5
          Увы, я пока могу увидеть немного
          Упал по SIGSEGV процесс 11101, это один из поллеров (poller #5).
          Поллеры занимаются опросом данных (обычные проверки агентов в пассивном режиме, опрос по SNMP, внутренние проверки); видимо, во время одной из таких проверок и произошёл сбой.
          Затем родительский процесс обнаружил неплановое отсутствие одного из дочерних процессов и остановил все остальные процессы сервера Zabbix - настолько корректно, насколько это возможно.
          Увы, самого интересного (stack trace) в этом дампе нет:
          backtrace is not available for this platform
          Возможно, имеет смысл открыть баг-репорт на support.zabbix.com.
          Если падает вскоре после старта, то можно попытаться повысить уровень логирования для процессов "поллер", выдав сразу же после старта команду:
          Code:
          zabbix_server -R log_level_increase=poller​
          Полученный лог приложить к баг-репорту - возможно, там будет какая-то более полезная информация.

          Comment

          • Andrew Grekhov
            Member
            • Aug 2021
            • 45

            #6
            Сейчас в направлении кластера копаю. Если его включить, то повляется ругань в System information
            ​High availability cluster Enabled Fail-over delay: 1 minute
            Что как раз похоже на время жизни сервера.

            UPD: zabbix_server -R ha_set_failover_delay=5m не влияет
            Сервер падает через 5-50секунд после старта
            Last edited by Andrew Grekhov; 09-08-2023, 10:46.

            Comment

            • Andrew Grekhov
              Member
              • Aug 2021
              • 45

              #7
              Ничего не понимаю. Отключил почти все хосты через веб интерфейс - сервер падать перестал!
              Как?
              Сейчас включаю потихоньку. Включил все SNMP - пока живёт.

              Comment

              • Andrew Grekhov
                Member
                • Aug 2021
                • 45

                #8
                Ура. Нашёл проблемный хост, после включения которого zabbix-server падает.
                Завтра уже буду детально разбираться.

                Comment

                • Andrew Grekhov
                  Member
                  • Aug 2021
                  • 45

                  #9
                  Конкретизировал проблему.
                  Проблема в шаблоне "Apache by HTTP" Apache: Get status
                  Вызов ключа "apache.get_status" гарантированно ложит сервер.(По кнопочке Test тоже работает.)
                  IMHO это проблема с zabbix 6.2, ибо у меня он не запустился, и я сразу обновился до 6.4.5.
                  мониторится хост с FC35, apache 2.4.54
                  ------------
                  2 Kos и Hamardaban,
                  поможите баг в zabbix.com оформить?
                  Вендру своей OC я сам напишу.

                  Comment

                  • Hamardaban
                    Senior Member
                    Zabbix Certified SpecialistZabbix Certified Professional
                    • May 2019
                    • 2713

                    #10
                    Насколько понимаю "Get status" делает запрос к страничке /status на веб сервере используя библиотеку curl... Скорее всего по протоколу httpS. libcrypto дурит? а может libnghttp2 ? .
                    Попробуйте изменить настройки апача чтоб статус отдавался по чистому http и посмотрите будут ли падения?

                    Comment

                    • Kos
                      Senior Member
                      Zabbix Certified SpecialistZabbix Certified Professional
                      • Aug 2015
                      • 3404

                      #11
                      Originally posted by Andrew Grekhov
                      поможите баг в zabbix.com оформить?
                      Там особых проблем нет - надо только зарегистрироваться (но это бесплатно) и писать по-английски. Там обычная Jira, создаётся тикет в проекте ZBX (это для баг-репортов, есть ещё общедоступный ZBXNEXT - это для enhancement request-ов, т.е. запросов на новый функционал). Вроде бы ничего сложного, если возникнут какие-то более конкретные вопросы - обращайтесь

                      Comment

                      • Andrew Grekhov
                        Member
                        • Aug 2021
                        • 45

                        #12
                        2 Hamardaban​,
                        похоже ваши подозрения подтверждаются.
                        После переключения на http падения zabbix-servera повторить не удалось.

                        Comment

                        Working...