v2.2.3: Got signal [signal:11(SIGSEGV),reason:1,refaddr:(nil)]. Crashing ...

[rick-pri]

Hi there,

Since updating out Zabbix servers to 2.2.3 from 2.0.3 our child node is now crashing with the error in the title.

Truncating the node_cksum table only provides a about 12 hours of respite before the zabbix server process crashes again.

I've tried to follow some google threads already but no luck there including https://support.zabbix.com/browse/ZBX-7757

Not sure what's up with the objdump as it just returns an error of no such file for me. The workaround in the thread isn't applicable to us.

I'm a bit stuck as to how to continue and help would be much appreciated.

[rick-pri]

Just adding more of the log here:

28324:20140425:111444.165 server #0 started [main process]
 28366:20140425:111444.165 server #27 started [self-monitoring #1]
 28342:20140425:111444.213 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit ite
ms in 0.068862 sec, idle 1 hour(s)]
 28348:20140425:111448.906 NODE 2: sending configuration changes to master node 1 for node 2 datalen 5195936
 28354:20140425:111457.120 Got signal [signal:11(SIGSEGV),reason:1,refaddr:(nil)]. Crashing ...
 28354:20140425:111457.120 ====== Fatal information: ======
 28354:20140425:111457.121 Program counter: 0x7f1f59bbc616
 28354:20140425:111457.121 === Registers: ===
 28354:20140425:111457.121 r8      =                1 =                    1 =                    1
 28354:20140425:111457.121 r9      =                1 =                    1 =                    1
 28354:20140425:111457.121 r10     = 5d66313833376332 =  6730120810598982450 =  6730120810598982450
 28354:20140425:111457.121 r11     =              206 =                  518 =                  518
 28354:20140425:111457.121 r12     =         ffffffff =           4294967295 =           4294967295
 28354:20140425:111457.122 r13     =     7fff09eefc30 =      140733360045104 =      140733360045104
 28354:20140425:111457.122 r14     =          201735d =             33649501 =             33649501
 28354:20140425:111457.122 r15     =     7fff09eefaa0 =      140733360044704 =      140733360044704
 28354:20140425:111457.122 rdi     =                0 =                    0 =                    0
 28354:20140425:111457.122 rsi     =          2018c70 =             33655920 =             33655920
 28354:20140425:111457.122 rbp     =         5358829a =           1398309530 =           1398309530
 28354:20140425:111457.122 rbx     =     7fff09eefbb0 =      140733360044976 =      140733360044976
 28354:20140425:111457.123 rdx     =           4a928a =              4887178 =              4887178
 28354:20140425:111457.123 rax     =                0 =                    0 =                    0
 28354:20140425:111457.123 rcx     =               30 =                   48 =                   48
 28354:20140425:111457.123 rsp     =     7fff09eefa28 =      140733360044584 =      140733360044584
 28354:20140425:111457.123 rip     =     7f1f59bbc616 =      139772626191894 =      139772626191894
 28354:20140425:111457.123 efl     =            10283 =                66179 =                66179
 28354:20140425:111457.123 csgsfs  =             e033 =                57395 =                57395
 28354:20140425:111457.123 err     =                4 =                    4 =                    4
 28354:20140425:111457.124 trapno  =                e =                   14 =                   14
 28354:20140425:111457.124 oldmask =                0 =                    0 =                    0
 28354:20140425:111457.124 cr2     =                0 =                    0 =                    0
 28354:20140425:111457.124 === Backtrace: ===
 28354:20140425:111457.146 12: /usr/local/sbin/zabbix_server: history syncer #4 [synced 0 items in 0.000057 sec, sy
ncing history](print_fatal_info+0xae) [0x45108e]
 28354:20140425:111457.146 11: /usr/local/sbin/zabbix_server: history syncer #4 [synced 0 items in 0.000057 sec, sy
ncing history]() [0x4514b1]
 28354:20140425:111457.146 10: /lib/x86_64-linux-gnu/libc.so.6(+0x364a0) [0x7f1f59b6b4a0]
 28354:20140425:111457.147 9: /lib/x86_64-linux-gnu/libc.so.6(+0x87616) [0x7f1f59bbc616]
 28354:20140425:111457.147 8: /usr/local/sbin/zabbix_server: history syncer #4 [synced 0 items in 0.000057 sec, syn
cing history](evaluate_function+0x28c6) [0x466636]
 28354:20140425:111457.147 7: /usr/local/sbin/zabbix_server: history syncer #4 [synced 0 items in 0.000057 sec, syn
cing history]() [0x4671e0]
 28354:20140425:111457.147 6: /usr/local/sbin/zabbix_server: history syncer #4 [synced 0 items in 0.000057 sec, syn
cing history](evaluate_expressions+0x756) [0x46e916]
 28354:20140425:111457.147 5: /usr/local/sbin/zabbix_server: history syncer #4 [synced 0 items in 0.000057 sec, syn
cing history](DCsync_history+0x26ab) [0x43b43b]
 28354:20140425:111457.147 4: /usr/local/sbin/zabbix_server: history syncer #4 [synced 0 items in 0.000057 sec, syncing history](main_dbsyncer_loop+0x1fd) [0x41584d]
 28354:20140425:111457.147 3: /usr/local/sbin/zabbix_server: history syncer #4 [synced 0 items in 0.000057 sec, syncing history](MAIN_ZABBIX_ENTRY+0x774) [0x414c34]
 28354:20140425:111457.147 2: /usr/local/sbin/zabbix_server: history syncer #4 [synced 0 items in 0.000057 sec, syncing history](daemon_start+0x1b2) [0x450942]
 28354:20140425:111457.148 1: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xed) [0x7f1f59b5676d]
 28354:20140425:111457.148 0: /usr/local/sbin/zabbix_server: history syncer #4 [synced 0 items in 0.000057 sec, syncing history]() [0x40ffb9]
 28354:20140425:111457.148 === Memory map: ===
 28354:20140425:111457.148 00400000-00532000 r-xp 00000000 ca:01 8781                               /usr/local/sbin/zabbix_server
 28354:20140425:111457.148 00731000-00732000 r--p 00131000 ca:01 8781                               /usr/local/sbin/zabbix_server
 28354:20140425:111457.148 00732000-00736000 rw-p 00132000 ca:01 8781                               /usr/local/sbin/zabbix_server
 28354:20140425:111457.148 00736000-0073c000 rw-p 00000000 00:00 0
 28354:20140425:111457.149 01fd2000-01ff3000 rw-p 00000000 00:00 0                                  [heap]
28354:20140425:111457.149 02020000-0203f000 rw-p 00000000 00:00 0                                  [heap]
 28354:20140425:111457.149 7f1f4c000000-7f1f4c021000 rw-p 00000000 00:00 0
 28354:20140425:111457.149 7f1f4c021000-7f1f50000000 ---p 00000000 00:00 0
 28354:20140425:111457.149 7f1f51d5e000-7f1f51d73000 r-xp 00000000 ca:01 608378                     /lib/x86_64-linux-gnu/libgcc_s.so.1
 28354:20140425:111457.149 7f1f51d73000-7f1f51f72000 ---p 00015000 ca:01 608378                     /lib/x86_64-linux-gnu/libgcc_s.so.1
 28354:20140425:111457.150 7f1f51f72000-7f1f51f73000 r--p 00014000 ca:01 608378                     /lib/x86_64-linux-gnu/libgcc_s.so.1
 28354:20140425:111457.150 7f1f51f73000-7f1f51f74000 rw-p 00015000 ca:01 608378                     /lib/x86_64-linux-gnu/libgcc_s.so.1
 28354:20140425:111457.150 7f1f51f7b000-7f1f51f7c000 ---p 00000000 00:00 0
 28354:20140425:111457.150 7f1f51f7c000-7f1f5277c000 rw-p 00000000 00:00 0
 28354:20140425:111457.150 7f1f5277c000-7f1f52f7c000 rw-s 00000000 00:04 2293766                    /SYSV7601215e (deleted)
 28354:20140425:111457.150 7f1f52f7c000-7f1f53649000 rw-s 00000000 00:04 2195459                    /SYSV6701215e (deleted)
 28354:20140425:111457.150 7f1f53649000-7f1f53a49000 rw-s 00000000 00:04 2162690                    /SYSV7401215e (deleted)
 28354:20140425:111457.151 7f1f53a49000-7f1f54a49000 rw-s 00000000 00:04 2129921                    /SYSV7801215e (deleted)
 28354:20140425:111457.151 7f1f54a49000-7f1f55249000 rw-s 00000000 00:04 2097152                    /SYSV6801215e (deleted)
 28354:20140425:111457.151 7f1f55249000-7f1f55255000 r-xp 00000000 ca:01 1925151                    /lib/x86_64-linux-gnu/libnss_files-2.15.so
 28354:20140425:111457.151 7f1f55255000-7f1f55454000 ---p 0000c000 ca:01 1925151                    /lib/x86_64-linux-gnu/libnss_files-2.15.so
 28354:20140425:111457.151 7f1f55454000-7f1f55455000 r--p 0000b000 ca:01 1925151                    /lib/x86_64-linux-gnu/libnss_files-2.15.so
 28354:20140425:111457.151 7f1f55455000-7f1f55456000 rw-p 0000c000 ca:01 1925151                    /lib/x86_64-linux-gnu/libnss_files-2.15.so
 28354:20140425:111457.151 7f1f55456000-7f1f55460000 r-xp 00000000 ca:01 1925155                    /lib/x86_64-linux-gnu/libnss_nis-2.15.so
 28354:20140425:111457.151 7f1f55460000-7f1f55660000 ---p 0000a000 ca:01 1925155                    /lib/x86_64-linux-gnu/libnss_nis-2.15.so
 28354:20140425:111457.152 7f1f55660000-7f1f55661000 r--p 0000a000 ca:01 1925155                    /lib/x86_64-linux-gnu/libnss_nis-2.15.so
 28354:20140425:111457.152 7f1f55661000-7f1f55662000 rw-p 0000b000 ca:01 1925155                    /lib/x86_64-linux-gnu/libnss_nis-2.15.so
 28354:20140425:111457.152 7f1f55662000-7f1f55679000 r-xp 00000000 ca:01 1925167                    /lib/x86_64-linux-gnu/libnsl-2.15.so
 28354:20140425:111457.152 7f1f55679000-7f1f55878000 ---p 00017000 ca:01 1925167                    /lib/x86_64-linux-gnu/libnsl-2.15.so
 28354:20140425:111457.152 7f1f55878000-7f1f55879000 r--p 00016000 ca:01 1925167                    /lib/x86_64-linux-gnu/libnsl-2.15.so
 28354:20140425:111457.152 7f1f55879000-7f1f5587a000 rw-p 00017000 ca:01 1925167                    /lib/x86_64-linux-gnu/libnsl-2.15.so
 28354:20140425:111457.152 7f1f5587a000-7f1f5587c000 rw-p 00000000 00:00 0
 28354:20140425:111457.153 7f1f5587c000-7f1f55884000 r-xp 00000000 ca:01 1925149                    /lib/x86_64-linux-gnu/libnss_compat-2.15.so
 28354:20140425:111457.153 7f1f55884000-7f1f55a83000 ---p 00008000 ca:01 1925149                    /lib/x86_64-linux-gnu/libnss_compat-2.15.so
 28354:20140425:111457.153 7f1f55a83000-7f1f55a84000 r--p 00007000 ca:01 1925149                    /lib/x86_64-linux-gnu/libnss_compat-2.15.so
 28354:20140425:111457.153 7f1f55a84000-7f1f55a85000 rw-p 00008000 ca:01 1925149                    /lib/x86_64-linux-gnu/libnss_compat-2.15.so
 28354:20140425:111457.153 7f1f55a85000-7f1f55a8e000 r-xp 00000000 ca:01 1925148                    /lib/x86_64-linux-gnu/libcrypt-2.15.so
 28354:20140425:111457.153 7f1f55a8e000-7f1f55c8e000 ---p 00009000 ca:01 1925148                    /lib/x86_64-linux-gnu/libcrypt-2.15.so
 28354:20140425:111457.153 7f1f55c8e000-7f1f55c8f000 r--p 00009000 ca:01 1925148                    /lib/x86_64-linux-gnu/libcrypt-2.15.so
 28354:20140425:111457.153 7f1f55c8f000-7f1f55c90000 rw-p 0000a000 ca:01 1925148                    /lib/x86_64-linux-gnu/libcrypt-2.15.so
 28354:20140425:111457.154 7f1f55c90000-7f1f55cbe000 rw-p 00000000 00:00 0
 28354:20140425:111457.154 7f1f55cbe000-7f1f55d5c000 r-xp 00000000 ca:01 590367                     /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6
 28354:20140425:111457.154 7f1f55d5c000-7f1f55f5c000 ---p 0009e000 ca:01 590367                     /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6
 28354:20140425:111457.154 7f1f55f5c000-7f1f55f5e000 r--p 0009e000 ca:01 590367                     /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6
 28354:20140425:111457.154 7f1f55f5e000-7f1f55f60000 rw-p 000a0000 ca:01 590367                     /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6
 28354:20140425:111457.154 7f1f55f60000-7f1f55f61000 rw-p 00000000 00:00 0
 28354:20140425:111457.154 7f1f55f61000-7f1f55fa6000 r-xp 00000000 ca:01 591515                     /usr/lib/x86_64-linux-gnu/libhx509.so.5.0.0
 28354:20140425:111457.155 7f1f55fa6000-7f1f561a6000 ---p 00045000 ca:01 591515                     /usr/lib/x86_64-linux-gnu/libhx509.so.5.0.0
 28354:20140425:111457.155 7f1f561a6000-7f1f561a8000 r--p 00045000 ca:01 591515                     /usr/lib/x86_64-linux-gnu/libhx509.so.5.0.0
 28354:20140425:111457.155 7f1f561a8000-7f1f561aa000 rw-p 00047000 ca:01 591515                     /usr/lib/x86_64-linux-gnu/libhx509.so.5.0.0
 28354:20140425:111457.155 7f1f561aa000-7f1f561ab000 rw-p 00000000 00:00 0
 28354:20140425:111457.155 7f1f561ab000-7f1f561b9000 r-xp 00000000 ca:01 590661                     /usr/lib/x86_64-linux-gnu/libheimbase.so.1.0.0
 28354:20140425:111457.155 7f1f561b9000-7f1f563b8000 ---p 0000e000 ca:01 590661                     /usr/lib/x86_64-linux-gnu/libheimbase.so.1.0.0
 28354:20140425:111457.155 7f1f563b8000-7f1f563b9000 r--p 0000d000 ca:01 590661                     /usr/lib/x86_64-linux-gnu/libheimbase.so.1.0.0
 28354:20140425:111457.155 7f1f563b9000-7f1f563ba000 rw-p 0000e000 ca:01 590661                     /usr/lib/x86_64-linux-gnu/libheimbase.so.1.0.0
 28354:20140425:111457.156 7f1f563ba000-7f1f563e2000 r-xp 00000000 ca:01 591497                     /usr/lib/x86_64-linux-gnu/libwind.so.0.0.0
 28354:20140425:111457.156 7f1f563e2000-7f1f565e1000 ---p 00028000 ca:01 591497                     /usr/lib/x86_64-linux-gnu/libwind.so.0.0.0
 28354:20140425:111457.156 7f1f565e1000-7f1f565e2000 r--p 00027000 ca:01 591497                     /usr/lib/x86_64-linux-gnu/libwind.so.0.0.0
 28354:20140425:111457.156 7f1f565e2000-7f1f565e3000 rw-p 00028000 ca:01 591497                     /usr/lib/x86_64-linux-gnu/libwind.so.0.0.0
 28354:20140425:111457.156 7f1f565e3000-7f1f565e6000 r-xp 00000000 ca:01 608383                     /lib/x86_64-linux-gnu/libkeyutils.so.1.4
 28354:20140425:111457.156 7f1f565e6000-7f1f567e5000 ---p 00003000 ca:01 608383                     /lib/x86_64-linux-gnu/libkeyutils.so.1.4
 28354:20140425:111457.156 7f1f567e5000-7f1f567e6000 r--p 00002000 ca:01 608383                     /lib/x86_64-linux-gnu/libkeyutils.so.1.4
 28354:20140425:111457.157 7f1f567e6000-7f1f567e7000 rw-p 00003000 ca:01 608383                     /lib/x86_64-linux-gnu/libkeyutils.so.1.4
 28354:20140425:111457.157 7f1f567e7000-7f1f567fb000 r-xp 00000000 ca:01 589939                     /usr/lib/x86_64-linux-gnu/libroken.so.18.1.0
 28354:20140425:111457.157 7f1f567fb000-7f1f569fa000 ---p 00014000 ca:01 589939                     /usr/lib/x86_64-linux-gnu/libroken.so.18.1.0
 28354:20140425:111457.157 7f1f569fa000-7f1f569fb000 r--p 00013000 ca:01 589939                     /usr/lib/x86_64-linux-gnu/libroken.so.18.1.0
 28354:20140425:111457.157 7f1f569fb000-7f1f569fc000 rw-p 00014000 ca:01 589939                     /usr/lib/x86_64-linux-gnu/libroken.so.18.1.0
 28354:20140425:111457.157 7f1f569fc000-7f1f56a2d000 r-xp 00000000 ca:01 590558                     /usr/lib/x86_64-linux-gnu/libhcrypto.so.4.1.0
 28354:20140425:111457.157 7f1f56a2d000-7f1f56c2d000 ---p 00031000 ca:01 590558                     /usr/lib/x86_64-linux-gnu/libhcrypto.so.4.1.0
 28354:20140425:111457.158 7f1f56c2d000-7f1f56c2e000 r--p 00031000 ca:01 590558                     /usr/lib/x86_64-linux-gnu/libhcrypto.so.4.1.0
 28354:20140425:111457.158 7f1f56c2e000-7f1f56c2f000 rw-p 00032000 ca:01 590558                     /usr/lib/x86_64-linux-gnu/libhcrypto.so.4.1.0
 28354:20140425:111457.158 7f1f56c2f000-7f1f56c30000 rw-p 00000000 00:00 0
 28354:20140425:111457.158 7f1f56c30000-7f1f56ccb000 r-xp 00000000 ca:01 590348                     /usr/lib/x86_64-linux-gnu/libasn1.so.8.0.0
 28354:20140425:111457.158 7f1f56ccb000-7f1f56eca000 ---p 0009b000 ca:01 590348                     /usr/lib/x86_64-linux-gnu/libasn1.so.8.0.0
 28354:20140425:111457.158 7f1f56eca000-7f1f56ecc000 r--p 0009a000 ca:01 590348                     /usr/lib/x86_64-linux-gnu/libasn1.so.8.0.0
 28354:20140425:111457.158 7f1f56ecc000-7f1f56ed0000 rw-p 0009c000 ca:01 590348                     /usr/lib/x86_64-linux-gnu/libasn1.so.8.0.0
 28354:20140425:111457.158 7f1f56ed0000-7f1f56f50000 r-xp 00000000 ca:01 591675                     /usr/lib/x86_64-linux-gnu/libkrb5.so.26.0.0
 28354:20140425:111457.159 7f1f56f50000-7f1f57150000 ---p 00080000 ca:01 591675                     /usr/lib/x86_64-linux-gnu/libkrb5.so.26.0.0
 28354:20140425:111457.159 7f1f57150000-7f1f57152000 r--p 00080000 ca:01 591675                     /usr/lib/x86_64-linux-gnu/libkrb5.so.26.0.0
 28354:20140425:111457.159 7f1f57152000-7f1f57156000 rw-p 00082000 ca:01 591675                     /usr/lib/x86_64-linux-gnu/libkrb5.so.26.0.0
 28354:20140425:111457.159 7f1f57156000-7f1f5715c000 r-xp 00000000 ca:01 591679                     /usr/lib/x86_64-linux-gnu/libheimntlm.so.0.1.0
 28354:20140425:111457.159 7f1f5715c000-7f1f5735b000 ---p 00006000 ca:01 591679                     /usr/lib/x86_64-linux-gnu/libheimntlm.so.0.1.0
 28354:20140425:111457.159 7f1f5735b000-7f1f5735c000 r--p 00005000 ca:01 591679                     /usr/lib/x86_64-linux-gnu/libheimntlm.so.0.1.0
 28354:20140425:111457.159 7f1f5735c000-7f1f5735d000 rw-p 00006000 ca:01 591679                     /usr/lib/x86_64-linux-gnu/libheimntlm.so.0.1.0
 28354:20140425:111457.160 7f1f5735d000-7f1f57360000 r-xp 00000000 ca:01 608381                     /lib/x86_64-linux-gnu/libgpg-error.so.0.8.0
 28354:20140425:111457.160 7f1f57360000-7f1f5755f000 ---p 00003000 ca:01 608381                     /lib/x86_64-linux-gnu/libgpg-error.so.0.8.0
 28354:20140425:111457.160 7f1f5755f000-7f1f57560000 r--p 00002000 ca:01 608381                     /lib/x86_64-linux-gnu/libgpg-error.so.0.8.0
 28354:20140425:111457.160 7f1f57560000-7f1f57561000 rw-p 00003000 ca:01 608381                     /lib/x86_64-linux-gnu/libgpg-error.so.0.8.0
 28354:20140425:111457.160 7f1f57561000-7f1f57572000 r-xp 00000000 ca:01 592029                     /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.0.0
 28354:20140425:111457.160 7f1f57572000-7f1f57771000 ---p 00011000 ca:01 592029                     /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.0.0
 28354:20140425:111457.160 7f1f57771000-7f1f57772000 r--p 00010000 ca:01 592029                     /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.0.0
 28354:20140425:111457.160 7f1f57772000-7f1f57773000 rw-p 00011000 ca:01 592029                     /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.0.0
 28354:20140425:111457.161 7f1f57773000-7f1f57783000 r-xp 00000000 ca:01 590793                     /usr/lib/x86_64-linux-gnu/libtasn1.so.3.1.12
 28354:20140425:111457.161 7f1f57783000-7f1f57982000 ---p 00010000 ca:01 590793                     /usr/lib/x86_64-linux-gnu/libtasn1.so.3.1.12
 28354:20140425:111457.161 7f1f57982000-7f1f57983000 r--p 0000f000 ca:01 590793                     /usr/lib/x86_64-linux-gnu/libtasn1.so.3.1.12
 28354:20140425:111457.161 7f1f57983000-7f1f57984000 rw-p 00010000 ca:01 590793                     /usr/lib/x86_64-linux-gnu/libtasn1.so.3.1.12
 28354:20140425:111457.161 7f1f57984000-7f1f5798b000 r-xp 00000000 ca:01 590947                     /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1
 28354:20140425:111457.161 7f1f5798b000-7f1f57b8a000 ---p 00007000 ca:01 590947                     /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1
 28354:20140425:111457.161 7f1f57b8a000-7f1f57b8b000 r--p 00006000 ca:01 590947                     /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1
 28354:20140425:111457.161 7f1f57b8b000-7f1f57b8c000 rw-p 00007000 ca:01 590947                     /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1
 28354:20140425:111457.162 7f1f57b8c000-7f1f57b8f000 r-xp 00000000 ca:01 608370                     /lib/x86_64-linux-gnu/libcom_err.so.2.1
 28354:20140425:111457.162 7f1f57b8f000-7f1f57d8e000 ---p 00003000 ca:01 608370                     /lib/x86_64-linux-gnu/libcom_err.so.2.1
 28354:20140425:111457.162 7f1f57d8e000-7f1f57d8f000 r--p 00002000 ca:01 608370                     /lib/x86_64-linux-gnu/libcom_err.so.2.1
 28354:20140425:111457.162 7f1f57d8f000-7f1f57d90000 rw-p 00003000 ca:01 608370                     /lib/x86_64-linux-gnu/libcom_err.so.2.1
 28354:20140425:111457.162 7f1f57d90000-7f1f57db5000 r-xp 00000000 ca:01 590940                     /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1
 28354:20140425:111457.162 7f1f57db5000-7f1f57fb5000 ---p 00025000 ca:01 590940                     /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1
 28354:20140425:111457.162 7f1f57fb5000-7f1f57fb6000 r--p 00025000 ca:01 590940                     /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1
 28354:20140425:111457.162 7f1f57fb6000-7f1f57fb7000 rw-p 00026000 ca:01 590940                     /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1
 28354:20140425:111457.162 7f1f57fb7000-7f1f57fb8000 rw-p 00000000 00:00 0
 28354:20140425:111457.162 7f1f57fb8000-7f1f5807c000 r-xp 00000000 ca:01 590945                     /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3
 28354:20140425:111457.162 7f1f5807c000-7f1f5827b000 ---p 000c4000 ca:01 590945                     /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3
 28354:20140425:111457.162 7f1f5827b000-7f1f58285000 r--p 000c3000 ca:01 590945                     /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3
 28354:20140425:111457.162 7f1f58285000-7f1f58286000 rw-p 000cd000 ca:01 590945                     /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3
 28354:20140425:111457.162 7f1f58286000-7f1f582c0000 r-xp 00000000 ca:01 591681                     /usr/lib/x86_64-linux-gnu/libgssapi.so.3.0.0
 28354:20140425:111457.162 7f1f582c0000-7f1f584c0000 ---p 0003a000 ca:01 591681                     /usr/lib/x86_64-linux-gnu/libgssapi.so.3.0.0
 28354:20140425:111457.162 7f1f584c0000-7f1f584c1000 r--p 0003a000 ca:01 591681                     /usr/lib/x86_64-linux-gnu/libgssapi.so.3.0.0
 28354:20140425:111457.162 7f1f584c1000-7f1f584c4000 rw-p 0003b000 ca:01 591681                     /usr/lib/x86_64-linux-gnu/libgssapi.so.3.0.0
 28354:20140425:111457.162 7f1f584c4000-7f1f584de000 r-xp 00000000 ca:01 590950                     /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25
 28354:20140425:111457.162 7f1f584de000-7f1f586dd000 ---p 0001a000 ca:01 590950                     /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25
 28354:20140425:111457.162 7f1f586dd000-7f1f586de000 r--p 00019000 ca:01 590950                     /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25
 28354:20140425:111457.162 7f1f586de000-7f1f586df000 rw-p 0001a000 ca:01 590950                     /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25
 28354:20140425:111457.163 7f1f586df000-7f1f586f7000 r-xp 00000000 ca:01 592038                     /usr/lib/x86_64-linux-gnu/librtmp.so.0
 28354:20140425:111457.163 7f1f586f7000-7f1f588f7000 ---p 00018000 ca:01 592038                     /usr/lib/x86_64-linux-gnu/librtmp.so.0
 28354:20140425:111457.163 7f1f588f7000-7f1f588f8000 r--p 00018000 ca:01 592038                     /usr/lib/x86_64-linux-gnu/librtmp.so.0
 28354:20140425:111457.163 7f1f588f8000-7f1f588f9000 rw-p 00019000 ca:01 592038                     /usr/lib/x86_64-linux-gnu/librtmp.so.0
 28354:20140425:111457.163 7f1f588f9000-7f1f58973000 r-xp 00000000 ca:01 1925128                    /lib/x86_64-linux-gnu/libgcrypt.so.11.7.0
 28354:20140425:111457.163 7f1f58973000-7f1f58b73000 ---p 0007a000 ca:01 1925128                    /lib/x86_64-linux-gnu/libgcrypt.so.11.7.0
 28354:20140425:111457.163 7f1f58b73000-7f1f58b74000 r--p 0007a000 ca:01 1925128                    /lib/x86_64-linux-gnu/libgcrypt.so.11.7.0
 28354:20140425:111457.163 7f1f58b74000-7f1f58b77000 rw-p 0007b000 ca:01 1925128                    /lib/x86_64-linux-gnu/libgcrypt.so.11.7.0
 28354:20140425:111457.163 7f1f58b77000-7f1f58c2b000 r-xp 00000000 ca:01 590142                     /usr/lib/x86_64-linux-gnu/libgnutls.so.26.21.8
 28354:20140425:111457.163 7f1f58c2b000-7f1f58e2b000 ---p 000b4000 ca:01 590142                     /usr/lib/x86_64-linux-gnu/libgnutls.so.26.21.8
 28354:20140425:111457.163 7f1f58e2b000-7f1f58e31000 r--p 000b4000 ca:01 590142                     /usr/lib/x86_64-linux-gnu/libgnutls.so.26.21.8
 28354:20140425:111457.163 7f1f58e31000-7f1f58e32000 rw-p 000ba000 ca:01 590142                     /usr/lib/x86_64-linux-gnu/libgnutls.so.26.21.8
 28354:20140425:111457.163 7f1f58e32000-7f1f58e33000 rw-p 00000000 00:00 0
 28354:20140425:111457.163 7f1f58e33000-7f1f58e6e000 r-xp 00000000 ca:01 590943                     /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2
 28354:20140425:111457.163 7f1f58e6e000-7f1f5906e000 ---p 0003b000 ca:01 590943                     /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2
 28354:20140425:111457.163 7f1f5906e000-7f1f5906f000 r--p 0003b000 ca:01 590943                     /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2
 28354:20140425:111457.163 7f1f5906f000-7f1f59071000 rw-p 0003c000 ca:01 590943                     /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2
 28354:20140425:111457.163 7f1f59071000-7f1f590bc000 r-xp 00000000 ca:01 591090                     /usr/lib/x86_64-linux-gnu/libldap_r-2.4.so.2.8.1
 28354:20140425:111457.163 7f1f590bc000-7f1f592bb000 ---p 0004b000 ca:01 591090                     /usr/lib/x86_64-linux-gnu/libldap_r-2.4.so.2.8.1
 28354:20140425:111457.163 7f1f592bb000-7f1f592bd000 r--p 0004a000 ca:01 591090                     /usr/lib/x86_64-linux-gnu/libldap_r-2.4.so.2.8.1
 28354:20140425:111457.164 7f1f592bd000-7f1f592be000 rw-p 0004c000 ca:01 591090                     /usr/lib/x86_64-linux-gnu/libldap_r-2.4.so.2.8.1
 28354:20140425:111457.164 7f1f592be000-7f1f592c0000 rw-p 00000000 00:00 0
 28354:20140425:111457.164 7f1f592c0000-7f1f592cd000 r-xp 00000000 ca:01 591092                     /usr/lib/x86_64-linux-gnu/liblber-2.4.so.2.8.1
 28354:20140425:111457.164 7f1f592cd000-7f1f594cc000 ---p 0000d000 ca:01 591092                     /usr/lib/x86_64-linux-gnu/liblber-2.4.so.2.8.1
 28354:20140425:111457.164 7f1f594cc000-7f1f594cd000 r--p 0000c000 ca:01 591092                     /usr/lib/x86_64
-linux-gnu/liblber-2.4.so.2.8.1
 28354:20140425:111457.164 7f1f594cd000-7f1f594ce000 rw-p 0000d000 ca:01 591092                     /usr/lib/x86_64
-linux-gnu/liblber-2.4.so.2.8.1
 28354:20140425:111457.164 7f1f594ce000-7f1f59500000 r-xp 00000000 ca:01 592018                     /usr/lib/x86_64
-linux-gnu/libidn.so.11.6.6
 28354:20140425:111457.164 7f1f59500000-7f1f596ff000 ---p 00032000 ca:01 592018                     /usr/lib/x86_64
-linux-gnu/libidn.so.11.6.6
 28354:20140425:111457.164 7f1f596ff000-7f1f59700000 r--p 00031000 ca:01 592018                     /usr/lib/x86_64
-linux-gnu/libidn.so.11.6.6
 28354:20140425:111457.164 7f1f59700000-7f1f59701000 rw-p 00032000 ca:01 592018                     /usr/lib/x86_64
-linux-gnu/libidn.so.11.6.6
 28354:20140425:111457.164 7f1f59701000-7f1f59719000 r-xp 00000000 ca:01 1925156                    /lib/x86_64-lin
ux-gnu/libpthread-2.15.so
 28354:20140425:111457.164 7f1f59719000-7f1f59918000 ---p 00018000 ca:01 1925156                    /lib/x86_64-lin
ux-gnu/libpthread-2.15.so
 28354:20140425:111457.164 7f1f59918000-7f1f59919000 r--p 00017000 ca:01 1925156                    /lib/x86_64-lin
ux-gnu/libpthread-2.15.so
 28354:20140425:111457.164 7f1f59919000-7f1f5991a000 rw-p 00018000 ca:01 1925156                    /lib/x86_64-lin
ux-gnu/libpthread-2.15.so
 28354:20140425:111457.164 7f1f5991a000-7f1f5991e000 rw-p 00000000 00:00 0
 28354:20140425:111457.164 7f1f5991e000-7f1f59934000 r-xp 00000000 ca:01 608425                     /lib/x86_64-lin
ux-gnu/libz.so.1.2.3.4
 28354:20140425:111457.164 7f1f59934000-7f1f59b33000 ---p 00016000 ca:01 608425                     /lib/x86_64-lin
ux-gnu/libz.so.1.2.3.4
 28354:20140425:111457.164 7f1f59b33000-7f1f59b34000 r--p 00015000 ca:01 608425                     /lib/x86_64-lin
ux-gnu/libz.so.1.2.3.4
 28354:20140425:111457.164 7f1f59b34000-7f1f59b35000 rw-p 00016000 ca:01 608425                     /lib/x86_64-lin
ux-gnu/libz.so.1.2.3.4
 28354:20140425:111457.164 7f1f59b35000-7f1f59cea000 r-xp 00000000 ca:01 1925147                    /lib/x86_64-lin
ux-gnu/libc-2.15.so
 28354:20140425:111457.165 7f1f59cea000-7f1f59eea000 ---p 001b5000 ca:01 1925147                    /lib/x86_64-lin
ux-gnu/libc-2.15.so
 28354:20140425:111457.165 7f1f59eea000-7f1f59eee000 r--p 001b5000 ca:01 1925147                    /lib/x86_64-lin
ux-gnu/libc-2.15.so
 28354:20140425:111457.165 7f1f59eee000-7f1f59ef0000 rw-p 001b9000 ca:01 1925147                    /lib/x86_64-lin
ux-gnu/libc-2.15.so
 28354:20140425:111457.165 7f1f59ef0000-7f1f59ef5000 rw-p 00000000 00:00 0
 28354:20140425:111457.165 7f1f59ef5000-7f1f59f0d000 r-xp 00000000 ca:01 1925152                    /lib/x86_64-lin
ux-gnu/libresolv-2.15.so
 28354:20140425:111457.165 7f1f59f0d000-7f1f5a10d000 ---p 00018000 ca:01 1925152                    /lib/x86_64-lin
ux-gnu/libresolv-2.15.so
 28354:20140425:111457.165 7f1f5a10d000-7f1f5a10e000 r--p 00018000 ca:01 1925152                    /lib/x86_64-lin
ux-gnu/libresolv-2.15.so
 28354:20140425:111457.165 7f1f5a10e000-7f1f5a10f000 rw-p 00019000 ca:01 1925152                    /lib/x86_64-lin
ux-gnu/libresolv-2.15.so
 28354:20140425:111457.165 7f1f5a10f000-7f1f5a111000 rw-p 00000000 00:00 0
 28354:20140425:111457.165 7f1f5a111000-7f1f5a118000 r-xp 00000000 ca:01 1925154                    /lib/x86_64-linux-gnu/librt-2.15.so
 28354:20140425:111457.165 7f1f5a118000-7f1f5a317000 ---p 00007000 ca:01 1925154                    /lib/x86_64-linux-gnu/librt-2.15.so
 28354:20140425:111457.165 7f1f5a317000-7f1f5a318000 r--p 00006000 ca:01 1925154                    /lib/x86_64-linux-gnu/librt-2.15.so
 28354:20140425:111457.165 7f1f5a318000-7f1f5a319000 rw-p 00007000 ca:01 1925154                    /lib/x86_64-linux-gnu/librt-2.15.so
 28354:20140425:111457.165 7f1f5a319000-7f1f5a31b000 r-xp 00000000 ca:01 1925162                    /lib/x86_64-linux-gnu/libdl-2.15.so
 28354:20140425:111457.165 7f1f5a31b000-7f1f5a51b000 ---p 00002000 ca:01 1925162                    /lib/x86_64-linux-gnu/libdl-2.15.so
 28354:20140425:111457.165 7f1f5a51b000-7f1f5a51c000 r--p 00002000 ca:01 1925162                    /lib/x86_64-linux-gnu/libdl-2.15.so
 28354:20140425:111457.165 7f1f5a51c000-7f1f5a51d000 rw-p 00003000 ca:01 1925162                    /lib/x86_64-linux-gnu/libdl-2.15.so
 28354:20140425:111457.165 7f1f5a51d000-7f1f5a618000 r-xp 00000000 ca:01 1925158                    /lib/x86_64-linux-gnu/libm-2.15.so
 28354:20140425:111457.165 7f1f5a618000-7f1f5a817000 ---p 000fb000 ca:01 1925158                    /lib/x86_64-linux-gnu/libm-2.15.so
 28354:20140425:111457.165 7f1f5a817000-7f1f5a818000 r--p 000fa000 ca:01 1925158                    /lib/x86_64-linux-gnu/libm-2.15.so
 28354:20140425:111457.165 7f1f5a818000-7f1f5a819000 rw-p 000fb000 ca:01 1925158                    /lib/x86_64-linux-gnu/libm-2.15.so
 28354:20140425:111457.166 7f1f5a819000-7f1f5a86e000 r-xp 00000000 ca:01 590510                     /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.2.0
 28354:20140425:111457.166 7f1f5a86e000-7f1f5aa6e000 ---p 00055000 ca:01 590510                     /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.2.0
 28354:20140425:111457.166 7f1f5aa6e000-7f1f5aa70000 r--p 00055000 ca:01 590510                     /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.2.0
 28354:20140425:111457.166 7f1f5aa70000-7f1f5aa71000 rw-p 00057000 ca:01 590510                     /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.2.0
 28354:20140425:111457.166 7f1f5aa71000-7f1f5ad2f000 r-xp 00000000 ca:01 301                        /usr/lib/x86_64-linux-gnu/libmysqlclient.so.18.0.0
 28354:20140425:111457.166 7f1f5ad2f000-7f1f5af2f000 ---p 002be000 ca:01 301                        /usr/lib/x86_64-linux-gnu/libmysqlclient.so.18.0.0
 28354:20140425:111457.166 7f1f5af2f000-7f1f5af35000 r--p 002be000 ca:01 301                        /usr/lib/x86_64-linux-gnu/libmysqlclient.so.18.0.0
 28354:20140425:111457.166 7f1f5af35000-7f1f5afb3000 rw-p 002c4000 ca:01 301                        /usr/lib/x86_64-linux-gnu/libmysqlclient.so.18.0.0
 28354:20140425:111457.166 7f1f5afb3000-7f1f5afb8000 rw-p 00000000 00:00 0
 28354:20140425:111457.166 7f1f5afb8000-7f1f5afda000 r-xp 00000000 ca:01 1925159                    /lib/x86_64-linux-gnu/ld-2.15.so
 28354:20140425:111457.166 7f1f5b08b000-7f1f5b1bf000 rw-s 00000000 00:04 2228228                    /SYSV7301215e (deleted)
 28354:20140425:111457.166 7f1f5b1bf000-7f1f5b1d1000 rw-p 00000000 00:00 0
 28354:20140425:111457.166 7f1f5b1d4000-7f1f5b1d5000 rw-p 00000000 00:00 0
 28354:20140425:111457.166 7f1f5b1d5000-7f1f5b1d7000 rw-s 00000000 00:04 2260997                    /SYSV5301215e (deleted)
 28354:20140425:111457.166 7f1f5b1d7000-7f1f5b1d8000 rw-p 00000000 00:00 0
 28354:20140425:111457.166 7f1f5b1d8000-7f1f5b1da000 rw-p 00000000 00:00 0
 28354:20140425:111457.166 7f1f5b1da000-7f1f5b1db000 r--p 00022000 ca:01 1925159                    /lib/x86_64-linux-gnu/ld-2.15.so
 28354:20140425:111457.166 7f1f5b1db000-7f1f5b1dd000 rw-p 00023000 ca:01 1925159                    /lib/x86_64-linux-gnu/ld-2.15.so
 28354:20140425:111457.166 7fff09edd000-7fff09f05000 rw-p 00000000 00:00 0                          [stack]
 28354:20140425:111457.166 7fff09fe7000-7fff09fe8000 r-xp 00000000 00:00 0                          [vdso]
 28354:20140425:111457.167 ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]
 28354:20140425:111457.167 ================================
 28354:20140425:111457.167 Please consider attaching a disassembly listing to your bug report.
 28354:20140425:111457.167 This listing can be produced with, e.g., objdump -DSswx zabbix_server.
 28354:20140425:111457.167 ================================
 28324:20140425:111457.170 One child process died (PID:28354,exitcode/signal:255). Exiting ...
 28324:20140425:111459.172 syncing history data...
 28324:20140425:111459.224 syncing history data done
 28324:20140425:111459.224 syncing trends data...
 28324:20140425:111501.938 syncing trends data done
 28324:20140425:111501.939 Zabbix Server stopped. Zabbix 2.2.3 (revision 44105).