Broken: zabbix_agentd 1.1.4/FreeBSD 5.4

[dcrandall]

Hi,

1.1.4 version of zabbix on FreeBSD 5.4 and 6.1 doesn't start. (neither does 1.1 version for that matter)
Doesn't leave anything in the log file at Debug=4

Had to go back to beta version.

Below is the stack trace from truss on 5.4, pretty much the same for 6.1 too:
The only thing that sticks out to me is

open("/etc/libmap.conf",0x0,0666) ERR#2 'No such file or directory'

Thanks!
dcran

263> truss /usr/local/bin/zabbix_agentd -p
mmap(0x0,3920,(0x3)PROT_READ|PROT_WRITE,(0x1000)MAP_ANON,-1,0x0) = 671604736 (0x2807e000)
munmap(0x2807e000,0xf50)                         = 0 (0x0)
__sysctl(0xbfbfe9e8,0x2,0x2807ac58,0xbfbfe9e4,0x0,0x0) = 0 (0x0)
mmap(0x0,32768,(0x3)PROT_READ|PROT_WRITE,(0x1002)MAP_ANON|MAP_PRIVATE,-1,0x0) = 671604736 (0x2807e000)
issetugid()                                      = 0 (0x0)
open("/etc/libmap.conf",0x0,0666)                ERR#2 'No such file or directory'
open("/var/run/ld-elf.so.hints",0x0,00)          = 3 (0x3)
read(0x3,0xbfbfea90,0x80)                        = 128 (0x80)
lseek(3,0x80,SEEK_SET)                           = 128 (0x80)
read(0x3,0x28083000,0x42)                        = 66 (0x42)
close(3)                                         = 0 (0x0)
access("/lib/libkvm.so.2",0)                     = 0 (0x0)
open("/lib/libkvm.so.2",0x0,00)                  = 3 (0x3)
fstat(3,0xbfbfeae0)                              = 0 (0x0)
read(0x3,0x28079ba0,0x1000)                      = 4096 (0x1000)
mmap(0x0,24576,(0x5)PROT_READ|PROT_EXEC,(0x20002)MAP_NOCORE|MAP_PRIVATE,3,0x0) = 671637504 (0x28086000)
mprotect(0x2808a000,4096,(0x7)PROT_READ|PROT_WRITE|PROT_EXEC) = 0 (0x0)
mprotect(0x2808a000,4096,(0x5)PROT_READ|PROT_EXEC) = 0 (0x0)
mmap(0x2808b000,4096,(0x3)PROT_READ|PROT_WRITE,(0x12)MAP_FIXED|MAP_PRIVATE,3,0x4000) = 671657984 (0x2808b000)
close(3)                                         = 0 (0x0)
access("/lib/libc.so.5",0)                       = 0 (0x0)
open("/lib/libc.so.5",0x0,027757765340)          = 3 (0x3)
fstat(3,0xbfbfeae0)                              = 0 (0x0)
read(0x3,0x28079ba0,0x1000)                      = 4096 (0x1000)
mmap(0x0,892928,(0x5)PROT_READ|PROT_EXEC,(0x20002)MAP_NOCORE|MAP_PRIVATE,3,0x0) = 671662080 (0x2808c000)
mprotect(0x2814d000,4096,(0x7)PROT_READ|PROT_WRITE|PROT_EXEC) = 0 (0x0)
mprotect(0x2814d000,4096,(0x5)PROT_READ|PROT_EXEC) = 0 (0x0)
mmap(0x2814e000,24576,(0x3)PROT_READ|PROT_WRITE,(0x12)MAP_FIXED|MAP_PRIVATE,3,0xc1000) = 672456704 (0x2814e000)
mmap(0x28154000,73728,(0x3)PROT_READ|PROT_WRITE,(0x1012)MAP_ANON|MAP_FIXED|MAP_PRIVATE,-1,0x0) = 672481280 (0x28154000)
close(3)                                         = 0 (0x0)
mmap(0x0,1056,(0x3)PROT_READ|PROT_WRITE,(0x1000)MAP_ANON,-1,0x0) = 672555008 (0x28166000)
munmap(0x28166000,0x420)                         = 0 (0x0)
mmap(0x0,688,(0x3)PROT_READ|PROT_WRITE,(0x1000)MAP_ANON,-1,0x0) = 672555008 (0x28166000)
munmap(0x28166000,0x2b0)                         = 0 (0x0)
mprotect(0x2808c000,794624,(0x7)PROT_READ|PROT_WRITE|PROT_EXEC) = 0 (0x0)
mmap(0x0,22232,(0x3)PROT_READ|PROT_WRITE,(0x1000)MAP_ANON,-1,0x0) = 672555008 (0x28166000)
munmap(0x28166000,0x56d8)                        = 0 (0x0)
mprotect(0x2808c000,794624,(0x5)PROT_READ|PROT_EXEC) = 0 (0x0)
sigaction(SIGILL,{ 0x28061b14 0x0|ONSTACK|RESTART|RESETHAND|NOCLDSTOP|NODEFER|NOCLDWAIT|SIGINFO ss_t },{ SIG_DFL 0x0|ONSTACK|RESTART|RESETHAND|NOCLDSTOP|NODEFER|NOCLDWAIT|SIGINFO ss_t }) = 0 (0x0)
sigprocmask(0x1,0x0,0x28079afc)                  = 0 (0x0)
sigaction(SIGILL,{ SIG_DFL 0x0|ONSTACK|RESTART|RESETHAND|NOCLDSTOP|NODEFER|NOCLDWAIT|SIGINFO ss_t },0x0) = 0 (0x0)
sysarch(0x1,0xbfbfeb40)                          = 17 (0x11)
sigprocmask(0x1,0x28079aa0,0xbfbfeb40)           = 0 (0x0)
sigprocmask(0x3,0x28079ab0,0x0)                  = 0 (0x0)
readlink("/etc/malloc.conf",0xbfbfea80,63)       ERR#2 'No such file or directory'
issetugid()                                      = 0 (0x0)
mmap(0x0,4096,(0x3)PROT_READ|PROT_WRITE,(0x1002)MAP_ANON|MAP_PRIVATE,-1,0x0) = 672555008 (0x28166000)
break(0x80ae000)                                 = 0 (0x0)
break(0x80af000)                                 = 0 (0x0)
break(0x80b0000)                                 = 0 (0x0)
break(0x80b1000)                                 = 0 (0x0)
open("/etc/zabbix/zabbix_agentd.conf",0x0,0666)  = 3 (0x3)
fstat(3,0xbfbfd810)                              = 0 (0x0)
break(0x80b5000)                                 = 0 (0x0)
read(0x3,0x80b1000,0x4000)                       = 3592 (0xe08)
read(0x3,0x80b1000,0x4000)                       = 0 (0x0)
pipe()                                           = 4 (0x4)
vfork()                                          = 59826 (0xe9b2)
getdtablesize()                                  = 64 (0x40)
fcntl(4,F_GETFL,0x0)                             = 2 (0x2)
close(5)                                         = 0 (0x0)
fstat(4,0xbfbfb7e0)                              = 0 (0x0)
read(0x4,0x80ae000,0x1000)                       = 20 (0x14)
read(0x4,0x80ae000,0x1000)                       = 0 (0x0)
close(4)                                         = 0 (0x0)
wait4(0xe9b2,0xbfbfb8c8,0x0,0x0)                 = 59826 (0xe9b2)
exit(0x1)
process exit, rval = 256

[Alexei]

Any chance to get a remote access to the box?

[dcrandall]

The machines I've tried it on are production boxes so that would probably be frowned.
But, I'll try to find one that isn't in production yet and see if I can get you onto that one....

[dcrandall]

I'm sorry, I'm not able to give you remote access.

I do have some more info though:

I started getting the same problem, with the same error in the stack trace, when changed the debug level to 4 and restarted zabbix_server.
The server just wouldn't start, and wasn't leaving much in the log.

When I set debug back to 3, it started right up. So it seems that debug level for causes /etc/libmap.conf to be referenced, and it's not there, so it dies.

When I get back from lunch, I'll see if the same holds true for zabbix_agentd.

[Alexei]

The problem is not related to libmap. Run strace with 'follow forks' option. This should help.

[juswan]

I'm having this same problem on Freebsd 6.1 on the AMD64 platform. I can't run strace as it's only supported for I386. I do have a ktrace dump if that would be helpful. I see multiple calls for /etc/libmap.conf and /etc/malloc.conf resulting in failures as these files don't exist. Do I need to set flags for malloc to get this working?

Thanks.

[dcrandall]

bump.......

[Alexei]

Sorry we cannot trace this without closer look to the problem. Is anyone here to provide remote access?

[dcrandall]

I don't have a machine that I can give remote access to.

I can tell you though, that the latest zabbix_agentd that works on FreeBSD is 1.1-beta9.