fping failed : "Aborted"

[marsipulami]

recently the ubuntu server on which our zabbixproxy was working is updated a few versions.
At this moment it is Ubuntu 10.04.4 LTS . unfortunatly after the update de zabbix_proxy is not operating 100%.
Some pings are lost. it looks completly random. also turning on debuglevel 4 did not show me anything interesting. the zabbix_proxy log looks like this:

---

18884:20120821:175309.296 Received configuration data from server. Datalen 631552
18909:20120821:175521.811 fping failed: "Aborted"
18884:20120821:175810.323 Received configuration data from server. Datalen 631552
18884:20120821:180311.374 Received configuration data from server. Datalen 631552
18917:20120821:180527.530 fping failed: "Aborted"
18917:20120821:180528.518 fping failed: "Aborted"
18884:20120821:180812.513 Received configuration data from server. Datalen 631552
18884:20120821:181313.583 Received configuration data from server. Datalen 631552
18923:20120821:181658.048 Executing housekeeper
18923:20120821:181705.861 Deleted 400859 records from history [7.812006 seconds]
18884:20120821:181814.621 Received configuration data from server. Datalen 631552
18884:20120821:182315.681 Received configuration data from server. Datalen 631552
18919:20120821:182509.867 fping failed: "Aborted"
18920:20120821:182521.838 fping failed: "Aborted"
18884:20120821:182816.722 Received configuration data from server. Datalen 631552
18922:20120821:183018.102 fping failed: "Aborted"
18908:20120821:183027.962 fping failed: "Aborted"
18884:20120821:183317.772 Received configuration data from server. Datalen 631552
18910:20120821:183533.283 fping failed: "Aborted"
18884:20120821:183818.743 Received configuration data from server. Datalen 631552
18884:20120821:184319.764 Received configuration data from server. Datalen 631552
18919:20120821:184506.305 fping failed: "Aborted"
18916:20120821:184613.260 fping failed: "Aborted"
18884:20120821:184820.774 Received configuration data from server. Datalen 631552
18908:20120821:185021.876 fping failed: "Aborted"
18884:20120821:185321.824 Received configuration data from server. Datalen 631552
18884:20120821:185822.753 Received configuration data from server. Datalen 631552
18884:20120821:190323.781 Received configuration data from server. Datalen 631552
18884:20120821:190824.833 Received configuration data from server. Datalen 631552
18884:20120821:191325.873 Received configuration data from server. Datalen 631552
18923:20120821:191659.077 Executing housekeeper
18923:20120821:191706.881 Deleted 403966 records from history [7.803581 seconds]
18884:20120821:191826.822 Received configuration data from server. Datalen 631552
18917:20120821:192018.537 fping failed: "Aborted"
18884:20120821:192327.822 Received configuration data from server. Datalen 631552
18884:20120821:192828.892 Received configuration data from server. Datalen 631552
18917:20120821:193020.429 fping failed: "Aborted"
18884:20120821:193329.922 Received configuration data from server. Datalen 631552
18922:20120821:193517.990 fping failed: "Aborted"
18884:20120821:193830.964 Received configuration data from server. Datalen 631552
18918:20120821:194005.773 fping failed: "Aborted"
18915:20120821:194009.814 fping failed: "Aborted"
18884:20120821:194332.022 Received configuration data from server. Datalen 631552
18884:20120821:194833.050 Received configuration data from server. Datalen 631552
18922:20120821:195003.845 fping failed: "Aborted"
18884:20120821:195334.111 Received configuration data from server. Datalen 631552
18884:20120821:195835.162 Received configuration data from server. Datalen 631552
18918:20120821:200053.708 fping failed: "Aborted"
18884:20120821:200336.203 Received configuration data from server. Datalen 631552
18884:20120821:200837.315 Received configuration data from server. Datalen 631552
18914:20120821:201009.538 fping failed: "Aborted"
18884:20120821:201338.371 Received configuration data from server. Datalen 631552
18923:20120821:201700.105 Executing housekeeper
18923:20120821:201707.872 Deleted 404425 records from history [7.765926 seconds]
18884:20120821:201841.121 Received configuration data from server. Datalen 631552

---

i tried reinstalling fping and reinstalled the zabbix proxy at version 2.0.2. still no change.
Also playing with the config, simultane pingers at minimum did not help.
systemload is normal

anyone else had this problem?

[marsipulami]

anyone ?

[marsipulami]

again a bump. anyone? It cant be that im the only one with the issue.
any thoughts about howto troubleshoot this issue?

[dafyre]

Fping by hand?

Can you try to use fping by hand?

To get the CLI options that are being passed to it, run top with the options to show the full command line.

Does that work?

[marsipulami]

i already tested fping seperate and had no issues there.
for zabbix i just found the following in the debuglevel 4 log:


what to do too fix this?

=====
11760:20120830:164009.320 read line [*** buffer overflow detected ***: /usr/local/sbin/fping terminated]
11760:20120830:164009.362 read line [======= Backtrace: =========]
11760:20120830:164009.362 read line [/lib/libc.so.6(__fortify_fail+0x37)[0x7f516f85b7e7]]
11760:20120830:164009.362 read line [/lib/libc.so.6(+0xfe6a0)[0x7f516f85a6a0]]
11760:20120830:164009.362 read line [/lib/libc.so.6(+0xfdb09)[0x7f516f859b09]]
11760:20120830:164009.362 read line [/lib/libc.so.6(_IO_default_xsputn+0xcc)[0x7f516f7d1f6c]]
11760:20120830:164009.362 read line [/lib/libc.so.6(_IO_vfprintf+0x1c08)[0x7f516f7a2fa8]]
11760:20120830:164009.362 read line [/lib/libc.so.6(__vsprintf_chk+0x99)[0x7f516f859ba9]]
11760:20120830:164009.362 read line [/lib/libc.so.6(__sprintf_chk+0x7f)[0x7f516f859aef]]
11760:20120830:164009.362 read line [/usr/local/sbin/fping[0x401a05]]
11760:20120830:164009.362 read line [/usr/local/sbin/fping[0x403452]]
11760:20120830:164009.362 read line [/usr/local/sbin/fping[0x403f45]]
11760:20120830:164009.362 read line [/lib/libc.so.6(__libc_start_main+0xfd)[0x7f516f77ac4d]]
11760:20120830:164009.362 read line [/usr/local/sbin/fping[0x401419]]
11760:20120830:164009.362 read line [======= Memory map: ========]
11760:20120830:164009.362 read line [00400000-00406000 r-xp 00000000 68:01 1414994 /usr/bin/fping]
11760:20120830:164009.362 read line [00606000-00607000 r--p 00006000 68:01 1414994 /usr/bin/fping]
11760:20120830:164009.362 read line [00607000-00608000 rw-p 00007000 68:01 1414994 /usr/bin/fping]
11760:20120830:164009.362 read line [00608000-00609000 rw-p 00000000 00:00 0 ]
11760:20120830:164009.362 read line [024f1000-02512000 rw-p 00000000 00:00 0 [heap]]
11760:20120830:164009.362 read line [7f516f338000-7f516f34e000 r-xp 00000000 68:01 351830 /lib/libgcc_s.so.1]
11760:20120830:164009.362 read line [7f516f34e000-7f516f54d000 ---p 00016000 68:01 351830 /lib/libgcc_s.so.1]
11760:20120830:164009.362 read line [7f516f54d000-7f516f54e000 r--p 00015000 68:01 351830 /lib/libgcc_s.so.1]
11760:20120830:164009.362 read line [7f516f54e000-7f516f54f000 rw-p 00016000 68:01 351830 /lib/libgcc_s.so.1]
11760:20120830:164009.362 read line [7f516f54f000-7f516f55b000 r-xp 00000000 68:01 351748 /lib/libnss_files-2.11.1.so]
11760:20120830:164009.362 read line [7f516f55b000-7f516f75a000 ---p 0000c000 68:01 351748 /lib/libnss_files-2.11.1.so]
11760:20120830:164009.362 read line [7f516f75a000-7f516f75b000 r--p 0000b000 68:01 351748 /lib/libnss_files-2.11.1.so]
11760:20120830:164009.362 read line [7f516f75b000-7f516f75c000 rw-p 0000c000 68:01 351748 /lib/libnss_files-2.11.1.so]
11760:20120830:164009.362 read line [7f516f75c000-7f516f8d6000 r-xp 00000000 68:01 351570 /lib/libc-2.11.1.so.backup]
11760:20120830:164009.362 read line [7f516f8d6000-7f516fad5000 ---p 0017a000 68:01 351570 /lib/libc-2.11.1.so.backup]
11760:20120830:164009.362 read line [7f516fad5000-7f516fad9000 r--p 00179000 68:01 351570 /lib/libc-2.11.1.so.backup]
11760:20120830:164009.362 read line [7f516fad9000-7f516fada000 rw-p 0017d000 68:01 351570 /lib/libc-2.11.1.so.backup]
11760:20120830:164009.362 read line [7f516fada000-7f516fadf000 rw-p 00000000 00:00 0 ]
11760:20120830:164009.362 read line [7f516fadf000-7f516faff000 r-xp 00000000 68:01 351663 /lib/ld-2.11.1.so]
11760:20120830:164009.362 read line [7f516fcf2000-7f516fcf5000 rw-p 00000000 00:00 0 ]
11760:20120830:164009.363 read line [7f516fcfc000-7f516fcfe000 rw-p 00000000 00:00 0 ]
11760:20120830:164009.363 read line [7f516fcfe000-7f516fcff000 r--p 0001f000 68:01 351663 /lib/ld-2.11.1.so]
11760:20120830:164009.363 read line [7f516fcff000-7f516fd00000 rw-p 00020000 68:01 351663 /lib/ld-2.11.1.so]
11760:20120830:164009.363 read line [7f516fd00000-7f516fd01000 rw-p 00000000 00:00 0 ]
11760:20120830:164009.363 read line [7fffba648000-7fffba65d000 rw-p 00000000 00:00 0 [stack]]
11760:20120830:164009.363 read line [7fffba6b2000-7fffba6b3000 r-xp 00000000 00:00 0 [vdso]]
11760:20120830:164009.363 read line [ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]]



==========

fping: Version 2.4b2_to $Date: 2002/01/16 00:33:42 $

[dafyre]

From Source

I checked my /usr/sbin/fping and it was linked to /usr/bin/fping ...

I checked /usr/bin/fping, and it had a bad symlink. (But the CLI still worked)

Even after an apt-get remove and install, it still did not work...

I nabbed a copy of the git repo for fping from

https://github.com/schweikert/fping

and miraculously, my system is working now again. You might want to give that a whirl as well. I am running Ubuntu 11.04 here.

[marsipulami]

thnx for your reply with your solution. i just installed it and now we will wait. i will tell here if it worked out for me

[dafyre]

One of My Symptoms

One of the symptoms that I had was that several of my hosts flagged as being down.

I checked under the Host Items for ICMPPING, and it was listed as "Not Supported" after I told it to enable again, my hosts that were down began to come back up again... Just something you may want to check.

Hopefully it is working for you!

[marsipulami]

unfortunatly this fix did not solve my issue. its still around

[marsipulami]

Solved

This morning i gave the server another distribution upgrade to 12.04 lts and so far everything looks fine again.

cannot say if i triggered a bug in combination with ubuntu 10.04.4 or the OS was just buggy after the previous upgrade