HP servers monitoring via iLO

[edelk]

Value should be a JSON object

Hi to all

This is my first post in this forum, sorry for my english

Tired to get IPMI work on a Ubuntu 14.04 lts and HP ILO I try it with this way.
But ..

I get always the error "Value should be a JSON objekt in the discovery rules.

If I start the script manually I see warnings like "when is experimental"
Solution :
Just Change "use warning" to "no warnings" in the Script
and you get a valid JSON object.
Now the Rules works fine

LG
Martin

[Dennieboy96]

dont get data.

hey you guy's i followed this thread. i am quite new to this..
but i can excecute every test command and get back the data that supposed to get back. but when i go to zabbix i dont get any data. it discover's everything with the server but the latest data stay's empty. what could that be?

[asteins]

hey you guy's i followed this thread. i am quite new to this..
but i can excecute every test command and get back the data that supposed to get back. but when i go to zabbix i dont get any data. it discover's everything with the server but the latest data stay's empty. what could that be?

Had the same issue, connected to iLo via browser, in Administration->Diagnostics "Restarted the iLo" and the values started to appear.

Hope this helps.

[Dennieboy96]

thanks! i am going to try that this evening!

Had the same issue, connected to iLo via browser, in Administration->Diagnostics "Restarted the iLo" and the values started to appear.

Hope this helps.

[Dennieboy96]

Had the same issue, connected to iLo via browser, in Administration->Diagnostics "Restarted the iLo" and the values started to appear.

Hope this helps.

it actualy did not work! i restarted it but the values dont appaer.


the user i used does have the next privilege's:
remote console, virtual media, administrator account privilege's

[mirddin]

Ilo_user+ilo_pass

At first, thanks topicstarter for the great script! =)

Here's a small update, just to be able to use different user/pass

Two additional variables {$ILO_USER} and {$ILO_PASS}.

[mirddin]

hi all!
does anybody know, is it possible to add macro {$ILO} to the template with smth like:

{$ILO}={$HOST.IP} (...or $HOST.NAME or anything else)

Just not to enter separate {$ILO} with ip address to every iLO host.

thanks beforehand!

[netfun2000]

In zabbix log periodically appears the following strings:

flock() on closed filehandle CACHE at /usr/local/etc/zabbix22/zabbix/externalscripts/ipmi_proliant.pl line 75.
readline() on closed filehandle CACHE at /usr/local/etc/zabbix22/zabbix/externalscripts/ipmi_proliant.pl line 76.

I have a suspicion that because of this zabbix at times receives no data...

have same errors.

[JasperE]

This is how to fix the error:

ilo:ipmi_proliant.pl['System Board 3 Fan 3',sensor,'{$ILO}',numeric]] became not supported: Received value [] is not suitable for value type [Numeric (float)]"

(This error has as a result that bits of iformation are missing from the graphs.)

Cause:
Cache files in /var/tmp get created twice for each host. Once with quotes, once without. Seems like about one in two ipmi-sensor cmd's is mistakenly fired, because it doesn't use a perfectly valid cached hit.

That's a problem, if you dig deeper and remove the "2>/dev/null" bits from the cmd's, then the following error appears:

ipmi_ctx_open_outofband_2_0: BMC busy

(Leave the error redirecting in there, removing that is *not* the fix)

This is how the script can be fixed. In both .pl perl files, add just below the line

my $server

the following two lines

$server =~ tr/"//d;
$server =~ tr/'//d;

That fixed it for me.

[mmcpherson]

$server =~ tr/"//d;
$server =~ tr/'//d;

That fixed it for me.

Hey thanks for posting this! - I was interested in solving this problem. Unfortunately for me after applying fix I still have been getting many of these errors still in the log:

"became not supported: Received value [] is not suitable"... etc

But still happy as it handles the cache files better.

I'm not sure but this issue may be occurring for me still as I'm actually using this on Cisco UCS hardware. But actually, the script successfully discovers disks, fans, memory, temps, power supplies and info on this hardware and triggers don't need modification! I'll still need to come back and tweak some stuff specific to this hardware, but a really good result.

Anyway, I've determined that the errors are in my case caused by the flock operation locking the cache file for writing and the script handles this by returning an empty value. External checks happily ignore empty return values for strings, but empty numeric return values cause the item to become unsupported. I've made some changes to implement a fix for this. The solution involves creating and reading from a secondary temp cache file (the second filename is appended with _tmp), while the flock operation is in progress on the primary cache file.

I've attached my modified version of the ipmi_proliant.pl script.

Also, here is a diff of the changes I made:

11d10
< use File::Copy qw(copy);
16,19d14
< # -- Start patch -- fix issue with redundant temp file with quotes - see https://www.zabbix.com/forum/showthread.php?t=44968&page=3 for info
< $server =~ tr/"//d;
< $server =~ tr/'//d;
< # -- End patch --
59d53
<                 copy $cache_file, $cache_file.'_tmp';
64a59
>     my $results = results();
67d61
<       my $results = results();
75c69
<             $cache_file = $cache_file.'_tmp';
---
>             exit(1);
80,87c74,77
< if (-e $cache_file) {
<     open(CACHE, '<' . $cache_file);
<     flock(CACHE, LOCK_EX);
<     @rows = <CACHE>;
<     close(CACHE);
< } else {
<     exit(1);
< }
---
> open(CACHE, '<' . $cache_file);
> flock(CACHE, LOCK_EX);
> @rows = <CACHE>;
> close(CACHE);
97,101c87
<                   if ($r eq '' or $r eq 'N/A') {
<                       exit(0);
<                   } else {
<                         print $r;
<                   }
---
>                     print $r;

[JasperE]

I've made some changes to implement a fix for this. The solution involves creating and reading from a secondary temp cache file (the second filename is appended with _tmp), while the flock operation is in progress on the primary cache file.

Hi there mmcpherson, that's indeed another bug you discovered. I think it occurs when two threads are refreshing the cache at the same time. Your fix however seems to output the previously cached value from the tmp file, rather than waiting for an acquired lock and outputting the current sensor values, only after the lock was acquired and the cache file was refreshed.

Being new to perl and file locking, I dug a little deeper in the documentation and the ipmi script. I think I found a proper fix for the locking issues the causing race condition errors.

The script I have attached below is supposed to:
1 - First determine if no cache file exists, or if it is outdated
2 - If that's the case, -first- acquire a lock, in a blocking mode. Meaning it waits for a lock if another thread has it locked.
3 - After the lock is acquired. Check again if another thread hasn't refreshed the cache file while the current thread was waiting for the lock.
4 - Only if the now locked cache file is outdated, and only then, truncate cache, issue $ipmi_cmd, and write outputs to cache.
5 - Release exclusive lock for write mode
6 - Acquire shared lock for reading the newly refreshed cache file.

See attachment.
Note that this is a version of the script which requires ILO username and password to be passed on from macros in the template as posted by Mirddin here: https://www.zabbix.com/forum/showpos...5&postcount=21

[JasperE]

I updated the attachment of my previous post.
The script wouldn't handle creation of cache files for new IPMI hosts properly.
(I had only tested with existing hosts for which cache files were already created)

I also added a debugmode with debug messages for cache file handling, the debugmode can be enabled by changing $debug = 0 to 1.

[karzer]

Thanks JasperE, it is running.

[mmcpherson]

Thanks JasperE, very nicely crafted!

Works perfect for me, and much appreciated that you included comments. I can't say I know anything about perl, and seldom code so it's a good opportunity for me to learn.

Cheers!

[dkmudrechenko]

Zabbix couldn't get values

Had a problem when Zabbix ran script but never got any data, the problem was with ilo_discovery.pl. Perl produced "experimental feature" warnings that broke JSON format of the output (since zabbix uses stderr + stdout). So I had to include the following line to stop perl acting funky and make it working -
"no if ($] >= 5.01, 'warnings' => 'experimental';"

Hope it will help someone!

Thanks