Complete HP server hardware monitoring

[mmarkwitzz]

A new template for zabbix 2.0 is available at: http://www.zabbix.com/forum/showthread.php?t=27057
The new template has better error handling, you now get notified if the HP WBEM providers are not properly installed.
Also you can now monitor an infinite number of components, instead of the limits described below, and the HP generated entries in the eventlog.
Finally, all items contain information about the component in their names instead of just numbers (eg: HP Physical Disk "Port:2I Box:1 Bay:3" status, HP Processor "Slot 1" status, HP SmartArray "Smart Array B110i SATA RAID Controller in Slot 0" status etc.)

Use the template below if you are still running zabbix 1.8 or later.


This is the template I built for monitoring HP servers hardware.

It uses active checks so it can work behind NAT (the agent connects the zabbix server), it uses WBEM so you only need to install WBEM providers and not HP SIM (and it can also monitor lowend servers like ML110 which DO NOT support HP SIM). No SNMP configuration required.

What it monitors (triggers):
-logical disk status (4 disks max)
-physical disk status (8 disks max)
-cpu status, fan status, temperature sensor (2 proc max)
-smart array status, cache status, battery status
-power supply status, temperature sensor

What graphs is has:
-processor temperature
-power source consumption
-processor max clock/current clock

How to use it:
-download the hp_server_template_export.xml from here and import it into your zabbix server.
-download HP WBEM providers from HP and install on your server
-download zabbix_hp_query.vbs from here and copy to your zabbix agent installation folder
-add the following lines to your zabbix_agentd.conf file and replace ZABBIX_AGENT_PATH with the actual path to your zabbix agent folder, replace HP_SERVER with the name you have given the host in the zabbix frontend (case sensitive?) and replace ZABBIX_SERVER_IP with the IP of your zabbix server.
-configure zabbix server to accept active checks (open port 10051 and forward it to your server if behind NAT).

#zabbix server to send values to
Server=ZABBIX_SERVER_IP
#hostname here must match the host name configured in zabbix server
Hostname=HP_SERVER
#enable active checks
DisableActive=0
#the port on which the agent will connect to the server
ServerPort=10051
#hp query
UserParameter = hp.query[*],cscript "ZABBIX_AGENT_PATH\zabbix_hp_query.vbs" //Nologo $1 $2 $3 $4

You should end up with a nice overview like this:


Hope you find it useful.

[fritz]

Hi mmarkwitzz,

I followed your instructions, but i don't get have any informations on the dashboard and even in the overview.

##### Active checks related

### Option: DisableActive
#	Disable active checks. The agent will work in passive mode listening for server.
#
# Mandatory: no
# Default:
# DisableActive=0

DisableActive=0

### Option: ServerPort
#	Server port for retrieving list of and  sending active checks.
#
# Mandatory: no
# Default:
ServerPort=10051

#HP Query
UserParameter = hp.query[*],cscript "C:\Program Files (x86)\Zabbix Agent\zabbix_hp_query.vbs" //Nologo $1 $2 $3 $4

Port 10051 open on zabbix server and port 10050 open on the zabbix monitored server.

Any idea ?

I tried manual check and it seems responding :

linux-yhbc:/var/log/zabbix # zabbix_get -s 10.205.211.116 -k hp.query[10,1,1]
2

[Colttt]

why you dont use the iLO-Interface?

[fritz]

Same problem. No data collecting.
In the overview i don't see any color, only blue arrows. And if i look on the graph : no data as well.

[mmarkwitzz]

Did you add the Hostname parameter in the config file and is it the same as the name you have given the host in zabbix frontend?

Also, I omitted that for active checks you have to add another paramter to the config file: Server=ZABBIX_SERVER_IP
This will tell the agent to what IP to send active checks.
Let me know if this helps.

@shad0w
My initial approach to the template was using snmp or telnet to interrogate the server over ILO.Turns out ILO can only return a limited number of checks and no smart array/logical disk status.

I prefer using a script to interrogate WBEM providers via WMI and get all the checks I need.
This way I can also use the template for low end hp servers like ML110 which don't even have an ILO port.

[fritz]

Did you add the Hostname parameter in the config file and is it the same as the name you have given the host in zabbix frontend?

Yes, same name in the host config and in the frontend.

Also, I omitted that for active checks you have to add another paramter to the config file: Server=ZABBIX_SERVER_IP
This will tell the agent to what IP to send active checks.


Yes, done in the initial configuration.

Let me know if this helps.

If you need other informations, tell me ...

Thanks anyway

[mmarkwitzz]

Can you telnet on 10051 from the monitored machine to the zabbix server?
If not, maybe your server is listening on another port or your fw is blocking access.

In the zabbix agent log are there any errors or any info why the checks might be disabled?

In the zabbix frontend, in the configuration->hosts, in the items view of the monitored server, do you have any errors next to the items (like "no data returned") or are they all green.
-If you have errors, then it means the agent actually contacted the zabbix server but there is a problem with the WBEM components and you might try reinstalling them.
-If there are no errors, the agent never contacted the server so its a connectivity problem.

[gizmo15]

i have the same problem, i have no data in the graph but i have no errors in the log, this is an extract of the log:

186000:20110315:093001.921 refresh_active_checks('192.168.2.189',10051)
185992:20110315:093001.937 In collect_cpustat()
186000:20110315:093002.015 Sending [{
"request":"active checks",
"host":"ad2003"}]
186000:20110315:093002.015 Before read
186000:20110315:093002.015 Got [{
"response":"success",
"data":[]}]
186000:20110315:093002.015 In parse_list_of_checks()
186000:20110315:093002.015 In disable_all_metrics()
186000:20110315:093002.015 In process_active_checks('192.168.2.189',10051)
186000:20110315:093002.015 In get_min_nextcheck()
186000:20110315:093002.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093002.015 Values in the buffer 0 Max 100
186000:20110315:093002.015 Sleeping for 1 seconds
185992:20110315:093002.937 In collect_cpustat()
186000:20110315:093003.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093003.015 Values in the buffer 0 Max 100
186000:20110315:093003.015 Sleeping for 1 seconds
185992:20110315:093003.937 In collect_cpustat()
186000:20110315:093004.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093004.015 Values in the buffer 0 Max 100
186000:20110315:093004.015 Sleeping for 1 seconds
185992:20110315:093004.937 In collect_cpustat()
186000:20110315:093005.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093005.015 Values in the buffer 0 Max 100
186000:20110315:093005.015 Sleeping for 1 seconds
185992:20110315:093005.937 In collect_cpustat()
186000:20110315:093006.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093006.015 Values in the buffer 0 Max 100
186000:20110315:093006.015 Sleeping for 1 seconds
185992:20110315:093006.937 In collect_cpustat()
186000:20110315:093007.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093007.015 Values in the buffer 0 Max 100
186000:20110315:093007.015 Sleeping for 1 seconds
185992:20110315:093007.937 In collect_cpustat()
186000:20110315:093008.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093008.015 Values in the buffer 0 Max 100
186000:20110315:093008.015 Sleeping for 1 seconds
185992:20110315:093008.937 In collect_cpustat()
186000:20110315:093009.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093009.015 Values in the buffer 0 Max 100
186000:20110315:093009.015 Sleeping for 1 seconds
185992:20110315:093009.937 In collect_cpustat()
186000:20110315:093010.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093010.015 Values in the buffer 0 Max 100
186000:20110315:093010.015 Sleeping for 1 seconds
185992:20110315:093010.937 In collect_cpustat()
186000:20110315:093011.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093011.015 Values in the buffer 0 Max 100
186000:20110315:093011.015 Sleeping for 1 seconds
185992:20110315:093011.937 In collect_cpustat()
186000:20110315:093012.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093012.015 Values in the buffer 0 Max 100
186000:20110315:093012.015 Sleeping for 1 seconds
185992:20110315:093012.937 In collect_cpustat()
186000:20110315:093013.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093013.015 Values in the buffer 0 Max 100
186000:20110315:093013.015 Sleeping for 1 seconds
185992:20110315:093013.937 In collect_cpustat()
186000:20110315:093014.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093014.015 Values in the buffer 0 Max 100
186000:20110315:093014.015 Sleeping for 1 seconds
185992:20110315:093014.937 In collect_cpustat()
186000:20110315:093015.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093015.015 Values in the buffer 0 Max 100
186000:20110315:093015.015 Sleeping for 1 seconds
185992:20110315:093015.937 In collect_cpustat()
186000:20110315:093016.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093016.015 Values in the buffer 0 Max 100
186000:20110315:093016.015 Sleeping for 1 seconds
185992:20110315:093016.937 In collect_cpustat()
186000:20110315:093017.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093017.015 Values in the buffer 0 Max 100
186000:20110315:093017.015 Sleeping for 1 seconds
185992:20110315:093017.937 In collect_cpustat()
186000:20110315:093018.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093018.015 Values in the buffer 0 Max 100
186000:20110315:093018.015 Sleeping for 1 seconds
185992:20110315:093018.937 In collect_cpustat()
186000:20110315:093019.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093019.015 Values in the buffer 0 Max 100
186000:20110315:093019.015 Sleeping for 1 seconds
185992:20110315:093019.937 In collect_cpustat()
186000:20110315:093020.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093020.015 Values in the buffer 0 Max 100
186000:20110315:093020.015 Sleeping for 1 seconds
185992:20110315:093020.937 In collect_cpustat()
186000:20110315:093021.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093021.015 Values in the buffer 0 Max 100
186000:20110315:093021.015 Sleeping for 1 seconds
185992:20110315:093021.937 In collect_cpustat()
186000:20110315:093022.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093022.015 Values in the buffer 0 Max 100
186000:20110315:093022.015 Sleeping for 1 seconds
185992:20110315:093022.937 In collect_cpustat()
186000:20110315:093023.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093023.015 Values in the buffer 0 Max 100
186000:20110315:093023.015 Sleeping for 1 seconds
185992:20110315:093023.937 In collect_cpustat()
186000:20110315:093024.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093024.015 Values in the buffer 0 Max 100
186000:20110315:093024.015 Sleeping for 1 seconds
185992:20110315:093024.937 In collect_cpustat()
186000:20110315:093025.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093025.015 Values in the buffer 0 Max 100
186000:20110315:093025.015 Sleeping for 1 seconds
185992:20110315:093025.937 In collect_cpustat()
186000:20110315:093026.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093026.015 Values in the buffer 0 Max 100
186000:20110315:093026.015 Sleeping for 1 seconds
185992:20110315:093026.937 In collect_cpustat()
186000:20110315:093027.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093027.015 Values in the buffer 0 Max 100
186000:20110315:093027.015 Sleeping for 1 seconds
185992:20110315:093027.937 In collect_cpustat()
186000:20110315:093028.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093028.015 Values in the buffer 0 Max 100
186000:20110315:093028.015 Sleeping for 1 seconds
185992:20110315:093028.937 In collect_cpustat()
186000:20110315:093029.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093029.015 Values in the buffer 0 Max 100
186000:20110315:093029.015 Sleeping for 1 seconds
185992:20110315:093029.937 In collect_cpustat()
186000:20110315:093030.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093030.015 Values in the buffer 0 Max 100
186000:20110315:093030.015 Sleeping for 1 seconds
185992:20110315:093030.937 In collect_cpustat()
186000:20110315:093031.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093031.015 Values in the buffer 0 Max 100
186000:20110315:093031.015 Sleeping for 1 seconds
185992:20110315:093031.937 In collect_cpustat()
186000:20110315:093032.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093032.015 Values in the buffer 0 Max 100
186000:20110315:093032.015 Sleeping for 1 seconds
185992:20110315:093032.937 In collect_cpustat()
186000:20110315:093033.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093033.015 Values in the buffer 0 Max 100
186000:20110315:093033.015 Sleeping for 1 seconds
185992:20110315:093033.937 In collect_cpustat()
186000:20110315:093034.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093034.015 Values in the buffer 0 Max 100
186000:20110315:093034.015 Sleeping for 1 seconds
185992:20110315:093034.937 In collect_cpustat()
186000:20110315:093035.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093035.015 Values in the buffer 0 Max 100
186000:20110315:093035.015 Sleeping for 1 seconds
185992:20110315:093035.937 In collect_cpustat()
186000:20110315:093036.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093036.015 Values in the buffer 0 Max 100
186000:20110315:093036.015 Sleeping for 1 seconds
185992:20110315:093036.937 In collect_cpustat()
186000:20110315:093037.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093037.015 Values in the buffer 0 Max 100
186000:20110315:093037.015 Sleeping for 1 seconds
185992:20110315:093037.937 In collect_cpustat()
186000:20110315:093038.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093038.015 Values in the buffer 0 Max 100
186000:20110315:093038.015 Sleeping for 1 seconds
185992:20110315:093038.937 In collect_cpustat()
186000:20110315:093039.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093039.015 Values in the buffer 0 Max 100
186000:20110315:093039.015 Sleeping for 1 seconds
185992:20110315:093039.937 In collect_cpustat()
186000:20110315:093040.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093040.015 Values in the buffer 0 Max 100
186000:20110315:093040.015 Sleeping for 1 seconds
185992:20110315:093040.937 In collect_cpustat()
186000:20110315:093041.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093041.015 Values in the buffer 0 Max 100
186000:20110315:093041.015 Sleeping for 1 seconds
185992:20110315:093041.937 In collect_cpustat()
186000:20110315:093042.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093042.015 Values in the buffer 0 Max 100
186000:20110315:093042.015 Sleeping for 1 seconds
185992:20110315:093042.937 In collect_cpustat()
186000:20110315:093043.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093043.015 Values in the buffer 0 Max 100
186000:20110315:093043.015 Sleeping for 1 seconds
185992:20110315:093043.937 In collect_cpustat()
186000:20110315:093044.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093044.015 Values in the buffer 0 Max 100
186000:20110315:093044.015 Sleeping for 1 seconds
185992:20110315:093044.937 In collect_cpustat()
186000:20110315:093045.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093045.015 Values in the buffer 0 Max 100
186000:20110315:093045.015 Sleeping for 1 seconds
185992:20110315:093045.937 In collect_cpustat()
186000:20110315:093046.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093046.015 Values in the buffer 0 Max 100
186000:20110315:093046.015 Sleeping for 1 seconds
185992:20110315:093046.937 In collect_cpustat()
186000:20110315:093047.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093047.015 Values in the buffer 0 Max 100
186000:20110315:093047.015 Sleeping for 1 seconds
185992:20110315:093047.937 In collect_cpustat()
186000:20110315:093048.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093048.015 Values in the buffer 0 Max 100
186000:20110315:093048.015 Sleeping for 1 seconds
185992:20110315:093048.937 In collect_cpustat()
186000:20110315:093049.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093049.015 Values in the buffer 0 Max 100
186000:20110315:093049.015 Sleeping for 1 seconds
185992:20110315:093049.937 In collect_cpustat()
186000:20110315:093050.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093050.015 Values in the buffer 0 Max 100
186000:20110315:093050.015 Sleeping for 1 seconds
185992:20110315:093050.937 In collect_cpustat()
186000:20110315:093051.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093051.015 Values in the buffer 0 Max 100
186000:20110315:093051.015 Sleeping for 1 seconds
185992:20110315:093051.937 In collect_cpustat()
186000:20110315:093052.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093052.015 Values in the buffer 0 Max 100
186000:20110315:093052.015 Sleeping for 1 seconds
185992:20110315:093052.937 In collect_cpustat()
186000:20110315:093053.015 In send_buffer('192.168.2.189','10051')
186000:20110315:093053.015 Values in the buffer 0 Max 100
186000:20110315:093053.015 Sleeping for 1 seconds

these lines repeat again and again

edit: i haven't any error in the item category

[mmarkwitzz]

Got [{
"response":"success",
"data":[]}]

I think this means the server returned no active checks for the host in question. I cannot think of any other reason besides the fact that the name of the host in zabbix server frontend does not match the hostname property in the agent config (I think they may be case sensitive).

Server=x.x.x.x
DisablePassive=0
ListenPort=10050
DisableActive=0
ServerPort=10051
Hostname=BITVMH1

If you don't work with active checks and have no need for them, an easy fix would be to edit all items in the template and change their type from "zabbix agent (active)" to "zabbix agent". It should work after this regardless of the hostname property value.

[gizmo15]

i have change the hostname, nothing different.
I have changed for zabbix agent, always no data :/

[fritz]

Can you telnet on 10051 from the monitored machine to the zabbix server?
If not, maybe your server is listening on another port or your fw is blocking access.

In the zabbix agent log are there any errors or any info why the checks might be disabled?

In the zabbix frontend, in the configuration->hosts, in the items view of the monitored server, do you have any errors next to the items (like "no data returned") or are they all green.
-If you have errors, then it means the agent actually contacted the zabbix server but there is a problem with the WBEM components and you might try reinstalling them.
-If there are no errors, the agent never contacted the server so its a connectivity problem.

Here is the agent log on the monitored host :

 4456:20110316:163111.761 zabbix_agentd collector stopped
  8168:20110316:163112.370 Zabbix Agent started. Zabbix 1.8.3 (revision 13926).
 12024:20110316:163112.370 zabbix_agentd collector started
 10264:20110316:163112.401 zabbix_agentd listener started
 12268:20110316:163112.401 zabbix_agentd listener started
  6196:20110316:163112.401 zabbix_agentd listener started
 10508:20110316:163112.401 zabbix_agentd listener started
 13084:20110316:163112.401 zabbix_agentd listener started
 13188:20110316:163112.401 zabbix_agentd active check started [10.205.211.254:10051]

So there is no problem with the agent itself.

I cannot telnet the zabbix server from a monitored host, even the port seems open in the /etc/services : 10051 tcp/udp

But i can telnet the monitored host from the zabbix server.

My zabbix server is running on a virtual machine (Suse environment) on VMWare Player.

I try to find a solution in this way ...

Thanks in advance

[mmarkwitzz]

On the monitored server, try running this from the zabbix agent path, in cmd:
cscript zabbix_hp_query.vbs //nologo 1 1
It should print out 2 if all is ok.

Run this on the zabbix server:
zabbix_get -s MONITORED_SERVER_IP -k hp.query[1,1]
Do you get any result (you should get 2 if all is ok)?

If you get result, try reactivating the items in configuration->host->items for the host in zabbix frontend (they should say "not supported" and clicking on then will set them to active).

[fritz]

mmarkwitzz,

Just deactivate the *@!#'_^ SUSe fw, and everything is working.
Got the data on the overview from the agents.

Thanks a lot.

[gizmo15]

cscript zabbix_hp_query.vbs //nologo 1 1

when i try that, the result is 0 :/

[mmarkwitzz]

@fritz
Glad you got it working

@gizmo15


The return value 0 is not documented and, as far as I can tell, you have a problem with the WBEM providers. Returned values should be 2, 3 or 5.

Anyway, the script returns SOMETHING and running "zabbix_get -s MONITORED_SERVER_IP -k hp.query[1,1]" on the server side should return you the same value.

If it does return the same value, AND you have changed "zabbix check (active)" to "zabbix check" for all items, it should work.
Do you have any OTHER templates linked to the host that do return valid results?