Cannot connect to IPMI host

[joergi]

Hello together,

I have some trouble to monitor Dell R720xd servers using ipmi. The ipmi user (user priv) is on the iDrac7 configured and ipmi is enabled.
In Zabbix I have configured MD5 as Authentication algorithm and "User" privilege level.

Zabbix shows the following error: cannot connect to IPMI host: [16777411] Unknown error 16777411

The ipmi command line tool is working fine...

ipmitool -I lanplus -H YYYYYYY -U ipmi -P XXXXX -L USER sdr

How can I solve this issue? Zabbix 2.0.12 is on Ubuntu 10.04.4 LTS installed...

Thanks,
Jörg

[zabb]

Hi,
same Problem here. Did anyone find a Solution?
ipmitool works fine with specified account and IPMI monitoring is enabled.
Zabbix 2.4 on Ubuntu 14.04.

[Colttt]

also here it works fine..

please set Authentication algorithm to none/default and try it again..
if it doesnt work, please use the debugloglevel and post the logfile

[zabb]

Hi Colttt,
I already test default and md5. The zabbix_server.log just show "network error" on debuglevel 3 and disable the item after 3rd try.

ipmitool works fine incl. lanplus and md5

ipmitool -H <hostip> -U <user> -P <pass> -L User -I lanplus -A MD5 sel

I don't know if zabbix use lanplus statement for ipmi 2.0 on default.
Read some threads like openipmi is default configured without openssl in ubuntu? (i have already recompile and activate --with-openssl)

Is there a special config- or log-file for ipmi-agent?

[Colttt]

can you please use DebugLevel=4 ? (if you do that increase the logfilesize too, (10MB)

and please try this, give the zabbix user Admin privileges, in zabbix and in the IPMI-Hostinterface and try it again..

[joergi]

I have started the proxy now in debug level 4 and found the following lines (IP and hostname removed):

  
4441:20141027:020544.649 In get_values()
  4441:20141027:020544.649 In DCconfig_get_poller_items() poller_type:0
  4441:20141027:020544.649 End of DCconfig_get_poller_items():0
  4441:20141027:020544.649 End of get_values():0
  4441:20141027:020544.649 poller #3 spent 0.000177 seconds while updating 0 values
  4441:20141027:020544.649 In DCconfig_get_poller_nextcheck() poller_type:0
  4441:20141027:020544.649 End of DCconfig_get_poller_nextcheck():1414400747
  4441:20141027:020544.649 sleeping for 3 seconds
  4452:20141027:020544.677 In setup_done() phost:0xcb20c0 host:'[the_IP]:623'
  4452:20141027:020544.677 setup_done() fail: [16777411] Unknown error 16777411
  4452:20141027:020544.677 End of setup_done():NETWORK_ERROR
  4452:20141027:020544.677 In domain_closed() phost:0xcb20c0 host:'[the_IP]:623'
  4452:20141027:020544.677 End of domain_closed()
  4452:20141027:020544.677 End of init_ipmi_host():0xcb20c0
  4452:20141027:020544.677 Item [the_hostname:Fan_6_RPM] error: cannot connect to IPMI host: [16777411] Unknown error 16777411
  4452:20141027:020544.677 End of get_value():NETWORK_ERROR
  4452:20141027:020544.677 In deactivate_host() hostid:12332 itemid:106474 type:12
  4452:20141027:020544.678 deactivate_host() errors_from:1409643882 available:2
  4452:20141027:020544.678 query [txnlev:1] [begin;]
  4452:20141027:020544.678 query [txnlev:1] [update hosts set ipmi_error='cannot connect to IPMI host: [16777411] Unknown error 16777411',ipmi_disable_until=1414400804 where hostid=12332]
  4452:20141027:020544.678 query [txnlev:1] [commit;]
  4452:20141027:020544.680 End of deactivate_host()
  4452:20141027:020544.680 End of get_values():1
  4452:20141027:020544.680 unreachable poller #9 spent 7.006268 seconds while updating 1 values
  4452:20141027:020544.680 In DCconfig_get_poller_nextcheck() poller_type:1
  4452:20141027:020544.680 End of DCconfig_get_poller_nextcheck():1414400762
  4452:20141027:020544.681 sleeping for 5 seconds
  4439:20141027:020544.754 In get_values()

[ufocek]

Hi,

I have the same problem on Debian 7.0 and ipmi 2.0.16, I send report to zabbix bugtrack and they told me, your openipmi is pretty old :-).
Wich version have youn on your debian system?

[joergi]

We are using Ubuntu 10.04.4 LTS and the following package versions are installed:
openipmi 2.0.16-1ubuntu1
ipmitool 1.8.11-1ubuntu1
libopenipmi-dev 2.0.16-1ubuntu1
libopenipmi0 2.0.16-1ubuntu1

Thanks,
Jörg

[ufocek]

We are using Ubuntu 10.04.4 LTS and the following package versions are installed:
openipmi 2.0.16-1ubuntu1
ipmitool 1.8.11-1ubuntu1
libopenipmi-dev 2.0.16-1ubuntu1
libopenipmi0 2.0.16-1ubuntu1

Thanks,
Jörg

This is info from zabbix:

OpenIPMI version 2.0.16 is pretty old and we had numerous issues with it. Could you please try with the latest version? (Note that ipmitool does not use OpenIPMI.)
I installed OpenIPMI from source 2.0.19 version bu effect is the same... and I have zabbix 2.2.7.

Zabbix error:

6912:20141027:141957.827 Item [ZabbixServ:BATT30V] error: cannot connect to IPMI host: [22] Invalid argument
6912:20141027:141957.827 query [txnlev:1] [update hosts set ipmi_disable_until=1414416057,ipmi_error='cannot connect to IPMI host: [22] Invalid argument' where hostid=10084]

or

6911:20141027:142156.715 Item [RX200S7:ipmi.ambient] error: cannot connect to IPMI host: [22] Invalid argument
6911:20141027:142156.716 query [txnlev:1] [update hosts set ipmi_disable_until=1414416176,ipmi_error='cannot connect to IPMI host: [22] Invalid argument' where hostid=10124]
6910:20141027:142210.512 Item [ZabbixServ:FAN2_SYS] error: Cannot connect to IPMI host [192.168.249.35]:623. ipmi_ip_setup_con() returned error 0x16
6910:20141027:142210.513 query [txnlev:1] [update hosts set ipmi_disable_until=1414416190,ipmi_error='Cannot connect to IPMI host [192.168.249.35]:623. ipmi_ip_setup_con() returned error 0x16' where hostid=10084]

[Slash]

Hello,

It works for me with the following package on Debian 7:

dpkg -l|grep -i ipmi
ii  ipmitool                                        1.8.11-5                      amd64        utility for IPMI control with kernel driver or LAN interface
ii  libopenipmi-dev                                 2.0.16-1.3                    amd64        Intelligent Platform Management Interface - development
ii  libopenipmi0                                    2.0.16-1.3                    amd64        Intelligent Platform Management Interface - runtime
ii  openipmi                                        2.0.16-1.3                    amd64        Intelligent Platform Management Interface (for servers)

I also compilled zabbix-server with the option "--with-openipmi".

I'm monitoring some Dell R710 too with the following IPMI options on zabbix:
- Authentication algorithm: MD5
- Privilege level: Operator

I think I had to use an user with operator priv to make it work.

BTW, I have migrated the majority of my servers from IPMI to SNMP (via iDrac7) because I had a lot of missing values with IPMI. I tried to work it out and I realised that the iDrac was simply not responding fast enough and was dropping some request. It works much better with SNMP.

Not sure if the newer versions of iDrac work better with IPMI but I advice you to switch to SNMP if you can't work it out.

[joergi]

Not sure if the newer versions of iDrac work better with IPMI but I advice you to switch to SNMP if you can't work it out.

I think that would be the best. I will test this now....

Regards,
Jörg

[ufocek]

Hi,

This my ipmi sensors from server:

Ambient | 23.50 degrees C | ok
Systemboard | 31 degrees C | ok
CPU1 | 51 degrees C | ok
CPU2 | 51 degrees C | ok
DIMM-1A | 40 degrees C | ok
DIMM-2A | 38 degrees C | ok
DIMM-3A | disabled | ns
DIMM-1B | 43 degrees C | ok
DIMM-2B | 40 degrees C | ok
DIMM-3B | disabled | ns
DIMM-1C | 44 degrees C | ok
DIMM-2C | 43 degrees C | ok
DIMM-3C | disabled | ns
DIMM-1D | 34 degrees C | ok
DIMM-2D | 33 degrees C | ok
DIMM-3D | disabled | ns
DIMM-1E | 35 degrees C | ok
DIMM-2E | 34 degrees C | ok
DIMM-3E | disabled | ns
DIMM-1F | 34 degrees C | ok
DIMM-2F | 34 degrees C | ok
DIMM-3F | disabled | ns
BATT 3.0V | 3.22 Volts | ok
STBY 3.3V | 3.33 Volts | ok
iRMC 1.2V STBY | 1.20 Volts | ok
iRMC 1.8V STBY | 1.79 Volts | ok
LAN 1.0V STBY | 1 Volts | ok
LAN 1.8V STBY | 1.79 Volts | ok
MAIN 12V | 12 Volts | ok
MAIN 5V | 5.10 Volts | ok
MAIN 3.3V | 3.40 Volts | ok
IOH 1.8V | 1.78 Volts | ok
IOH 1.1V | 1.10 Volts | ok
IOH 1.1V AUX | 1.09 Volts | ok
ICH 1.5V | 1.49 Volts | ok
CPU1 1.8V | 1.80 Volts | ok
CPU2 1.8V | 1.80 Volts | ok
FAN1 SYS | 5760 RPM | ok
FAN2 SYS | 6120 RPM | ok
FAN3 SYS | 5760 RPM | ok
FAN4 SYS | 6000 RPM | ok
FAN5 SYS | 6120 RPM | ok
FAN6 SYS | 6120 RPM | ok
FAN7 SYS | 5880 RPM | ok
FAN8 SYS | 6120 RPM | ok
FAN9 SYS | 5880 RPM | ok
FAN10 SYS | 6120 RPM | ok
FAN11 SYS | 5760 RPM | ok
FAN12 SYS | 6480 RPM | ok
PSU1 Power | 92 Watts | ok
PSU2 Power | 100 Watts | ok
Total Power | 192 Watts | ok
Total Power Out | 164 Watts | ok
FAN1 PSU1 | 12060 RPM | ok
FAN2 PSU1 | disabled | ns
FAN1 PSU2 | 12330 RPM | ok
FAN2 PSU2 | disabled | ns

Now I add for test in zabbix key:

Name: FAN1 SYS
Type: ipmi agent
Key: ipmi.fan2.sys.rpm
Host interface: ip:623
IPMI sensor: FAN1 SYS (I put space between FAN1 and SYS)
Type of information: Numeric
Units: RPM

Zabbix show me information about item: not_supported, sensor data is not available...
What I set wrong in zabbix, that isn't work?

[x0x01]

Looks like it's openipmi lib ssl problem

I have same problem, ubuntu 12.04, zbx 2.4.2
On older servers (PowerEdge 2950) work fine, in new (PowerEdge R720) - error

FIX:
1. Install openipmi with ssl enabled from this ppa (or rebuild from sources --with-openssl)

dpkg -l|grep -i ipmi
ii  libopenipmi-dev                   2.0.18-0ubuntu3.1ppa1        Intelligent Platform Management Interface - development
ii  libopenipmi0                      2.0.18-0ubuntu3.1ppa1        Intelligent Platform Management Interface - runtime
ii  openipmi                          2.0.18-0ubuntu3.1ppa1        Intelligent Platform Management Interface (for servers)

2. Rebuild zabbix with --with-openipmi
3. On front values are next:

Authentication algorithm: RMCP+
Privilege level: Admin

[evertonco]

I have same problem, ubuntu 12.04, zbx 2.4.2
On older servers (PowerEdge 2950) work fine, in new (PowerEdge R720) - error

FIX:
1. Install openipmi with ssl enabled from this ppa (or rebuild from sources --with-openssl)

dpkg -l|grep -i ipmi
ii  libopenipmi-dev                   2.0.18-0ubuntu3.1ppa1        Intelligent Platform Management Interface - development
ii  libopenipmi0                      2.0.18-0ubuntu3.1ppa1        Intelligent Platform Management Interface - runtime
ii  openipmi                          2.0.18-0ubuntu3.1ppa1        Intelligent Platform Management Interface (for servers)

2. Rebuild zabbix with --with-openipmi
3. On front values are next:

Authentication algorithm: RMCP+
Privilege level: Admin

It works for me! Thanks!

[johntest]

I have same problem, ubuntu 12.04, zbx 2.4.2
On older servers (PowerEdge 2950) work fine, in new (PowerEdge R720) - error

FIX:
1. Install openipmi with ssl enabled from this ppa (or rebuild from sources --with-openssl)

dpkg -l|grep -i ipmi
ii  libopenipmi-dev                   2.0.18-0ubuntu3.1ppa1        Intelligent Platform Management Interface - development
ii  libopenipmi0                      2.0.18-0ubuntu3.1ppa1        Intelligent Platform Management Interface - runtime
ii  openipmi                          2.0.18-0ubuntu3.1ppa1        Intelligent Platform Management Interface (for servers)

2. Rebuild zabbix with --with-openipmi
3. On front values are next:

Authentication algorithm: RMCP+
Privilege level: Admin

Thank you very much!!!