user Parameters stopped working in 1.8.2 " is not supported by agent Old status [0]"

[shaunr]

Hi

I've upgrade zabbix from 1.6.5 to 1.8.2 a few months back. Everything worked fine. I have a number of custom scripts and graphs and all worked fine until I added a new item to the template.

When I added the new item, the rest of the items stopped working. I can get the values from command line with no problem, which tells me that the agent and scripts work fine.

[root@palantir ~]# zabbix_get -s rprd-db1 -k iostat_disk[ASM3K,svctm]
14.56

The zabbix log file has these errors:

4902:20100603:150944.603 Parameter [rprd-db3:iostat_disk[ASM3K,svctm]] is not supported by agent Old status [0]

This is causing zabbix not to collect the info which is leaving huge blank spaces in my custom graphs.

Any help appreciated!

Zabbix Server :
OS : Centos 5.4 64bit
zabbix : 1.8.2
Agent : 1.6

Any help appreciated!

Shaun

[Wonderer]

First of all your log enrty is for rprd-db3 host, and you are trying to do zabbix_get for another rprd-db1 host.
Try to remove the new item, which you have added.

Also please provide more information for iostat_disk[ASM3K,svctm] items. Better if you post your UserParameter entries from the zabbix_agentd.conf file.
May be you made an typo in the zabbix_agentd.conf file when you add the new item?

[shaunr]

Hi Wonderer

Thanks for you response.

Yes the two servers do not match in my example cause I have a 4 node cluster that thats being monitored and I experience the same problem with all of them.

This used to work until recently when I tried to add a new item. All the others stopped working. I thought it maybe be a DB issue in mysql cause I frequently find " MySQL server has gone away" errors as well. I have since split my DB ibdata1 file into files per table according to

http://crazytoon.com/2007/04/03/mysql-ibdata-files-do-not-shrink-on-database-deletion-innodb/

but this has not gone away.

The user parameter in the zabbix_agent.conf is

UserParameter=iostat_disk[*],/usr/local/bin/zabbix_disk.sh $1 $2

The script zabbix_disk.sh takes 2 inputs and checks a log file for a vaule and returns that value.

[root@rprd-db1 ~]# /usr/local/bin/zabbix_disk.sh ASM3K svctm
0.46

From my zabbix server I can test this

[root@palantir zabbix]# zabbix_get -s rprd-db1 -k iostat_disk[ASM3K,svctm]
0.53

I am going to recreate the template where I store these items and relink them to the servers. We have changed the naming stds on the ASM disks over the weekend so I need to recreate the template with the new disk names anyways.

Shaun

[Wonderer]

One more.
How long it takes to get the data by the script zabbix_disk.sh? By default zabbix server timeout for receiving answer from the agent is 5 seconds.
See zabbix_server.conf, Timeout parameter.

[shaunr]

Hi

Here is the output of the time

[root@rprd-db1 ~]# time /usr/local/bin/zabbix_disk.sh ASM3K svctm
0.52

real	0m0.007s
user	0m0.001s
sys	0m0.010s
[root@rprd-db1 ~]#

[karichel]

user Parameters stopped working in 1.8.2 " is not supported by agent Old status [0]"

I am having the similar problem, does any one have solution to this.

Thanks,
Kishore

[shaunr]

OK some feedback,

I've created a new template and added the triggers for the ASM disks. I still get these errors in the log file

27309:20100609:090357.270 Parameter [56635][rprd-db1:iostat_disk[REDO2_4,write_m]] became supported by agent
.
.
 27278:20100609:090425.702 Parameter [rprd-db1:iostat_disk[REDO2_4,write_m]] is not supported by agent Old status [0]

The zabbix server command line still works

[root@palantir zabbix]# zabbix_get -s rprd-db1 -k iostat_disk[REDO2_4,write_m]
1455.83

So far I've tuned the Mysql DB, but this has not solved the problem of the database being down at random times.

27283:20100609:090430.983 [Z3005] Query failed: [2006] MySQL server has gone away [begin;]
 27283:20100609:090430.983 [Z3005] Query failed: [2006] MySQL server has gone away [select t.triggerid,i.itemid from triggers t,functions f,items i where t.triggerid=f.triggerid and f.itemid=i.itemid and t.status in (0) and t.value not in (2) and i.itemid in (50690)]
 27283:20100609:090430.983 Database is down. Retrying in 10 seconds
 27305:20100609:090435.672 [Z3005] Query failed: [2006] MySQL server has gone away [begin;]
 27305:20100609:090435.672 [Z3005] Query failed: [2006] MySQL server has gone away [update hosts set errors_from=0,disable_until=0,error='' where hostid=10068]
 27305:20100609:090435.672 Database is down. Retrying in 10 seconds
 27270:20100609:090437.431 Item [rmb-dev-legolas-ap1:net.if.in[eth0,bytes]] error: Type of received value [1699446044489] is not suitable for value type [Numeric (float)]
 27270:20100609:090437.431 [Z3005] Query failed: [2006] MySQL server has gone away [begin;]
 27270:20100609:090437.431 [Z3005] Query failed: [2006] MySQL server has gone away [select t.triggerid,i.itemid from triggers t,functions f,items i where t.triggerid=f.triggerid and f.itemid=i.itemid and t.status in (0) and t.value not in (2) and i.itemid in (39277)]
 27270:20100609:090437.431 Database is down. Retrying in 10 seconds

I'm not sure if these two are related.

[sineex]

Have the same problem with v1.8.2 (revision 11211). The zabbix_get mostly works, but Zabbix server doesn't. Mostly works means it shows values, but sometimes give the ZBX_NOTSUPPORTED answer.

[shaunr]

Yup I still have that problem. I have since moved away from Mysql and I'm now using postgres. I face a whole host of performance issues now.

[markl]

Did you ever get to the bottom of why items stopped working? I've a similar issue (with 1.8.4) and if it wasn't for looking in the log files we would have never known that Zabbix was displaying old status's :-(

Scripts have not changed since 1.6 days and they were working fine. Command line runs of the scripts work fine. Example error:

19007:20110311:143549.960 Item [xxxx:database[live,dbname]] error: Type of received value [The process cannot access the file because it is being used by another process.] is not suitable for value type [Numeric (unsigned)]

Cheers.

Mark.

[shaunr]

Hi Mark

No I have not Found the problem.

I have managed to work around those items and disabled some.

If you find anything, let me know

Thanks
shaun

[kdx200rider]

Change value type

I had a similar problem when I upgraded from 1.4.6 to 1.8.2. for many of my UserParameters items that issue OS commands and then trim and return the output. I was able to solve most by switching the item to "Numeric (Float)" from "Numeric (Unsighed).

[markl]

Thanks. I'll give that a try.

[markl]

Sorry. Changing from numeric (unsigned) to numeric (float) didn't fix any of my items that use parameters. Since upgrading to 1.8.4 it now seems that most of my items are not working so Zabbix is pretty much useless as we can't rely on the data being shown. I'll persist with trying to resolve but we are now evaluating another product in the hope its more reliable.

[kostya2]

I seem to have a similar problem. Somehow it is limited to just one subnet that is configured to use a particular proxy.