DM - child Node data not displayed in Master

[machtech]

Hi all,

Our business is working through a large scale Zabbix implementation project, and we are experiencing an issue with a Distributed Monitoring (DM) deployment, that the documentation and forums have not yet helped us to resolve.

We are running Zabbix 1.8 on PostgreSQL 8.3 on Ubuntu 9.04 Server_64. DM is the only issue we have with the system - all other functions are as expected.

We have the following architecture (in our test bed rig):
Master (z1 NodeID=1)
- Node child (z2 NodeID=2)
- - Agents on hosts
- Agents on hosts

This should have z2 collect its data, and forward up to z1. The issue is that z1 is not displaying any z2 data.

We had one issue in the logs that we thought was preventing the data transfer (see our fix posted here) but this has not solved the problem.

Please see the screenshots below for what we are experiencing....

Node child (z2) displaying its monitoring results correctly:


Master (z1) with the "All" node option selected top-right, i.e. it should display both z1 + z2 data, but z2 data not shown (only z1 is shown):


Master (z1) with the "z2" node selected as "current", and no z2 data shown:


Any advice or pointers most welcome, thanks :-)

Once we have this working, we look forward to posting back our HOWTO guide on deploying a complex and distributed solution with HA.

Cheers

Paul

[svenw]

hi there,

a lot of these problems are already fixed in the development version, as its a sole webinterface problem, just try out the new version.

sadly, not everything is fixed, i have high hopes for 1.8.1 which is to be released very soon (last week, yesterday, today.....)

svn co svn://svn.zabbix.com/branches/1.8/frontends/php if i get the syntax right here.....

good luck
svenw

[machtech]

Hi svenw

Many thanks for your post and suggestion.

I have just taken the latest SVN code from "trunk" and used the web frontend files under /php/ on the Master (z1) server.

This logs into the database ok, and is displaying "Zabbix 1.9 Copyright 2001-2009 by SIA Zabbix" (not 1.8) now in the footer on the pages.

Unfortunately, this has no impact in displaying child Node (z2) data.

Assuming the 1.8.1 release is not as bleeding edge as trunk, I fear the solution will have to come from another source.

All - is this just a PostgreSQL issue? Has anyone else experienced and found a solution??

Cheers,

Paul

[machtech]

This issue is isolated to PostgreSQL.

We have run up a new test bed, 1x Master and 1x Node child. This time, we used MySQL and not PostgreSQL. Added some hosts into the child Node and we were shortly rewarded with seeing the results on our Master web gui screen. Worked perfectly out of the box.

We also checked out the latest 'trunk' code from SVN, in case it was the web front-end, but that had no impact.

To the developers - is this issue with PostgreSQL going to be addressed in the 1.8.1 release? (I can find no specific reference in the 1.8.1 release notes)??

Many thanks - we are keen to use PostgreSQL if at all possible.

Cheers,

Paul

[nbrenckle]

mactech - I too have had strange issues with the proxy/DM configs in 1.8.1 and 1.8. One odd thing I have found, after the hosts disappearing is that I lose all the templates. My first thought was just to re-add the lost host, but then I cannot, as there are no templates. So either server or proxy must be editing the database in a bad way.

Is the latest SVN working for you or are you still having proxy issues? When I have servers monitored by proxy, they show by proxy:servername in the overview. Which is pretty handy, if it worked :-)

Nick

[machtech]

Hi Nick

We unfortunately were not able to get PostgreSQL working with 1.8, 1.8.1 or SVN "trunk" in a DM architecture with a Master and one or more child Nodes.

Our only solution was to give up on PostgreSQL and use MySQL. It all then "just worked". We otherwise followed identical build doco.

Cheers

Paul

[Remteic]

Hi,

I'm using zabbix 1.8.2 and I have the same problem: distributed monitoring doesn't work with PostgreSQL (no data display by master node).
Is it currently possible to resolve this problem?

[sire]

Same for me. Using Zabbix 1.8.2, PostgreSQL 8.4.4 on CentOS 5.5. Everything works except DM.
After creating md5 and length functions as described in http://www.zabbix.com/forum/showthre...8259#post58259 Zabbix server on master node terminates after I start Zabbix server on slave node.
Zabbix master server log attached.

[Remteic]

Sorry, I don't know how to fix your problem. Look the name of the died process with the PID. It's just an idea..

And the other problem, the database (PostgreSQL) on the master node contains the child (hosts, items,..). But no data of this child is displayed on the master frontend...
Any suggestions?

[Remteic]

I upgraded zabbix 1.8.2 to 1.8.3. Same problem but this error appears in dashboard:

reset() [<a href='function.reset'>function.reset</a>]: Passed variable is not an array or object[/var/www/include/blocks.inc.php:904]

for problems of child node. In blocks.inc.php, the erros refers to

// Check for dependencies
                $group = reset($trigger['groups']);

I take a look on the database. The database contains hosts, items,.. of child node but no data in the hosts_groups table for this child.

[Remteic]

After creating hosts groups on child node (in master node frontend), child hosts added in these groups are displayed. Changing configuration of hosts from child node (in master node frontend) are considered.
So all works fine except sending hosts groups from child node to master node. How to make it work?

[Remteic]

Problem resolved! But I don't know why...
I reinstalled zabbix servers on master and child nodes, several times with different ways. All works this time after basic setup of distributed monitoring.

Don't forget to include these following postgres requests:

CREATE FUNCTION md5(numeric) RETURNS text AS 'SELECT md5(($1)::text);'LANGUAGE SQL IMMUTABLE RETURNS NULL ON NULL INPUT;
CREATE FUNCTION length(numeric) RETURNS integer AS 'SELECT length(($1)::text);'LANGUAGE SQL IMMUTABLE RETURNS NULL ON NULL INPUT;

[sire]

I have done a clean install of Zabbix 1.8.3, created sql functions, set up DM according to the manual, and it worked! Seems that some issues have been fixed in this release.

[steev]

do you see the events from child nodes in the 'latest 20 events' on the master node? Everything seems to work on mine except this and I can't tell whether it's really supposed to be there or not.

[eres]

Hi guys,

is there any update on this?

we are recently migrated to a DM Setup with Master/Child and experiencing exactly the same issues.

- child and master are running fine
- child and master are communicating fine

at the child:
31988:20110523:172554.481 NODE 2: Sending configuration changes to master node 1 for node 2 datalen 584
and the master:
NODE 1: Received configuration changes from slave node 2 for node 2 datalen 225044

- trigger/items/hosts from the child are summed up within the master webfronend at the dashboard status window
- both node and child are configured well within the webfronend on both sides (master and child)

BUT at the select Nodes dropdown from masters webpanel i won't see the childnode - also there is no possibility of getting events or anything from the data visible which is obviously sent to the masternode...


Setup looks like this:

Zabbix Server v1.8.5 (revision 19050)
PostgreSQL 8.4.7

480 monitored hosts
67523 items
3537 triggers

Any advice would be welcome!