No more notifications for new web scenarios

[schoeppi]

I am using zabbix 7.0.9 and for new web scenarios I do not get notifications if a problem ocurs. For older web scenarios I still get notifications, but I can't say how long back the problem is there. I have this behaviour on two zabbix instances and now I am wondering if this is a bug or if I am doing something wrong.

Steps to reproduce:

1. Create a hostt and link the ICMP Ping and the Website Certificate for Agent 2. As interface type select agent and set the propper ip address for this host. In the macro section specify the right FQDN for the new host.
2. After the new host is saved create a new web scenario. Define only one step, give it a name (e.g. search body for regex), specify a workingURL and give a pattern that can be searched in the body. In the section for authentification check that SSL peers and the SSL hostname should be checked. Save the step and then the whole scenario.
3. Now watch the latest data for the new host till at least the data for the web scenario are there. Chack that searching for the pattern is OK.
4. Now change the search pattern in the web scenario configuration to a value that can not be found and wait till this new configuration is processed. In the latest data overview for the host at this point it can be seen that there is a problem with the web scenario and normaly a notification should be send out. That ist not longer working for new web scenarios, but for older scenarios this kind of setup is still OK and I get a mail notification.
5. Even if I change the URL in the web scenario to a invalid value that can not be found no notification is triggered.

Now I wonder if I am the only one with this problem, if I am doing something wrong setting up web scenarios or if it is a general problem with my two Zabbix 7.0.9 instances or with the 7.0.9 release in general. I've updated all my templates before and checked the logs but I can't find nay helpfull hints...

[kyus]

There are some points to be checked...

A event was generated for the failed step in this scenario?
Is there a trigger action to send notifications in case of a problem in this scenario? If so, the user who should send the notification has a media configured?
The user has access to the data from this host?

[schoeppi]

There are some points to be checked...

A event was generated for the failed step in this scenario?

No. For new web scenarios I've created with 7.0.9 no event is created. For scenarios I've created before 7.0.9 and updated with 7.0.9 also no event is created. For scenarios created before 7.0.9 an event is created instead and also notifications are send. I've checked the events table in the database to see when and if events are created.

Is there a trigger action to send notifications in case of a problem in this scenario? If so, the user who should send the notification has a media configured?
The user has access to the data from this host?

Yes to all points. Because I get notifications I've created before 7.0.9 I think the setup and configuration is OK. I also get notifications for new hosts created with 7.0.9 or for other things I've changed with 7.0.9, only the notifications or the event creation for new or updated web scenarios do not longer work.

I've no idea how to further debug the problem :-(.

[kyus]

You were already in version 7 or the upgrade was form 6.x or 5.x?

only the notifications or the event creation for new or updated web scenarios do not longer work.

Oh, so the notifications aren't working because there are no problems being created for your web scenarios?

[schoeppi]

You were already in version 7 or the upgrade was form 6.x or 5.x?

I've updated from 6.4 to 7.0. With earlier version of the 7.0.x versions all was fine and even now older scenarios do trigger an event and a notification if they fail.


Oh, so the notifications aren't working because there are no problems being created for your web scenarios?

Yes, that seems to be the problem.

As said, older scenarios do still work. For them a notification is send and I can see in the overview for the problems that there is something wrong.

But for updated scenarios or for new hosts with a new scenario or also for already existing hosts with a new scenario nothing happens. For the not working scenarios I can see in the latest data that there is a problem, so the items seem to work, but there is not longer an event triggered and therefore no notifications are send.

Because I have the problem on two Zabbix installations I think there must be something basicaly wrong with the web scenarios at the moment. Or I am doing something basicaly wrong...

I've set the debug level to 4 now and try to find something in the logs, but the logs are really difficult to read. Its not really clear what belongs to which process. But maybe I'll find something.

Any ideas how to solve this unwanted behaviour is wellcome, otherwise I have to roll back to a earlier version and restore data from backup and need to perform the changes I made the last two weeks or so again :-(. I can also setup a new 7.0.9 instance just to test those scenario thing with one host if this is helpfull, at least such a setup would create not that much of logs and the reason might be easier to find.

[kyus]

How are your triggers configurated for the web scenarios?

[schoeppi]

How are your triggers configurated for the web scenarios?

How and where can I see the items and triggers for web scenarios? I do not see items or triggers for any web scenario, no matter it is working or not :-(. I really do not know it, asked myself this question already.

[kyus]

Items for web scenarios are displayed in the "Web" section when you go to monitoring > Hosts > Web

Triggers in the other hand need to be created for the web scenario
You can use a expression like:
sum(/host/web.test.fail[some string],#3)>=3

I would suggest building a template to do web monitoring...

[kyus]

Here's the documentation for web monitoring, it will be helpful:

https://www.zabbix.com/documentation/7.0/en/manual/web_monitoring

https://www.zabbix.com/documentation/7.0/en/manual/web_monitoring/items

https://www.zabbix.com/documentation/7.0/en/manual/web_monitoring/example

[schoeppi]

Items for web scenarios are displayed in the "Web" section when you go to monitoring > Hosts > Web

Sorry, I can't find them :-(.

If I go to monitoring, host and then select "View web" or "configure web" I can see my web scenarios or configure them, but I can't see the items or triggers that are created when web scenarios are configured.

I would suggest building a template to do web monitoring...

That is absolutely not what I want to do for several reasons:

1. Older web scenarios still do work without a problem.
2. I need to have web scenarios for hosts with one or more steps depending on the host I like to check. for some hosts special things like authentication or invalid SSL certificates have to be configured. Web scenarios are perfect for this needs and building a template for all this needs would be very complicated I think.

The web scenarios worked perfectly till now and they should still work, otherwise it is a bug that have to be fixed. Just wo work around a bug by building a template for a thing that has worked and that is still working for most of my scenarios isn't a propper solution and would make things only much more complicated.

I'll setup a fresh Zabbix now to test if web scenarios do work with this installation. If not it is a problem with my current setup, if yes it is a bug that needs to be fixed.

BTW.: Where can I report zabbix bugs?

[kyus]

I mentioned building a template to make life easier when seting up new hosts/web scenarios not to workaround a bug.

It's pretty simple, if you haven't created a trigger for any of the new web scenarios that you added, you won't receive any warnings when something happen.

If I go to monitoring, host and then select "View web" or "configure web" I can see my web scenarios or configure them, but I can't see the items or triggers that are created when web scenarios are configured.

You can't see web scenario "items" in configuration > host > items. But you can see them in Monitoring > Latest data.
Triggers aren't automatically generated once you add a web scenario... If you want a trigger you have to create one

[schoeppi]

It's pretty simple, if you haven't created a trigger for any of the new web scenarios that you added, you won't receive any warnings when something happen.

Yes, thats clear.

You can't see web scenario "items" in configuration > host > items. But you can see them in Monitoring > Latest data.

There I can see all items of the scenarios.

Triggers aren't automatically generated once you add a web scenario... If you want a trigger you have to create one

OK, and this must be new.

Why do my old scenarios work allthough I never created a trigger? I just created scenarios and nothing else and everything worked. But this is not longer the case for new or updated scenarios.

I understand that the triggers are not created any more and therefore also no events are triggered, but why? Has this changed in 7.0.9?

[kyus]

Triggers were never created automatically for web scenarios...

If you want, share the configuration of the action that sends the emails...

[schoeppi]

[QUOTE=kyus;n498740]Triggers were never created automatically for web scenarios...

OK, your right :-).

I really do not understand how my older web scenarios worked because I do not remember that I also created triggers for them manualy. But you are absolutely right that no triggers are created automaticaly when web scenarios are configured. This I can see in my current Zabbix instances and also in a new instance I've created for testing. I am really confused now, is my brain really that bad already :-)?

I now will follow your tip and create a template for the triggers.

Thanks a lot for all you help and especialy for your patience!

[schoeppi]

I've tried to create a template for web scenarios now but its not clear to me how to create this trigger for a template to work with all web scenarios with different names:

length(last(/host/web.test.error[Scenario]))>0 and last(/host/web.test.fail[Scenario])>0

The trigger works for single hosts if I specify the name of the scenario, but how can I create such a trigger for a template that is linked to different hosts with different scenarios with different names?