SNMP Trap Problems - Unmatched Trap Received

[jf5264835]

In our environment we have recently started having issues with SNMP traps being logged as unmatched, despite matching items being present in the template on the hosts in question. A reboot of the zabbix-server process resolves the issue temporarily, however the problem returns after an unspecified period of time.
Our environment is CentOS 8 and Zabbix 6.4.12-1.

Below is one of the unmatched trap alerts from the zabbix-server.log as well as a screenshot of the items on this particular host.

2094260:20240310:003007.665 unmatched trap received from "10.1.9.25": 2024-03-10T00:30:07-0600 PDU INFO:
  receivedfrom                   UDP: [10.1.9.25]:162->[10.1.1.230]:162
  errorindex                     0
  messageid                      0
  transactionid                  599102
  requestid                      24363
  notificationtype               TRAP
  version                        1
  errorstatus                    0
  community                      ZhonePrivate
VARBINDS:
  DISMAN-EVENT-MIB::sysUpTimeInstance type=67 value=Timeticks: (1001924156) 115 days, 23:07:21.56
  SNMPv2-MIB::snmpTrapOID.0      type=6  value=OID: Zhone-GPON-MIB::zhoneGponOnuError
  ZHONE-SYSTEM-MIB::zhoneTrapVersion.0 type=2  value=INTEGER: 1
  ZHONE-SYSTEM-MIB::zhoneTrapFlags.0 type=4  value=Hex-STRING: 00
  ZHONE-SYSTEM-MIB::zhoneTrapsSequenceNumber.10.1.1.230 type=66 value=Gauge32: 24362
  ZHONE-SYSTEM-MIB::zhoneTrapsSeverity.10.1.1.230 type=2  value=INTEGER: 3
  ZHONE-SYSTEM-MIB::zhoneTrapsAllowedCategories.10.1.1.230 type=4  value=Hex-STRING: 02
  SNMPv2-MIB::sysObjectID.0      type=6  value=OID: ZhoneProductRegistrations::mxk1421
  ZHONE-SYSTEM-MIB::zhoneTrapUtcTime.0.10.1.1.230 type=66 value=Gauge32: 1710052206
  Zhone-GPON-MIB::zhoneGponOnuStatusWord.1107297227 type=4  value=Hex-STRING: 80 00 04 00
  Zhone::zhoneDsx.2.1.15.1107297227 type=67 value=Timeticks: (1710004683) 197 days, 22:00:46.83
  IF-MIB::ifAlias.1107297227     type=4  value=STRING: "1709570500909"
  Zhone-GPON-MIB::zhoneGponOltOnuConfigSerialNoVendorId.1107297227 type=4  value=STRING: "ZNTS"
  Zhone-GPON-MIB::zhoneGponOltOnuConfigSerialNoVendorSpecific.1107297227 type=4  value=STRING: "84541733"
  ZHONE-SYSTEM-MIB::zhoneTrapShelf.0 type=2  value=INTEGER: 1
  ZHONE-SYSTEM-MIB::zhoneTrapSlot.0 type=2  value=INTEGER: 2
  ZHONE-SYSTEM-MIB::zhoneTrapPort.0 type=2  value=INTEGER: 15
  ZHONE-SYSTEM-MIB::zhoneTrapSubPort.0 type=2  value=INTEGER: 6
  ZHONE-SYSTEM-MIB::zhoneTrapAlarmAction.1107297227.1024 type=2  value=INTEGER: 1
  ZHONE-SYSTEM-MIB::zhoneTrapAlarmId.1107297227.1024 type=2  value=INTEGER: 10174

[Juraj]

Hello,

we are experiencing exactly the same issue...
if you fully clone the host then this newly cloned host will get matched SNMP trap but not the original hosts....
and this all started with the 6.4.12 version....
wondering if moving from PERL to BASH SNMP trap processing will make any difference....
However the PERL script is correctly populating the trap file but it seems like the server doesn't match the hosts IP with the IP in the trap file...

Thanks,
J

[tfineberg]

So happy to find others with the same issue.
I am having the same problem with both traps coming into the server and proxy servers, both get fixed with a restart of the zabbix_server or zabbix_proxy service .
It is not all hosts that are been monitored by the server/proxy that snmp traps stop working at the same time. They start to drop off over time. sometimes within 1 hour. If any one has a fix please do post as this is a big issue for us.

[Juraj]

I have submitted ZBX bug to the support portal. Ticket ZBX-24247

https://support.zabbix.com/projects/ZBX/issues/ZBX-24247?filter=allissues&orderby=priority+ASC%2C+updated+DESC

[jf5264835]

Following that bug. I did attempt doing a full clone of one of my hosts that is acting up however it did not resolve the issue. The only "fix" we currently have is just a reboot of the server process once too many hosts are no longer processing traps.

[jf5264835]

Looks like this was resolved in 6.4.13. https://support.zabbix.com/browse/ZBX-24050