I had a unique requirement where I had to do deduplication based on substring of a whole message but after dedup want to preserver the full message.
For example if the alarm message formed is like "VARBIND1=<varbind-value1> VARBIND2=<varbind-value2> VARBIND3=<varbind-value3>"...