Hi,
My HouseKeepingFrequency is currently set to 3. I think this was set a long time ago. I don't know the reasoning behind the decision.
House keeping usually takes between 1000 and 2000 seconds (15-30 minutes), but every now and then it takes MUCH longer. Like 30 000 seconds (8+ hours).
I can see in the log that this is when a lot of items/triggers are deleted but I don't understand why the amount differs so much.
Sometimes our Zabbix setup craps out completely and all respons time/heartbeat type triggers go off. I'm pretty sure this is because the database is overloaded. I suspect this is in some part caused by big housekeeper runs.
Basically my questions are
1. Why does the number of deletes differ so much when comparing housekeeper runs? Mostly 0 but then sometimes millions!
2. Could lowering the HouseKeepingFrequency from 3 to 1 help? Hoping that maybe those really heavy runs might be split up.
Here is an example of a period of housekeeper logs:
My HouseKeepingFrequency is currently set to 3. I think this was set a long time ago. I don't know the reasoning behind the decision.
House keeping usually takes between 1000 and 2000 seconds (15-30 minutes), but every now and then it takes MUCH longer. Like 30 000 seconds (8+ hours).
I can see in the log that this is when a lot of items/triggers are deleted but I don't understand why the amount differs so much.
Sometimes our Zabbix setup craps out completely and all respons time/heartbeat type triggers go off. I'm pretty sure this is because the database is overloaded. I suspect this is in some part caused by big housekeeper runs.
Basically my questions are
1. Why does the number of deletes differ so much when comparing housekeeper runs? Mostly 0 but then sometimes millions!
2. Could lowering the HouseKeepingFrequency from 3 to 1 help? Hoping that maybe those really heavy runs might be split up.
Here is an example of a period of housekeeper logs:
Code:
67058:20190630:072756.231 housekeeper [deleted 12786592 hist/trends, 0 items/triggers, 1338 events, 8138 problems, 2496 sessions, 0 alarms, 2701 audit items in 1303.351585 sec, idle for 3 hour(s)] 67058:20190630:105222.941 housekeeper [deleted 14840663 hist/trends, 0 items/triggers, 890 events, 230 problems, 2427 sessions, 0 alarms, 2626 audit items in 1434.899820 sec, idle for 3 hour(s)] 67058:20190630:141620.337 housekeeper [deleted 15643501 hist/trends, 0 items/triggers, 623 events, 242 problems, 2450 sessions, 0 alarms, 2650 audit items in 1422.781315 sec, idle for 3 hour(s)] 67058:20190630:173956.797 housekeeper [deleted 15171196 hist/trends, 0 items/triggers, 531 events, 973 problems, 2444 sessions, 0 alarms, 2643 audit items in 1398.136232 sec, idle for 3 hour(s)] 67058:20190630:210505.835 housekeeper [deleted 14323139 hist/trends, 32 items/triggers, 535 events, 230 problems, 3014 sessions, 0 alarms, 3214 audit items in 1493.537297 sec, idle for 3 hour(s)] 67058:20190701:003324.106 housekeeper [deleted 13348539 hist/trends, 0 items/triggers, 720 events, 234 problems, 3474 sessions, 0 alarms, 3676 audit items in 1678.072912 sec, idle for 3 hour(s)] [B] 67058:20190701:120223.487 housekeeper [deleted 12468054 hist/trends, 98532823 items/triggers, 1955 events, 440 problems, 2503 sessions, 0 alarms, 2708 audit items in 30528.617477 sec, idle for 3 hour(s)] 88867:20190703:064616.394 housekeeper [deleted 14587030 hist/trends, 140221301 items/triggers, 6408 events, 20708 problems, 20519 sessions, 0 alarms, 5630 audit items in 36666.300540 sec, idle for 3 hour(s)][/B] 28485:20190703:110222.448 housekeeper [deleted 14855766 hist/trends, 88 items/triggers, 1214 events, 30976 problems, 17888 sessions, 0 alarms, 3460 audit items in 5779.056954 sec, idle for 3 hour(s)] [B] 28485:20190703:210336.611 housekeeper [deleted 44069413 hist/trends, 21039403 items/triggers, 4224 events, 1687 problems, 3807 sessions, 0 alarms, 9662 audit items in 25146.993433 sec, idle for 3 hour(s)][/B] 28485:20190704:013219.042 housekeeper [deleted 39496483 hist/trends, 0 items/triggers, 4741 events, 6950 problems, 7246 sessions, 0 alarms, 13638 audit items in 5242.912676 sec, idle for 3 hour(s)] 28485:20190704:060837.956 housekeeper [deleted 37619917 hist/trends, 0 items/triggers, 3445 events, 7286 problems, 3213 sessions, 0 alarms, 16052 audit items in 5771.998779 sec, idle for 3 hour(s)] 28485:20190704:101209.106 housekeeper [deleted 36217983 hist/trends, 0 items/triggers, 3969 events, 1493 problems, 3325 sessions, 0 alarms, 13300 audit items in 3765.438135 sec, idle for 3 hour(s)] [B] 28485:20190704:160149.496 housekeeper [deleted 35023746 hist/trends, 27332014 items/triggers, 1851 events, 1807 problems, 6609 sessions, 0 alarms, 9373 audit items in 10164.894914 sec, idle for 3 hour(s)][/B] 28485:20190704:195449.286 housekeeper [deleted 25678501 hist/trends, 0 items/triggers, 3947 events, 805 problems, 11149 sessions, 0 alarms, 16653 audit items in 3164.897905 sec, idle for 3 hour(s)] 28485:20190704:231522.760 housekeeper [deleted 15196041 hist/trends, 0 items/triggers, 1368 events, 475 problems, 5419 sessions, 0 alarms, 11426 audit items in 1220.692083 sec, idle for 3 hour(s)] 28485:20190705:023459.857 housekeeper [deleted 9977404 hist/trends, 0 items/triggers, 795 events, 346 problems, 4598 sessions, 0 alarms, 4794 audit items in 1162.449456 sec, idle for 3 hour(s)] 28485:20190705:054907.444 housekeeper [deleted 8680610 hist/trends, 0 items/triggers, 1186 events, 9099 problems, 4623 sessions, 0 alarms, 4819 audit items in 835.051035 sec, idle for 3 hour(s)] 28485:20190705:091003.178 housekeeper [deleted 10863573 hist/trends, 0 items/triggers, 1114 events, 490 problems, 5933 sessions, 0 alarms, 6123 audit items in 1244.474991 sec, idle for 3 hour(s)] 28485:20190705:122632.398 housekeeper [deleted 9374202 hist/trends, 0 items/triggers, 744 events, 450 problems, 7204 sessions, 0 alarms, 7385 audit items in 978.518366 sec, idle for 3 hour(s)] [B] 28485:20190705:170632.200 housekeeper [deleted 10408833 hist/trends, 19370999 items/triggers, 543 events, 580 problems, 7165 sessions, 0 alarms, 7358 audit items in 5992.795214 sec, idle for 3 hour(s)] 28485:20190705:205312.521 housekeeper [deleted 17463263 hist/trends, 2951626 items/triggers, 1097 events, 575 problems, 8206 sessions, 0 alarms, 8481 audit items in 2789.053763 sec, idle for 3 hour(s)][/B] 28485:20190706:001644.007 housekeeper [deleted 14503992 hist/trends, 0 items/triggers, 737 events, 368 problems, 5303 sessions, 0 alarms, 5526 audit items in 1403.175397 sec, idle for 3 hour(s)] 28485:20190706:033651.761 housekeeper [deleted 11865954 hist/trends, 0 items/triggers, 1277 events, 620 problems, 4231 sessions, 0 alarms, 4431 audit items in 1193.482517 sec, idle for 3 hour(s)] 28485:20190706:065611.142 housekeeper [deleted 10218165 hist/trends, 0 items/triggers, 2437 events, 7443 problems, 2698 sessions, 0 alarms, 2893 audit items in 1147.746009 sec, idle for 3 hour(s)] 28485:20190706:102417.881 housekeeper [deleted 13711486 hist/trends, 0 items/triggers, 1661 events, 1300 problems, 3948 sessions, 0 alarms, 4144 audit items in 1662.003475 sec, idle for 3 hour(s)] 28485:20190706:135623.545 housekeeper [deleted 15786055 hist/trends, 0 items/triggers, 931 events, 293 problems, 4981 sessions, 0 alarms, 5186 audit items in 1900.670158 sec, idle for 3 hour(s)] 28485:20190706:172931.614 housekeeper [deleted 16175564 hist/trends, 0 items/triggers, 1071 events, 538 problems, 5098 sessions, 0 alarms, 5306 audit items in 1973.711561 sec, idle for 3 hour(s)] 28485:20190706:210146.130 housekeeper [deleted 15539733 hist/trends, 0 items/triggers, 970 events, 505 problems, 5124 sessions, 0 alarms, 5330 audit items in 1916.026015 sec, idle for 3 hour(s)] 28485:20190707:002951.847 housekeeper [deleted 16141278 hist/trends, 0 items/triggers, 671 events, 316 problems, 5091 sessions, 0 alarms, 5298 audit items in 1668.847219 sec, idle for 3 hour(s)] [B] 28485:20190707:061241.502 housekeeper [deleted 12183792 hist/trends, 28518575 items/triggers, 1840 events, 407 problems, 4997 sessions, 0 alarms, 5202 audit items in 9755.735260 sec, idle for 3 hour(s)][/B] 28485:20190707:095421.688 housekeeper [deleted 22064584 hist/trends, 0 items/triggers, 1733 events, 9192 problems, 8226 sessions, 0 alarms, 8564 audit items in 2484.763481 sec, idle for 3 hour(s)] 28485:20190707:132216.859 housekeeper [deleted 15332542 hist/trends, 0 items/triggers, 854 events, 282 problems, 5317 sessions, 0 alarms, 5533 audit items in 1660.920519 sec, idle for 3 hour(s)] 28485:20190707:164904.678 housekeeper [deleted 14859993 hist/trends, 0 items/triggers, 693 events, 247 problems, 4974 sessions, 0 alarms, 5177 audit items in 1597.460337 sec, idle for 3 hour(s)] 28485:20190707:201345.882 housekeeper [deleted 13218570 hist/trends, 0 items/triggers, 667 events, 294 problems, 4969 sessions, 0 alarms, 5171 audit items in 1470.208648 sec, idle for 3 hour(s)] 28485:20190707:233233.890 housekeeper [deleted 12734259 hist/trends, 0 items/triggers, 601 events, 279 problems, 4915 sessions, 0 alarms, 5115 audit items in 1115.445842 sec, idle for 3 hour(s)] 28485:20190708:030237.890 housekeeper [deleted 11812100 hist/trends, 0 items/triggers, 928 events, 487 problems, 4766 sessions, 0 alarms, 4961 audit items in 1784.790124 sec, idle for 3 hour(s)]
Comment