I have many servers running windows 2003 server and just on 4 zabbix agents are constantly crashing. I use the same template for every server so no difference there. At first log did not gave me any useful information but when i changed log level it gave me information to work with, but cant get my head around it. Can someone explain what happens ? Thank You.
5088:20111028:171222.695 Requested [perf_counter[\Memory\Cache Bytes]]
5088:20111028:171222.695 Sending back [196517888.000000]
3944:20111028:171222.930 Processing request.
3944:20111028:171222.930 Requested [perf_counter[\Memory\Pages Input/sec]]
4212:20111028:171223.242 In collect_cpustat()
5212:20111028:171223.258 In send_buffer('xxxxx','10051')
5212:20111028:171223.258 Values in the buffer 2 Max 100
5212:20111028:171223.258 Will not send now. Now 1319811143 lastsent 1319811142 < 5
5212:20111028:171223.258 Sleeping for 1 seconds
3944:20111028:171223.930 Sending back [0.000000]
4212:20111028:171224.242 In collect_cpustat()
5212:20111028:171224.258 In send_buffer('xxxxxx','10051')
5212:20111028:171224.258 Values in the buffer 2 Max 100
5212:20111028:171224.258 Will not send now. Now 1319811144 lastsent 1319811142 < 5
5212:20111028:171224.258 Sleeping for 1 seconds
1104:20111028:171225.117 Processing request.
1104:20111028:171225.117 Requested [perf_counter[\PhysicalDisk(_Total)\Disk Transfers/sec]]
4212:20111028:171225.242 In collect_cpustat()
5212:20111028:171225.258 In send_buffer('xxxxx','10051')
5212:20111028:171225.258 Values in the buffer 2 Max 100
5212:20111028:171225.258 Will not send now. Now 1319811145 lastsent 1319811142 < 5
5212:20111028:171225.258 Sleeping for 1 seconds
1104:20111028:171226.133 Sending back [1.001399]
4212:20111028:171226.242 In collect_cpustat()
5212:20111028:171226.258 In send_buffer('xxxxx','10051')
5212:20111028:171226.258 Values in the buffer 2 Max 100
5212:20111028:171226.258 Will not send now. Now 1319811146 lastsent 1319811142 < 5
5212:20111028:171226.258 Sleeping for 1 seconds
5088:20111028:171226.930 Processing request.
5088:20111028:171226.930 Requested [vfs.file.size[c:\msdos.sys]]
5088:20111028:171226.930 Sending back [0]
3944:20111028:171227.055 Processing request.
3944:20111028:171227.055 Requested [perf_counter[\Memory\Page Faults/sec]]
4212:20111028:171227.242 In collect_cpustat()
5212:20111028:171227.258 In send_buffer('xxxxx','10051')
5212:20111028:171227.258 Values in the buffer 2 Max 100
5212:20111028:171227.258 JSON before sending [{
"request":"agent data",
"data":[
{
"host":"ALRPROD1_Admin",
"key":"eventlog[System]",
"value":"The ZABBIX Agent service terminated unexpectedly. It has done this 1 time(s). The following corrective action will be taken in 1000 milliseconds: Restart the service.\r\n",
"lastlogsize":371,
"timestamp":1319811141,
"source":"Service Control Manager",
"severity":4,
"eventid":7031,
"clock":1319811142},
{
"host":"ALRPROD1_Admin",
"key":"eventlog[System]",
"value":"The ZABBIX Agent service entered the running state.\r\n",
"lastlogsize":372,
"timestamp":1319811142,
"source":"Service Control Manager",
"severity":1,
"eventid":7036,
"clock":1319811142}],
"clock":1319811147}]
5212:20111028:171227.258 JSON back [{
"response":"success",
"info":"Processed 2 Failed 0 Total 2 Seconds spent 0.000092"}]
5212:20111028:171227.258 In check_response({
"response":"success",
"info":"Processed 2 Failed 0 Total 2 Seconds spent 0.000092"})
5212:20111028:171227.258 Info from server: Processed 2 Failed 0 Total 2 Seconds spent 0.000092
5212:20111028:171227.258 OK
5212:20111028:171227.258 Sleeping for 1 seconds
3944:20111028:171228.055 Sending back [6.008183]
4212:20111028:171228.242 In collect_cpustat()
5212:20111028:171228.258 In send_buffer('xxxxx','10051')
5212:20111028:171228.258 Values in the buffer 0 Max 100
5212:20111028:171228.258 Will not send now. Now 1319811148 lastsent 1319811147 < 5
5088:20111028:171222.695 Sending back [196517888.000000]
3944:20111028:171222.930 Processing request.
3944:20111028:171222.930 Requested [perf_counter[\Memory\Pages Input/sec]]
4212:20111028:171223.242 In collect_cpustat()
5212:20111028:171223.258 In send_buffer('xxxxx','10051')
5212:20111028:171223.258 Values in the buffer 2 Max 100
5212:20111028:171223.258 Will not send now. Now 1319811143 lastsent 1319811142 < 5
5212:20111028:171223.258 Sleeping for 1 seconds
3944:20111028:171223.930 Sending back [0.000000]
4212:20111028:171224.242 In collect_cpustat()
5212:20111028:171224.258 In send_buffer('xxxxxx','10051')
5212:20111028:171224.258 Values in the buffer 2 Max 100
5212:20111028:171224.258 Will not send now. Now 1319811144 lastsent 1319811142 < 5
5212:20111028:171224.258 Sleeping for 1 seconds
1104:20111028:171225.117 Processing request.
1104:20111028:171225.117 Requested [perf_counter[\PhysicalDisk(_Total)\Disk Transfers/sec]]
4212:20111028:171225.242 In collect_cpustat()
5212:20111028:171225.258 In send_buffer('xxxxx','10051')
5212:20111028:171225.258 Values in the buffer 2 Max 100
5212:20111028:171225.258 Will not send now. Now 1319811145 lastsent 1319811142 < 5
5212:20111028:171225.258 Sleeping for 1 seconds
1104:20111028:171226.133 Sending back [1.001399]
4212:20111028:171226.242 In collect_cpustat()
5212:20111028:171226.258 In send_buffer('xxxxx','10051')
5212:20111028:171226.258 Values in the buffer 2 Max 100
5212:20111028:171226.258 Will not send now. Now 1319811146 lastsent 1319811142 < 5
5212:20111028:171226.258 Sleeping for 1 seconds
5088:20111028:171226.930 Processing request.
5088:20111028:171226.930 Requested [vfs.file.size[c:\msdos.sys]]
5088:20111028:171226.930 Sending back [0]
3944:20111028:171227.055 Processing request.
3944:20111028:171227.055 Requested [perf_counter[\Memory\Page Faults/sec]]
4212:20111028:171227.242 In collect_cpustat()
5212:20111028:171227.258 In send_buffer('xxxxx','10051')
5212:20111028:171227.258 Values in the buffer 2 Max 100
5212:20111028:171227.258 JSON before sending [{
"request":"agent data",
"data":[
{
"host":"ALRPROD1_Admin",
"key":"eventlog[System]",
"value":"The ZABBIX Agent service terminated unexpectedly. It has done this 1 time(s). The following corrective action will be taken in 1000 milliseconds: Restart the service.\r\n",
"lastlogsize":371,
"timestamp":1319811141,
"source":"Service Control Manager",
"severity":4,
"eventid":7031,
"clock":1319811142},
{
"host":"ALRPROD1_Admin",
"key":"eventlog[System]",
"value":"The ZABBIX Agent service entered the running state.\r\n",
"lastlogsize":372,
"timestamp":1319811142,
"source":"Service Control Manager",
"severity":1,
"eventid":7036,
"clock":1319811142}],
"clock":1319811147}]
5212:20111028:171227.258 JSON back [{
"response":"success",
"info":"Processed 2 Failed 0 Total 2 Seconds spent 0.000092"}]
5212:20111028:171227.258 In check_response({
"response":"success",
"info":"Processed 2 Failed 0 Total 2 Seconds spent 0.000092"})
5212:20111028:171227.258 Info from server: Processed 2 Failed 0 Total 2 Seconds spent 0.000092
5212:20111028:171227.258 OK
5212:20111028:171227.258 Sleeping for 1 seconds
3944:20111028:171228.055 Sending back [6.008183]
4212:20111028:171228.242 In collect_cpustat()
5212:20111028:171228.258 In send_buffer('xxxxx','10051')
5212:20111028:171228.258 Values in the buffer 0 Max 100
5212:20111028:171228.258 Will not send now. Now 1319811148 lastsent 1319811147 < 5