Ad Widget

Collapse

Zabbix 1.9.9

Collapse
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • frater
    Senior Member
    • Oct 2010
    • 340
    #1

    Zabbix 1.9.9

    It seems everything I do regarding change of configuration will give me errors:

    Here I'm merely changing port 10050 to 10052
    Code:
        Error in query [UPDATE interface SET interfaceid='10022', type='1', ip='89.250.170.164', dns='', useip='1', port='10052', main='1', hostid='10056' WHERE (interfaceid IN ('10022')) ] [Lock wait timeout exceeded; try restarting transaction]
    SQL statement execution has failed "UPDATE interface SET interfaceid='10022', type='1', ip='89.250.170.164', dns='', useip='1', port='10052', main='1', hostid='10056' WHERE (interfaceid IN ('10022')) ".
    Code:
    root@ns5:~# grep -B1 impossi /var/log/zabbix-server/zabbix_server.log
 14813:20120215:133320.638 [Z3005] query failed: [1205] Lock wait timeout exceeded; try restarting transaction [update ids set nextid=nextid+1 where nodeid=0 and table_name='events' and field_name='eventid']
zabbix_server [14813]: ERROR [file:db.c,line:1403] Something impossible has just happened.
--
 14812:20120215:133425.532 [Z3005] query failed: [1205] Lock wait timeout exceeded; try restarting transaction [update ids set nextid=nextid+1 where nodeid=0 and table_name='events' and field_name='eventid']
zabbix_server [14812]: ERROR [file:db.c,line:1403] Something impossible has just happened.
--
 14812:20120215:133531.607 [Z3005] query failed: [1205] Lock wait timeout exceeded; try restarting transaction [update ids set nextid=nextid+1 where nodeid=0 and table_name='events' and field_name='eventid']
zabbix_server [14812]: ERROR [file:db.c,line:1403] Something impossible has just happened.
--
 14812:20120215:133635.948 [Z3005] query failed: [1205] Lock wait timeout exceeded; try restarting transaction [update ids set nextid=nextid+1 where nodeid=0 and table_name='events' and field_name='eventid']
zabbix_server [14812]: ERROR [file:db.c,line:1403] Something impossible has just happened.
--
 14812:20120215:133740.760 [Z3005] query failed: [1205] Lock wait timeout exceeded; try restarting transaction [update ids set nextid=nextid+1 where nodeid=0 and table_name='events' and field_name='eventid']
zabbix_server [14812]: ERROR [file:db.c,line:1403] Something impossible has just happened.
--
 14812:20120215:133845.836 [Z3005] query failed: [1205] Lock wait timeout exceeded; try restarting transaction [update ids set nextid=nextid+1 where nodeid=0 and table_name='events' and field_name='eventid']
zabbix_server [14812]: ERROR [file:db.c,line:1403] Something impossible has just happened.
--
 14812:20120215:133950.945 [Z3005] query failed: [1205] Lock wait timeout exceeded; try restarting transaction [update ids set nextid=nextid+1 where nodeid=0 and table_name='events' and field_name='eventid']
zabbix_server [14812]: ERROR [file:db.c,line:1403] Something impossible has just happened.
--
 14823:20120215:134004.929 [Z3005] query failed: [1205] Lock wait timeout exceeded; try restarting transaction [update ids set nextid=nextid+1 where nodeid=0 and table_name='events' and field_name='eventid']
zabbix_server [14823]: ERROR [file:db.c,line:1403] Something impossible has just happened.
 14826:20120215:134010.430 [Z3005] query failed: [1205] Lock wait timeout exceeded; try restarting transaction [update ids set nextid=nextid+1 where nodeid=0 and table_name='events' and field_name='eventid']
zabbix_server [14826]: ERROR [file:db.c,line:1403] Something impossible has just happened.
--
 14814:20120215:134055.990 [Z3005] query failed: [1205] Lock wait timeout exceeded; try restarting transaction [update ids set nextid=nextid+1 where nodeid=0 and table_name='events' and field_name='eventid']
zabbix_server [14814]: ERROR [file:db.c,line:1403] Something impossible has just happened.
--
 14814:20120215:134200.143 [Z3005] query failed: [1205] Lock wait timeout exceeded; try restarting transaction [update ids set nextid=nextid+1 where nodeid=0 and table_name='events' and field_name='eventid']
zabbix_server [14814]: ERROR [file:db.c,line:1403] Something impossible has just happened.

    grep -A10 revision /var/log/zabbix-server/zabbix_server.log
    2134:20111227:144455.126 Zabbix Server stopped. Zabbix 1.9.8 (revision 23551).
    20835:20111227:144459.389 Starting Zabbix Server. Zabbix 1.9.8 (revision 23551).
    20835:20111227:144459.389 ****** Enabled features ******
    20835:20111227:144459.389 SNMP monitoring: YES
    20835:20111227:144459.390 IPMI monitoring: NO
    20835:20111227:144459.390 WEB monitoring: YES
    20835:20111227:144459.390 Jabber notifications: NO
    20835:20111227:144459.390 Ez Texting notifications: YES
    20835:20111227:144459.390 ODBC: NO
    20835:20111227:144459.390 SSH2 support: NO
    20835:20111227:144459.390 IPv6 support: NO
    20835:20111227:144459.390 ******************************
    --
    20835:20120214:151724.576 Zabbix Server stopped. Zabbix 1.9.8 (revision 23551).
    14778:20120214:151802.196 Starting Zabbix Server. Zabbix 1.9.9 (revision 25148).
    14778:20120214:151802.196 ****** Enabled features ******
    14778:20120214:151802.196 SNMP monitoring: YES
    14778:20120214:151802.196 IPMI monitoring: NO
    14778:20120214:151802.196 WEB monitoring: YES
    14778:20120214:151802.196 Jabber notifications: NO
    14778:20120214:151802.196 Ez Texting notifications: YES
    14778:20120214:151802.196 ODBC: NO
    14778:20120214:151802.196 SSH2 support: NO
    14778:20120214:151802.197 IPv6 support: NO
    14778:20120214:151802.197 ******************************

    ./configure --enable-agent --enable-server --with-mysql --with-net-snmp --with-libcurl --sysconfdir=/etc/zabbix
    Last edited by frater; 15-02-2012, 14:55.
    Zabbix agents on Linux, FreeBSD, Windows, AVM-Fritz!box, DD-WRT and QNAP
    Tags: None
    • frater
      Senior Member
      • Oct 2010
      • 340
      #2
      Is 1.9.9 so much heavier on my server than 1.9.8?
      Zabbix agents on Linux, FreeBSD, Windows, AVM-Fritz!box, DD-WRT and QNAP

        Comment

        • ahowell
          Member
          • Jan 2011
          • 66
          #3
          Did you apply the incremental database patches when upgrading from 1.9.8?

            Comment

            • frater
              Senior Member
              • Oct 2010
              • 340
              #4
              Yes I did....
              I even did a comparison of the schema.

              I checked the CPU-history of the server itself (with zabbix).
              It didn't happen immediately after the upgrade, but only after changing the config (adding a host, changing a trigger)

              mysqld has always been high in top, but now it's sometimes in the 300% and always high. After I killed zabbix_server it took 10 minutes for mysqld to become low on CPU.


              I installed mtop (new for me) and saw this expression taking way too long

              Code:
              9305     mrwolf_z localhost        mrwolf_zabbi 620    Query   Sending data SELECT ... FROM hosts_groups hgg,rights rr,users_groups gg WHERE hgg.hostid=ii.hostid AND rr.id=hgg.groupid AND rr.groupid=gg.u
9314     mrwolf_z localhost        mrwolf_zabbi 552    Query   Sending data SELECT ... FROM hosts_groups hgg,rights rr,users_groups gg WHERE hgg.hostid=ii.hostid AND rr.id=hgg.groupid AND rr.groupid=gg.u
9331     mrwolf_z localhost        mrwolf_zabbi 480    Query   Sending data SELECT ... FROM hosts_groups hgg,rights rr,users_groups gg WHERE hgg.hostid=ii.hostid AND rr.id=hgg.groupid AND rr.groupid=gg.u
9341     mrwolf_z localhost        mrwolf_zabbi 420    Query   Sending data SELECT ... FROM hosts_groups hgg,rights rr,users_groups gg WHERE hgg.hostid=ii.hostid AND rr.id=hgg.groupid AND rr.groupid=gg.u
9353     mrwolf_z localhost        mrwolf_zabbi 360    Query   Sending data SELECT ... FROM hosts_groups hgg,rights rr,users_groups gg WHERE hgg.hostid=ii.hostid AND rr.id=hgg.groupid AND rr.groupid=gg.u
9363     mrwolf_z localhost        mrwolf_zabbi 300    Query   Sending data SELECT ... FROM hosts_groups hgg,rights rr,users_groups gg WHERE hgg.hostid=ii.hostid AND rr.id=hgg.groupid AND rr.groupid=gg.u
9378     mrwolf_z localhost        mrwolf_zabbi 240    Query   Sending data SELECT ... FROM hosts_groups hgg,rights rr,users_groups gg WHERE hgg.hostid=ii.hostid AND rr.id=hgg.groupid AND rr.groupid=gg.u
9384     mrwolf_z localhost        mrwolf_zabbi 180    Query   Sending data SELECT ... FROM hosts_groups hgg,rights rr,users_groups gg WHERE hgg.hostid=ii.hostid AND rr.id=hgg.groupid AND rr.groupid=gg.u
9399     mrwolf_z localhost        mrwolf_zabbi 118    Query   Sending data SELECT ... FROM hosts_groups hgg,rights rr,users_groups gg WHERE hgg.hostid=ii.hostid AND rr.id=hgg.groupid AND rr.groupid=gg.u
9244     mrwolf_z localhost        mrwolf_zabbi 3      Query   Sending data select ... from hosts h,items i,functions f,triggers t where h.hostid=i.hostid and i.itemid=f.itemid and f.triggerid=t.triggeri
9239     admin    localhost                            Query                show full processlist
9258     mrwolf_z localhost        mrwolf_zabbi        Query   Sending data select ... from hosts h,items i where i.hostid=h.hostid and i.itemid in (23274,23994,24294,24354,25074,27953,28884,28914)
9259     mrwolf_z localhost        mrwolf_zabbi        Query   update       insert into history_uint (itemid,clock,value,ns) values (27944,1329391815,0,797433398),(25305,1329391815,0,939241594),(23865,13
              Zabbix agents on Linux, FreeBSD, Windows, AVM-Fritz!box, DD-WRT and QNAP

                Comment

                • frater
                  Senior Member
                  • Oct 2010
                  • 340
                  #5
                  I think it's the frontend that's causing it....
                  I have stopped both and things went normal
                  After enabling the server things stayed normal... only after I enabled the frontend again, things went haywire...
                  Zabbix agents on Linux, FreeBSD, Windows, AVM-Fritz!box, DD-WRT and QNAP

                    Comment

                    • Alexei
                      Founder, CEO
                      Zabbix Certified Trainer
                      Zabbix Certified SpecialistZabbix Certified Professional
                      • Sep 2004
                      • 5654
                      #6
                      Is there any chance to get full text of the slow SQL statements?
                      Alexei Vladishev
                      Creator of Zabbix, Product manager
                      New York | Tokyo | Riga
                      My Twitter

                        Comment

                        • frater
                          Senior Member
                          • Oct 2010
                          • 340
                          #7
                          I only found out about "mtop" during my troubleshoot session of this problem. I don't think mtop can do this for me....

                          I gave up after a while because I needed some sleep....
                          When I wanted to continue on it, it turned out the problem was gone.

                          It took 36 hours and then the server suddenly came to rest.....
                          Attached Files
                          Zabbix agents on Linux, FreeBSD, Windows, AVM-Fritz!box, DD-WRT and QNAP

                            Comment

                            Previous template Next
                            Working...