Uploaded image for project: 'ZABBIX BUGS AND ISSUES'
  1. ZABBIX BUGS AND ISSUES
  2. ZBX-20419

A deadlock occurred in lld worker (ids)

XMLWordPrintable

    • Sprint 84 (Jan 2022), Sprint 85 (Feb 2022), Sprint 86 (Mar 2022), Sprint 87 (Apr 2022), Sprint 88 (May 2022), Sprint 89 (Jun 2022), Sprint 90 (Jul 2022)
    • 1

      Report for investigation:
      Deadlock output below from the LLD Worker. (Zabbix 5.0.16)

         701:20220107:143417.284 [Z3005] query failed: [1213] Deadlock found when trying to get lock; try restarting transaction [update ids set nextid=nextid+2 where table_name='triggers' and field_name='triggerid']
         700:20220107:143417.298 [Z3005] query failed: [1213] Deadlock found when trying to get lock; try restarting transaction [update ids set nextid=nextid+2 where table_name='triggers' and field_name='triggerid']
         704:20220107:143417.301 [Z3005] query failed: [1213] Deadlock found when trying to get lock; try restarting transaction [update ids set nextid=nextid+4 where table_name='triggers' and field_name='triggerid']
         703:20220107:143417.305 [Z3005] query failed: [1213] Deadlock found when trying to get lock; try restarting transaction [update ids set nextid=nextid+4 where table_name='triggers' and field_name='triggerid']
         702:20220107:143417.362 [Z3005] query failed: [1213] Deadlock found when trying to get lock; try restarting transaction [update ids set nextid=nextid+1 where table_name='trigger_depends' and field_name='triggerdepid']
      
         702:20220107:143417.362 [Z3005] query failed: [1213] Deadlock found when trying to get lock; try restarting transaction [update ids set nextid=nextid+1 where table_name='trigger_depends' and field_name='triggerdepid']
         702:20220107:143417.362 slow query: 45.143978 sec, "update ids set nextid=nextid+1 where table_name='trigger_depends' and field_name='triggerdepid'"
      zabbix_server [702]: ERROR [file and function: <db.c,DBget_nextid>, revision:422e00c66a, line:824] Something impossible has just happened.
         702:20220107:143417.365 === Backtrace: ===
         702:20220107:143417.366 13: /usr/sbin/zabbix_server: lld worker #3 [processed 31 LLD rules, idle 4.703067 sec during 5.107193 sec](zbx_backtrace+0x52) [0x563150702809]
         702:20220107:143417.366 12: /usr/sbin/zabbix_server: lld worker #3 [processed 31 LLD rules, idle 4.703067 sec during 5.107193 sec](+0x26ceab) [0x563150777eab]
         702:20220107:143417.366 11: /usr/sbin/zabbix_server: lld worker #3 [processed 31 LLD rules, idle 4.703067 sec during 5.107193 sec](DBget_maxid_num+0x112) [0x56315077804f]
         702:20220107:143417.366 10: /usr/sbin/zabbix_server: lld worker #3 [processed 31 LLD rules, idle 4.703067 sec during 5.107193 sec](+0x16124a) [0x56315066c24a]
         702:20220107:143417.366 9: /usr/sbin/zabbix_server: lld worker #3 [processed 31 LLD rules, idle 4.703067 sec during 5.107193 sec](lld_update_triggers+0x2e9) [0x56315066effe]
         702:20220107:143417.366 8: /usr/sbin/zabbix_server: lld worker #3 [processed 31 LLD rules, idle 4.703067 sec during 5.107193 sec](lld_process_discovery_rule+0x5a1) [0x563150646574]
         702:20220107:143417.366 7: /usr/sbin/zabbix_server: lld worker #3 [processed 31 LLD rules, idle 4.703067 sec during 5.107193 sec](+0x137823) [0x563150642823]
         702:20220107:143417.366 6: /usr/sbin/zabbix_server: lld worker #3 [processed 31 LLD rules, idle 4.703067 sec during 5.107193 sec](lld_worker_thread+0x36c) [0x563150642f74]
         702:20220107:143417.366 5: /usr/sbin/zabbix_server: lld worker #3 [processed 31 LLD rules, idle 4.703067 sec during 5.107193 sec](zbx_thread_start+0x3b) [0x563150712dd7]
         702:20220107:143417.366 4: /usr/sbin/zabbix_server: lld worker #3 [processed 31 LLD rules, idle 4.703067 sec during 5.107193 sec](MAIN_ZABBIX_ENTRY+0xfef) [0x563150556939]
         702:20220107:143417.366 3: /usr/sbin/zabbix_server: lld worker #3 [processed 31 LLD rules, idle 4.703067 sec during 5.107193 sec](daemon_start+0x303) [0x56315070234b]
         702:20220107:143417.366 2: /usr/sbin/zabbix_server: lld worker #3 [processed 31 LLD rules, idle 4.703067 sec during 5.107193 sec](main+0x309) [0x5631505558e7]
         702:20220107:143417.366 1: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3) [0x7f566fa700b3]
         702:20220107:143417.366 0: /usr/sbin/zabbix_server: lld worker #3 [processed 31 LLD rules, idle 4.703067 sec during 5.107193 sec](_start+0x2e) [0x56315055488e]
      

      +Add information
      For about 30 minutes before the deadlock occurred, there was some UI task of adding triggers and trigger prototypes.

      More details are in the attachment files.

        1. LATEST_DETECTED_DEADLOCK.txt
          12 kB
          Kim Jongkwon
        2. zabbix_server.log
          14 kB
          Kim Jongkwon

            ak Andrejs Kozlovs
            JKKim Kim Jongkwon
            Team C
            Votes:
            1 Vote for this issue
            Watchers:
            10 Start watching this issue

              Created:
              Updated:
              Resolved: