Uploaded image for project: 'ZABBIX BUGS AND ISSUES'
  1. ZABBIX BUGS AND ISSUES
  2. ZBX-22084

Server crashed on DBget_nextid

XMLWordPrintable

    • Icon: Problem report Problem report
    • Resolution: Duplicate
    • Icon: Trivial Trivial
    • None
    • None
    • Server (S)
    • None
    • Debian 11.5 - 8 CPU - 64 RAM - 64 Swap - MySQL 8 Group Replication

      Server suddenly start to spill errors like:

      zabbix_server [609851]: ERROR [file and function: <db.c,DBget_nextid>, revision:98ee88fc19d, line:716] Something impossible has just happened.
      609851:20221214:162156.659 === Backtrace: ===
      609851:20221214:162156.659 14: /usr/sbin/zabbix_server: lld worker #8 [processed 17 LLD rules, idle 0.010701 sec during 6.740668 sec](zbx_backtrace+0x3f) [0x565322f4f83c]
      609851:20221214:162156.659 13: /usr/sbin/zabbix_server: lld worker #8 [processed 17 LLD rules, idle 0.010701 sec during 6.740668 sec](+0x31e01b) [0x565322ff101b]
      609851:20221214:162156.659 12: /usr/sbin/zabbix_server: lld worker #8 [processed 17 LLD rules, idle 0.010701 sec during 6.740668 sec](DBget_maxid_num+0x129) [0x565322ff11be]
      609851:20221214:162156.659 11: /usr/sbin/zabbix_server: lld worker #8 [processed 17 LLD rules, idle 0.010701 sec during 6.740668 sec](+0x1bbd10) [0x565322e8ed10]
      609851:20221214:162156.659 10: /usr/sbin/zabbix_server: lld worker #8 [processed 17 LLD rules, idle 0.010701 sec during 6.740668 sec](lld_update_triggers+0x2b4) [0x565322e91cd4]
      609851:20221214:162156.659 9: /usr/sbin/zabbix_server: lld worker #8 [processed 17 LLD rules, idle 0.010701 sec during 6.740668 sec](lld_process_discovery_rule+0x520) [0x565322e69102]
      609851:20221214:162156.659 8: /usr/sbin/zabbix_server: lld worker #8 [processed 17 LLD rules, idle 0.010701 sec during 6.740668 sec](+0x192dcb) [0x565322e65dcb]
      609851:20221214:162156.659 7: /usr/sbin/zabbix_server: lld worker #8 [processed 17 LLD rules, idle 0.010701 sec during 6.740668 sec](lld_worker_thread+0x2fe) [0x565322e66437]
      609851:20221214:162156.659 6: /usr/sbin/zabbix_server: lld worker #8 [processed 17 LLD rules, idle 0.010701 sec during 6.740668 sec](zbx_thread_start+0x37) [0x565322f5c668]
      609851:20221214:162156.659 5: /usr/sbin/zabbix_server: lld worker #8 [processed 17 LLD rules, idle 0.010701 sec during 6.740668 sec](+0x71fa7) [0x565322d44fa7]
      609851:20221214:162156.659 4: /usr/sbin/zabbix_server: lld worker #8 [processed 17 LLD rules, idle 0.010701 sec during 6.740668 sec](MAIN_ZABBIX_ENTRY+0x844) [0x565322d45c60]
      609851:20221214:162156.659 3: /usr/sbin/zabbix_server: lld worker #8 [processed 17 LLD rules, idle 0.010701 sec during 6.740668 sec](zbx_daemon_start+0x3b1) [0x565322f4f436]
      609851:20221214:162156.659 2: /usr/sbin/zabbix_server: lld worker #8 [processed 17 LLD rules, idle 0.010701 sec during 6.740668 sec](main+0x36a) [0x565322d4429b]
      609851:20221214:162156.659 1: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xea) [0x7f2758e56d0a]
      609851:20221214:162156.659 0: /usr/sbin/zabbix_server: lld worker #8 [processed 17 LLD rules, idle 0.010701 sec during 6.740668 sec](_start+0x2a) [0x565322d42dea]
      609863:20221214:162159.656 [Z3005] query failed: [1205] Lock wait timeout exceeded; try restarting transaction [update ids set nextid=nextid+1 where table_name='functions' and field_name='functionid'] 

      and after several errors like that the server died.

      I am attaching an objdump as suggested at the server.log and the log itself with the errors and the crash.

      Thanks to the limitation uploading files here, I cannot update the whole log, just the object dump in two parts – used split to break in two pieces, then I could upload them.

        1. zabbix_server_log_crash.gz
          5 kB
          jchegedus
        2. zabbix_server.objdump.pt1.tgz
          9.45 MB
          jchegedus
        3. zabbix_server.objdump.pt2.tgz
          7.09 MB
          jchegedus

            zabbix.dev Zabbix Development Team
            spectroman jchegedus
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: