Uploaded image for project: 'ZABBIX BUGS AND ISSUES'
  1. ZABBIX BUGS AND ISSUES
  2. ZBX-26478

Alert manager crashes when custom alertscript is executed for database down message

XMLWordPrintable

    • Icon: Problem report Problem report
    • Resolution: Fixed
    • Icon: Blocker Blocker
    • 7.0.14rc1, 7.2.8rc1, 7.4.0rc1 (master)
    • 7.0.12, 7.2.6
    • Server (S)
    • None
    • Zabbix Server 7.0.12, MySQL 8.0.42, Ubuntu 24.04
      Zabbix Server 7.2.7, PostgreSQL 16.9, Ubuntu 24.04
    • S25-W22/23
    • 3

      1. Create a simple test custom alert script, place it in the default alertscripts path:

      2. Verify that script works:

      3. Set up this alerting method in Zabbix:



      4. Shutdown the database, and wait for watchdog to notify about the database being down.

      Result:

      110849:20250526:192551.440 [Z3001] connection to database 'zabbix' failed: [2002] Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)
110849:20250526:192551.440 End of zbx_db_connect():-2
110849:20250526:192551.440 database connection lost
110849:20250526:192551.440 am_queue_watchdog_alerts() recipients:2
110849:20250526:192551.440 zbx_setproctitle() title:'alert manager #1 [sent 0, failed 0 alerts, idle 5.004801 sec during 5.005239 sec]'
110849:20250526:192551.440 am_process_alert() alertid:0 mediatypeid:34 alertpoolid:0x0
110849:20250526:192551.440 In zbx_ipc_client_send() clientid:5
110849:20250526:192551.440 End of zbx_ipc_client_send():SUCCEED
110849:20250526:192551.440 End of am_process_alert()
110849:20250526:192551.440 am_process_alert() alertid:0 mediatypeid:42 alertpoolid:0x0
110849:20250526:192551.441 Got signal [signal:11(SIGSEGV),reason:1,refaddr:(nil)]. Crashing ...
110849:20250526:192551.441 ====== Fatal information: ======
110849:20250526:192551.441 Program counter: 0x56ecbbf43779
110849:20250526:192551.441 === Registers: ===
110849:20250526:192551.441 r8      =     56ecee00d010 =       95575605301264 =       95575605301264
110849:20250526:192551.441 r9      =                7 =                    7 =                    7
110849:20250526:192551.441 r10     =     56ecee07ac60 =       95575605750880 =       95575605750880
110849:20250526:192551.441 r11     =              202 =                  514 =                  514
110849:20250526:192551.441 r12     =     7fff0c0192a0 =      140733394817696 =      140733394817696
110849:20250526:192551.441 r13     =     7fff0c019310 =      140733394817808 =      140733394817808
110849:20250526:192551.441 r14     =     56ecee089720 =       95575605810976 =       95575605810976
110849:20250526:192551.441 r15     =     56ecee0631c0 =       95575605653952 =       95575605653952
110849:20250526:192551.441 rdi     =                0 =                    0 =                    0
110849:20250526:192551.441 rsi     =     7fff0c0192a0 =      140733394817696 =      140733394817696
110849:20250526:192551.441 rbp     =     56ecbc0afd92 =       95574767107474 =       95574767107474
110849:20250526:192551.441 rbx     =                0 =                    0 =                    0
110849:20250526:192551.441 rdx     =     56e980c9125a =       95560888029786 =       95560888029786
110849:20250526:192551.441 rax     =                0 =                    0 =                    0
110849:20250526:192551.441 rcx     =     73c0a4f0e62b =      127271238166059 =      127271238166059
110849:20250526:192551.441 rsp     =     7fff0c019090 =      140733394817168 =      140733394817168
110849:20250526:192551.441 rip     =     56ecbbf43779 =       95574765614969 =       95574765614969
110849:20250526:192551.441 efl     =            10206 =                66054 =                66054
110849:20250526:192551.441 csgsfs  =   2b000000000033 =    12103423998558259 =    12103423998558259
110849:20250526:192551.441 err     =                4 =                    4 =                    4
110849:20250526:192551.441 trapno  =                e =                   14 =                   14
110849:20250526:192551.441 oldmask =                0 =                    0 =                    0
110849:20250526:192551.441 cr2     =                0 =                    0 =                    0
110849:20250526:192551.441 === Backtrace: ===
110914:20250526:192551.441 [Z3001] connection to database 'zabbix' failed: [2002] Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)
110914:20250526:192551.441 database is down: reconnecting in 10 seconds
110849:20250526:192551.443 12: /usr/sbin/zabbix_server: alert manager #1 [sent 0, failed 0 alerts, idle 5.004801 sec during 5.005239 sec](zbx_backtrace+0x52) [0x56ecbc00a312]
110849:20250526:192551.443 11: /usr/sbin/zabbix_server: alert manager #1 [sent 0, failed 0 alerts, idle 5.004801 sec during 5.005239 sec](zbx_log_fatal_info+0x13d) [0x56ecbc00a54d]
110849:20250526:192551.443 10: /usr/sbin/zabbix_server: alert manager #1 [sent 0, failed 0 alerts, idle 5.004801 sec during 5.005239 sec](+0x3facda) [0x56ecbc00acda]
110849:20250526:192551.443 9: /lib/x86_64-linux-gnu/libc.so.6(+0x45330) [0x73c0a4e3d330]
110849:20250526:192551.443 8: /usr/sbin/zabbix_server: alert manager #1 [sent 0, failed 0 alerts, idle 5.004801 sec during 5.005239 sec](zbx_json_open+0x19) [0x56ecbbf43779]
110849:20250526:192551.443 7: /usr/sbin/zabbix_server: alert manager #1 [sent 0, failed 0 alerts, idle 5.004801 sec during 5.005239 sec](zbx_alert_manager_thread+0x759) [0x56ecbbcede29]
110849:20250526:192551.443 6: /usr/sbin/zabbix_server: alert manager #1 [sent 0, failed 0 alerts, idle 5.004801 sec during 5.005239 sec](zbx_thread_start+0x24) [0x56ecbbf29e74]
110849:20250526:192551.443 5: /usr/sbin/zabbix_server: alert manager #1 [sent 0, failed 0 alerts, idle 5.004801 sec during 5.005239 sec](+0xd3722) [0x56ecbbce3722]
110849:20250526:192551.443 4: /usr/sbin/zabbix_server: alert manager #1 [sent 0, failed 0 alerts, idle 5.004801 sec during 5.005239 sec](MAIN_ZABBIX_ENTRY+0x1024) [0x56ecbbce4fb4]
110849:20250526:192551.443 3: /usr/sbin/zabbix_server: alert manager #1 [sent 0, failed 0 alerts, idle 5.004801 sec during 5.005239 sec](main+0x3ab) [0x56ecbbcd8e9b]
110849:20250526:192551.443 2: /lib/x86_64-linux-gnu/libc.so.6(+0x2a1ca) [0x73c0a4e221ca]
110849:20250526:192551.443 1: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0x8b) [0x73c0a4e2228b]
110849:20250526:192551.443 0: /usr/sbin/zabbix_server: alert manager #1 [sent 0, failed 0 alerts, idle 5.004801 sec during 5.005239 sec](_start+0x25) [0x56ecbbce0035]

      Attaching log with memory map.
      zabbix_server.log

        1. image-2025-05-26-22-32-42-059.png
          image-2025-05-26-22-32-42-059.png
          5 kB
        2. image-2025-05-26-22-33-01-410.png
          image-2025-05-26-22-33-01-410.png
          6 kB
        3. image-2025-05-26-22-33-48-570.png
          image-2025-05-26-22-33-48-570.png
          5 kB
        4. image-2025-05-26-22-34-11-942.png
          image-2025-05-26-22-34-11-942.png
          22 kB
        5. image-2025-05-26-22-34-30-632.png
          image-2025-05-26-22-34-30-632.png
          15 kB
        6. screenshot-1.png
          screenshot-1.png
          54 kB
        7. zabbix_server.log
          63 kB

            askolmeisters Armands Arseniuss Skolmeisters
            tbross Tomass Janis Bross
            Team C
            Votes:
            1 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved:

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - Not Specified
                Not Specified
                Logged:
                Time Spent - 21h
                21h