[ZBX-20697] Zabbix server crashes Created: 2022 Mar 02  Updated: 2024 Apr 10  Resolved: 2022 Mar 07

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Server (S)
Affects Version/s: 6.0.1
Fix Version/s: 6.0.2rc1, 6.2.0alpha1, 6.2 (plan)

Type: Problem report Priority: Blocker
Reporter: Alek Assignee: Vladislavs Sokurenko
Resolution: Fixed Votes: 10
Labels: crash
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Linux zabbix 5.4.0-100-generic #113-Ubuntu SMP Thu Feb 3 18:43:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

Attachments: File ZBX-20697-6.0-fix.diff     Text File _zabbix_server_logs (5).txt     File zabbix-server-mysql-6.0.1-0.zbx20697.el8.x86_64.rpm     File zabbix-server-mysql-6.0.1-0.zbx20697extradebug.el8.x86_64.rpm     File zabbix-server-pgsql-6.0.1-0.zbx20697.el8.x86_64.rpm     File zabbix-server-pgsql-6.0.1-0.zbx20697extradebug.el8.x86_64.rpm     Text File zabbix_server.log    
Issue Links:
Causes
Duplicate
is duplicated by ZBX-20696 Configuration Syncer Crashing Closed
is duplicated by ZBX-20717 Child Process has died , no obvious e... Closed
is duplicated by ZBX-20721 Upgrade Zabbix 6.0.1 from 5.0.3 - Got... Closed
is duplicated by ZBX-20731 Zabbix-Server 6.0.0 or 6.0.1 service ... Closed
Sub-task
Team: Team A
Sprint: Sprint 85 (Feb 2022)
Story Points: 1

 Description   

Steps to reproduce:

After upgrading from 5.4 line to 6.1 server crashes

Result:

 

 28295:20220302:112309.351 Got signal [signal:11(SIGSEGV),reason:1,refaddr:(nil)]. Crashing ...
...
 28295:20220302:112309.352 === Backtrace: ===
 28295:20220302:112309.353 19: /usr/sbin/zabbix_server: history syncer #1 [processed 0 values, 0 triggers in 0.000049 sec, syncing history](zbx_backtrace+0x52) [0x556eece129c8]
 28295:20220302:112309.353 18: /usr/sbin/zabbix_server: history syncer #1 [processed 0 values, 0 triggers in 0.000049 sec, syncing history](zbx_log_fatal_info+0x183) [0x556eece12cc1]
 28295:20220302:112309.353 17: /usr/sbin/zabbix_server: history syncer #1 [processed 0 values, 0 triggers in 0.000049 sec, syncing history](+0x278673) [0x556eece13673]
 28295:20220302:112309.353 16: /lib/x86_64-linux-gnu/libpthread.so.0(+0x143c0) [0x7f4e202d93c0]
 28295:20220302:112309.353 15: /lib/x86_64-linux-gnu/libc.so.6(+0x1885f5) [0x7f4e1f6565f5]
 28295:20220302:112309.353 14: /lib/x86_64-linux-gnu/libc.so.6(__strdup+0x13) [0x7f4e1f56d3b3]
 28295:20220302:112309.353 13: /usr/sbin/zabbix_server: history syncer #1 [processed 0 values, 0 triggers in 0.000049 sec, syncing history](zbx_strdup2+0x53) [0x556eece41d1f]
 28295:20220302:112309.353 12: /usr/sbin/zabbix_server: history syncer #1 [processed 0 values, 0 triggers in 0.000049 sec, syncing history](+0x20a194) [0x556eecda5194]
 28295:20220302:112309.353 11: /usr/sbin/zabbix_server: history syncer #1 [processed 0 values, 0 triggers in 0.000049 sec, syncing history](DCconfig_get_triggers_by_itemids+0x103) [0x556eecda6eaa]
 28295:20220302:112309.353 10: /usr/sbin/zabbix_server: history syncer #1 [processed 0 values, 0 triggers in 0.000049 sec, syncing history](+0x1ea81d) [0x556eecd8581d]
 28295:20220302:112309.353 9: /usr/sbin/zabbix_server: history syncer #1 [processed 0 values, 0 triggers in 0.000049 sec, syncing history](+0x1eed36) [0x556eecd89d36]
 28295:20220302:112309.353 8: /usr/sbin/zabbix_server: history syncer #1 [processed 0 values, 0 triggers in 0.000049 sec, syncing history](zbx_sync_history_cache+0x8b) [0x556eecd8a884]
 28295:20220302:112309.353 7: /usr/sbin/zabbix_server: history syncer #1 [processed 0 values, 0 triggers in 0.000049 sec, syncing history](dbsyncer_thread+0x236) [0x556eecc173bf]
 28295:20220302:112309.353 6: /usr/sbin/zabbix_server: history syncer #1 [processed 0 values, 0 triggers in 0.000049 sec, syncing history](zbx_thread_start+0x3b) [0x556eece24017]
 28295:20220302:112309.353 5: /usr/sbin/zabbix_server: history syncer #1 [processed 0 values, 0 triggers in 0.000049 sec, syncing history](+0x68b92) [0x556eecc03b92]
 28295:20220302:112309.353 4: /usr/sbin/zabbix_server: history syncer #1 [processed 0 values, 0 triggers in 0.000049 sec, syncing history](MAIN_ZABBIX_ENTRY+0x87c) [0x556eecc04b6c]
 28295:20220302:112309.353 3: /usr/sbin/zabbix_server: history syncer #1 [processed 0 values, 0 triggers in 0.000049 sec, syncing history](daemon_start+0x2f9) [0x556eece124ff]
 28295:20220302:112309.353 2: /usr/sbin/zabbix_server: history syncer #1 [processed 0 values, 0 triggers in 0.000049 sec, syncing history](main+0x34d) [0x556eecc02ee2]
 28295:20220302:112309.353 1: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3) [0x7f4e1f4f20b3]
 28295:20220302:112309.353 0: /usr/sbin/zabbix_server: history syncer #1 [processed 0 values, 0 triggers in 0.000049 sec, syncing history](_start+0x2e) [0x556eecc01b4e]


 Comments   
Comment by Malte H. [ 2022 Mar 02 ]

+1 on this. I'm running the Zabbix VM Appliance (upgraded to Ubuntu Server 20.04 LTS earlier and Zabbix 6 yesterday) and having the same problem. Zabbix Server keeps crashing the whole time:

251882:20220302:093652.211 Got signal [signal:11(SIGSEGV),reason:1,refaddr:(nil)]. Crashing ...
251882:20220302:093652.211 ====== Fatal information: ======
251882:20220302:093652.211 Program counter: 0x7f28f2b75d5a
251882:20220302:093652.211 === Registers: ===
251882:20220302:093652.211 r8      =     55a2b333e530 =       94157279585584 =       94157279585584
251882:20220302:093652.211 r9      =                8 =                    8 =                    8
251882:20220302:093652.211 r10     =     55a2b32cc018 =       94157279117336 =       94157279117336
251882:20220302:093652.211 r11     =     7f28f2cacbe0 =      139813848796128 =      139813848796128
251882:20220302:093652.211 r12     =                3 =                    3 =                    3
251882:20220302:093652.211 r13     =     7ffd6a038590 =      140726382069136 =      140726382069136
251882:20220302:093652.211 r14     =                0 =                    0 =                    0
251882:20220302:093652.211 r15     =                0 =                    0 =                    0
251882:20220302:093652.212 rdi     =                0 =                    0 =                    0
251882:20220302:093652.212 rsi     =             1f6c =                 8044 =                 8044
251882:20220302:093652.212 rbp     =                0 =                    0 =                    0
251882:20220302:093652.212 rbx     =     7ffd6a0373a0 =      140726382064544 =      140726382064544
251882:20220302:093652.212 rdx     =                0 =                    0 =                    0
251882:20220302:093652.212 rax     =                0 =                    0 =                    0
251882:20220302:093652.212 rcx     =                0 =                    0 =                    0
251882:20220302:093652.212 rsp     =     7ffd6a02b368 =      140726382015336 =      140726382015336
251882:20220302:093652.212 rip     =     7f28f2b75d5a =      139813847522650 =      139813847522650
251882:20220302:093652.212 efl     =            10293 =                66195 =                66195
251882:20220302:093652.212 csgsfs  =   2b000000000033 =    12103423998558259 =    12103423998558259
251882:20220302:093652.212 err     =                4 =                    4 =                    4
251882:20220302:093652.212 trapno  =                e =                   14 =                   14
251882:20220302:093652.212 oldmask =             4a06 =                18950 =                18950
251882:20220302:093652.212 cr2     =                0 =                    0 =                    0

251882:20220302:093652.212 === Backtrace: ===
251882:20220302:093652.214 19: /usr/sbin/zabbix_server: history syncer #3 [processed 0 values, 0 triggers in 0.000093 sec, syncing history](zbx_backtrace+0x52) [0x55a2b123f9c8]
251882:20220302:093652.214 18: /usr/sbin/zabbix_server: history syncer #3 [processed 0 values, 0 triggers in 0.000093 sec, syncing history](zbx_log_fatal_info+0x183) [0x55a2b123fcc1]
251882:20220302:093652.214 17: /usr/sbin/zabbix_server: history syncer #3 [processed 0 values, 0 triggers in 0.000093 sec, syncing history](+0x278673) [0x55a2b1240673]
251882:20220302:093652.214 16: /lib/x86_64-linux-gnu/libpthread.so.0(+0x153c0) [0x7f28f38cd3c0]
251882:20220302:093652.214 15: /lib/x86_64-linux-gnu/libc.so.6(+0xb4d5a) [0x7f28f2b75d5a]
251882:20220302:093652.214 14: /lib/x86_64-linux-gnu/libc.so.6(__strdup+0x13) [0x7f28f2b63503]
251882:20220302:093652.214 13: /usr/sbin/zabbix_server: history syncer #3 [processed 0 values, 0 triggers in 0.000093 sec, syncing history](zbx_strdup2+0x53) [0x55a2b126ed1f]
251882:20220302:093652.214 12: /usr/sbin/zabbix_server: history syncer #3 [processed 0 values, 0 triggers in 0.000093 sec, syncing history](+0x20a194) [0x55a2b11d2194]
251882:20220302:093652.214 11: /usr/sbin/zabbix_server: history syncer #3 [processed 0 values, 0 triggers in 0.000093 sec, syncing history](DCconfig_get_triggers_by_itemids+0x103) [0x55a2b11d3eaa]
251882:20220302:093652.214 10: /usr/sbin/zabbix_server: history syncer #3 [processed 0 values, 0 triggers in 0.000093 sec, syncing history](+0x1ea81d) [0x55a2b11b281d]
251882:20220302:093652.214 9: /usr/sbin/zabbix_server: history syncer #3 [processed 0 values, 0 triggers in 0.000093 sec, syncing history](+0x1eed36) [0x55a2b11b6d36]
251882:20220302:093652.214 8: /usr/sbin/zabbix_server: history syncer #3 [processed 0 values, 0 triggers in 0.000093 sec, syncing history](zbx_sync_history_cache+0x8b) [0x55a2b11b7884]
251882:20220302:093652.215 7: /usr/sbin/zabbix_server: history syncer #3 [processed 0 values, 0 triggers in 0.000093 sec, syncing history](dbsyncer_thread+0x236) [0x55a2b10443bf]
251882:20220302:093652.215 6: /usr/sbin/zabbix_server: history syncer #3 [processed 0 values, 0 triggers in 0.000093 sec, syncing history](zbx_thread_start+0x3b) [0x55a2b1251017]
251882:20220302:093652.215 5: /usr/sbin/zabbix_server: history syncer #3 [processed 0 values, 0 triggers in 0.000093 sec, syncing history](+0x68b92) [0x55a2b1030b92]
251882:20220302:093652.215 4: /usr/sbin/zabbix_server: history syncer #3 [processed 0 values, 0 triggers in 0.000093 sec, syncing history](MAIN_ZABBIX_ENTRY+0x87c) [0x55a2b1031b6c]
251882:20220302:093652.215 3: /usr/sbin/zabbix_server: history syncer #3 [processed 0 values, 0 triggers in 0.000093 sec, syncing history](daemon_start+0x2f9) [0x55a2b123f4ff]
251882:20220302:093652.215 2: /usr/sbin/zabbix_server: history syncer #3 [processed 0 values, 0 triggers in 0.000093 sec, syncing history](main+0x34d) [0x55a2b102fee2]
251882:20220302:093652.215 1: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3) [0x7f28f2ae80b3]
251882:20220302:093652.215 0: /usr/sbin/zabbix_server: history syncer #3 [processed 0 values, 0 triggers in 0.000093 sec, syncing history](_start+0x2e) [0x55a2b102eb4e]

Any suggestions?

Kind regards

Malte

Comment by Oleksii Zagorskyi [ 2022 Mar 02 ]

May be similar to ZBX-20696

Comment by Oleksii Zagorskyi [ 2022 Mar 02 ]

Identical crash from another installation:

  2513:20220302:095644.657 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x2]. Crashing ...
...
  2513:20220302:095644.657 === Backtrace: ===
  2513:20220302:095644.658 14: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](zbx_backtrace+0x52) [0x55db604815d5]
  2513:20220302:095644.658 13: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](zbx_log_fatal_info+0x183) [0x55db604818ce]
  2513:20220302:095644.658 12: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](+0x279280) [0x55db60482280]
  2513:20220302:095644.658 11: /lib/x86_64-linux-gnu/libpthread.so.0(+0x143c0) [0x7fb5811e43c0]
  2513:20220302:095644.658 10: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](+0x201e89) [0x55db6040ae89]
  2513:20220302:095644.658 9: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](+0x202460) [0x55db6040b460]
  2513:20220302:095644.658 8: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](DCsync_configuration+0x15a3) [0x55db6040ccea]
  2513:20220302:095644.658 7: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](dbconfig_thread+0x149) [0x55db60285834]
  2513:20220302:095644.658 6: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](zbx_thread_start+0x3b) [0x55db60492c24]
  2513:20220302:095644.658 5: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](+0x6884f) [0x55db6027184f]
  2513:20220302:095644.658 4: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](MAIN_ZABBIX_ENTRY+0x87c) [0x55db60272b4c]
  2513:20220302:095644.658 3: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](daemon_start+0x2f9) [0x55db6048110c]
  2513:20220302:095644.658 2: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](main+0x34d) [0x55db60270ec2]
  2513:20220302:095644.659 1: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3) [0x7fb58078c0b3]
  2513:20220302:095644.659 0: /usr/sbin/zabbix_server: configuration syncer [syncing configuration](_start+0x2e) [0x55db6026fb2e]
...
  2501:20220302:095644.675 One child process died (PID:2513,exitcode/signal:1). Exiting ...
  2501:20220302:095644.686 Zabbix Server stopped. Zabbix 6.0.1 (revision a80cb13868).

Full debuglog of this crash shared in PM to vso

Comment by Vladislavs Sokurenko [ 2022 Mar 02 ]

Could you please be so kind to increase log level and attach log ?

Comment by Vladislavs Sokurenko [ 2022 Mar 02 ]

Thanks for the log, it crashes when recalculating triggers

 72233:20220302:121308.658 In recalculate_triggers()
 72227:20220302:121308.658 query [txnlev:1] [commit;]
 72233:20220302:121308.658 Got signal [signal:11(SIGSEGV),reason:1,refaddr:(nil)]. Crashing ...
Comment by Malte H. [ 2022 Mar 02 ]

Same here:

265646:20220302:101352.933 In recalculate_triggers()
265646:20220302:101352.933 Got signal [signal:11(SIGSEGV),reason:1,refaddr:(nil)]. Crashing ...
Comment by Vladislavs Sokurenko [ 2022 Mar 02 ]

Could you please be so kind and double check server version ?

Comment by Malte H. [ 2022 Mar 02 ]

Mine is:

265044:20220302:101215.579 Starting Zabbix Server. Zabbix 6.0.1 (revision a80cb13868).
Comment by Alek [ 2022 Mar 02 ]

Increased log level reported incidents only with mongo involved machines.

Malte, do you have mongo monitored machines? I've disabled monitoring for them and seems to be crashing stopped.

Comment by Malte H. [ 2022 Mar 02 ]

Yes, I have mongo machines, too.

Tried to disable that machines, but server keeps crashing. 

Comment by Aleksey Volodin [ 2022 Mar 02 ]

Another crash. Docker container.

.519 Starting Zabbix Server. Zabbix 6.0.1 (revision a80cb13).
.519 ****** Enabled features ******
.519 SNMP monitoring:   YES
.519 IPMI monitoring:   YES
.519 Web monitoring:  YES
.519 VMware monitoring:    YES
.519 SMTP authentication:  YES
.519 ODBC:    YES
.519 SSH support:     YES
.519 IPv6 support:    YES
.519 TLS support:     YES
.519 ******************************
.519 using configuration file: /etc/zabbix/zabbix_server.conf
.544 current database version (mandatory/optional): 06000000/06000000
.544 required mandatory version: 06000000
.549 database could be upgraded to use primary keys in history tables
21.559 starting HA manager
21.568 HA manager started in active mode
...
.563 server #68 started [history poller #1]
.568 server #70 started [history poller #3]
.633 server #8 started [preprocessing worker #1]
.558 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0]. Crashing ...
.558 ====== Fatal information: ======
.558 Program counter: 0x7f2d6ec65871
.558 === Registers: ===
.558 r8 = fefefefefefefeff = 18374403900871474943 =   -72340172838076673
.558 r9 =  7f2d6e2f324c = 139833098842700 = 139833098842700
.558 r10  =   0 =     0 =     0
.558 r11  =   0 =     0 =     0
.558 r12  =   2 =     2 =     2
.558 r13  =  7ffe54b3e640 = 140730319496768 = 140730319496768
.558 r14  =  563e28bcd1f0 =  94824971424240 =  94824971424240
.558 r15  =   0 =     0 =     0
.558 rdi  =   0 =     0 =     0
.558 rsi  = 8080808080808080 =  9259542123273814144 = -9187201950435737472
.558 rbp  =   0 =     0 =     0
.558 rbx  =  7f2d6e2d0e20 = 139833098702368 = 139833098702368
.558 rdx  =   0 =     0 =     0
.558 rax  =   0 =     0 =     0
.558 rcx  =   0 =     0 =     0
.558 rsp  =  7ffe54b31498 = 140730319443096 = 140730319443096
.558 rip  =  7f2d6ec65871 = 139833108748401 = 139833108748401
.558 efl  =  10246 =   66118 =   66118
.558 csgsfs  =   2b000000000033 = 12103423998558259 = 12103423998558259
.558 err  =   4 =     4 =     4
.558 trapno  =   e =    14 =    14
.558 oldmask =   4a06 =   18950 =   18950
.558 cr2  =   0 =     0 =     0
.558 backtrace is not available for this platform
.558 === Memory map: ===
.558 563e2874c000-563e2877a000 r--p 00000000 fd:00 9831023     /usr/sbin/zabbix_server
.558 563e2877a000-563e28aae000 r-xp 0002e000 fd:00 9831023     /usr/sbin/zabbix_server
.558 563e28aae000-563e28bcc000 r--p 00362000 fd:00 9831023     /usr/sbin/zabbix_server
.558 563e28bcd000-563e28c96000 r--p 00480000 fd:00 9831023     /usr/sbin/zabbix_server
.558 563e28c96000-563e28ca6000 rw-p 00549000 fd:00 9831023     /usr/sbin/zabbix_server
.558 563e28ca6000-563e28cb5000 rw-p 00000000 00:00 0 
.558 563e295a0000-563e295a1000 ---p 00000000 00:00 0      [heap]
.558 563e295a1000-563e295a4000 rw-p 00000000 00:00 0      [heap]
.558 7f2cac291000-7f2cac67d000 rw-p 00000000 00:00 0 
.558 7f2cac67d000-7f2caca7d000 rw-s 00000000 00:01 8      /SYSV00000000 (deleted)
.558 7f2caca7d000-7f2cad27d000 rw-s 00000000 00:01 7      /SYSV00000000 (deleted)
.558 7f2cad27d000-7f2cada7d000 rw-s 00000000 00:01 6      /SYSV00000000 (deleted)
.558 7f2cada7d000-7f2d2da7d000 rw-s 00000000 00:01 4      /SYSV00000000 (deleted)
.558 7f2d2da7d000-7f2d2de7d000 rw-s 00000000 00:01 3      /SYSV00000000 (deleted)
.558 7f2d2de7d000-7f2d2e27d000 rw-s 00000000 00:01 2      /SYSV00000000 (deleted)
.558 7f2d2e27d000-7f2d6e27d000 rw-s 00000000 00:01 1      /SYSV00000000 (deleted)
.558 7f2d6e27d000-7f2d6e27e000 r--p 00000000 fd:00 9831614     /usr/lib/mariadb/plugin/caching_sha2_password.so
.558 7f2d6e27e000-7f2d6e27f000 r-xp 00001000 fd:00 9831614     /usr/lib/mariadb/plugin/caching_sha2_password.so
.558 7f2d6e27f000-7f2d6e280000 r--p 00002000 fd:00 9831614     /usr/lib/mariadb/plugin/caching_sha2_password.so
.558 7f2d6e280000-7f2d6e281000 r--p 00002000 fd:00 9831614     /usr/lib/mariadb/plugin/caching_sha2_password.so
.558 7f2d6e281000-7f2d6e282000 rw-p 00003000 fd:00 9831614     /usr/lib/mariadb/plugin/caching_sha2_password.so
.558 7f2d6e282000-7f2d6e284000 rw-p 00000000 00:00 0 
.558 7f2d6e284000-7f2d6e28a000 rw-s 00000000 00:01 5      /SYSV00000000 (deleted)
.558 7f2d6e28a000-7f2d6e299000 rw-p 00000000 00:00 0 
.558 7f2d6e299000-7f2d6e29a000 rw-p 00000000 00:00 0 
.558 7f2d6e29a000-7f2d6e2a9000 rw-p 00000000 00:00 0 
.558 7f2d6e2a9000-7f2d6e2aa000 rw-p 00000000 00:00 0 
.558 7f2d6e2aa000-7f2d6e2ab000 r--s 00000000 fd:00 1181602     /etc/localtime
.558 7f2d6e2ab000-7f2d6e2ac000 rw-s 00000000 00:01 0      /SYSV00000000 (deleted)
.558 7f2d6e2ac000-7f2d6e2ae000 rw-p 00000000 00:00 0 
.558 7f2d6e2ae000-7f2d6e2af000 r--p 00000000 fd:00 9831521     /usr/lib/libbrotlicommon.so.1.0.9
.558 7f2d6e2af000-7f2d6e2b0000 r-xp 00001000 fd:00 9831521     /usr/lib/libbrotlicommon.so.1.0.9
.558 7f2d6e2b0000-7f2d6e2cf000 r--p 00002000 fd:00 9831521     /usr/lib/libbrotlicommon.so.1.0.9
.558 7f2d6e2cf000-7f2d6e2d0000 r--p 00020000 fd:00 9831521     /usr/lib/libbrotlicommon.so.1.0.9
.558 7f2d6e2d0000-7f2d6e2d1000 rw-p 00021000 fd:00 9831521     /usr/lib/libbrotlicommon.so.1.0.9
.558 7f2d6e2d1000-7f2d6e2d4000 r--p 00000000 fd:00 9831566     /usr/lib/liblzma.so.5.2.5
.558 7f2d6e2d4000-7f2d6e2e7000 r-xp 00003000 fd:00 9831566     /usr/lib/liblzma.so.5.2.5
.558 7f2d6e2e7000-7f2d6e2f2000 r--p 00016000 fd:00 9831566     /usr/lib/liblzma.so.5.2.5
.558 7f2d6e2f2000-7f2d6e2f3000 r--p 00020000 fd:00 9831566     /usr/lib/liblzma.so.5.2.5
.558 7f2d6e2f3000-7f2d6e2f4000 rw-p 00021000 fd:00 9831566     /usr/lib/liblzma.so.5.2.5
.558 7f2d6e2f4000-7f2d6e2f5000 r--p 00000000 fd:00 9831523     /usr/lib/libbrotlidec.so.1.0.9
.558 7f2d6e2f5000-7f2d6e2fc000 r-xp 00001000 fd:00 9831523     /usr/lib/libbrotlidec.so.1.0.9
.558 7f2d6e2fc000-7f2d6e2ff000 r--p 00008000 fd:00 9831523     /usr/lib/libbrotlidec.so.1.0.9
.558 7f2d6e2ff000-7f2d6e300000 r--p 0000a000 fd:00 9831523     /usr/lib/libbrotlidec.so.1.0.9
.558 7f2d6e300000-7f2d6e301000 rw-p 0000b000 fd:00 9831523     /usr/lib/libbrotlidec.so.1.0.9
.558 7f2d6e301000-7f2d6e306000 r--p 00000000 fd:00 9831583     /usr/lib/libnghttp2.so.14.21.1
.558 7f2d6e306000-7f2d6e315000 r-xp 00005000 fd:00 9831583     /usr/lib/libnghttp2.so.14.21.1
.558 7f2d6e315000-7f2d6e322000 r--p 00014000 fd:00 9831583     /usr/lib/libnghttp2.so.14.21.1
.558 7f2d6e322000-7f2d6e325000 r--p 00020000 fd:00 9831583     /usr/lib/libnghttp2.so.14.21.1
.558 7f2d6e325000-7f2d6e326000 rw-p 00023000 fd:00 9831583     /usr/lib/libnghttp2.so.14.21.1
.558 7f2d6e326000-7f2d6e32a000 r--p 00000000 fd:00 9831605     /usr/lib/libsasl2.so.3.0.0
.558 7f2d6e32a000-7f2d6e339000 r-xp 00004000 fd:00 9831605     /usr/lib/libsasl2.so.3.0.0
.558 7f2d6e339000-7f2d6e33e000 r--p 00013000 fd:00 9831605     /usr/lib/libsasl2.so.3.0.0
.558 7f2d6e33e000-7f2d6e33f000 r--p 00018000 fd:00 9831605     /usr/lib/libsasl2.so.3.0.0
.558 7f2d6e33f000-7f2d6e340000 r--p 00018000 fd:00 9831605     /usr/lib/libsasl2.so.3.0.0
.558 7f2d6e340000-7f2d6e341000 rw-p 00019000 fd:00 9831605     /usr/lib/libsasl2.so.3.0.0
.558 7f2d6e341000-7f2d6e343000 r--p 00000000 fd:00 9831519     /usr/lib/libOpenIPMIutils.so.0.0.1
.558 7f2d6e343000-7f2d6e347000 r-xp 00002000 fd:00 9831519     /usr/lib/libOpenIPMIutils.so.0.0.1
.558 7f2d6e347000-7f2d6e349000 r--p 00006000 fd:00 9831519     /usr/lib/libOpenIPMIutils.so.0.0.1
.558 7f2d6e349000-7f2d6e34a000 r--p 00007000 fd:00 9831519     /usr/lib/libOpenIPMIutils.so.0.0.1
.558 7f2d6e34a000-7f2d6e34b000 rw-p 00008000 fd:00 9831519     /usr/lib/libOpenIPMIutils.so.0.0.1
.558 7f2d6e34b000-7f2d6e34d000 r--p 00000000 fd:00 9831595     /usr/lib/libpcre2-8.so.0.10.4
.558 7f2d6e34d000-7f2d6e3bc000 r-xp 00002000 fd:00 9831595     /usr/lib/libpcre2-8.so.0.10.4
.558 7f2d6e3bc000-7f2d6e3e6000 r--p 00071000 fd:00 9831595     /usr/lib/libpcre2-8.so.0.10.4
.559 7f2d6e3e6000-7f2d6e3e7000 r--p 0009a000 fd:00 9831595     /usr/lib/libpcre2-8.so.0.10.4
.559 7f2d6e3e7000-7f2d6e3e8000 rw-p 0009b000 fd:00 9831595     /usr/lib/libpcre2-8.so.0.10.4
.559 7f2d6e3e8000-7f2d6e417000 r--p 00000000 fd:00 9831611     /usr/lib/libxml2.so.2.9.12
.559 7f2d6e417000-7f2d6e4c4000 r-xp 0002f000 fd:00 9831611     /usr/lib/libxml2.so.2.9.12
.559 7f2d6e4c4000-7f2d6e507000 r--p 000dc000 fd:00 9831611     /usr/lib/libxml2.so.2.9.12
.559 7f2d6e507000-7f2d6e510000 r--p 0011e000 fd:00 9831611     /usr/lib/libxml2.so.2.9.12
.559 7f2d6e510000-7f2d6e511000 rw-p 00127000 fd:00 9831611     /usr/lib/libxml2.so.2.9.12
.559 7f2d6e511000-7f2d6e512000 rw-p 00000000 00:00 0 
.559 7f2d6e512000-7f2d6e51e000 r--p 00000000 fd:00 9831529     /usr/lib/libcurl.so.4.7.0
.559 7f2d6e51e000-7f2d6e56d000 r-xp 0000c000 fd:00 9831529     /usr/lib/libcurl.so.4.7.0
.559 7f2d6e56d000-7f2d6e587000 r--p 0005b000 fd:00 9831529     /usr/lib/libcurl.so.4.7.0
.559 7f2d6e587000-7f2d6e58a000 r--p 00074000 fd:00 9831529     /usr/lib/libcurl.so.4.7.0
.559 7f2d6e58a000-7f2d6e58c000 rw-p 00077000 fd:00 9831529     /usr/lib/libcurl.so.4.7.0
.559 7f2d6e58c000-7f2d6e58d000 rw-p 00000000 00:00 0 
.559 7f2d6e58d000-7f2d6e590000 r--p 00000000 fd:00 9831562     /usr/lib/liblber.so.2.0.200
.559 7f2d6e590000-7f2d6e596000 r-xp 00003000 fd:00 9831562     /usr/lib/liblber.so.2.0.200
.559 7f2d6e596000-7f2d6e599000 r--p 00009000 fd:00 9831562     /usr/lib/liblber.so.2.0.200
.559 7f2d6e599000-7f2d6e59a000 r--p 0000b000 fd:00 9831562     /usr/lib/liblber.so.2.0.200
.559 7f2d6e59a000-7f2d6e59b000 rw-p 0000c000 fd:00 9831562     /usr/lib/liblber.so.2.0.200
.559 7f2d6e59b000-7f2d6e5ab000 r--p 00000000 fd:00 9831564     /usr/lib/libldap.so.2.0.200
.559 7f2d6e5ab000-7f2d6e5d9000 r-xp 00010000 fd:00 9831564     /usr/lib/libldap.so.2.0.200
.559 7f2d6e5d9000-7f2d6e5e9000 r--p 0003e000 fd:00 9831564     /usr/lib/libldap.so.2.0.200
.559 7f2d6e5e9000-7f2d6e5ea000 r--p 0004e000 fd:00 9831564     /usr/lib/libldap.so.2.0.200
.559 7f2d6e5ea000-7f2d6e5ec000 r--p 0004e000 fd:00 9831564     /usr/lib/libldap.so.2.0.200
.559 7f2d6e5ec000-7f2d6e5ed000 rw-p 00050000 fd:00 9831564     /usr/lib/libldap.so.2.0.200
.559 7f2d6e5ed000-7f2d6e5ef000 rw-p 00000000 00:00 0 
.559 7f2d6e5ef000-7f2d6e664000 r--p 00000000 fd:00 9830676     /lib/libcrypto.so.1.1
.559 7f2d6e664000-7f2d6e7bb000 r-xp 00075000 fd:00 9830676     /lib/libcrypto.so.1.1
.559 7f2d6e7bb000-7f2d6e83f000 r--p 001cc000 fd:00 9830676     /lib/libcrypto.so.1.1
.559 7f2d6e83f000-7f2d6e86a000 r--p 0024f000 fd:00 9830676     /lib/libcrypto.so.1.1
.559 7f2d6e86a000-7f2d6e86c000 rw-p 0027a000 fd:00 9830676     /lib/libcrypto.so.1.1
.559 7f2d6e86c000-7f2d6e870000 rw-p 00000000 00:00 0 
.559 7f2d6e870000-7f2d6e88c000 r--p 00000000 fd:00 9830677     /lib/libssl.so.1.1
.559 7f2d6e88c000-7f2d6e8cc000 r-xp 0001c000 fd:00 9830677     /lib/libssl.so.1.1
.559 7f2d6e8cc000-7f2d6e8e4000 r--p 0005c000 fd:00 9830677     /lib/libssl.so.1.1
.559 7f2d6e8e4000-7f2d6e8ed000 r--p 00073000 fd:00 9830677     /lib/libssl.so.1.1
.559 7f2d6e8ed000-7f2d6e8f1000 rw-p 0007c000 fd:00 9830677     /lib/libssl.so.1.1
.559 7f2d6e8f1000-7f2d6e8ff000 r--p 00000000 fd:00 9831531     /usr/lib/libevent-2.1.so.7.0.1
.559 7f2d6e8ff000-7f2d6e928000 r-xp 0000e000 fd:00 9831531     /usr/lib/libevent-2.1.so.7.0.1
.559 7f2d6e928000-7f2d6e93b000 r--p 00037000 fd:00 9831531     /usr/lib/libevent-2.1.so.7.0.1
.559 7f2d6e93b000-7f2d6e93d000 r--p 00049000 fd:00 9831531     /usr/lib/libevent-2.1.so.7.0.1
.559 7f2d6e93d000-7f2d6e93e000 rw-p 0004b000 fd:00 9831531     /usr/lib/libevent-2.1.so.7.0.1
.559 7f2d6e93e000-7f2d6e941000 r--p 00000000 fd:00 9830679     /lib/libz.so.1.2.11
.559 7f2d6e941000-7f2d6e94f000 r-xp 00003000 fd:00 9830679     /lib/libz.so.1.2.11
.559 7f2d6e94f000-7f2d6e956000 r--p 00011000 fd:00 9830679     /lib/libz.so.1.2.11
.559 7f2d6e956000-7f2d6e957000 r--p 00017000 fd:00 9830679     /lib/libz.so.1.2.11
.559 7f2d6e957000-7f2d6e958000 rw-p 00018000 fd:00 9830679     /lib/libz.so.1.2.11
.559 7f2d6e958000-7f2d6e95a000 r--p 00000000 fd:00 9831513     /usr/lib/libOpenIPMIposix.so.0.0.1
.559 7f2d6e95a000-7f2d6e95d000 r-xp 00002000 fd:00 9831513     /usr/lib/libOpenIPMIposix.so.0.0.1
.559 7f2d6e95d000-7f2d6e95e000 r--p 00005000 fd:00 9831513     /usr/lib/libOpenIPMIposix.so.0.0.1
.559 7f2d6e95e000-7f2d6e95f000 r--p 00006000 fd:00 9831513     /usr/lib/libOpenIPMIposix.so.0.0.1
.559 7f2d6e95f000-7f2d6e960000 r--p 00006000 fd:00 9831513     /usr/lib/libOpenIPMIposix.so.0.0.1
.559 7f2d6e960000-7f2d6e961000 rw-p 00007000 fd:00 9831513     /usr/lib/libOpenIPMIposix.so.0.0.1
.559 7f2d6e961000-7f2d6e994000 r--p 00000000 fd:00 9831507     /usr/lib/libOpenIPMI.so.0.0.5
.559 7f2d6e994000-7f2d6e9fc000 r-xp 00033000 fd:00 9831507     /usr/lib/libOpenIPMI.so.0.0.5
.559 7f2d6e9fc000-7f2d6ea37000 r--p 0009b000 fd:00 9831507     /usr/lib/libOpenIPMI.so.0.0.5
.559 7f2d6ea37000-7f2d6ea4f000 r--p 000d5000 fd:00 9831507     /usr/lib/libOpenIPMI.so.0.0.5
.559 7f2d6ea4f000-7f2d6ea54000 rw-p 000ed000 fd:00 9831507     /usr/lib/libOpenIPMI.so.0.0.5
.559 7f2d6ea54000-7f2d6ea58000 rw-p 00000000 00:00 0 
.559 7f2d6ea58000-7f2d6ea65000 r--p 00000000 fd:00 9831607     /usr/lib/libssh.so.4.8.7
.559 7f2d6ea65000-7f2d6ea98000 r-xp 0000d000 fd:00 9831607     /usr/lib/libssh.so.4.8.7
.559 7f2d6ea98000-7f2d6eab1000 r--p 00040000 fd:00 9831607     /usr/lib/libssh.so.4.8.7
.559 7f2d6eab1000-7f2d6eab3000 r--p 00058000 fd:00 9831607     /usr/lib/libssh.so.4.8.7
.559 7f2d6eab3000-7f2d6eab5000 rw-p 0005a000 fd:00 9831607     /usr/lib/libssh.so.4.8.7
.559 7f2d6eab5000-7f2d6eacd000 r--p 00000000 fd:00 9831573     /usr/lib/libnetsnmp.so.40.1.0
.559 7f2d6eacd000-7f2d6eb32000 r-xp 00018000 fd:00 9831573     /usr/lib/libnetsnmp.so.40.1.0
.559 7f2d6eb32000-7f2d6eb54000 r--p 0007d000 fd:00 9831573     /usr/lib/libnetsnmp.so.40.1.0
.559 7f2d6eb54000-7f2d6eb57000 r--p 0009e000 fd:00 9831573     /usr/lib/libnetsnmp.so.40.1.0
.559 7f2d6eb57000-7f2d6eb5a000 rw-p 000a1000 fd:00 9831573     /usr/lib/libnetsnmp.so.40.1.0
.559 7f2d6eb5a000-7f2d6eb5f000 rw-p 00000000 00:00 0 
.559 7f2d6eb5f000-7f2d6eb66000 r--p 00000000 fd:00 9831585     /usr/lib/libodbc.so.2.0.0
.559 7f2d6eb66000-7f2d6eba7000 r-xp 00007000 fd:00 9831585     /usr/lib/libodbc.so.2.0.0
.559 7f2d6eba7000-7f2d6ebb9000 r--p 00048000 fd:00 9831585     /usr/lib/libodbc.so.2.0.0
.559 7f2d6ebb9000-7f2d6ebba000 r--p 0005a000 fd:00 9831585     /usr/lib/libodbc.so.2.0.0
.559 7f2d6ebba000-7f2d6ebbb000 r--p 0005a000 fd:00 9831585     /usr/lib/libodbc.so.2.0.0
.559 7f2d6ebbb000-7f2d6ebc2000 rw-p 0005b000 fd:00 9831585     /usr/lib/libodbc.so.2.0.0
.559 7f2d6ebc2000-7f2d6ebc6000 rw-p 00000000 00:00 0 
.559 7f2d6ebc6000-7f2d6ebdc000 r--p 00000000 fd:00 9831567     /usr/lib/libmariadb.so.3
.559 7f2d6ebdc000-7f2d6ebfd000 r-xp 00016000 fd:00 9831567     /usr/lib/libmariadb.so.3
.559 7f2d6ebfd000-7f2d6ec09000 r--p 00037000 fd:00 9831567     /usr/lib/libmariadb.so.3
.559 7f2d6ec09000-7f2d6ec11000 r--p 00042000 fd:00 9831567     /usr/lib/libmariadb.so.3
.559 7f2d6ec11000-7f2d6ec13000 rw-p 0004a000 fd:00 9831567     /usr/lib/libmariadb.so.3
.559 7f2d6ec13000-7f2d6ec15000 rw-p 00000000 00:00 0 
.559 7f2d6ec15000-7f2d6ec2a000 r--p 00000000 fd:00 9830673     /lib/ld-musl-x86_64.so.1
.559 7f2d6ec2a000-7f2d6ec72000 r-xp 00015000 fd:00 9830673     /lib/ld-musl-x86_64.so.1
.560 7f2d6ec72000-7f2d6eca8000 r--p 0005d000 fd:00 9830673     /lib/ld-musl-x86_64.so.1
.560 7f2d6eca8000-7f2d6eca9000 r--p 00092000 fd:00 9830673     /lib/ld-musl-x86_64.so.1
.560 7f2d6eca9000-7f2d6ecaa000 rw-p 00093000 fd:00 9830673     /lib/ld-musl-x86_64.so.1
.560 7f2d6ecaa000-7f2d6ecad000 rw-p 00000000 00:00 0 
.560 7ffe54b1e000-7ffe54b3f000 rw-p 00000000 00:00 0      [stack]
.560 7ffe54be7000-7ffe54beb000 r--p 00000000 00:00 0      [vvar]
.560 7ffe54beb000-7ffe54bed000 r-xp 00000000 00:00 0      [vdso]
.560 ffffffffff600000-ffffffffff601000 --xp 00000000 00:00 0   [vsyscall]
.560 ================================
.560 Please consider attaching a disassembly listing to your bug report.
.560 This listing can be produced with, e.g., objdump -DSswx zabbix_server.
.560 ================================
7:20220301:200414.561 One child process died (PID:237,exitcode/signal:1). Exiting ...
.561 PROCESS EXIT: 237
21.562 HA manager has been paused
zabbix_server [7]: Error waiting for process with PID 237: [10] No child process
21.580 HA manager has been stopped
.588 syncing history data...
.600 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0]. Crashing ...
.600 ====== Fatal information: ======
.600 Program counter: 0x7f2d6ec65871
.600 === Registers: ===
.600 r8 = fefefefefefefeff = 18374403900871474943 =   -72340172838076673
.600 r9 =  7f2d6e58c51c = 139833101567260 = 139833101567260
.600 r10  =   0 =     0 =     0
.600 r11  =   0 =     0 =     0
.600 r12  =  7ffe54b3e618 = 140730319496728 = 140730319496728
.600 r13  =  7ffe54b3e640 = 140730319496768 = 140730319496768
.600 r14  =  563e28bcd1f0 =  94824971424240 =  94824971424240
.600 r15  =   0 =     0 =     0
.600 rdi  =   0 =     0 =     0
.600 rsi  = 8080808080808080 =  9259542123273814144 = -9187201950435737472
.600 rbp  =   0 =     0 =     0
.600 rbx  =  563e2890112b =  94824968491307 =  94824968491307
.600 rdx  =   0 =     0 =     0
.600 rax  =   0 =     0 =     0
.600 rcx  =   0 =     0 =     0
.600 rsp  =  7ffe54b314e8 = 140730319443176 = 140730319443176
.600 rip  =  7f2d6ec65871 = 139833108748401 = 139833108748401
.600 efl  =  10246 =   66118 =   66118
.600 csgsfs  =   2b000000000033 = 12103423998558259 = 12103423998558259
.600 err  =   4 =     4 =     4
.600 trapno  =   e =    14 =    14
.600 oldmask =  10000 =   65536 =   65536
.600 cr2  =   0 =     0 =     0
.600 backtrace is not available for this platform
.600 === Memory map: ===
.600 563e2874c000-563e2877a000 r--p 00000000 fd:00 9831023     /usr/sbin/zabbix_server
.600 563e2877a000-563e28aae000 r-xp 0002e000 fd:00 9831023     /usr/sbin/zabbix_server
.600 563e28aae000-563e28bcc000 r--p 00362000 fd:00 9831023     /usr/sbin/zabbix_server
.600 563e28bcd000-563e28c96000 r--p 00480000 fd:00 9831023     /usr/sbin/zabbix_server
.600 563e28c96000-563e28ca6000 rw-p 00549000 fd:00 9831023     /usr/sbin/zabbix_server
.600 563e28ca6000-563e28cb5000 rw-p 00000000 00:00 0 
.600 563e295a0000-563e295a1000 ---p 00000000 00:00 0      [heap]
.600 563e295a1000-563e295a4000 rw-p 00000000 00:00 0      [heap]
.600 7f2cac213000-7f2cac67d000 rw-p 00000000 00:00 0 
.600 7f2cac67d000-7f2caca7d000 rw-s 00000000 00:01 8      /SYSV00000000 (deleted)
.600 7f2caca7d000-7f2cad27d000 rw-s 00000000 00:01 7      /SYSV00000000 (deleted)
.600 7f2cad27d000-7f2cada7d000 rw-s 00000000 00:01 6      /SYSV00000000 (deleted)
.600 7f2cada7d000-7f2d2da7d000 rw-s 00000000 00:01 4      /SYSV00000000 (deleted)
.600 7f2d2da7d000-7f2d2de7d000 rw-s 00000000 00:01 3      /SYSV00000000 (deleted)
.600 7f2d2de7d000-7f2d2e27d000 rw-s 00000000 00:01 2      /SYSV00000000 (deleted)
.600 7f2d2e27d000-7f2d6e27d000 rw-s 00000000 00:01 1      /SYSV00000000 (deleted)
.600 7f2d6e27d000-7f2d6e27e000 r--p 00000000 fd:00 9831614     /usr/lib/mariadb/plugin/caching_sha2_password.so
.600 7f2d6e27e000-7f2d6e27f000 r-xp 00001000 fd:00 9831614     /usr/lib/mariadb/plugin/caching_sha2_password.so
.600 7f2d6e27f000-7f2d6e280000 r--p 00002000 fd:00 9831614     /usr/lib/mariadb/plugin/caching_sha2_password.so
.600 7f2d6e280000-7f2d6e281000 r--p 00002000 fd:00 9831614     /usr/lib/mariadb/plugin/caching_sha2_password.so
.600 7f2d6e281000-7f2d6e282000 rw-p 00003000 fd:00 9831614     /usr/lib/mariadb/plugin/caching_sha2_password.so
.600 7f2d6e282000-7f2d6e284000 rw-p 00000000 00:00 0 
.600 7f2d6e284000-7f2d6e28a000 rw-s 00000000 00:01 5      /SYSV00000000 (deleted)
.600 7f2d6e28a000-7f2d6e2a9000 rw-p 00000000 00:00 0 
.600 7f2d6e2a9000-7f2d6e2aa000 rw-p 00000000 00:00 0 
.600 7f2d6e2aa000-7f2d6e2ab000 r--s 00000000 fd:00 1181602     /etc/localtime
.600 7f2d6e2ab000-7f2d6e2ac000 rw-s 00000000 00:01 0      /SYSV00000000 (deleted)
.600 7f2d6e2ac000-7f2d6e2ae000 rw-p 00000000 00:00 0 
.600 7f2d6e2ae000-7f2d6e2af000 r--p 00000000 fd:00 9831521     /usr/lib/libbrotlicommon.so.1.0.9
.600 7f2d6e2af000-7f2d6e2b0000 r-xp 00001000 fd:00 9831521     /usr/lib/libbrotlicommon.so.1.0.9
.600 7f2d6e2b0000-7f2d6e2cf000 r--p 00002000 fd:00 9831521     /usr/lib/libbrotlicommon.so.1.0.9
.600 7f2d6e2cf000-7f2d6e2d0000 r--p 00020000 fd:00 9831521     /usr/lib/libbrotlicommon.so.1.0.9
.600 7f2d6e2d0000-7f2d6e2d1000 rw-p 00021000 fd:00 9831521     /usr/lib/libbrotlicommon.so.1.0.9
.600 7f2d6e2d1000-7f2d6e2d4000 r--p 00000000 fd:00 9831566     /usr/lib/liblzma.so.5.2.5
.600 7f2d6e2d4000-7f2d6e2e7000 r-xp 00003000 fd:00 9831566     /usr/lib/liblzma.so.5.2.5
.600 7f2d6e2e7000-7f2d6e2f2000 r--p 00016000 fd:00 9831566     /usr/lib/liblzma.so.5.2.5
.600 7f2d6e2f2000-7f2d6e2f3000 r--p 00020000 fd:00 9831566     /usr/lib/liblzma.so.5.2.5
.600 7f2d6e2f3000-7f2d6e2f4000 rw-p 00021000 fd:00 9831566     /usr/lib/liblzma.so.5.2.5
.600 7f2d6e2f4000-7f2d6e2f5000 r--p 00000000 fd:00 9831523     /usr/lib/libbrotlidec.so.1.0.9
.600 7f2d6e2f5000-7f2d6e2fc000 r-xp 00001000 fd:00 9831523     /usr/lib/libbrotlidec.so.1.0.9
.600 7f2d6e2fc000-7f2d6e2ff000 r--p 00008000 fd:00 9831523     /usr/lib/libbrotlidec.so.1.0.9
.600 7f2d6e2ff000-7f2d6e300000 r--p 0000a000 fd:00 9831523     /usr/lib/libbrotlidec.so.1.0.9
.600 7f2d6e300000-7f2d6e301000 rw-p 0000b000 fd:00 9831523     /usr/lib/libbrotlidec.so.1.0.9
.600 7f2d6e301000-7f2d6e306000 r--p 00000000 fd:00 9831583     /usr/lib/libnghttp2.so.14.21.1
.600 7f2d6e306000-7f2d6e315000 r-xp 00005000 fd:00 9831583     /usr/lib/libnghttp2.so.14.21.1
.600 7f2d6e315000-7f2d6e322000 r--p 00014000 fd:00 9831583     /usr/lib/libnghttp2.so.14.21.1
.600 7f2d6e322000-7f2d6e325000 r--p 00020000 fd:00 9831583     /usr/lib/libnghttp2.so.14.21.1
.600 7f2d6e325000-7f2d6e326000 rw-p 00023000 fd:00 9831583     /usr/lib/libnghttp2.so.14.21.1
.600 7f2d6e326000-7f2d6e32a000 r--p 00000000 fd:00 9831605     /usr/lib/libsasl2.so.3.0.0
.600 7f2d6e32a000-7f2d6e339000 r-xp 00004000 fd:00 9831605     /usr/lib/libsasl2.so.3.0.0
.600 7f2d6e339000-7f2d6e33e000 r--p 00013000 fd:00 9831605     /usr/lib/libsasl2.so.3.0.0
.600 7f2d6e33e000-7f2d6e33f000 r--p 00018000 fd:00 9831605     /usr/lib/libsasl2.so.3.0.0
.600 7f2d6e33f000-7f2d6e340000 r--p 00018000 fd:00 9831605     /usr/lib/libsasl2.so.3.0.0
.600 7f2d6e340000-7f2d6e341000 rw-p 00019000 fd:00 9831605     /usr/lib/libsasl2.so.3.0.0
.600 7f2d6e341000-7f2d6e343000 r--p 00000000 fd:00 9831519     /usr/lib/libOpenIPMIutils.so.0.0.1
.600 7f2d6e343000-7f2d6e347000 r-xp 00002000 fd:00 9831519     /usr/lib/libOpenIPMIutils.so.0.0.1
.600 7f2d6e347000-7f2d6e349000 r--p 00006000 fd:00 9831519     /usr/lib/libOpenIPMIutils.so.0.0.1
.600 7f2d6e349000-7f2d6e34a000 r--p 00007000 fd:00 9831519     /usr/lib/libOpenIPMIutils.so.0.0.1
.600 7f2d6e34a000-7f2d6e34b000 rw-p 00008000 fd:00 9831519     /usr/lib/libOpenIPMIutils.so.0.0.1
.600 7f2d6e34b000-7f2d6e34d000 r--p 00000000 fd:00 9831595     /usr/lib/libpcre2-8.so.0.10.4
.600 7f2d6e34d000-7f2d6e3bc000 r-xp 00002000 fd:00 9831595     /usr/lib/libpcre2-8.so.0.10.4
.600 7f2d6e3bc000-7f2d6e3e6000 r--p 00071000 fd:00 9831595     /usr/lib/libpcre2-8.so.0.10.4
.600 7f2d6e3e6000-7f2d6e3e7000 r--p 0009a000 fd:00 9831595     /usr/lib/libpcre2-8.so.0.10.4
.600 7f2d6e3e7000-7f2d6e3e8000 rw-p 0009b000 fd:00 9831595     /usr/lib/libpcre2-8.so.0.10.4
.600 7f2d6e3e8000-7f2d6e417000 r--p 00000000 fd:00 9831611     /usr/lib/libxml2.so.2.9.12
.600 7f2d6e417000-7f2d6e4c4000 r-xp 0002f000 fd:00 9831611     /usr/lib/libxml2.so.2.9.12
.600 7f2d6e4c4000-7f2d6e507000 r--p 000dc000 fd:00 9831611     /usr/lib/libxml2.so.2.9.12
.600 7f2d6e507000-7f2d6e510000 r--p 0011e000 fd:00 9831611     /usr/lib/libxml2.so.2.9.12
.600 7f2d6e510000-7f2d6e511000 rw-p 00127000 fd:00 9831611     /usr/lib/libxml2.so.2.9.12
.600 7f2d6e511000-7f2d6e512000 rw-p 00000000 00:00 0 
.600 7f2d6e512000-7f2d6e51e000 r--p 00000000 fd:00 9831529     /usr/lib/libcurl.so.4.7.0
.600 7f2d6e51e000-7f2d6e56d000 r-xp 0000c000 fd:00 9831529     /usr/lib/libcurl.so.4.7.0
.600 7f2d6e56d000-7f2d6e587000 r--p 0005b000 fd:00 9831529     /usr/lib/libcurl.so.4.7.0
.601 7f2d6e587000-7f2d6e58a000 r--p 00074000 fd:00 9831529     /usr/lib/libcurl.so.4.7.0
.601 7f2d6e58a000-7f2d6e58c000 rw-p 00077000 fd:00 9831529     /usr/lib/libcurl.so.4.7.0
.601 7f2d6e58c000-7f2d6e58d000 rw-p 00000000 00:00 0 
.601 7f2d6e58d000-7f2d6e590000 r--p 00000000 fd:00 9831562     /usr/lib/liblber.so.2.0.200
.601 7f2d6e590000-7f2d6e596000 r-xp 00003000 fd:00 9831562     /usr/lib/liblber.so.2.0.200
.601 7f2d6e596000-7f2d6e599000 r--p 00009000 fd:00 9831562     /usr/lib/liblber.so.2.0.200
.601 7f2d6e599000-7f2d6e59a000 r--p 0000b000 fd:00 9831562     /usr/lib/liblber.so.2.0.200
.601 7f2d6e59a000-7f2d6e59b000 rw-p 0000c000 fd:00 9831562     /usr/lib/liblber.so.2.0.200
.601 7f2d6e59b000-7f2d6e5ab000 r--p 00000000 fd:00 9831564     /usr/lib/libldap.so.2.0.200
.601 7f2d6e5ab000-7f2d6e5d9000 r-xp 00010000 fd:00 9831564     /usr/lib/libldap.so.2.0.200
.601 7f2d6e5d9000-7f2d6e5e9000 r--p 0003e000 fd:00 9831564     /usr/lib/libldap.so.2.0.200
.601 7f2d6e5e9000-7f2d6e5ea000 r--p 0004e000 fd:00 9831564     /usr/lib/libldap.so.2.0.200
.601 7f2d6e5ea000-7f2d6e5ec000 r--p 0004e000 fd:00 9831564     /usr/lib/libldap.so.2.0.200
.601 7f2d6e5ec000-7f2d6e5ed000 rw-p 00050000 fd:00 9831564     /usr/lib/libldap.so.2.0.200
.601 7f2d6e5ed000-7f2d6e5ef000 rw-p 00000000 00:00 0 
.601 7f2d6e5ef000-7f2d6e664000 r--p 00000000 fd:00 9830676     /lib/libcrypto.so.1.1
.601 7f2d6e664000-7f2d6e7bb000 r-xp 00075000 fd:00 9830676     /lib/libcrypto.so.1.1
.601 7f2d6e7bb000-7f2d6e83f000 r--p 001cc000 fd:00 9830676     /lib/libcrypto.so.1.1
.601 7f2d6e83f000-7f2d6e86a000 r--p 0024f000 fd:00 9830676     /lib/libcrypto.so.1.1
.601 7f2d6e86a000-7f2d6e86c000 rw-p 0027a000 fd:00 9830676     /lib/libcrypto.so.1.1
.601 7f2d6e86c000-7f2d6e870000 rw-p 00000000 00:00 0 
.601 7f2d6e870000-7f2d6e88c000 r--p 00000000 fd:00 9830677     /lib/libssl.so.1.1
.601 7f2d6e88c000-7f2d6e8cc000 r-xp 0001c000 fd:00 9830677     /lib/libssl.so.1.1
.601 7f2d6e8cc000-7f2d6e8e4000 r--p 0005c000 fd:00 9830677     /lib/libssl.so.1.1
.601 7f2d6e8e4000-7f2d6e8ed000 r--p 00073000 fd:00 9830677     /lib/libssl.so.1.1
.601 7f2d6e8ed000-7f2d6e8f1000 rw-p 0007c000 fd:00 9830677     /lib/libssl.so.1.1
.601 7f2d6e8f1000-7f2d6e8ff000 r--p 00000000 fd:00 9831531     /usr/lib/libevent-2.1.so.7.0.1
.601 7f2d6e8ff000-7f2d6e928000 r-xp 0000e000 fd:00 9831531     /usr/lib/libevent-2.1.so.7.0.1
.601 7f2d6e928000-7f2d6e93b000 r--p 00037000 fd:00 9831531     /usr/lib/libevent-2.1.so.7.0.1
.601 7f2d6e93b000-7f2d6e93d000 r--p 00049000 fd:00 9831531     /usr/lib/libevent-2.1.so.7.0.1
0.1
.601 7f2d6e93e000-7f2d6e941000 r--p 00000000 fd:00 9830679     /lib/libz.so.1.2.11
.601 7f2d6e941000-7f2d6e94f000 r-xp 00003000 fd:00 9830679     /lib/libz.so.1.2.11
.601 7f2d6e94f000-7f2d6e956000 r--p 00011000 fd:00 9830679     /lib/libz.so.1.2.11
.601 7f2d6e956000-7f2d6e957000 r--p 00017000 fd:00 9830679     /lib/libz.so.1.2.11
.601 7f2d6e957000-7f2d6e958000 rw-p 00018000 fd:00 9830679     /lib/libz.so.1.2.11
.601 7f2d6e958000-7f2d6e95a000 r--p 00000000 fd:00 9831513     /usr/lib/libOpenIPMIposix.so.0.0.1
.601 7f2d6e95a000-7f2d6e95d000 r-xp 00002000 fd:00 9831513     /usr/lib/libOpenIPMIposix.so.0.0.1
.601 7f2d6e95d000-7f2d6e95e000 r--p 00005000 fd:00 9831513     /usr/lib/libOpenIPMIposix.so.0.0.1
.601 7f2d6e95e000-7f2d6e95f000 r--p 00006000 fd:00 9831513     /usr/lib/libOpenIPMIposix.so.0.0.1
.601 7f2d6e95f000-7f2d6e960000 r--p 00006000 fd:00 9831513     /usr/lib/libOpenIPMIposix.so.0.0.1
.601 7f2d6e960000-7f2d6e961000 rw-p 00007000 fd:00 9831513     /usr/lib/libOpenIPMIposix.so.0.0.1
.601 7f2d6e961000-7f2d6e994000 r--p 00000000 fd:00 9831507     /usr/lib/libOpenIPMI.so.0.0.5
.601 7f2d6e994000-7f2d6e9fc000 r-xp 00033000 fd:00 9831507     /usr/lib/libOpenIPMI.so.0.0.5
.601 7f2d6e9fc000-7f2d6ea37000 r--p 0009b000 fd:00 9831507     /usr/lib/libOpenIPMI.so.0.0.5
.601 7f2d6ea37000-7f2d6ea4f000 r--p 000d5000 fd:00 9831507     /usr/lib/libOpenIPMI.so.0.0.5
.601 7f2d6ea4f000-7f2d6ea54000 rw-p 000ed000 fd:00 9831507     /usr/lib/libOpenIPMI.so.0.0.5
.601 7f2d6ea54000-7f2d6ea58000 rw-p 00000000 00:00 0 
.601 7f2d6ea58000-7f2d6ea65000 r--p 00000000 fd:00 9831607     /usr/lib/libssh.so.4.8.7
.601 7f2d6ea65000-7f2d6ea98000 r-xp 0000d000 fd:00 9831607     /usr/lib/libssh.so.4.8.7
.601 7f2d6ea98000-7f2d6eab1000 r--p 00040000 fd:00 9831607     /usr/lib/libssh.so.4.8.7
.601 7f2d6eab1000-7f2d6eab3000 r--p 00058000 fd:00 9831607     /usr/lib/libssh.so.4.8.7
.601 7f2d6eab3000-7f2d6eab5000 rw-p 0005a000 fd:00 9831607     /usr/lib/libssh.so.4.8.7
.601 7f2d6eab5000-7f2d6eacd000 r--p 00000000 fd:00 9831573     /usr/lib/libnetsnmp.so.40.1.0
.601 7f2d6eacd000-7f2d6eb32000 r-xp 00018000 fd:00 9831573     /usr/lib/libnetsnmp.so.40.1.0
.601 7f2d6eb32000-7f2d6eb54000 r--p 0007d000 fd:00 9831573     /usr/lib/libnetsnmp.so.40.1.0
.601 7f2d6eb54000-7f2d6eb57000 r--p 0009e000 fd:00 9831573     /usr/lib/libnetsnmp.so.40.1.0
.601 7f2d6eb57000-7f2d6eb5a000 rw-p 000a1000 fd:00 9831573     /usr/lib/libnetsnmp.so.40.1.0
.601 7f2d6eb5a000-7f2d6eb5f000 rw-p 00000000 00:00 0 
.601 7f2d6eb5f000-7f2d6eb66000 r--p 00000000 fd:00 9831585     /usr/lib/libodbc.so.2.0.0
.601 7f2d6eb66000-7f2d6eba7000 r-xp 00007000 fd:00 9831585     /usr/lib/libodbc.so.2.0.0
.601 7f2d6eba7000-7f2d6ebb9000 r--p 00048000 fd:00 9831585     /usr/lib/libodbc.so.2.0.0
.601 7f2d6ebb9000-7f2d6ebba000 r--p 0005a000 fd:00 9831585     /usr/lib/libodbc.so.2.0.0
.601 7f2d6ebba000-7f2d6ebbb000 r--p 0005a000 fd:00 9831585     /usr/lib/libodbc.so.2.0.0
.601 7f2d6ebbb000-7f2d6ebc2000 rw-p 0005b000 fd:00 9831585     /usr/lib/libodbc.so.2.0.0
.601 7f2d6ebc2000-7f2d6ebc6000 rw-p 00000000 00:00 0 
.601 7f2d6ebc6000-7f2d6ebdc000 r--p 00000000 fd:00 9831567     /usr/lib/libmariadb.so.3
.601 7f2d6ebdc000-7f2d6ebfd000 r-xp 00016000 fd:00 9831567     /usr/lib/libmariadb.so.3
.601 7f2d6ebfd000-7f2d6ec09000 r--p 00037000 fd:00 9831567     /usr/lib/libmariadb.so.3
.601 7f2d6ec09000-7f2d6ec11000 r--p 00042000 fd:00 9831567     /usr/lib/libmariadb.so.3
.601 7f2d6ec11000-7f2d6ec13000 rw-p 0004a000 fd:00 9831567     /usr/lib/libmariadb.so.3
.601 7f2d6ec13000-7f2d6ec15000 rw-p 00000000 00:00 0 
.601 7f2d6ec15000-7f2d6ec2a000 r--p 00000000 fd:00 9830673     /lib/ld-musl-x86_64.so.1
.601 7f2d6ec2a000-7f2d6ec72000 r-xp 00015000 fd:00 9830673     /lib/ld-musl-x86_64.so.1
.601 7f2d6ec72000-7f2d6eca8000 r--p 0005d000 fd:00 9830673     /lib/ld-musl-x86_64.so.1
.601 7f2d6eca8000-7f2d6eca9000 r--p 00092000 fd:00 9830673     /lib/ld-musl-x86_64.so.1
.601 7f2d6eca9000-7f2d6ecaa000 rw-p 00093000 fd:00 9830673     /lib/ld-musl-x86_64.so.1
.601 7f2d6ecaa000-7f2d6ecad000 rw-p 00000000 00:00 0 
.601 7ffe54b1e000-7ffe54b3f000 rw-p 00000000 00:00 0      [stack]
.601 7ffe54be7000-7ffe54beb000 r--p 00000000 00:00 0      [vvar]
.601 7ffe54beb000-7ffe54bed000 r-xp 00000000 00:00 0      [vdso]
.601 ffffffffff600000-ffffffffff601000 --xp 00000000 00:00 0   [vsyscall]
.601 ================================
.601 Please consider attaching a disassembly listing to your bug report.
.601 This listing can be produced with, e.g., objdump -DSswx zabbix_server.
.601 ================================ 
Comment by Hans Vos [ 2022 Mar 02 ]

We have the same issue. 
Can we help with providing any log files ? 

 

Update: Restoring only the zabbix_server binary stopped the server from crashing. 

Comment by Patrick Winnertz [ 2022 Mar 02 ]

I can reproduce the issue too in my docker instance.

The instance was running quite stable on 6.0.0 the last days and after upgrading to 6.0.1 it starts to crash every ~60s.

 

Comment by Vladislavs Sokurenko [ 2022 Mar 02 ]

How often is configuration cache refresh ?

Comment by Patrick Winnertz [ 2022 Mar 02 ]

Where can i find  that information?

Here is the relevant information from docker-compose:

zabbixserver:
    image: zabbix/zabbix-server-mysql:latest
    container_name: zabbixserver
    hostname: zabbixserver
    domainname: xxxx
    restart: always
    ports:
      - 10051:10051
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - /etc/timezone:/etc/timezone:ro
      - /home/docker/zabbixserver/externalscripts:/usr/lib/zabbix/externalscripts:ro
      - /home/docker/zabbixserver/modules:/var/lib/zabbix/modules:ro
      - /home/docker/zabbixserver/enc:/var/lib/zabbix/enc:ro
      - /home/docker/zabbixserver/ssh_keys:/var/lib/zabbix/ssh_keys:ro
      - /home/docker/zabbixserver/mibs:/var/lib/zabbix/mibs:ro
      - /home/docker/zabbixserver/snmptraps:/var/lib/zabbix/snmptraps:rw
    environment:
      - DB_SERVER_HOST=mysql
      - DB_SERVER_PORT=3306
      - MYSQL_USER=xxxx
      - MYSQL_PASSWORD=xxxxx
      - MYSQL_DATABASE=xxxx
      - ZBX_DEBUGLEVEL=5
    links:
      - mysql

 

 

Comment by Vladislavs Sokurenko [ 2022 Mar 02 ]

If defaults are used then it should be exactly 60 seconds, ZBX_CACHEUPDATEFREQUENCY=60

Comment by Patrick Winnertz [ 2022 Mar 02 ]

Yes - defaults are used.

Comment by Ryan Eberly [ 2022 Mar 03 ]

Original poster and Malte's crash is the same crash I've observed in ZBX-20649 running on version 5.4.10. Previous version we were using (5.4.2) was fine. Patched dbconfig.c file from ZBX-20649 did not fix the segfault.

Comment by Alexander Meindl [ 2022 Mar 03 ]

We have same problems, which started yesterday with libc update for Ubuntu 20.04 to glibc_2.31-0ubuntu9.7 - this was the only change, for this reason maybe this cause the problem.

see http://changelogs.ubuntu.com/changelogs/pool/main/g/glibc/glibc_2.31-0ubuntu9.7/changelog

We use debian packages from repo.zabbix.com version 6.0.1

Comment by Patrick Winnertz [ 2022 Mar 03 ]

I can't test the zbx-20697-6.0.diff patch  on my server - I'm using pure docker there - sorry :S

 

Comment by Vladislavs Sokurenko [ 2022 Mar 03 ]

Fixed in pull request feature/ZBX-20697-6.0

Comment by Vladislavs Sokurenko [ 2022 Mar 03 ]

Fixed in:

Comment by Patrick Winnertz [ 2022 Mar 03 ]

When can we expect 6.0.2 to be released? Currently zabbix is not useable at all

Comment by Amal Raj [ 2022 Mar 03 ]

We are also facing the same issue on upgrade from 5.4 to 6.0. Zabbix is not useable for us too. 

Comment by Malte H. [ 2022 Mar 03 ]

When can we expect 6.0.2 to be released? Currently zabbix is not useable at all

+1 for this. Fast fix would be nice.

Comment by Aigars Kadikis [ 2022 Mar 04 ]

Uploading a patched 6.0.1 for RHEL8/CentOS8/OracleLinux8:

with PostgreSQL: zabbix-server-pgsql-6.0.1-0.zbx20697.el8.x86_64.rpm

with MySQL: zabbix-server-mysql-6.0.1-0.zbx20697.el8.x86_64.rpm

To install in graceful way, at first downgrade existing 6.0.1 to 6.0.0

dnf downgrade zabbix-server-mysql-6.0.0
# dnf downgrade zabbix-server-psql-6.0.0

Install patched version:

rpm -Uvh zabbix-server-mysql-6.0.1-0.zbx20697.el8.x86_64.rpm
# rpm -Uvh zabbix-server-psql-6.0.1-0.zbx20697.el8.x86_64.rpm
Comment by Patrick Winnertz [ 2022 Mar 04 ]

This isn't useful for me - first of all I'm debian based (and second: I'm using just docker images for all services.).. Please release a 6.0.2 version soon.

Comment by Aigars Kadikis [ 2022 Mar 04 ]

Hi Patrick,

Sorry, docker container 6.0.1 will be no re-compiled. As for workaround use:

  • Force the zabbix-server-mysql (or zabbix-server-psql) to use version 6.0.0 (do not use tag 'latest').
  • For frontend please use 6.0.1.

Official 6.0.2 is planned to be released on March 15.

Comment by Malte H. [ 2022 Mar 05 ]

Hey @aigars.kadikis 

can you provide a rebuild for Ubuntu/Debian based installations? (NO Docker!)

Thank you very much!

Comment by Lubomir Spacek [ 2022 Mar 11 ]

Same problem on clear UBUNTU 20.04 installation.

Comment by Chris V [ 2022 Mar 11 ]

same here, why is the bug closed with no critical release?

at least say NOT to upgrade zabbix in the first place, call it broken

Comment by Malte H. [ 2022 Mar 11 ]

If anyone interested I can provide an Ubuntu 20.04 LTS compatible build of zabbix_server 6.0.2rc1 that fixes this bug.  

Comment by Lubomir Spacek [ 2022 Mar 12 ]

Iam interested for zabbix_server_mysql 6.0.2rc1, thank you.

EDIT: Now I downdrade to 6.0.0. Problem solved for now.

Comment by Malte H. [ 2022 Mar 12 ]

https://we.tl/t-yebH8ZWyN0 (Upload here not possible due to filesize limitation) 

No guarantees, but you can give it a try. Just overwrite the 6.0.1 zabbix_server binary. (Create a backup before!) 

Generated at Sat Aug 02 09:01:12 EEST 2025 using Jira 9.12.4#9120004-sha1:625303b708afdb767e17cb2838290c41888e9ff0.