[ZBX-17728] zabbix-server-mysql crashes since 5.0 upgrade Created: 2020 May 13  Updated: 2024 Apr 10  Resolved: 2020 May 15

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Server (S)
Affects Version/s: 5.0.0
Fix Version/s: 5.0.1rc1, 5.2.0alpha1, 5.2 (plan)

Type: Problem report Priority: Critical
Reporter: Undefined_ID Assignee: Artjoms Rimdjonoks
Resolution: Fixed Votes: 0
Labels: 5.0, crash, server, sigsegv, zabbix-server-mysql
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Ubuntu Minimal Virtual 18.04.4
Docker Engine Community - Version: 19.03.8
Official zabbix/zabbix-server-mysql:latest build ca2e378e53a3
Zabbix 5.0.0 (revision 9665d62)


Attachments: PNG File zabbix_5.0_sigsegv.png    
Issue Links:
Causes
caused by ZBXNEXT-702 Compare last "text" value with any ot... Closed
Team: Team C
Sprint: Sprint 64 (May 2020)
Story Points: 0.25

 Description   

Steps to reproduce:

  • No changes in configuration since v4.4.8
  • Simply start or restart the container after its image upgraded to latest

Result:

  • Zabbix Server backend crashes

Container log:
 

Starting Zabbix Server. Zabbix 5.0.0 (revision 9665d62).
Press Ctrl+C to exit.     1:20200513:193410.630 Starting Zabbix Server. Zabbix 5.0.0 (revision 9665d62).
     1:20200513:193410.630 ****** Enabled features ******
     1:20200513:193410.630 SNMP monitoring:           YES
     1:20200513:193410.630 IPMI monitoring:           YES
     1:20200513:193410.630 Web monitoring:            YES
     1:20200513:193410.630 VMware monitoring:         YES
     1:20200513:193410.630 SMTP authentication:       YES
     1:20200513:193410.630 ODBC:                      YES
     1:20200513:193410.630 SSH support:               YES
     1:20200513:193410.630 IPv6 support:              YES
     1:20200513:193410.630 TLS support:               YES
     1:20200513:193410.630 ******************************
     1:20200513:193410.630 using configuration file: /etc/zabbix/zabbix_server.conf
     1:20200513:193410.636 current database version (mandatory/optional): 05000000/05000000
     1:20200513:193410.636 required mandatory version: 05000000
     1:20200513:193410.645 database is not upgraded to use double precision values
     1:20200513:193410.647 server #0 started [main process]
   204:20200513:193410.647 server #1 started [configuration syncer #1]
   205:20200513:193410.749 server #2 started [housekeeper #1]
   206:20200513:193410.749 server #3 started [timer #1]
   208:20200513:193410.750 server #5 started [discoverer #1]
   209:20200513:193410.752 server #6 started [discoverer #2]
   210:20200513:193410.753 server #7 started [history syncer #1]
   211:20200513:193410.753 server #8 started [history syncer #2]
   215:20200513:193410.754 server #12 started [snmp trapper #1]
   218:20200513:193410.755 server #15 started [vmware collector #1]
   220:20200513:193410.756 server #17 started [task manager #1]
   222:20200513:193410.757 server #19 started [poller #2]
   207:20200513:193410.760 server #4 started [http poller #1]
   216:20200513:193410.760 server #13 started [proxy poller #1]
   228:20200513:193410.760 server #25 started [poller #8]
   223:20200513:193410.760 server #20 started [poller #3]
   227:20200513:193410.761 server #24 started [poller #7]
   221:20200513:193410.761 server #18 started [poller #1]
   224:20200513:193410.762 server #21 started [poller #4]
   219:20200513:193410.762 server #16 started [vmware collector #2]
   217:20200513:193410.762 server #14 started [self-monitoring #1]
   214:20200513:193410.762 server #11 started [escalator #1]
   213:20200513:193410.762 server #10 started [history syncer #4]
   225:20200513:193410.763 server #22 started [poller #5]
   212:20200513:193410.765 server #9 started [history syncer #3]
   226:20200513:193410.766 server #23 started [poller #6]
   233:20200513:193410.768 server #30 started [unreachable poller #5]
   234:20200513:193410.769 server #31 started [unreachable poller #6]
   237:20200513:193410.772 server #34 started [trapper #1]
   248:20200513:193410.773 server #45 started [preprocessing manager #1]
   229:20200513:193410.773 server #26 started [unreachable poller #1]
   235:20200513:193410.773 server #32 started [unreachable poller #7]
   236:20200513:193410.774 server #33 started [unreachable poller #8]
   230:20200513:193410.776 server #27 started [unreachable poller #2]
   231:20200513:193410.780 server #28 started [unreachable poller #3]
   232:20200513:193410.784 server #29 started [unreachable poller #4]
   242:20200513:193410.796 server #39 started [icmp pinger #1]
   244:20200513:193410.797 server #41 started [alert manager #1]
   245:20200513:193410.797 server #42 started [alerter #1]
   243:20200513:193410.798 server #40 started [icmp pinger #2]
   240:20200513:193410.798 server #37 started [trapper #4]
   239:20200513:193410.800 server #36 started [trapper #3]
   241:20200513:193410.804 server #38 started [trapper #5]
   238:20200513:193410.808 server #35 started [trapper #2]
   246:20200513:193410.816 server #43 started [alerter #2]
   247:20200513:193410.817 server #44 started [alerter #3]
   253:20200513:193410.829 server #50 started [lld worker #1]
   254:20200513:193410.829 server #51 started [lld worker #2]
   255:20200513:193410.829 server #52 started [alert syncer #1]
   250:20200513:193410.836 server #47 started [preprocessing worker #2]
   251:20200513:193410.837 server #48 started [preprocessing worker #3]
   252:20200513:193410.837 server #49 started [lld manager #1]
   249:20200513:193410.842 server #46 started [preprocessing worker #1]
   214:20200513:193410.842 Got signal [signal:11(SIGSEGV),reason:128,refaddr:0]. Crashing ...
   214:20200513:193410.842 ====== Fatal information: ======
   214:20200513:193410.842 Program counter: 0x7f147dc41e63
   214:20200513:193410.842 === Registers: ===
   214:20200513:193410.842 r8      =     561a9a0d5bd0 =       94672253705168 =       94672253705168
   214:20200513:193410.842 r9      =     561a9a0d5c00 =       94672253705216 =       94672253705216
   214:20200513:193410.842 r10     =                1 =                    1 =                    1
   214:20200513:193410.842 r11     =                0 =                    0 =                    0
   214:20200513:193410.842 r12     =     561a9a0d5bd0 =       94672253705168 =       94672253705168
   214:20200513:193410.842 r13     =                1 =                    1 =                    1
   214:20200513:193410.842 r14     =     561a995904e0 =       94672241886432 =       94672241886432
   214:20200513:193410.842 r15     =  400000100003e00 =   288230380446694912 =   288230380446694912
   214:20200513:193410.842 rdi     =     561a9a0d5bd0 =       94672253705168 =       94672253705168
   214:20200513:193410.842 rsi     =               21 =                   33 =                   33
   214:20200513:193410.842 rbp     =     7ffe6d109530 =      140730728224048 =      140730728224048
   214:20200513:193410.842 rbx     =     561a9a0d5bf0 =       94672253705200 =       94672253705200
   214:20200513:193410.842 rdx     =                0 =                    0 =                    0
   214:20200513:193410.842 rax     =               21 =                   33 =                   33
   214:20200513:193410.842 rcx     =               20 =                   32 =                   32
   214:20200513:193410.842 rsp     =     7ffe6d100d40 =      140730728189248 =      140730728189248
   214:20200513:193410.842 rip     =     7f147dc41e63 =      139725986078307 =      139725986078307
   214:20200513:193410.842 efl     =            10293 =                66195 =                66195
   214:20200513:193410.842 csgsfs  =   2b000000000033 =    12103423998558259 =    12103423998558259
   214:20200513:193410.842 err     =                0 =                    0 =                    0
   214:20200513:193410.842 trapno  =                d =                   13 =                   13
   214:20200513:193410.842 oldmask =                0 =                    0 =                    0
   214:20200513:193410.842 cr2     =                0 =                    0 =                    0
   214:20200513:193410.842 backtrace is not available for this platform
   214:20200513:193410.842 === Memory map: ===
   214:20200513:193410.843 561a99251000-561a99279000 r--p 00000000 08:01 2105486                    /usr/sbin/zabbix_server
   214:20200513:193410.843 561a99279000-561a994c1000 r-xp 00028000 08:01 2105486                    /usr/sbin/zabbix_server
   214:20200513:193410.843 561a994c1000-561a9958f000 r--p 00270000 08:01 2105486                    /usr/sbin/zabbix_server
   214:20200513:193410.843 561a99590000-561a99620000 r--p 0033e000 08:01 2105486                    /usr/sbin/zabbix_server
   214:20200513:193410.843 561a99620000-561a9962c000 rw-p 003ce000 08:01 2105486                    /usr/sbin/zabbix_server
   214:20200513:193410.843 561a9962c000-561a99636000 rw-p 00000000 00:00 0
   214:20200513:193410.843 561a9a087000-561a9a0cc000 rw-p 00000000 00:00 0                          [heap]
   214:20200513:193410.843 561a9a0cc000-561a9a0f2000 rw-p 00000000 00:00 0                          [heap]
   214:20200513:193410.843 7f147a2a2000-7f147aaa2000 rw-s 00000000 00:05 229383                     /SYSV00000000 (deleted)
   214:20200513:193410.843 7f147aaa2000-7f147b2a2000 rw-s 00000000 00:05 196614                     /SYSV00000000 (deleted)
   214:20200513:193410.843 7f147b2a2000-7f147b2a6000 rw-s 00000000 00:05 163845                     /SYSV00000000 (deleted)
   214:20200513:193410.843 7f147b2a6000-7f147baa6000 rw-s 00000000 00:05 131076                     /SYSV00000000 (deleted)
   214:20200513:193410.843 7f147baa6000-7f147bea6000 rw-s 00000000 00:05 98307                      /SYSV00000000 (deleted)
   214:20200513:193410.843 7f147bea6000-7f147c2a6000 rw-s 00000000 00:05 65538                      /SYSV00000000 (deleted)
   214:20200513:193410.843 7f147c2a6000-7f147d2a6000 rw-s 00000000 00:05 32769                      /SYSV00000000 (deleted)
   214:20200513:193410.843 7f147d2a6000-7f147d2a7000 r--s 00000000 08:01 138349                     /etc/localtime
   214:20200513:193410.843 7f147d2a7000-7f147d2ac000 r--p 00000000 08:01 2104968                    /usr/lib/libnghttp2.so.14.19.0
   214:20200513:193410.843 7f147d2ac000-7f147d2bb000 r-xp 00005000 08:01 2104968                    /usr/lib/libnghttp2.so.14.19.0
   214:20200513:193410.843 7f147d2bb000-7f147d2c8000 r--p 00014000 08:01 2104968                    /usr/lib/libnghttp2.so.14.19.0
   214:20200513:193410.843 7f147d2c8000-7f147d2cb000 r--p 00020000 08:01 2104968                    /usr/lib/libnghttp2.so.14.19.0
   214:20200513:193410.843 7f147d2cb000-7f147d2cc000 rw-p 00023000 08:01 2104968                    /usr/lib/libnghttp2.so.14.19.0
   214:20200513:193410.843 7f147d2cc000-7f147d2d0000 r--p 00000000 08:01 2104984                    /usr/lib/libsasl2.so.3.0.0
   214:20200513:193410.843 7f147d2d0000-7f147d2df000 r-xp 00004000 08:01 2104984                    /usr/lib/libsasl2.so.3.0.0
   214:20200513:193410.843 7f147d2df000-7f147d2e5000 r--p 00013000 08:01 2104984                    /usr/lib/libsasl2.so.3.0.0
   214:20200513:193410.843 7f147d2e5000-7f147d2e6000 r--p 00018000 08:01 2104984                    /usr/lib/libsasl2.so.3.0.0
   214:20200513:193410.843 7f147d2e6000-7f147d2e7000 rw-p 00019000 08:01 2104984                    /usr/lib/libsasl2.so.3.0.0
   214:20200513:193410.843 7f147d2e7000-7f147d2e9000 r--p 00000000 08:01 2104910                    /usr/lib/libOpenIPMIutils.so.0.0.1
   214:20200513:193410.843 7f147d2e9000-7f147d2ed000 r-xp 00002000 08:01 2104910                    /usr/lib/libOpenIPMIutils.so.0.0.1
   214:20200513:193410.843 7f147d2ed000-7f147d2ef000 r--p 00006000 08:01 2104910                    /usr/lib/libOpenIPMIutils.so.0.0.1
   214:20200513:193410.843 7f147d2ef000-7f147d2f0000 r--p 00007000 08:01 2104910                    /usr/lib/libOpenIPMIutils.so.0.0.1
   214:20200513:193410.843 7f147d2f0000-7f147d2f1000 rw-p 00008000 08:01 2104910                    /usr/lib/libOpenIPMIutils.so.0.0.1
   214:20200513:193410.843 7f147d2f1000-7f147d2f4000 r--p 00000000 08:01 2104951                    /usr/lib/liblzma.so.5.2.4
   214:20200513:193410.843 7f147d2f4000-7f147d307000 r-xp 00003000 08:01 2104951                    /usr/lib/liblzma.so.5.2.4
   214:20200513:193410.843 7f147d307000-7f147d312000 r--p 00016000 08:01 2104951                    /usr/lib/liblzma.so.5.2.4
   214:20200513:193410.843 7f147d312000-7f147d313000 r--p 00020000 08:01 2104951                    /usr/lib/liblzma.so.5.2.4
   214:20200513:193410.843 7f147d313000-7f147d314000 rw-p 00021000 08:01 2104951                    /usr/lib/liblzma.so.5.2.4
   214:20200513:193410.843 7f147d314000-7f147d316000 r--p 00000000 08:01 2104978                    /usr/lib/libpcre.so.1.2.11
   214:20200513:193410.843 7f147d316000-7f147d352000 r-xp 00002000 08:01 2104978                    /usr/lib/libpcre.so.1.2.11
   214:20200513:193410.843 7f147d352000-7f147d36e000 r--p 0003e000 08:01 2104978                    /usr/lib/libpcre.so.1.2.11
   214:20200513:193410.843 7f147d36e000-7f147d36f000 r--p 00059000 08:01 2104978                    /usr/lib/libpcre.so.1.2.11
   214:20200513:193410.843 7f147d36f000-7f147d370000 rw-p 0005a000 08:01 2104978                    /usr/lib/libpcre.so.1.2.11
   214:20200513:193410.843 7f147d370000-7f147d37a000 r--p 00000000 08:01 2104914                    /usr/lib/libcurl.so.4.6.0
   214:20200513:193410.843 7f147d37a000-7f147d3c2000 r-xp 0000a000 08:01 2104914                    /usr/lib/libcurl.so.4.6.0
   214:20200513:193410.843 7f147d3c2000-7f147d3d9000 r--p 00052000 08:01 2104914                    /usr/lib/libcurl.so.4.6.0
   214:20200513:193410.843 7f147d3d9000-7f147d3dc000 r--p 00068000 08:01 2104914                    /usr/lib/libcurl.so.4.6.0
   214:20200513:193410.843 7f147d3dc000-7f147d3dd000 rw-p 0006b000 08:01 2104914                    /usr/lib/libcurl.so.4.6.0
   214:20200513:193410.843 7f147d3dd000-7f147d3e0000 r--p 00000000 08:01 2104945                    /usr/lib/liblber-2.4.so.2.10.11
   214:20200513:193410.843 7f147d3e0000-7f147d3e6000 r-xp 00003000 08:01 2104945                    /usr/lib/liblber-2.4.so.2.10.11
   214:20200513:193410.843 7f147d3e6000-7f147d3e9000 r--p 00009000 08:01 2104945                    /usr/lib/liblber-2.4.so.2.10.11
   214:20200513:193410.843 7f147d3e9000-7f147d3ea000 r--p 0000b000 08:01 2104945                    /usr/lib/liblber-2.4.so.2.10.11
   214:20200513:193410.843 7f147d3ea000-7f147d3eb000 rw-p 0000c000 08:01 2104945                    /usr/lib/liblber-2.4.so.2.10.11
   214:20200513:193410.843 7f147d3eb000-7f147d3f7000 r--p 00000000 08:01 2104947                    /usr/lib/libldap-2.4.so.2.10.11
   214:20200513:193410.843 7f147d3f7000-7f147d41c000 r-xp 0000c000 08:01 2104947                    /usr/lib/libldap-2.4.so.2.10.11
   214:20200513:193410.843 7f147d41c000-7f147d429000 r--p 00031000 08:01 2104947                    /usr/lib/libldap-2.4.so.2.10.11
   214:20200513:193410.843 7f147d429000-7f147d42b000 r--p 0003d000 08:01 2104947                    /usr/lib/libldap-2.4.so.2.10.11
   214:20200513:193410.843 7f147d42b000-7f147d42c000 rw-p 0003f000 08:01 2104947                    /usr/lib/libldap-2.4.so.2.10.11
   214:20200513:193410.843 7f147d42c000-7f147d4a1000 r--p 00000000 08:01 933338                     /lib/libcrypto.so.1.1
   214:20200513:193410.843 7f147d4a1000-7f147d5f6000 r-xp 00075000 08:01 933338                     /lib/libcrypto.so.1.1
   214:20200513:193410.843 7f147d5f6000-7f147d67a000 r--p 001ca000 08:01 933338                     /lib/libcrypto.so.1.1
   214:20200513:193410.843 7f147d67a000-7f147d6a5000 r--p 0024d000 08:01 933338                     /lib/libcrypto.so.1.1
   214:20200513:193410.843 7f147d6a5000-7f147d6a7000 rw-p 00278000 08:01 933338                     /lib/libcrypto.so.1.1
   214:20200513:193410.843 7f147d6a7000-7f147d6ab000 rw-p 00000000 00:00 0
   214:20200513:193410.843 7f147d6ab000-7f147d6c7000 r--p 00000000 08:01 933339                     /lib/libssl.so.1.1
   214:20200513:193410.843 7f147d6c7000-7f147d707000 r-xp 0001c000 08:01 933339                     /lib/libssl.so.1.1
   214:20200513:193410.843 7f147d707000-7f147d71f000 r--p 0005c000 08:01 933339                     /lib/libssl.so.1.1
   214:20200513:193410.843 7f147d71f000-7f147d728000 r--p 00073000 08:01 933339                     /lib/libssl.so.1.1
   214:20200513:193410.843 7f147d728000-7f147d72c000 rw-p 0007c000 08:01 933339                     /lib/libssl.so.1.1
   214:20200513:193410.843 7f147d72c000-7f147d739000 r--p 00000000 08:01 2104917                    /usr/lib/libevent-2.1.so.7.0.0
   214:20200513:193410.843 7f147d739000-7f147d761000 r-xp 0000d000 08:01 2104917                    /usr/lib/libevent-2.1.so.7.0.0
   214:20200513:193410.843 7f147d761000-7f147d774000 r--p 00035000 08:01 2104917                    /usr/lib/libevent-2.1.so.7.0.0
   214:20200513:193410.843 7f147d774000-7f147d776000 r--p 00047000 08:01 2104917                    /usr/lib/libevent-2.1.so.7.0.0
   214:20200513:193410.843 7f147d776000-7f147d777000 rw-p 00049000 08:01 2104917                    /usr/lib/libevent-2.1.so.7.0.0
   214:20200513:193410.843 7f147d777000-7f147d77a000 r--p 00000000 08:01 933341                     /lib/libz.so.1.2.11
   214:20200513:193410.843 7f147d77a000-7f147d788000 r-xp 00003000 08:01 933341                     /lib/libz.so.1.2.11
   214:20200513:193410.843 7f147d788000-7f147d78f000 r--p 00011000 08:01 933341                     /lib/libz.so.1.2.11
   214:20200513:193410.843 7f147d78f000-7f147d790000 r--p 00017000 08:01 933341                     /lib/libz.so.1.2.11
   214:20200513:193410.843 7f147d790000-7f147d791000 rw-p 00018000 08:01 933341                     /lib/libz.so.1.2.11
   214:20200513:193410.843 7f147d791000-7f147d793000 r--p 00000000 08:01 2104904                    /usr/lib/libOpenIPMIposix.so.0.0.1
   214:20200513:193410.843 7f147d793000-7f147d796000 r-xp 00002000 08:01 2104904                    /usr/lib/libOpenIPMIposix.so.0.0.1
   214:20200513:193410.843 7f147d796000-7f147d798000 r--p 00005000 08:01 2104904                    /usr/lib/libOpenIPMIposix.so.0.0.1
   214:20200513:193410.843 7f147d798000-7f147d799000 r--p 00006000 08:01 2104904                    /usr/lib/libOpenIPMIposix.so.0.0.1
   214:20200513:193410.843 7f147d799000-7f147d79a000 rw-p 00007000 08:01 2104904                    /usr/lib/libOpenIPMIposix.so.0.0.1
   214:20200513:193410.843 7f147d79a000-7f147d7cd000 r--p 00000000 08:01 2104898                    /usr/lib/libOpenIPMI.so.0.0.5
   214:20200513:193410.843 7f147d7cd000-7f147d833000 r-xp 00033000 08:01 2104898                    /usr/lib/libOpenIPMI.so.0.0.5
   214:20200513:193410.843 7f147d833000-7f147d86d000 r--p 00099000 08:01 2104898                    /usr/lib/libOpenIPMI.so.0.0.5
   214:20200513:193410.843 7f147d86d000-7f147d885000 r--p 000d2000 08:01 2104898                    /usr/lib/libOpenIPMI.so.0.0.5
   214:20200513:193410.843 7f147d885000-7f147d88a000 rw-p 000ea000 08:01 2104898                    /usr/lib/libOpenIPMI.so.0.0.5
   214:20200513:193410.843 7f147d88a000-7f147d88e000 rw-p 00000000 00:00 0
   214:20200513:193410.843 7f147d88e000-7f147d895000 r--p 00000000 08:01 2104986                    /usr/lib/libssh2.so.1.0.1
   214:20200513:193410.843 7f147d895000-7f147d8b7000 r-xp 00007000 08:01 2104986                    /usr/lib/libssh2.so.1.0.1
   214:20200513:193410.843 7f147d8b7000-7f147d8c3000 r--p 00029000 08:01 2104986                    /usr/lib/libssh2.so.1.0.1
   214:20200513:193410.843 7f147d8c3000-7f147d8c5000 r--p 00034000 08:01 2104986                    /usr/lib/libssh2.so.1.0.1
   214:20200513:193410.843 7f147d8c5000-7f147d8c6000 rw-p 00036000 08:01 2104986                    /usr/lib/libssh2.so.1.0.1
   214:20200513:193410.843 7f147d8c6000-7f147d8df000 r--p 00000000 08:01 2104958                    /usr/lib/libnetsnmp.so.35.0.0
   214:20200513:193410.843 7f147d8df000-7f147d945000 r-xp 00019000 08:01 2104958                    /usr/lib/libnetsnmp.so.35.0.0
   214:20200513:193410.843 7f147d945000-7f147d967000 r--p 0007f000 08:01 2104958                    /usr/lib/libnetsnmp.so.35.0.0
   214:20200513:193410.843 7f147d967000-7f147d96a000 r--p 000a0000 08:01 2104958                    /usr/lib/libnetsnmp.so.35.0.0
   214:20200513:193410.843 7f147d96a000-7f147d96d000 rw-p 000a3000 08:01 2104958                    /usr/lib/libnetsnmp.so.35.0.0
   214:20200513:193410.843 7f147d96d000-7f147da32000 rw-p 00000000 00:00 0
   214:20200513:193410.843 7f147da32000-7f147da39000 r--p 00000000 08:01 2104970                    /usr/lib/libodbc.so.2.0.0
   214:20200513:193410.843 7f147da39000-7f147da7a000 r-xp 00007000 08:01 2104970                    /usr/lib/libodbc.so.2.0.0
   214:20200513:193410.843 7f147da7a000-7f147da8d000 r--p 00048000 08:01 2104970                    /usr/lib/libodbc.so.2.0.0
   214:20200513:193410.843 7f147da8d000-7f147da8e000 r--p 0005a000 08:01 2104970                    /usr/lib/libodbc.so.2.0.0
   214:20200513:193410.843 7f147da8e000-7f147da95000 rw-p 0005b000 08:01 2104970                    /usr/lib/libodbc.so.2.0.0
   214:20200513:193410.843 7f147da95000-7f147da99000 rw-p 00000000 00:00 0
   214:20200513:193410.844 7f147da99000-7f147dac7000 r--p 00000000 08:01 2104990                    /usr/lib/libxml2.so.2.9.10
   214:20200513:193410.844 7f147dac7000-7f147db73000 r-xp 0002e000 08:01 2104990                    /usr/lib/libxml2.so.2.9.10
   214:20200513:193410.844 7f147db73000-7f147dbb6000 r--p 000da000 08:01 2104990                    /usr/lib/libxml2.so.2.9.10
   214:20200513:193410.844 7f147dbb6000-7f147dbbf000 r--p 0011c000 08:01 2104990                    /usr/lib/libxml2.so.2.9.10
   214:20200513:193410.844 7f147dbbf000-7f147dbc0000 rw-p 00125000 08:01 2104990                    /usr/lib/libxml2.so.2.9.10
   214:20200513:193410.844 7f147dbc0000-7f147dbc2000 rw-p 00000000 00:00 0
   214:20200513:193410.844 7f147dbc2000-7f147dbd8000 r--p 00000000 08:01 2104952                    /usr/lib/libmariadb.so.3
   214:20200513:193410.844 7f147dbd8000-7f147dc06000 r-xp 00016000 08:01 2104952                    /usr/lib/libmariadb.so.3
   214:20200513:193410.844 7f147dc06000-7f147dc13000 r--p 00044000 08:01 2104952                    /usr/lib/libmariadb.so.3
   214:20200513:193410.844 7f147dc13000-7f147dc1b000 r--p 00050000 08:01 2104952                    /usr/lib/libmariadb.so.3
   214:20200513:193410.844 7f147dc1b000-7f147dc1d000 rw-p 00058000 08:01 2104952                    /usr/lib/libmariadb.so.3
   214:20200513:193410.844 7f147dc1d000-7f147dc1f000 rw-p 00000000 00:00 0
   214:20200513:193410.844 7f147dc1f000-7f147dc34000 r--p 00000000 08:01 933336                     /lib/ld-musl-x86_64.so.1
   214:20200513:193410.844 7f147dc34000-7f147dc7b000 r-xp 00015000 08:01 933336                     /lib/ld-musl-x86_64.so.1
   214:20200513:193410.844 7f147dc7b000-7f147dcaf000 r--p 0005c000 08:01 933336                     /lib/ld-musl-x86_64.so.1
   214:20200513:193410.844 7f147dcaf000-7f147dcb0000 rw-s 00000000 00:05 0                          /SYSV00000000 (deleted)
   214:20200513:193410.844 7f147dcb0000-7f147dcb1000 r--p 00090000 08:01 933336                     /lib/ld-musl-x86_64.so.1
   214:20200513:193410.844 7f147dcb1000-7f147dcb2000 rw-p 00091000 08:01 933336                     /lib/ld-musl-x86_64.so.1
   214:20200513:193410.844 7f147dcb2000-7f147dcb5000 rw-p 00000000 00:00 0
   214:20200513:193410.844 7ffe6d0ec000-7ffe6d10d000 rw-p 00000000 00:00 0                          [stack]
   214:20200513:193410.844 7ffe6d187000-7ffe6d18a000 r--p 00000000 00:00 0                          [vvar]
   214:20200513:193410.844 7ffe6d18a000-7ffe6d18c000 r-xp 00000000 00:00 0                          [vdso]
   214:20200513:193410.844 ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]
   214:20200513:193410.844 ================================
   214:20200513:193410.844 Please consider attaching a disassembly listing to your bug report.
   214:20200513:193410.844 This listing can be produced with, e.g., objdump -DSswx zabbix_server.
   214:20200513:193410.844 ================================
     1:20200513:193410.854 One child process died (PID:214,exitcode/signal:1). Exiting ...
zabbix_server [1]: Error waiting for process with PID 214: [10] No child process
     1:20200513:193413.281 syncing trend data...
     1:20200513:193413.282 syncing trend data done
     1:20200513:193413.282 Zabbix Server stopped. Zabbix 5.0.0 (revision 9665d62).

 

Expected:

 



 Comments   
Comment by Alexey Pustovalov [ 2020 May 13 ]

Please enable debug mode for the container and attach container log output

Comment by Undefined_ID [ 2020 May 13 ]

I attached both json and normal log outputs. Passwd is fake.

Comment by Alexey Pustovalov [ 2020 May 13 ]

I mean Zabbix server debug, not container debug. Sorry for confusing. The environment variable is ZBX_DEBUGLEVEL with 5 value.

Comment by Undefined_ID [ 2020 May 13 ]

My bad, too. Here they are, still json and normal one. Passwd changed.

Comment by Vladislavs Sokurenko [ 2020 May 13 ]

Issue is reproduced by analyzing suspicious code, see evalfunc.c:3338. Can be only reproduced when value mapping is used, the bigger value mapping, the bigger chance of crash.

char		*value = NULL

later see in evalfunc.c:3358

zbx_format_value(value, MAX_BUFFER_LEN, item.valuemapid, item.units, item.value_type);

Problem is that there is no buffer only small value allocated.

 20034:20200513:232752.172 server #31 started [alert syncer #1]
munmap_chunk(): invalid pointer
 19999:20200513:232752.441 One child process died (PID:20009,exitcode/signal:6). Exiting ...
zabbix_server [19999]: Error waiting for process with PID 20009: [10] No child processes
 19999:20200513:232752.450 syncing trend data...
 19999:20200513:232752.450 syncing trend data done
 19999:20200513:232752.450 Zabbix Server stopped. Zabbix 5.0.0 (revision {ZABBIX_REVISION})

with valgrind:

==19521== Invalid write of size 8
==19521==    at 0x4841543: memmove (vg_replace_strmem.c:1272)
==19521==    by 0x5DF164: zbx_strlcpy_utf8 (str.c:710)
==19521==    by 0x561D99: replace_value_by_map (evalfunc.c:3266)
==19521==    by 0x561EA0: zbx_format_value (evalfunc.c:3304)
==19521==    by 0x56210F: evaluate_macro_function (evalfunc.c:3358)
==19521==    by 0x5675FA: get_trigger_function_value (expression.c:2616)
==19521==    by 0x568283: substitute_simple_macros_impl (expression.c:2955)
==19521==    by 0x5735A3: substitute_simple_macros (expression.c:6374)
==19521==    by 0x470CDF: add_user_msg (escalator.c:398)
==19521==    by 0x471244: add_user_msgs (escalator.c:519)
==19521==    by 0x4714C0: add_object_msg (escalator.c:587)
==19521==    by 0x4740FE: escalation_execute_operations (escalator.c:1526)
==19521==  Address 0x67c7ad0 is 0 bytes inside a block of size 4 alloc'd
==19521==    at 0x483A809: malloc (vg_replace_malloc.c:309)
==19521==    by 0x5D852B: zbx_malloc2 (misc.c:575)
==19521==    by 0x5DE4D2: zbx_snprintf_alloc (str.c:236)
==19521==    by 0x5B5A83: zbx_history_value2str_dyn (history.c:316)
==19521==    by 0x55BDB2: evaluate_LAST (evalfunc.c:1141)
==19521==    by 0x56047A: evaluate_function (evalfunc.c:2767)
==19521==    by 0x562046: evaluate_macro_function (evalfunc.c:3348)
==19521==    by 0x5675FA: get_trigger_function_value (expression.c:2616)
==19521==    by 0x568283: substitute_simple_macros_impl (expression.c:2955)
==19521==    by 0x5735A3: substitute_simple_macros (expression.c:6374)
==19521==    by 0x470CDF: add_user_msg (escalator.c:398)
==19521==    by 0x471244: add_user_msgs (escalator.c:519)
==19521== 
==19521== Invalid write of size 8
==19521==    at 0x484154B: memmove (vg_replace_strmem.c:1272)
==19521==    by 0x5DF164: zbx_strlcpy_utf8 (str.c:710)
==19521==    by 0x561D99: replace_value_by_map (evalfunc.c:3266)
==19521==    by 0x561EA0: zbx_format_value (evalfunc.c:3304)
==19521==    by 0x56210F: evaluate_macro_function (evalfunc.c:3358)
==19521==    by 0x5675FA: get_trigger_function_value (expression.c:2616)
==19521==    by 0x568283: substitute_simple_macros_impl (expression.c:2955)
==19521==    by 0x5735A3: substitute_simple_macros (expression.c:6374)
==19521==    by 0x470CDF: add_user_msg (escalator.c:398)
==19521==    by 0x471244: add_user_msgs (escalator.c:519)
==19521==    by 0x4714C0: add_object_msg (escalator.c:587)
==19521==    by 0x4740FE: escalation_execute_operations (escalator.c:1526)
==19521==  Address 0x67c7ad8 is 4 bytes after a block of size 4 alloc'd
==19521==    at 0x483A809: malloc (vg_replace_malloc.c:309)
==19521==    by 0x5D852B: zbx_malloc2 (misc.c:575)
==19521==    by 0x5DE4D2: zbx_snprintf_alloc (str.c:236)
==19521==    by 0x5B5A83: zbx_history_value2str_dyn (history.c:316)
==19521==    by 0x55BDB2: evaluate_LAST (evalfunc.c:1141)
==19521==    by 0x56047A: evaluate_function (evalfunc.c:2767)
==19521==    by 0x562046: evaluate_macro_function (evalfunc.c:3348)
==19521==    by 0x5675FA: get_trigger_function_value (expression.c:2616)
==19521==    by 0x568283: substitute_simple_macros_impl (expression.c:2955)
==19521==    by 0x5735A3: substitute_simple_macros (expression.c:6374)
==19521==    by 0x470CDF: add_user_msg (escalator.c:398)
==19521==    by 0x471244: add_user_msgs (escalator.c:519)
==19521== 
==19521== Invalid write of size 8
==19521==    at 0x4841553: memmove (vg_replace_strmem.c:1272)
==19521==    by 0x5DF164: zbx_strlcpy_utf8 (str.c:710)
==19521==    by 0x561D99: replace_value_by_map (evalfunc.c:3266)
==19521==    by 0x561EA0: zbx_format_value (evalfunc.c:3304)
==19521==    by 0x56210F: evaluate_macro_function (evalfunc.c:3358)
==19521==    by 0x5675FA: get_trigger_function_value (expression.c:2616)
==19521==    by 0x568283: substitute_simple_macros_impl (expression.c:2955)
==19521==    by 0x5735A3: substitute_simple_macros (expression.c:6374)
==19521==    by 0x470CDF: add_user_msg (escalator.c:398)
==19521==    by 0x471244: add_user_msgs (escalator.c:519)
==19521==    by 0x4714C0: add_object_msg (escalator.c:587)
==19521==    by 0x4740FE: escalation_execute_operations (escalator.c:1526)
==19521==  Address 0x67c7ae0 is 12 bytes after a block of size 4 alloc'd
==19521==    at 0x483A809: malloc (vg_replace_malloc.c:309)
==19521==    by 0x5D852B: zbx_malloc2 (misc.c:575)
==19521==    by 0x5DE4D2: zbx_snprintf_alloc (str.c:236)
==19521==    by 0x5B5A83: zbx_history_value2str_dyn (history.c:316)
==19521==    by 0x55BDB2: evaluate_LAST (evalfunc.c:1141)
==19521==    by 0x56047A: evaluate_function (evalfunc.c:2767)
==19521==    by 0x562046: evaluate_macro_function (evalfunc.c:3348)
==19521==    by 0x5675FA: get_trigger_function_value (expression.c:2616)
==19521==    by 0x568283: substitute_simple_macros_impl (expression.c:2955)
==19521==    by 0x5735A3: substitute_simple_macros (expression.c:6374)
==19521==    by 0x470CDF: add_user_msg (escalator.c:398)
==19521==    by 0x471244: add_user_msgs (escalator.c:519)

caused by ZBXNEXT-702

Comment by Artjoms Rimdjonoks [ 2020 May 14 ]

Available in versions:

Generated at Thu Apr 17 20:57:08 EEST 2025 using Jira 9.12.4#9120004-sha1:625303b708afdb767e17cb2838290c41888e9ff0.