Uploaded image for project: 'ZABBIX BUGS AND ISSUES'
  1. ZABBIX BUGS AND ISSUES
  2. ZBX-15057

zabbix_server Segfault on CentOS 7.5 (upgrade from 3.4 via RPMs)

    Details

    • Team:
      Team A
    • Sprint:
      Sprint 45, Sprint 46, Nov 2018
    • Story Points:
      0.25

      Description

      Steps to reproduce:

      1. Upgrade from Zabbix 3.4.x to 4.0.0 on CentOS7 with MariaDB 10.3 (not sure if MariaDB 10.3 specifically is playing a part in the problem here or not).

      Result:

      This is with debug level set to 4.

      Since the problem appeared to be with DCsync_hostgroup_hosts() I grabbed the sources, commented out the call to this, and zabbix_server starts successfully (albeit complaining that something impossible happened). I notice this function didn't exist in 3.4 at all.

      It happens with 4.0 as well as 4.0.1rc1.

       21292:20181023:153225.860 Starting Zabbix Server. Zabbix 4.0.0 (revision 85308).
       21292:20181023:153225.860 ****** Enabled features ******
       21292:20181023:153225.860 SNMP monitoring:           YES
       21292:20181023:153225.860 IPMI monitoring:           YES
       21292:20181023:153225.860 Web monitoring:            YES
       21292:20181023:153225.860 VMware monitoring:         YES
       21292:20181023:153225.860 SMTP authentication:       YES
       21292:20181023:153225.860 Jabber notifications:      YES
       21292:20181023:153225.860 Ez Texting notifications:  YES
       21292:20181023:153225.860 ODBC:                      YES
       21292:20181023:153225.860 SSH2 support:              YES
       21292:20181023:153225.860 IPv6 support:              YES
       21292:20181023:153225.860 TLS support:               YES
       21292:20181023:153225.860 ******************************
       21292:20181023:153225.860 using configuration file: /etc/zabbix/zabbix_server.conf
       21292:20181023:153225.860 In zbx_load_modules()
       21292:20181023:153225.860 End of zbx_load_modules():SUCCEED
       21292:20181023:153225.860 In init_database_cache()
       21292:20181023:153225.860 In zbx_mem_create() param:'HistoryCacheSize' size:134217728
       21292:20181023:153225.860 valid user addresses: [0x7f4517b52168, 0x7f451fb51ff0] total size: 134217352
       21292:20181023:153225.860 End of zbx_mem_create()
       21292:20181023:153225.860 In zbx_mem_create() param:'HistoryIndexCacheSize' size:33554432
       21292:20181023:153225.860 valid user addresses: [0x7f4515b52178, 0x7f4517b51ff0] total size: 33554040
       21292:20181023:153225.860 End of zbx_mem_create()
       21292:20181023:153225.860 In init_trend_cache()
       21292:20181023:153225.860 In zbx_mem_required_size() size:0 chunks_num:1 descr:'trend cache' param:'TrendCacheSize'
       21292:20181023:153225.861 End of zbx_mem_required_size() size:414
       21292:20181023:153225.861 In zbx_mem_create() param:'TrendCacheSize' size:134217728
       21292:20181023:153225.861 valid user addresses: [0x7f450db52168, 0x7f4515b51ff0] total size: 134217352
       21292:20181023:153225.861 End of zbx_mem_create()
       21292:20181023:153225.861 End of init_trend_cache()
       21292:20181023:153225.861 End of init_database_cache()
       21292:20181023:153225.861 In init_configuration_cache() size:536870912
       21292:20181023:153225.861 In zbx_mem_create() param:'CacheSize' size:536870912
       21292:20181023:153225.861 valid user addresses: [0x7f44edb52168, 0x7f450db51ff0] total size: 536870536
       21292:20181023:153225.861 End of zbx_mem_create()
       21292:20181023:153225.861 End of init_configuration_cache()
       21292:20181023:153225.861 In init_selfmon_collector()
       21292:20181023:153225.861 init_selfmon_collector() size:66528
       21292:20181023:153225.861 End of init_selfmon_collector() collector:0x7f45285de000
       21292:20181023:153225.861 In zbx_vc_init()
       21292:20181023:153225.861 In zbx_mem_required_size() size:0 chunks_num:1 descr:'value cache size' param:'ValueCacheSize'
       21292:20181023:153225.861 End of zbx_mem_required_size() size:419
       21292:20181023:153225.861 In zbx_mem_create() param:'ValueCacheSize' size:134217728
       21292:20181023:153225.861 valid user addresses: [0x7f44e5b52168, 0x7f44edb51ff0] total size: 134217352
       21292:20181023:153225.861 End of zbx_mem_create()
       21292:20181023:153225.861 End of zbx_vc_init()
       21292:20181023:153225.861 In zbx_db_get_database_type()
       21292:20181023:153225.862 In DBconnect() flag:0
       21292:20181023:153225.864 End of DBconnect():0
       21292:20181023:153225.864 query [txnlev:0] [select userid from users limit 1]
       21292:20181023:153225.865 there is at least 1 record in "users" table
       21292:20181023:153225.865 End of zbx_db_get_database_type():ZBX_DB_SERVER
       21292:20181023:153225.865 In DBcheck_version()
       21292:20181023:153225.865 In DBconnect() flag:0
       21292:20181023:153225.865 End of DBconnect():0
       21292:20181023:153225.865 query [txnlev:0] [show tables like 'dbversion']
       21292:20181023:153225.865 query [txnlev:0] [select mandatory,optional from dbversion]
       21292:20181023:153225.866 current database version (mandatory/optional): 04000000/04000000
       21292:20181023:153225.866 required mandatory version: 04000000
       21292:20181023:153225.866 End of DBcheck_version():SUCCEED
       21292:20181023:153225.866 In DBconnect() flag:0
       21292:20181023:153225.866 End of DBconnect():0
       21292:20181023:153225.866 In DCsync_configuration()
       21292:20181023:153225.866 query [txnlev:0] [select refresh_unsupported,discovery_groupid,snmptrap_logging,severity_name_0,severity_name_1,severity_name_2,severity_name_3,severity_name_4,severity_name_5,hk_events_mode,hk_events_trigger,hk_events_internal,hk_events_discovery,hk_events_autoreg,hk_services_mode,hk_services,hk_audit_mode,hk_audit,hk_sessions_mode,hk_sessions,hk_history_mode,hk_history_global,hk_history,hk_trends_mode,hk_trends_global,hk_trends,default_inventory_mode from config order by configid]
       21292:20181023:153225.866 In DCsync_config()
       21292:20181023:153225.866 End of DCsync_config()
       21292:20181023:153225.866 query [txnlev:0] [select hostid,templateid from hosts_templates order by hostid]
       21292:20181023:153225.874 query [txnlev:0] [select globalmacroid,macro,value from globalmacro]
       21292:20181023:153225.874 query [txnlev:0] [select hostmacroid,hostid,macro,value from hostmacro]
       21292:20181023:153225.893 In DCsync_htmpls()
       21292:20181023:153225.904 End of DCsync_htmpls()
       21292:20181023:153225.904 In DCsync_gmacros()
       21292:20181023:153225.905 End of DCsync_gmacros()
       21292:20181023:153225.905 In DCsync_hmacros()
       21292:20181023:153225.953 End of DCsync_hmacros()
       21292:20181023:153225.953 query [txnlev:0] [select hostid,proxy_hostid,host,ipmi_authtype,ipmi_privilege,ipmi_username,ipmi_password,maintenance_status,maintenance_type,maintenance_from,errors_from,available,disable_until,snmp_errors_from,snmp_available,snmp_disable_until,ipmi_errors_from,ipmi_available,ipmi_disable_until,jmx_errors_from,jmx_available,jmx_disable_until,status,name,lastaccess,error,snmp_error,ipmi_error,jmx_error,tls_connect,tls_accept,tls_issuer,tls_subject,tls_psk_identity,tls_psk,proxy_address,auto_compress,maintenanceid from hosts where status in (0,1,5,6) and flags<>2]
       21292:20181023:153226.014 query [txnlev:0] [select hostid,inventory_mode,type,type_full,name,alias,os,os_full,os_short,serialno_a,serialno_b,tag,asset_tag,macaddress_a,macaddress_b,hardware,hardware_full,software,software_full,software_app_a,software_app_b,software_app_c,software_app_d,software_app_e,contact,location,location_lat,location_lon,notes,chassis,model,hw_arch,vendor,contract_number,installer_name,deployment_status,url_a,url_b,url_c,host_networks,host_netmask,host_router,oob_ip,oob_netmask,oob_router,date_hw_purchase,date_hw_install,date_hw_expiry,date_hw_decomm,site_address_a,site_address_b,site_address_c,site_city,site_state,site_country,site_zip,site_rack,site_notes,poc_1_name,poc_1_email,poc_1_phone_a,poc_1_phone_b,poc_1_cell,poc_1_screen,poc_1_notes,poc_2_name,poc_2_email,poc_2_phone_a,poc_2_phone_b,poc_2_cell,poc_2_screen,poc_2_notes from host_inventory]
       21292:20181023:153226.111 query [txnlev:0] [select groupid,name from hstgrp]
       21292:20181023:153226.112 query [txnlev:0] [select hg.groupid,hg.hostid from hosts_groups hg,hosts h where hg.hostid=h.hostid and h.status in (0,1) and h.flags<>2]
       21292:20181023:153226.144 query [txnlev:0] [select maintenanceid,maintenance_type,active_since,active_till,tags_evaltype from maintenances]
       21292:20181023:153226.144 query [txnlev:0] [select maintenancetagid,maintenanceid,operator,tag,value from maintenance_tag]
       21292:20181023:153226.144 query [txnlev:0] [select t.timeperiodid,t.timeperiod_type,t.every,t.month,t.dayofweek,t.day,t.start_time,t.period,t.start_date,m.maintenanceid from maintenances_windows m,timeperiods t where t.timeperiodid=m.timeperiodid]
       21292:20181023:153226.144 query [txnlev:0] [select maintenanceid,groupid from maintenances_groups order by maintenanceid]
       21292:20181023:153226.144 query [txnlev:0] [select maintenanceid,hostid from maintenances_hosts order by maintenanceid]
       21292:20181023:153226.144 In DCsync_hosts()
       21292:20181023:153226.177 End of DCsync_hosts()
       21292:20181023:153226.177 In DCsync_host_inventory()
       21292:20181023:153226.253 End of DCsync_host_inventory()
       21292:20181023:153226.253 In DCsync_hostgroups()
       21292:20181023:153226.254 End of DCsync_hostgroups()
       21292:20181023:153226.254 In DCsync_hostgroup_hosts()
       21292:20181023:153226.254 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x40]. Crashing ...
       21292:20181023:153226.254 ====== Fatal information: ======
       21292:20181023:153226.254 Program counter: 0x55704fb2b4e6
       21292:20181023:153226.254 === Registers: ===
       21292:20181023:153226.254 r8      =                0 =                    0 =                    0
       21292:20181023:153226.254 r9      =     7f45249fff00 =      139934943936256 =      139934943936256
       21292:20181023:153226.254 r10     =                8 =                    8 =                    8
       21292:20181023:153226.254 r11     =     7f4524a3ed20 =      139934944193824 =      139934944193824
       21292:20181023:153226.254 r12     =     55704fa6c400 =       93940861027328 =       93940861027328
       21292:20181023:153226.254 r13     =     7ffc8103a8e0 =      140722472986848 =      140722472986848
       21292:20181023:153226.254 r14     =                0 =                    0 =                    0
       21292:20181023:153226.254 r15     =                0 =                    0 =                    0
       21292:20181023:153226.254 rdi     =               38 =                   56 =                   56
       21292:20181023:153226.254 rsi     =     7ffc810387f8 =      140722472978424 =      140722472978424
       21292:20181023:153226.254 rbp     =     7ffc810387a0 =      140722472978336 =      140722472978336
       21292:20181023:153226.254 rbx     =                0 =                    0 =                    0
       21292:20181023:153226.254 rdx     =                8 =                    8 =                    8
       21292:20181023:153226.254 rax     =               38 =                   56 =                   56
       21292:20181023:153226.254 rcx     =                0 =                    0 =                    0
       21292:20181023:153226.254 rsp     =     7ffc81038740 =      140722472978240 =      140722472978240
       21292:20181023:153226.254 rip     =     55704fb2b4e6 =       93940861809894 =       93940861809894
       21292:20181023:153226.254 efl     =            10202 =                66050 =                66050
       21292:20181023:153226.254 csgsfs  =               33 =                   51 =                   51
       21292:20181023:153226.254 err     =                4 =                    4 =                    4
       21292:20181023:153226.254 trapno  =                e =                   14 =                   14
       21292:20181023:153226.254 oldmask =                0 =                    0 =                    0
       21292:20181023:153226.254 cr2     =               40 =                   64 =                   64
       21292:20181023:153226.254 === Backtrace: ===
       21292:20181023:153226.254 11: /usr/sbin/zabbix_server(zbx_log_fatal_info+0x142) [0x55704fb26706]
       21292:20181023:153226.254 10: /usr/sbin/zabbix_server(+0xf1b19) [0x55704fb26b19]
       21292:20181023:153226.255 9: /lib64/libpthread.so.0(+0xf6d0) [0x7f4527c446d0]
       21292:20181023:153226.255 8: /usr/sbin/zabbix_server(zbx_hashset_insert_ext+0x1c) [0x55704fb2b4e6]
       21292:20181023:153226.255 7: /usr/sbin/zabbix_server(zbx_hashset_insert+0x2d) [0x55704fb2b4c8]
       21292:20181023:153226.255 6: /usr/sbin/zabbix_server(+0xc4ee0) [0x55704faf9ee0]
       21292:20181023:153226.255 5: /usr/sbin/zabbix_server(DCsync_configuration+0x7cb) [0x55704fafad9a]
       21292:20181023:153226.255 4: /usr/sbin/zabbix_server(MAIN_ZABBIX_ENTRY+0x6ab) [0x55704fa6d8ec]
       21292:20181023:153226.255 3: /usr/sbin/zabbix_server(daemon_start+0x31b) [0x55704fb25e4a]
       21292:20181023:153226.255 2: /usr/sbin/zabbix_server(main+0x312) [0x55704fa6d23f]
       21292:20181023:153226.255 1: /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f45248d4445]
       21292:20181023:153226.255 0: /usr/sbin/zabbix_server(+0x37429) [0x55704fa6c429]
       21292:20181023:153226.255 === Memory map: ===
      
      < snip - see attachment >
      
       21292:20181023:153226.260 ================================
       21292:20181023:153226.260 Please consider attaching a disassembly listing to your bug report.
       21292:20181023:153226.260 This listing can be produced with, e.g., objdump -DSswx zabbix_server.
      

        Attachments

          Activity

            People

            • Assignee:
              wiper Andris Zeila
              Reporter:
              jonathanspw Jonathan W
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: