-
Problem report
-
Resolution: Fixed
-
Critical
-
4.0.0, 4.0.1rc1, 4.2.0alpha1
-
Sprint 45, Sprint 46, Nov 2018
-
0.25
Steps to reproduce:
- Upgrade from Zabbix 3.4.x to 4.0.0 on CentOS7 with MariaDB 10.3 (not sure if MariaDB 10.3 specifically is playing a part in the problem here or not).
Result:
This is with debug level set to 4.
Since the problem appeared to be with DCsync_hostgroup_hosts() I grabbed the sources, commented out the call to this, and zabbix_server starts successfully (albeit complaining that something impossible happened). I notice this function didn't exist in 3.4 at all.
It happens with 4.0 as well as 4.0.1rc1.
21292:20181023:153225.860 Starting Zabbix Server. Zabbix 4.0.0 (revision 85308). 21292:20181023:153225.860 ****** Enabled features ****** 21292:20181023:153225.860 SNMP monitoring: YES 21292:20181023:153225.860 IPMI monitoring: YES 21292:20181023:153225.860 Web monitoring: YES 21292:20181023:153225.860 VMware monitoring: YES 21292:20181023:153225.860 SMTP authentication: YES 21292:20181023:153225.860 Jabber notifications: YES 21292:20181023:153225.860 Ez Texting notifications: YES 21292:20181023:153225.860 ODBC: YES 21292:20181023:153225.860 SSH2 support: YES 21292:20181023:153225.860 IPv6 support: YES 21292:20181023:153225.860 TLS support: YES 21292:20181023:153225.860 ****************************** 21292:20181023:153225.860 using configuration file: /etc/zabbix/zabbix_server.conf 21292:20181023:153225.860 In zbx_load_modules() 21292:20181023:153225.860 End of zbx_load_modules():SUCCEED 21292:20181023:153225.860 In init_database_cache() 21292:20181023:153225.860 In zbx_mem_create() param:'HistoryCacheSize' size:134217728 21292:20181023:153225.860 valid user addresses: [0x7f4517b52168, 0x7f451fb51ff0] total size: 134217352 21292:20181023:153225.860 End of zbx_mem_create() 21292:20181023:153225.860 In zbx_mem_create() param:'HistoryIndexCacheSize' size:33554432 21292:20181023:153225.860 valid user addresses: [0x7f4515b52178, 0x7f4517b51ff0] total size: 33554040 21292:20181023:153225.860 End of zbx_mem_create() 21292:20181023:153225.860 In init_trend_cache() 21292:20181023:153225.860 In zbx_mem_required_size() size:0 chunks_num:1 descr:'trend cache' param:'TrendCacheSize' 21292:20181023:153225.861 End of zbx_mem_required_size() size:414 21292:20181023:153225.861 In zbx_mem_create() param:'TrendCacheSize' size:134217728 21292:20181023:153225.861 valid user addresses: [0x7f450db52168, 0x7f4515b51ff0] total size: 134217352 21292:20181023:153225.861 End of zbx_mem_create() 21292:20181023:153225.861 End of init_trend_cache() 21292:20181023:153225.861 End of init_database_cache() 21292:20181023:153225.861 In init_configuration_cache() size:536870912 21292:20181023:153225.861 In zbx_mem_create() param:'CacheSize' size:536870912 21292:20181023:153225.861 valid user addresses: [0x7f44edb52168, 0x7f450db51ff0] total size: 536870536 21292:20181023:153225.861 End of zbx_mem_create() 21292:20181023:153225.861 End of init_configuration_cache() 21292:20181023:153225.861 In init_selfmon_collector() 21292:20181023:153225.861 init_selfmon_collector() size:66528 21292:20181023:153225.861 End of init_selfmon_collector() collector:0x7f45285de000 21292:20181023:153225.861 In zbx_vc_init() 21292:20181023:153225.861 In zbx_mem_required_size() size:0 chunks_num:1 descr:'value cache size' param:'ValueCacheSize' 21292:20181023:153225.861 End of zbx_mem_required_size() size:419 21292:20181023:153225.861 In zbx_mem_create() param:'ValueCacheSize' size:134217728 21292:20181023:153225.861 valid user addresses: [0x7f44e5b52168, 0x7f44edb51ff0] total size: 134217352 21292:20181023:153225.861 End of zbx_mem_create() 21292:20181023:153225.861 End of zbx_vc_init() 21292:20181023:153225.861 In zbx_db_get_database_type() 21292:20181023:153225.862 In DBconnect() flag:0 21292:20181023:153225.864 End of DBconnect():0 21292:20181023:153225.864 query [txnlev:0] [select userid from users limit 1] 21292:20181023:153225.865 there is at least 1 record in "users" table 21292:20181023:153225.865 End of zbx_db_get_database_type():ZBX_DB_SERVER 21292:20181023:153225.865 In DBcheck_version() 21292:20181023:153225.865 In DBconnect() flag:0 21292:20181023:153225.865 End of DBconnect():0 21292:20181023:153225.865 query [txnlev:0] [show tables like 'dbversion'] 21292:20181023:153225.865 query [txnlev:0] [select mandatory,optional from dbversion] 21292:20181023:153225.866 current database version (mandatory/optional): 04000000/04000000 21292:20181023:153225.866 required mandatory version: 04000000 21292:20181023:153225.866 End of DBcheck_version():SUCCEED 21292:20181023:153225.866 In DBconnect() flag:0 21292:20181023:153225.866 End of DBconnect():0 21292:20181023:153225.866 In DCsync_configuration() 21292:20181023:153225.866 query [txnlev:0] [select refresh_unsupported,discovery_groupid,snmptrap_logging,severity_name_0,severity_name_1,severity_name_2,severity_name_3,severity_name_4,severity_name_5,hk_events_mode,hk_events_trigger,hk_events_internal,hk_events_discovery,hk_events_autoreg,hk_services_mode,hk_services,hk_audit_mode,hk_audit,hk_sessions_mode,hk_sessions,hk_history_mode,hk_history_global,hk_history,hk_trends_mode,hk_trends_global,hk_trends,default_inventory_mode from config order by configid] 21292:20181023:153225.866 In DCsync_config() 21292:20181023:153225.866 End of DCsync_config() 21292:20181023:153225.866 query [txnlev:0] [select hostid,templateid from hosts_templates order by hostid] 21292:20181023:153225.874 query [txnlev:0] [select globalmacroid,macro,value from globalmacro] 21292:20181023:153225.874 query [txnlev:0] [select hostmacroid,hostid,macro,value from hostmacro] 21292:20181023:153225.893 In DCsync_htmpls() 21292:20181023:153225.904 End of DCsync_htmpls() 21292:20181023:153225.904 In DCsync_gmacros() 21292:20181023:153225.905 End of DCsync_gmacros() 21292:20181023:153225.905 In DCsync_hmacros() 21292:20181023:153225.953 End of DCsync_hmacros() 21292:20181023:153225.953 query [txnlev:0] [select hostid,proxy_hostid,host,ipmi_authtype,ipmi_privilege,ipmi_username,ipmi_password,maintenance_status,maintenance_type,maintenance_from,errors_from,available,disable_until,snmp_errors_from,snmp_available,snmp_disable_until,ipmi_errors_from,ipmi_available,ipmi_disable_until,jmx_errors_from,jmx_available,jmx_disable_until,status,name,lastaccess,error,snmp_error,ipmi_error,jmx_error,tls_connect,tls_accept,tls_issuer,tls_subject,tls_psk_identity,tls_psk,proxy_address,auto_compress,maintenanceid from hosts where status in (0,1,5,6) and flags<>2] 21292:20181023:153226.014 query [txnlev:0] [select hostid,inventory_mode,type,type_full,name,alias,os,os_full,os_short,serialno_a,serialno_b,tag,asset_tag,macaddress_a,macaddress_b,hardware,hardware_full,software,software_full,software_app_a,software_app_b,software_app_c,software_app_d,software_app_e,contact,location,location_lat,location_lon,notes,chassis,model,hw_arch,vendor,contract_number,installer_name,deployment_status,url_a,url_b,url_c,host_networks,host_netmask,host_router,oob_ip,oob_netmask,oob_router,date_hw_purchase,date_hw_install,date_hw_expiry,date_hw_decomm,site_address_a,site_address_b,site_address_c,site_city,site_state,site_country,site_zip,site_rack,site_notes,poc_1_name,poc_1_email,poc_1_phone_a,poc_1_phone_b,poc_1_cell,poc_1_screen,poc_1_notes,poc_2_name,poc_2_email,poc_2_phone_a,poc_2_phone_b,poc_2_cell,poc_2_screen,poc_2_notes from host_inventory] 21292:20181023:153226.111 query [txnlev:0] [select groupid,name from hstgrp] 21292:20181023:153226.112 query [txnlev:0] [select hg.groupid,hg.hostid from hosts_groups hg,hosts h where hg.hostid=h.hostid and h.status in (0,1) and h.flags<>2] 21292:20181023:153226.144 query [txnlev:0] [select maintenanceid,maintenance_type,active_since,active_till,tags_evaltype from maintenances] 21292:20181023:153226.144 query [txnlev:0] [select maintenancetagid,maintenanceid,operator,tag,value from maintenance_tag] 21292:20181023:153226.144 query [txnlev:0] [select t.timeperiodid,t.timeperiod_type,t.every,t.month,t.dayofweek,t.day,t.start_time,t.period,t.start_date,m.maintenanceid from maintenances_windows m,timeperiods t where t.timeperiodid=m.timeperiodid] 21292:20181023:153226.144 query [txnlev:0] [select maintenanceid,groupid from maintenances_groups order by maintenanceid] 21292:20181023:153226.144 query [txnlev:0] [select maintenanceid,hostid from maintenances_hosts order by maintenanceid] 21292:20181023:153226.144 In DCsync_hosts() 21292:20181023:153226.177 End of DCsync_hosts() 21292:20181023:153226.177 In DCsync_host_inventory() 21292:20181023:153226.253 End of DCsync_host_inventory() 21292:20181023:153226.253 In DCsync_hostgroups() 21292:20181023:153226.254 End of DCsync_hostgroups() 21292:20181023:153226.254 In DCsync_hostgroup_hosts() 21292:20181023:153226.254 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x40]. Crashing ... 21292:20181023:153226.254 ====== Fatal information: ====== 21292:20181023:153226.254 Program counter: 0x55704fb2b4e6 21292:20181023:153226.254 === Registers: === 21292:20181023:153226.254 r8 = 0 = 0 = 0 21292:20181023:153226.254 r9 = 7f45249fff00 = 139934943936256 = 139934943936256 21292:20181023:153226.254 r10 = 8 = 8 = 8 21292:20181023:153226.254 r11 = 7f4524a3ed20 = 139934944193824 = 139934944193824 21292:20181023:153226.254 r12 = 55704fa6c400 = 93940861027328 = 93940861027328 21292:20181023:153226.254 r13 = 7ffc8103a8e0 = 140722472986848 = 140722472986848 21292:20181023:153226.254 r14 = 0 = 0 = 0 21292:20181023:153226.254 r15 = 0 = 0 = 0 21292:20181023:153226.254 rdi = 38 = 56 = 56 21292:20181023:153226.254 rsi = 7ffc810387f8 = 140722472978424 = 140722472978424 21292:20181023:153226.254 rbp = 7ffc810387a0 = 140722472978336 = 140722472978336 21292:20181023:153226.254 rbx = 0 = 0 = 0 21292:20181023:153226.254 rdx = 8 = 8 = 8 21292:20181023:153226.254 rax = 38 = 56 = 56 21292:20181023:153226.254 rcx = 0 = 0 = 0 21292:20181023:153226.254 rsp = 7ffc81038740 = 140722472978240 = 140722472978240 21292:20181023:153226.254 rip = 55704fb2b4e6 = 93940861809894 = 93940861809894 21292:20181023:153226.254 efl = 10202 = 66050 = 66050 21292:20181023:153226.254 csgsfs = 33 = 51 = 51 21292:20181023:153226.254 err = 4 = 4 = 4 21292:20181023:153226.254 trapno = e = 14 = 14 21292:20181023:153226.254 oldmask = 0 = 0 = 0 21292:20181023:153226.254 cr2 = 40 = 64 = 64 21292:20181023:153226.254 === Backtrace: === 21292:20181023:153226.254 11: /usr/sbin/zabbix_server(zbx_log_fatal_info+0x142) [0x55704fb26706] 21292:20181023:153226.254 10: /usr/sbin/zabbix_server(+0xf1b19) [0x55704fb26b19] 21292:20181023:153226.255 9: /lib64/libpthread.so.0(+0xf6d0) [0x7f4527c446d0] 21292:20181023:153226.255 8: /usr/sbin/zabbix_server(zbx_hashset_insert_ext+0x1c) [0x55704fb2b4e6] 21292:20181023:153226.255 7: /usr/sbin/zabbix_server(zbx_hashset_insert+0x2d) [0x55704fb2b4c8] 21292:20181023:153226.255 6: /usr/sbin/zabbix_server(+0xc4ee0) [0x55704faf9ee0] 21292:20181023:153226.255 5: /usr/sbin/zabbix_server(DCsync_configuration+0x7cb) [0x55704fafad9a] 21292:20181023:153226.255 4: /usr/sbin/zabbix_server(MAIN_ZABBIX_ENTRY+0x6ab) [0x55704fa6d8ec] 21292:20181023:153226.255 3: /usr/sbin/zabbix_server(daemon_start+0x31b) [0x55704fb25e4a] 21292:20181023:153226.255 2: /usr/sbin/zabbix_server(main+0x312) [0x55704fa6d23f] 21292:20181023:153226.255 1: /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f45248d4445] 21292:20181023:153226.255 0: /usr/sbin/zabbix_server(+0x37429) [0x55704fa6c429] 21292:20181023:153226.255 === Memory map: === < snip - see attachment > 21292:20181023:153226.260 ================================ 21292:20181023:153226.260 Please consider attaching a disassembly listing to your bug report. 21292:20181023:153226.260 This listing can be produced with, e.g., objdump -DSswx zabbix_server.
