[ZBX-15057] zabbix_server Segfault on CentOS 7.5 (upgrade from 3.4 via RPMs) Created: 2018 Oct 24  Updated: 2018 Nov 06  Resolved: 2018 Oct 31

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Server (S)
Affects Version/s: 4.0.0, 4.0.1rc1, 4.2.0alpha1
Fix Version/s: 4.0.1rc2, 4.2.0alpha1, 4.2 (plan)

Type: Problem report Priority: Critical
Reporter: Jonathan W Assignee: Andris Zeila
Resolution: Fixed Votes: 0
Labels: crash, groups, segfault
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: HTML File zabbix-log    
Team: Team A
Sprint: Sprint 45, Sprint 46, Nov 2018
Story Points: 0.25

 Description   

Steps to reproduce:

  1. Upgrade from Zabbix 3.4.x to 4.0.0 on CentOS7 with MariaDB 10.3 (not sure if MariaDB 10.3 specifically is playing a part in the problem here or not).

Result:

This is with debug level set to 4.

Since the problem appeared to be with DCsync_hostgroup_hosts() I grabbed the sources, commented out the call to this, and zabbix_server starts successfully (albeit complaining that something impossible happened). I notice this function didn't exist in 3.4 at all.

It happens with 4.0 as well as 4.0.1rc1.

 21292:20181023:153225.860 Starting Zabbix Server. Zabbix 4.0.0 (revision 85308).
 21292:20181023:153225.860 ****** Enabled features ******
 21292:20181023:153225.860 SNMP monitoring:           YES
 21292:20181023:153225.860 IPMI monitoring:           YES
 21292:20181023:153225.860 Web monitoring:            YES
 21292:20181023:153225.860 VMware monitoring:         YES
 21292:20181023:153225.860 SMTP authentication:       YES
 21292:20181023:153225.860 Jabber notifications:      YES
 21292:20181023:153225.860 Ez Texting notifications:  YES
 21292:20181023:153225.860 ODBC:                      YES
 21292:20181023:153225.860 SSH2 support:              YES
 21292:20181023:153225.860 IPv6 support:              YES
 21292:20181023:153225.860 TLS support:               YES
 21292:20181023:153225.860 ******************************
 21292:20181023:153225.860 using configuration file: /etc/zabbix/zabbix_server.conf
 21292:20181023:153225.860 In zbx_load_modules()
 21292:20181023:153225.860 End of zbx_load_modules():SUCCEED
 21292:20181023:153225.860 In init_database_cache()
 21292:20181023:153225.860 In zbx_mem_create() param:'HistoryCacheSize' size:134217728
 21292:20181023:153225.860 valid user addresses: [0x7f4517b52168, 0x7f451fb51ff0] total size: 134217352
 21292:20181023:153225.860 End of zbx_mem_create()
 21292:20181023:153225.860 In zbx_mem_create() param:'HistoryIndexCacheSize' size:33554432
 21292:20181023:153225.860 valid user addresses: [0x7f4515b52178, 0x7f4517b51ff0] total size: 33554040
 21292:20181023:153225.860 End of zbx_mem_create()
 21292:20181023:153225.860 In init_trend_cache()
 21292:20181023:153225.860 In zbx_mem_required_size() size:0 chunks_num:1 descr:'trend cache' param:'TrendCacheSize'
 21292:20181023:153225.861 End of zbx_mem_required_size() size:414
 21292:20181023:153225.861 In zbx_mem_create() param:'TrendCacheSize' size:134217728
 21292:20181023:153225.861 valid user addresses: [0x7f450db52168, 0x7f4515b51ff0] total size: 134217352
 21292:20181023:153225.861 End of zbx_mem_create()
 21292:20181023:153225.861 End of init_trend_cache()
 21292:20181023:153225.861 End of init_database_cache()
 21292:20181023:153225.861 In init_configuration_cache() size:536870912
 21292:20181023:153225.861 In zbx_mem_create() param:'CacheSize' size:536870912
 21292:20181023:153225.861 valid user addresses: [0x7f44edb52168, 0x7f450db51ff0] total size: 536870536
 21292:20181023:153225.861 End of zbx_mem_create()
 21292:20181023:153225.861 End of init_configuration_cache()
 21292:20181023:153225.861 In init_selfmon_collector()
 21292:20181023:153225.861 init_selfmon_collector() size:66528
 21292:20181023:153225.861 End of init_selfmon_collector() collector:0x7f45285de000
 21292:20181023:153225.861 In zbx_vc_init()
 21292:20181023:153225.861 In zbx_mem_required_size() size:0 chunks_num:1 descr:'value cache size' param:'ValueCacheSize'
 21292:20181023:153225.861 End of zbx_mem_required_size() size:419
 21292:20181023:153225.861 In zbx_mem_create() param:'ValueCacheSize' size:134217728
 21292:20181023:153225.861 valid user addresses: [0x7f44e5b52168, 0x7f44edb51ff0] total size: 134217352
 21292:20181023:153225.861 End of zbx_mem_create()
 21292:20181023:153225.861 End of zbx_vc_init()
 21292:20181023:153225.861 In zbx_db_get_database_type()
 21292:20181023:153225.862 In DBconnect() flag:0
 21292:20181023:153225.864 End of DBconnect():0
 21292:20181023:153225.864 query [txnlev:0] [select userid from users limit 1]
 21292:20181023:153225.865 there is at least 1 record in "users" table
 21292:20181023:153225.865 End of zbx_db_get_database_type():ZBX_DB_SERVER
 21292:20181023:153225.865 In DBcheck_version()
 21292:20181023:153225.865 In DBconnect() flag:0
 21292:20181023:153225.865 End of DBconnect():0
 21292:20181023:153225.865 query [txnlev:0] [show tables like 'dbversion']
 21292:20181023:153225.865 query [txnlev:0] [select mandatory,optional from dbversion]
 21292:20181023:153225.866 current database version (mandatory/optional): 04000000/04000000
 21292:20181023:153225.866 required mandatory version: 04000000
 21292:20181023:153225.866 End of DBcheck_version():SUCCEED
 21292:20181023:153225.866 In DBconnect() flag:0
 21292:20181023:153225.866 End of DBconnect():0
 21292:20181023:153225.866 In DCsync_configuration()
 21292:20181023:153225.866 query [txnlev:0] [select refresh_unsupported,discovery_groupid,snmptrap_logging,severity_name_0,severity_name_1,severity_name_2,severity_name_3,severity_name_4,severity_name_5,hk_events_mode,hk_events_trigger,hk_events_internal,hk_events_discovery,hk_events_autoreg,hk_services_mode,hk_services,hk_audit_mode,hk_audit,hk_sessions_mode,hk_sessions,hk_history_mode,hk_history_global,hk_history,hk_trends_mode,hk_trends_global,hk_trends,default_inventory_mode from config order by configid]
 21292:20181023:153225.866 In DCsync_config()
 21292:20181023:153225.866 End of DCsync_config()
 21292:20181023:153225.866 query [txnlev:0] [select hostid,templateid from hosts_templates order by hostid]
 21292:20181023:153225.874 query [txnlev:0] [select globalmacroid,macro,value from globalmacro]
 21292:20181023:153225.874 query [txnlev:0] [select hostmacroid,hostid,macro,value from hostmacro]
 21292:20181023:153225.893 In DCsync_htmpls()
 21292:20181023:153225.904 End of DCsync_htmpls()
 21292:20181023:153225.904 In DCsync_gmacros()
 21292:20181023:153225.905 End of DCsync_gmacros()
 21292:20181023:153225.905 In DCsync_hmacros()
 21292:20181023:153225.953 End of DCsync_hmacros()
 21292:20181023:153225.953 query [txnlev:0] [select hostid,proxy_hostid,host,ipmi_authtype,ipmi_privilege,ipmi_username,ipmi_password,maintenance_status,maintenance_type,maintenance_from,errors_from,available,disable_until,snmp_errors_from,snmp_available,snmp_disable_until,ipmi_errors_from,ipmi_available,ipmi_disable_until,jmx_errors_from,jmx_available,jmx_disable_until,status,name,lastaccess,error,snmp_error,ipmi_error,jmx_error,tls_connect,tls_accept,tls_issuer,tls_subject,tls_psk_identity,tls_psk,proxy_address,auto_compress,maintenanceid from hosts where status in (0,1,5,6) and flags<>2]
 21292:20181023:153226.014 query [txnlev:0] [select hostid,inventory_mode,type,type_full,name,alias,os,os_full,os_short,serialno_a,serialno_b,tag,asset_tag,macaddress_a,macaddress_b,hardware,hardware_full,software,software_full,software_app_a,software_app_b,software_app_c,software_app_d,software_app_e,contact,location,location_lat,location_lon,notes,chassis,model,hw_arch,vendor,contract_number,installer_name,deployment_status,url_a,url_b,url_c,host_networks,host_netmask,host_router,oob_ip,oob_netmask,oob_router,date_hw_purchase,date_hw_install,date_hw_expiry,date_hw_decomm,site_address_a,site_address_b,site_address_c,site_city,site_state,site_country,site_zip,site_rack,site_notes,poc_1_name,poc_1_email,poc_1_phone_a,poc_1_phone_b,poc_1_cell,poc_1_screen,poc_1_notes,poc_2_name,poc_2_email,poc_2_phone_a,poc_2_phone_b,poc_2_cell,poc_2_screen,poc_2_notes from host_inventory]
 21292:20181023:153226.111 query [txnlev:0] [select groupid,name from hstgrp]
 21292:20181023:153226.112 query [txnlev:0] [select hg.groupid,hg.hostid from hosts_groups hg,hosts h where hg.hostid=h.hostid and h.status in (0,1) and h.flags<>2]
 21292:20181023:153226.144 query [txnlev:0] [select maintenanceid,maintenance_type,active_since,active_till,tags_evaltype from maintenances]
 21292:20181023:153226.144 query [txnlev:0] [select maintenancetagid,maintenanceid,operator,tag,value from maintenance_tag]
 21292:20181023:153226.144 query [txnlev:0] [select t.timeperiodid,t.timeperiod_type,t.every,t.month,t.dayofweek,t.day,t.start_time,t.period,t.start_date,m.maintenanceid from maintenances_windows m,timeperiods t where t.timeperiodid=m.timeperiodid]
 21292:20181023:153226.144 query [txnlev:0] [select maintenanceid,groupid from maintenances_groups order by maintenanceid]
 21292:20181023:153226.144 query [txnlev:0] [select maintenanceid,hostid from maintenances_hosts order by maintenanceid]
 21292:20181023:153226.144 In DCsync_hosts()
 21292:20181023:153226.177 End of DCsync_hosts()
 21292:20181023:153226.177 In DCsync_host_inventory()
 21292:20181023:153226.253 End of DCsync_host_inventory()
 21292:20181023:153226.253 In DCsync_hostgroups()
 21292:20181023:153226.254 End of DCsync_hostgroups()
 21292:20181023:153226.254 In DCsync_hostgroup_hosts()
 21292:20181023:153226.254 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x40]. Crashing ...
 21292:20181023:153226.254 ====== Fatal information: ======
 21292:20181023:153226.254 Program counter: 0x55704fb2b4e6
 21292:20181023:153226.254 === Registers: ===
 21292:20181023:153226.254 r8      =                0 =                    0 =                    0
 21292:20181023:153226.254 r9      =     7f45249fff00 =      139934943936256 =      139934943936256
 21292:20181023:153226.254 r10     =                8 =                    8 =                    8
 21292:20181023:153226.254 r11     =     7f4524a3ed20 =      139934944193824 =      139934944193824
 21292:20181023:153226.254 r12     =     55704fa6c400 =       93940861027328 =       93940861027328
 21292:20181023:153226.254 r13     =     7ffc8103a8e0 =      140722472986848 =      140722472986848
 21292:20181023:153226.254 r14     =                0 =                    0 =                    0
 21292:20181023:153226.254 r15     =                0 =                    0 =                    0
 21292:20181023:153226.254 rdi     =               38 =                   56 =                   56
 21292:20181023:153226.254 rsi     =     7ffc810387f8 =      140722472978424 =      140722472978424
 21292:20181023:153226.254 rbp     =     7ffc810387a0 =      140722472978336 =      140722472978336
 21292:20181023:153226.254 rbx     =                0 =                    0 =                    0
 21292:20181023:153226.254 rdx     =                8 =                    8 =                    8
 21292:20181023:153226.254 rax     =               38 =                   56 =                   56
 21292:20181023:153226.254 rcx     =                0 =                    0 =                    0
 21292:20181023:153226.254 rsp     =     7ffc81038740 =      140722472978240 =      140722472978240
 21292:20181023:153226.254 rip     =     55704fb2b4e6 =       93940861809894 =       93940861809894
 21292:20181023:153226.254 efl     =            10202 =                66050 =                66050
 21292:20181023:153226.254 csgsfs  =               33 =                   51 =                   51
 21292:20181023:153226.254 err     =                4 =                    4 =                    4
 21292:20181023:153226.254 trapno  =                e =                   14 =                   14
 21292:20181023:153226.254 oldmask =                0 =                    0 =                    0
 21292:20181023:153226.254 cr2     =               40 =                   64 =                   64
 21292:20181023:153226.254 === Backtrace: ===
 21292:20181023:153226.254 11: /usr/sbin/zabbix_server(zbx_log_fatal_info+0x142) [0x55704fb26706]
 21292:20181023:153226.254 10: /usr/sbin/zabbix_server(+0xf1b19) [0x55704fb26b19]
 21292:20181023:153226.255 9: /lib64/libpthread.so.0(+0xf6d0) [0x7f4527c446d0]
 21292:20181023:153226.255 8: /usr/sbin/zabbix_server(zbx_hashset_insert_ext+0x1c) [0x55704fb2b4e6]
 21292:20181023:153226.255 7: /usr/sbin/zabbix_server(zbx_hashset_insert+0x2d) [0x55704fb2b4c8]
 21292:20181023:153226.255 6: /usr/sbin/zabbix_server(+0xc4ee0) [0x55704faf9ee0]
 21292:20181023:153226.255 5: /usr/sbin/zabbix_server(DCsync_configuration+0x7cb) [0x55704fafad9a]
 21292:20181023:153226.255 4: /usr/sbin/zabbix_server(MAIN_ZABBIX_ENTRY+0x6ab) [0x55704fa6d8ec]
 21292:20181023:153226.255 3: /usr/sbin/zabbix_server(daemon_start+0x31b) [0x55704fb25e4a]
 21292:20181023:153226.255 2: /usr/sbin/zabbix_server(main+0x312) [0x55704fa6d23f]
 21292:20181023:153226.255 1: /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f45248d4445]
 21292:20181023:153226.255 0: /usr/sbin/zabbix_server(+0x37429) [0x55704fa6c429]
 21292:20181023:153226.255 === Memory map: ===

< snip - see attachment >

 21292:20181023:153226.260 ================================
 21292:20181023:153226.260 Please consider attaching a disassembly listing to your bug report.
 21292:20181023:153226.260 This listing can be produced with, e.g., objdump -DSswx zabbix_server.


 Comments   
Comment by Vladislavs Sokurenko [ 2018 Oct 24 ]

Could you please be so kind and show output of following command ?

show create table hosts_groups;
Comment by Vladislavs Sokurenko [ 2018 Oct 24 ]

Does this patch help ?

Index: src/libs/zbxdbcache/dbsync.c
===================================================================
--- src/libs/zbxdbcache/dbsync.c	(revision 85978)
+++ src/libs/zbxdbcache/dbsync.c	(working copy)
@@ -3757,7 +3757,7 @@
 			" from hosts_groups hg,hosts h"
 			" where hg.hostid=h.hostid"
 			" and h.status in (%d,%d)"
-			" and h.flags<>%d",
+			" and h.flags<>%d order by hg.groupid",
 			HOST_STATUS_MONITORED, HOST_STATUS_NOT_MONITORED, ZBX_FLAG_DISCOVERY_PROTOTYPE)))
 	{
 		return FAIL;
Comment by Jonathan W [ 2018 Oct 24 ]
show create table host_groups;
MariaDB [zabbix]> show create table hosts_groups; 
+--------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------+ 
| Table        | Create Table                                                                                                                                                                                                                
                                                                                                                                                                                                                                            
                                                                     | 
+--------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------+ 
| hosts_groups | CREATE TABLE `hosts_groups` ( 
 `hostgroupid` bigint(20) unsigned NOT NULL, 
 `hostid` bigint(20) unsigned NOT NULL, 
 `groupid` bigint(20) unsigned NOT NULL, 
 PRIMARY KEY (`hostgroupid`), 
 UNIQUE KEY `hosts_groups_1` (`hostid`,`groupid`), 
 KEY `hosts_groups_2` (`groupid`), 
 CONSTRAINT `c_hosts_groups_1` FOREIGN KEY (`hostid`) REFERENCES `hosts` (`hostid`) ON DELETE CASCADE, 
 CONSTRAINT `c_hosts_groups_2` FOREIGN KEY (`groupid`) REFERENCES `hstgrp` (`groupid`) ON DELETE CASCADE 
) ENGINE=InnoDB DEFAULT CHARSET=latin1 | 
+--------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------+

About to test the patch.

Comment by Jonathan W [ 2018 Oct 24 ]

The patch let the server start without segfaulting but it does complain about something impossible on line 2115 in dbconfig.c:

29582:20181024:081918.951 Starting Zabbix Server. Zabbix 4.0.1rc1 (revision 85951). 
29582:20181024:081918.952 ****** Enabled features ****** 
29582:20181024:081918.952 SNMP monitoring:           YES 
29582:20181024:081918.952 IPMI monitoring:           YES 
29582:20181024:081918.952 Web monitoring:            YES 
29582:20181024:081918.952 VMware monitoring:         YES 
29582:20181024:081918.952 SMTP authentication:       YES 
29582:20181024:081918.952 Jabber notifications:      YES 
29582:20181024:081918.952 Ez Texting notifications:  YES 
29582:20181024:081918.952 ODBC:                       NO 
29582:20181024:081918.952 SSH2 support:               NO 
29582:20181024:081918.952 IPv6 support:              YES 
29582:20181024:081918.952 TLS support:               YES 
29582:20181024:081918.952 ****************************** 
29582:20181024:081918.952 using configuration file: /etc/zabbix/zabbix_server.conf 
29582:20181024:081918.952 In zbx_load_modules() 
29582:20181024:081918.952 End of zbx_load_modules():SUCCEED 
29582:20181024:081918.952 In init_database_cache() 
29582:20181024:081918.952 In zbx_mem_create() param:'HistoryCacheSize' size:134217728 
29582:20181024:081918.952 valid user addresses: [0x7f0190757168, 0x7f0198756ff0] total size: 134217352 
29582:20181024:081918.952 End of zbx_mem_create() 
29582:20181024:081918.952 In zbx_mem_create() param:'HistoryIndexCacheSize' size:33554432 
29582:20181024:081918.952 valid user addresses: [0x7f018e757178, 0x7f0190756ff0] total size: 33554040 
29582:20181024:081918.952 End of zbx_mem_create() 
29582:20181024:081918.952 In init_trend_cache() 
29582:20181024:081918.952 In zbx_mem_required_size() size:0 chunks_num:1 descr:'trend cache' param:'TrendCacheSize' 
29582:20181024:081918.952 End of zbx_mem_required_size() size:414 
29582:20181024:081918.952 In zbx_mem_create() param:'TrendCacheSize' size:134217728 
29582:20181024:081918.953 valid user addresses: [0x7f0186757168, 0x7f018e756ff0] total size: 134217352 
29582:20181024:081918.953 End of zbx_mem_create() 
29582:20181024:081918.953 End of init_trend_cache() 
29582:20181024:081918.953 End of init_database_cache() 
29582:20181024:081918.953 In init_configuration_cache() size:536870912 
29582:20181024:081918.953 In zbx_mem_create() param:'CacheSize' size:536870912 
29582:20181024:081918.953 valid user addresses: [0x7f0166757168, 0x7f0186756ff0] total size: 536870536 
29582:20181024:081918.953 End of zbx_mem_create() 
29582:20181024:081918.953 End of init_configuration_cache() 
29582:20181024:081918.953 In init_selfmon_collector() 
29582:20181024:081918.953 init_selfmon_collector() size:66832 
29582:20181024:081918.953 End of init_selfmon_collector() collector:0x7f01a0d72000 
29582:20181024:081918.953 In zbx_vc_init() 
29582:20181024:081918.953 In zbx_mem_required_size() size:0 chunks_num:1 descr:'value cache size' param:'ValueCacheSize' 
29582:20181024:081918.953 End of zbx_mem_required_size() size:419 
29582:20181024:081918.953 In zbx_mem_create() param:'ValueCacheSize' size:134217728 
29582:20181024:081918.953 valid user addresses: [0x7f015e757168, 0x7f0166756ff0] total size: 134217352 
29582:20181024:081918.953 End of zbx_mem_create() 
29582:20181024:081918.953 End of zbx_vc_init() 
29582:20181024:081918.953 In zbx_db_get_database_type() 
29582:20181024:081918.953 In DBconnect() flag:0 
29582:20181024:081918.955 End of DBconnect():0 
29582:20181024:081918.955 query [txnlev:0] [select userid from users limit 1] 
29582:20181024:081918.955 there is at least 1 record in "users" table 
29582:20181024:081918.955 End of zbx_db_get_database_type():ZBX_DB_SERVER 
29582:20181024:081918.956 In DBcheck_version() 
29582:20181024:081918.956 In DBconnect() flag:0 
29582:20181024:081918.956 End of DBconnect():0 
29582:20181024:081918.956 query [txnlev:0] [show tables like 'dbversion'] 
29582:20181024:081918.956 query [txnlev:0] [select mandatory,optional from dbversion] 
29582:20181024:081918.956 current database version (mandatory/optional): 04000000/04000000 
29582:20181024:081918.957 required mandatory version: 04000000 
29582:20181024:081918.957 End of DBcheck_version():SUCCEED 
29582:20181024:081918.957 In DBconnect() flag:0 
29582:20181024:081918.957 End of DBconnect():0 
29582:20181024:081918.957 In DCsync_configuration() 
29582:20181024:081918.957 query [txnlev:0] [select refresh_unsupported,discovery_groupid,snmptrap_logging,severity_name_0,severity_name_1,severity_name_2,severity_name_3,severity_name_4,severity_name_5,hk_events_mode,hk_events_trigger,h
k_events_internal,hk_events_discovery,hk_events_autoreg,hk_services_mode,hk_services,hk_audit_mode,hk_audit,hk_sessions_mode,hk_sessions,hk_history_mode,hk_history_global,hk_history,hk_trends_mode,hk_trends_global,hk_trends,default_inven
tory_mode from config order by configid] 
29582:20181024:081918.957 In DCsync_config() 
29582:20181024:081918.957 End of DCsync_config() 
29582:20181024:081918.957 query [txnlev:0] [select hostid,templateid from hosts_templates order by hostid] 
29582:20181024:081918.965 query [txnlev:0] [select globalmacroid,macro,value from globalmacro] 
29582:20181024:081918.965 query [txnlev:0] [select hostmacroid,hostid,macro,value from hostmacro] 
29582:20181024:081918.983 In DCsync_htmpls() 
29582:20181024:081918.989 End of DCsync_htmpls() 
29582:20181024:081918.989 In DCsync_gmacros() 
29582:20181024:081918.989 End of DCsync_gmacros() 
29582:20181024:081918.989 In DCsync_hmacros() 
29582:20181024:081919.016 End of DCsync_hmacros() 
29582:20181024:081919.016 query [txnlev:0] [select hostid,proxy_hostid,host,ipmi_authtype,ipmi_privilege,ipmi_username,ipmi_password,maintenance_status,maintenance_type,maintenance_from,errors_from,available,disable_until,snmp_errors_fr
om,snmp_available,snmp_disable_until,ipmi_errors_from,ipmi_available,ipmi_disable_until,jmx_errors_from,jmx_available,jmx_disable_until,status,name,lastaccess,error,snmp_error,ipmi_error,jmx_error,tls_connect,tls_accept,tls_issuer,tls_su
bject,tls_psk_identity,tls_psk,proxy_address,auto_compress,maintenanceid from hosts where status in (0,1,5,6) and flags<>2] 
29582:20181024:081919.075 query [txnlev:0] [select hostid,inventory_mode,type,type_full,name,alias,os,os_full,os_short,serialno_a,serialno_b,tag,asset_tag,macaddress_a,macaddress_b,hardware,hardware_full,software,software_full,software_
app_a,software_app_b,software_app_c,software_app_d,software_app_e,contact,location,location_lat,location_lon,notes,chassis,model,hw_arch,vendor,contract_number,installer_name,deployment_status,url_a,url_b,url_c,host_networks,host_netmask
,host_router,oob_ip,oob_netmask,oob_router,date_hw_purchase,date_hw_install,date_hw_expiry,date_hw_decomm,site_address_a,site_address_b,site_address_c,site_city,site_state,site_country,site_zip,site_rack,site_notes,poc_1_name,poc_1_email
,poc_1_phone_a,poc_1_phone_b,poc_1_cell,poc_1_screen,poc_1_notes,poc_2_name,poc_2_email,poc_2_phone_a,poc_2_phone_b,poc_2_cell,poc_2_screen,poc_2_notes from host_inventory] 
29582:20181024:081919.171 query [txnlev:0] [select groupid,name from hstgrp] 
29582:20181024:081919.171 query [txnlev:0] [select hg.groupid,hg.hostid from hosts_groups hg,hosts h where hg.hostid=h.hostid and h.status in (0,1) and h.flags<>2 order by hg.groupid] 
29582:20181024:081919.201 query [txnlev:0] [select maintenanceid,maintenance_type,active_since,active_till,tags_evaltype from maintenances] 
29582:20181024:081919.201 query [txnlev:0] [select maintenancetagid,maintenanceid,operator,tag,value from maintenance_tag] 
29582:20181024:081919.202 query [txnlev:0] [select t.timeperiodid,t.timeperiod_type,t.every,t.month,t.dayofweek,t.day,t.start_time,t.period,t.start_date,m.maintenanceid from maintenances_windows m,timeperiods t where t.timeperiodid=m.ti
meperiodid] 
29582:20181024:081919.202 query [txnlev:0] [select maintenanceid,groupid from maintenances_groups order by maintenanceid] 
29582:20181024:081919.202 query [txnlev:0] [select maintenanceid,hostid from maintenances_hosts order by maintenanceid] 
29582:20181024:081919.202 In DCsync_hosts() 
29582:20181024:081919.222 End of DCsync_hosts() 
29582:20181024:081919.223 In DCsync_host_inventory() 
29582:20181024:081919.264 End of DCsync_host_inventory() 
29582:20181024:081919.264 In DCsync_hostgroups() 
29582:20181024:081919.264 End of DCsync_hostgroups() 
29582:20181024:081919.264 In DCsync_maintenances() 
29582:20181024:081919.264 End of DCsync_maintenances() 
29582:20181024:081919.264 In DCsync_maintenance_tags() 
29582:20181024:081919.264 End of DCsync_maintenance_tags() 
29582:20181024:081919.264 In DCsync_maintenance_groups() 
29582:20181024:081919.264 End of DCsync_maintenance_groups() 
29582:20181024:081919.264 In DCsync_maintenance_hosts() 
29582:20181024:081919.264 End of DCsync_maintenance_hosts() 
29582:20181024:081919.264 In DCsync_maintenance_periods() 
29582:20181024:081919.264 End of DCsync_maintenance_periods() 
29582:20181024:081919.264 query [txnlev:0] [select interfaceid,hostid,type,main,useip,ip,dns,port,bulk from interface] 
29582:20181024:081919.278 query [txnlev:0] [select i.itemid,i.hostid,i.status,i.type,i.value_type,i.key_,i.snmp_community,i.snmp_oid,i.port,i.snmpv3_securityname,i.snmpv3_securitylevel,i.snmpv3_authpassphrase,i.snmpv3_privpassphrase,i.i
pmi_sensor,i.delay,i.trapper_hosts,i.logtimefmt,i.params,i.state,i.authtype,i.username,i.password,i.publickey,i.privatekey,i.flags,i.interfaceid,i.snmpv3_authprotocol,i.snmpv3_privprotocol,i.snmpv3_contextname,i.lastlogsize,i.mtime,i.his
tory,i.trends,i.inventory_link,i.valuemapid,i.units,i.error,i.jmx_endpoint,i.master_itemid,i.timeout,i.url,i.query_fields,i.posts,i.status_codes,i.follow_redirects,i.post_type,i.http_proxy,i.headers,i.retrieve_mode,i.request_method,i.out
put_format,i.ssl_cert_file,i.ssl_key_file,i.ssl_key_password,i.verify_peer,i.verify_host,i.allow_traps from items i,hosts h where i.hostid=h.hostid and h.status in (0,1) and i.flags<>2] 
29582:20181024:081922.847 slow query: 3.569306 sec, "select i.itemid,i.hostid,i.status,i.type,i.value_type,i.key_,i.snmp_community,i.snmp_oid,i.port,i.snmpv3_securityname,i.snmpv3_securitylevel,i.snmpv3_authpassphrase,i.snmpv3_privpassp
hrase,i.ipmi_sensor,i.delay,i.trapper_hosts,i.logtimefmt,i.params,i.state,i.authtype,i.username,i.password,i.publickey,i.privatekey,i.flags,i.interfaceid,i.snmpv3_authprotocol,i.snmpv3_privprotocol,i.snmpv3_contextname,i.lastlogsize,i.mt
ime,i.history,i.trends,i.inventory_link,i.valuemapid,i.units,i.error,i.jmx_endpoint,i.master_itemid,i.timeout,i.url,i.query_fields,i.posts,i.status_codes,i.follow_redirects,i.post_type,i.http_proxy,i.headers,i.retrieve_mode,i.request_met
hod,i.output_format,i.ssl_cert_file,i.ssl_key_file,i.ssl_key_password,i.verify_peer,i.verify_host,i.allow_traps from items i,hosts h where i.hostid=h.hostid and h.status in (0,1) and i.flags<>2" 
29582:20181024:081922.847 query [txnlev:0] [select pp.item_preprocid,pp.itemid,pp.type,pp.params,pp.step,i.hostid from item_preproc pp,items i,hosts h where pp.itemid=i.itemid and i.hostid=h.hostid and h.status in (0,1) and i.flags<>2 o
rder by pp.itemid] 
29582:20181024:081923.544 In DCsync_interfaces() 
zabbix_server [29582]: ERROR [file:dbconfig.c,line:2115] Something impossible has just happened. 
29582:20181024:081923.544 === Backtrace: === 
29582:20181024:081923.544 6: /usr/sbin/zabbix_server(zbx_backtrace+0x2b) [0x49cdfb] 
29582:20181024:081923.545 5: /usr/sbin/zabbix_server(DCsync_configuration+0x2889) [0x481f99] 
29582:20181024:081923.545 4: /usr/sbin/zabbix_server(MAIN_ZABBIX_ENTRY+0x37e) [0x42307e] 
29582:20181024:081923.545 3: /usr/sbin/zabbix_server(daemon_start+0x1a5) [0x49c915] 
29582:20181024:081923.545 2: /usr/sbin/zabbix_server(main+0x338) [0x422548] 
29582:20181024:081923.545 1: /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f019d70f445] 
29582:20181024:081923.545 0: /usr/sbin/zabbix_server() [0x422872] 

< lots and lots of the error/backtrace repeating here >

zabbix_server [29582]: ERROR [file:dbconfig.c,line:2115] Something impossible has just happened. 
29582:20181024:081923.562 === Backtrace: === 
29582:20181024:081923.562 6: /usr/sbin/zabbix_server(zbx_backtrace+0x2b) [0x49cdfb] 
29582:20181024:081923.562 5: /usr/sbin/zabbix_server(DCsync_configuration+0x2889) [0x481f99] 
29582:20181024:081923.562 4: /usr/sbin/zabbix_server(MAIN_ZABBIX_ENTRY+0x37e) [0x42307e] 
29582:20181024:081923.562 3: /usr/sbin/zabbix_server(daemon_start+0x1a5) [0x49c915] 
29582:20181024:081923.562 2: /usr/sbin/zabbix_server(main+0x338) [0x422548] 
29582:20181024:081923.562 1: /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f019d70f445] 
29582:20181024:081923.562 0: /usr/sbin/zabbix_server() [0x422872] 
29582:20181024:081923.577 End of DCsync_interfaces() 
29582:20181024:081923.577 In DCsync_items() 
29582:20181024:081925.361 End of DCsync_items() 
29582:20181024:081925.361 In DCsync_item_preproc() 
29582:20181024:081925.508 End of DCsync_item_preproc() 

< snipped normal stuff from here on >
Comment by Andris Zeila [ 2018 Oct 25 ]

It's a harmless message, could happen when a host is added during configuration cache synchronization. Still it's obviously misleading, so created ZBX-15067 for it.

Comment by Andris Zeila [ 2018 Oct 25 ]

Released in:

  • pre-4.0.1rc2 r86019
  • pre-4.2.0alpha1 r86020
Generated at Fri Mar 29 13:00:05 EET 2024 using Jira 9.12.4#9120004-sha1:625303b708afdb767e17cb2838290c41888e9ff0.