Uploaded image for project: 'ZABBIX BUGS AND ISSUES'
  1. ZABBIX BUGS AND ISSUES
  2. ZBX-21159

Zabbix HA Manager crashing

XMLWordPrintable

    • Team A
    • Sprint 90 (Jul 2022)
    • 1

      I have my system set to auto-update (I know mistake )I believe when it got the 6.0.5 update this issue popped up.  I'm running a since server not in HA mode.  It appears to be stuck in a loop.  zabbix-server starts up, attempts to start HA Manager, fails, crashes zabbix-server, zabbix-server starts up, rinse and repeat.

      Config
      /etc/zabbix/zabbix_server.conf (Blank lines and comments removed)

      LogFile=/var/log/zabbix/zabbix_server.log
      LogFileSize=0
      DebugLevel=4
      PidFile=/var/run/zabbix/zabbix_server.pid
      SocketDir=/var/run/zabbix
      DBName=zabbix
      DBUser=zabbix
      DBPassword=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
      StartPollers=25
      StartPollersUnreachable=100
      SNMPTrapperFile=/var/log/snmptrap/snmptrap.log
      CacheSize=64M
      Timeout=20
      LogSlowQueries=3000
      StatsAllowedIP=127.0.0.1 

      Steps to reproduce:

      1. systemctl start zabbix-server

      Result:
      See log file:

      8823:20220602:094806.426 Starting Zabbix Server. Zabbix 6.0.5 (revision 8da3e1f8419).
        8823:20220602:094806.426 ****** Enabled features ******
        8823:20220602:094806.426 SNMP monitoring:           YES
        8823:20220602:094806.426 IPMI monitoring:           YES
        8823:20220602:094806.427 Web monitoring:            YES
        8823:20220602:094806.427 VMware monitoring:         YES
        8823:20220602:094806.427 SMTP authentication:       YES
        8823:20220602:094806.427 ODBC:                      YES
        8823:20220602:094806.427 SSH support:               YES
        8823:20220602:094806.427 IPv6 support:              YES
        8823:20220602:094806.427 TLS support:               YES
        8823:20220602:094806.427 ******************************
        8823:20220602:094806.427 using configuration file: /etc/zabbix/zabbix_server.conf
        8823:20220602:094806.427 In zbx_load_modules()
        8823:20220602:094806.427 End of zbx_load_modules():SUCCEED
        8823:20220602:094806.427 In zbx_ipc_service_start() service:rtc
        8823:20220602:094806.427 In zbx_ipc_socket_open()
        8823:20220602:094806.427 End of zbx_ipc_socket_open():FAIL
        8823:20220602:094806.427 End of zbx_ipc_service_start():SUCCEED
        8823:20220602:094806.427 In zbx_db_get_database_type()
        8823:20220602:094806.427 In DBconnect() flag:0
        8823:20220602:094806.432 End of DBconnect():0
        8823:20220602:094806.432 query [txnlev:0] [select userid from users limit 1]
        8823:20220602:094806.432 there is at least 1 record in "users" table
        8823:20220602:094806.432 End of zbx_db_get_database_type():ZBX_DB_SERVER
        8823:20220602:094806.432 In init_database_cache()
        8823:20220602:094806.432 In zbx_mem_create() param:'HistoryCacheSize' size:16777216
        8823:20220602:094806.432 valid user addresses: [0x7f0437693170, 0x7f0438692ff0] total size: 16776832
        8823:20220602:094806.432 End of zbx_mem_create()
        8823:20220602:094806.432 In zbx_mem_create() param:'HistoryIndexCacheSize' size:4194304
        8823:20220602:094806.432 valid user addresses: [0x7f0437293180, 0x7f0437692ff0] total size: 4193904
        8823:20220602:094806.432 End of zbx_mem_create()
        8823:20220602:094806.432 In init_trend_cache()
        8823:20220602:094806.432 In zbx_mem_required_size() size:0 chunks_num:1 descr:'trend cache' param:'TrendCacheSize'
        8823:20220602:094806.432 End of zbx_mem_required_size() size:422
        8823:20220602:094806.432 In zbx_mem_create() param:'TrendCacheSize' size:4194304
        8823:20220602:094806.432 valid user addresses: [0x7f0436e93170, 0x7f0437292ff0] total size: 4193920
        8823:20220602:094806.432 End of zbx_mem_create()
        8823:20220602:094806.432 End of init_trend_cache()
        8823:20220602:094806.432 End of init_database_cache()
        8823:20220602:094806.432 In DBconnect() flag:0
        8823:20220602:094806.434 End of DBconnect():0
        8823:20220602:094806.434 query [txnlev:0] [select default_character_set_name,default_collation_name from information_schema.SCHEMATA where schema_name='zabbix']
        8823:20220602:094806.434 query [txnlev:0] [select count(*) from information_schema.`COLUMNS` where table_schema='zabbix' and data_type in ('text','varchar','longtext') and (character_set_name not in ('utf8','utf8mb3','utf8mb4') or collation_name not in ('utf8_bin','utf8mb3_bin','utf8mb4_bin'))]
        8823:20220602:094806.444 In DBconnect() flag:0
        8823:20220602:094806.444 End of DBconnect():0
        8823:20220602:094806.444 In zbx_dbms_version_info_extract()
        8823:20220602:094806.444 End of zbx_dbms_version_info_extract() version:80026
        8823:20220602:094806.444 In DBcheck_version()
        8823:20220602:094806.444 In DBconnect() flag:0
        8823:20220602:094806.445 End of DBconnect():0
        8823:20220602:094806.445 query [txnlev:0] [show tables like 'dbversion']
        8823:20220602:094806.446 query [txnlev:0] [select mandatory,optional from dbversion]
        8823:20220602:094806.446 current database version (mandatory/optional): 06000000/06000002
        8823:20220602:094806.447 required mandatory version: 06000000
        8823:20220602:094806.447 End of DBcheck_version():SUCCEED
        8823:20220602:094806.447 In DBconnect() flag:0
        8823:20220602:094806.448 End of DBconnect():0
        8823:20220602:094806.448 query [txnlev:0] [show columns from config like 'dbversion_status']
        8823:20220602:094806.450 query [txnlev:0] [show index from history where key_name='PRIMARY']
        8823:20220602:094806.451 In DBflush_version_requirements()
        8823:20220602:094806.451 query without transaction detected
        8823:20220602:094806.451 query [txnlev:0] [update config set dbversion_status='[{"database":"MySQL","current_version":"8.00.26","min_version":"5.07.28","max_version":"8.00.x","history_pk":1,"min_supported_version":"8.00.0","flag":0}]']
        8823:20220602:094806.452 End of DBflush_version_requirements()
        8823:20220602:094806.452 In DBcheck_double_type()
        8823:20220602:094806.452 In DBconnect() flag:0
        8823:20220602:094806.453 End of DBconnect():0
        8823:20220602:094806.453 query [txnlev:0] [select count(*) from information_schema.columns where table_schema='zabbix' and column_type='double' and ((lower(table_name)='trends' and (lower(column_name) in ('value_min', 'value_avg', 'value_max'))) or (lower(table_name)='history' and lower(column_name)='value'))]
        8823:20220602:094806.454 End of DBcheck_double_type()
        8823:20220602:094806.454 In DBconnect() flag:0
        8823:20220602:094806.455 End of DBconnect():0
        8823:20220602:094806.455 query [txnlev:0] [select configid,instanceid from config order by configid]
        8823:20220602:094806.456 In zbx_ha_start()
        8823:20220602:094806.456 In zbx_ipc_service_recv() timeout:1.000
        8824:20220602:094806.456 zbx_setproctitle() title:'ha manager'
        8824:20220602:094806.456 starting HA manager
        8824:20220602:094806.457 In zbx_ipc_service_start() service:haservice
        8824:20220602:094806.457 In zbx_ipc_socket_open()
        8824:20220602:094806.457 End of zbx_ipc_socket_open():FAIL
        8824:20220602:094806.457 End of zbx_ipc_service_start():SUCCEED
        8824:20220602:094806.457 In zbx_ipc_async_socket_open()
        8824:20220602:094806.457 In zbx_ipc_socket_open()
        8823:20220602:094807.457 End of zbx_ipc_service_recv():2
        8823:20220602:094807.458 In zbx_ipc_service_recv() timeout:1.000
        8823:20220602:094808.459 End of zbx_ipc_service_recv():2
        8823:20220602:094808.459 In zbx_ipc_service_recv() timeout:1.000
        8823:20220602:094809.460 End of zbx_ipc_service_recv():2
        8823:20220602:094809.460 In zbx_ipc_service_recv() timeout:1.000
        8823:20220602:094810.461 End of zbx_ipc_service_recv():2
        8823:20220602:094810.461 In zbx_ipc_service_recv() timeout:1.000
        8823:20220602:094811.461 End of zbx_ipc_service_recv():2
        8823:20220602:094811.461 In zbx_ipc_service_recv() timeout:1.000
        8823:20220602:094812.462 End of zbx_ipc_service_recv():2
        8823:20220602:094812.462 In zbx_ipc_service_recv() timeout:1.000
        8823:20220602:094813.464 End of zbx_ipc_service_recv():2
        8823:20220602:094813.464 In zbx_ipc_service_recv() timeout:1.000
        8823:20220602:094814.465 End of zbx_ipc_service_recv():2
        8823:20220602:094814.465 In zbx_ipc_service_recv() timeout:1.000
        8823:20220602:094815.465 End of zbx_ipc_service_recv():2
        8823:20220602:094815.465 In zbx_ipc_service_recv() timeout:1.000
        8823:20220602:094816.466 End of zbx_ipc_service_recv():2
        8823:20220602:094816.467 One child process died (PID:8824,exitcode/signal:9). Exiting ...
        8823:20220602:094816.467 End of zbx_ha_start():FAIL
        8823:20220602:094816.467 cannot start HA manager: timeout while waiting for HA manager registration 

      Expected:
      zabbix server to start sucessfully

            wiper Andris Zeila
            cbateson Chris Bateson
            Team A
            Votes:
            1 Vote for this issue
            Watchers:
            10 Start watching this issue

              Created:
              Updated:
              Resolved: