Uploaded image for project: 'ZABBIX BUGS AND ISSUES'
  1. ZABBIX BUGS AND ISSUES
  2. ZBX-23787

processes are crashing in "zbx_replace_invalid_utf8" call

XMLWordPrintable

    • Sprint 107 (Dec 2023)
    • 0.25

      This seem to start happening after upgrade from 6.0.23 to 6.0.24.
      From this forum thread
      https://www.zabbix.com/forum/zabbix-troubleshooting-and-problems/475331-zabbix-6-0-24-on-ubuntu-22-04-crashes-on-startup :

      51098:20231204:154632.811 === Backtrace: ===
      51098:20231204:154632.814 25: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](zbx_backtrace+0x51) [0x55eeef1e9da1]
      51098:20231204:154632.814 24: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](zbx_log_fatal_info+0x2d5) [0x55eeef1ea185]
      51098:20231204:154632.814 23: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](+0x1f981a) [0x55eeef1ea81a]
      51098:20231204:154632.814 22: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fbb66830520]
      51098:20231204:154632.814 21: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](zbx_replace_invalid_utf8+0x4) [0x55eeef2100d4]
      51098:20231204:154632.814 20: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](zbx_http_convert_to_utf8+0xea) [0x55eeef237d1a]
      51098:20231204:154632.814 19: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](+0xf085b) [0x55eeef0e185b]
      51098:20231204:154632.814 18: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](+0xfa554) [0x55eeef0eb554]
      51098:20231204:154632.814 17: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](+0x70710) [0x55eeef061710]
      51098:20231204:154632.814 16: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](+0xf96eb) [0x55eeef0ea6eb]
      51098:20231204:154632.814 15: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](+0xfa73d) [0x55eeef0eb73d]
      51098:20231204:154632.814 14: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](+0x100ba8) [0x55eeef0f1ba8]
      51098:20231204:154632.814 13: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](+0xfc8ff) [0x55eeef0ed8ff]
      51098:20231204:154632.814 12: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](duk_pcall+0x6f) [0x55eeef0f991f]
      51098:20231204:154632.814 11: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](zbx_es_execute+0x1ea) [0x55eeef0e024a]
      51098:20231204:154632.814 10: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](get_value_script+0xd7) [0x55eeef0863c7]
      51098:20231204:154632.814 9: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](zbx_check_items+0x164) [0x55eeef080f74]
      51098:20231204:154632.814 8: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](+0x905a7) [0x55eeef0815a7]
      51098:20231204:154632.814 7: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](poller_thread+0x153) [0x55eeef081af3]
      51098:20231204:154632.814 6: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](zbx_thread_start+0x24) [0x55eeef1ec424]
      51098:20231204:154632.814 5: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](+0x77f3a) [0x55eeef068f3a]
      51098:20231204:154632.814 4: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](MAIN_ZABBIX_ENTRY+0xa33) [0x55eeef06a4c3]
      51098:20231204:154632.814 3: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](main+0x4cc) [0x55eeef060f4c]
      51098:20231204:154632.814 2: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fbb66817d90]
      51098:20231204:154632.815 1: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0x80) [0x7fbb66817e40]
      51098:20231204:154632.815 0: zabbix_server: poller #10 [got 0 values in 0.000000 sec, getting values](_start+0x25) [0x55eeef0685d5]
      

      From another case, proxy in docker:

      Dec  5 09:56:22 zabbix-docker zabbix_proxy[216]: Starting Zabbix Proxy (active) [ZABBIX-xxx]. Zabbix 6.0.24 (revision b2b72d85a4d).
      ...
      Dec  5 09:56:22 zabbix-docker zabbix_proxy[338]: proxy #80 started [poller #22]
      ...
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: === Backtrace: ===
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 23: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](zbx_backtrace+0x3c) [0x55f711d67dec]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 22: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](zbx_log_fatal_info+0x28d) [0x55f711d682cd]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 21: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](+0x188476) [0x55f711d68476]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 20: /lib64/libc.so.6(+0x54db0) [0x7f78a6cb9db0]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 19: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](zbx_replace_invalid_utf8+0) [0x55f711d7f6c0]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 18: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](zbx_http_convert_to_utf8+0xdd) [0x55f711d9decd]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 17: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](+0xa9336) [0x55f711c89336]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 16: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](+0xd4e94) [0x55f711cb4e94]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 15: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](+0x61f10) [0x55f711c41f10]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 14: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](+0xdfd84) [0x55f711cbfd84]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 13: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](+0xd507d) [0x55f711cb507d]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 12: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](+0xabf61) [0x55f711c8bf61]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 11: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](+0xd45c8) [0x55f711cb45c8]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 10: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](zbx_es_execute+0x19d) [0x55f711c8575d]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 9: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](get_value_script+0xc8) [0x55f711c5c898]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 8: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](zbx_check_items+0x174) [0x55f711c5b9e4]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 7: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](+0x7bcde) [0x55f711c5bcde]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 6: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](poller_thread+0x15d) [0x55f711c5c2dd]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 5: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](zbx_thread_start+0x20) [0x55f711d75eb0]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 4: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](MAIN_ZABBIX_ENTRY+0x709) [0x55f711c499b9]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 3: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](daemon_start+0x272) [0x55f711d6f9c2]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 2: /lib64/libc.so.6(+0x3feb0) [0x7f78a6ca4eb0]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 1: /lib64/libc.so.6(__libc_start_main+0x80) [0x7f78a6ca4f60]
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[338]: 0: /usr/sbin/zabbix_proxy: poller #22 [got 4 values in 0.659596 sec, getting values](_start+0x25) [0x55f711c48d85]
      ...
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[216]: One child process died (PID:338,exitcode/signal:1). Exiting ...
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[216]: PROCESS EXIT: 338
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[216]: syncing history data...
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[216]: syncing history data... 100.000000%
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[216]: syncing history data done
      Dec  5 09:56:41 zabbix-docker zabbix_proxy[216]: Zabbix Proxy stopped. Zabbix 6.0.24 (revision b2b72d85a4d).
      

      Yet one more, another case, alerters all the time:

       65043:20231204:131301.607 === Backtrace: ===
       65043:20231204:131301.609 22: /usr/sbin/zabbix_server: alerter #1 started(zbx_backtrace+0x3c) [0x56464c65df0c]
       65043:20231204:131301.609 21: /usr/sbin/zabbix_server: alerter #1 started(zbx_log_fatal_info+0x475) [0x56464c65e4a5]
       65043:20231204:131301.609 20: /usr/sbin/zabbix_server: alerter #1 started(+0x1547c6) [0x56464c6617c6]
       65043:20231204:131301.609 19: /lib64/libpthread.so.0(+0x12cf0) [0x7f663846dcf0]
       65043:20231204:131301.609 18: /usr/sbin/zabbix_server: alerter #1 started(zbx_replace_invalid_utf8+0x3) [0x56464c630ec3]
       65043:20231204:131301.609 17: /usr/sbin/zabbix_server: alerter #1 started(zbx_http_convert_to_utf8+0xe9) [0x56464c61b279]
       65043:20231204:131301.609 16: /usr/sbin/zabbix_server: alerter #1 started(+0x244a33) [0x56464c751a33]
       65043:20231204:131301.609 15: /usr/sbin/zabbix_server: alerter #1 started(+0x21fe25) [0x56464c72ce25]
       65043:20231204:131301.609 14: /usr/sbin/zabbix_server: alerter #1 started(+0x6faa3) [0x56464c57caa3]
       65043:20231204:131301.609 13: /usr/sbin/zabbix_server: alerter #1 started(+0x221036) [0x56464c72e036]
       65043:20231204:131301.609 12: /usr/sbin/zabbix_server: alerter #1 started(+0x21fff5) [0x56464c72cff5]
       65043:20231204:131301.609 11: /usr/sbin/zabbix_server: alerter #1 started(+0x2374d7) [0x56464c7444d7]
       65043:20231204:131301.609 10: /usr/sbin/zabbix_server: alerter #1 started(+0x21f6e6) [0x56464c72c6e6]
       65043:20231204:131301.609 9: /usr/sbin/zabbix_server: alerter #1 started(duk_pcall+0x32) [0x56464c7477d2]
       65043:20231204:131301.609 8: /usr/sbin/zabbix_server: alerter #1 started(zbx_es_execute+0x201) [0x56464c755851]
       65043:20231204:131301.609 7: /usr/sbin/zabbix_server: alerter #1 started(alerter_thread+0x26f) [0x56464c7ba5ff]
       65043:20231204:131301.609 6: /usr/sbin/zabbix_server: alerter #1 started(zbx_thread_start+0x27) [0x56464c65fb47]
       65043:20231204:131301.609 5: /usr/sbin/zabbix_server: alerter #1 started(+0x7723a) [0x56464c58423a]
       65043:20231204:131301.609 4: /usr/sbin/zabbix_server: alerter #1 started(MAIN_ZABBIX_ENTRY+0xa03) [0x56464c7c1103]
       65043:20231204:131301.609 3: /usr/sbin/zabbix_server: alerter #1 started(daemon_start+0x228) [0x56464c661d18]
       65043:20231204:131301.609 2: /usr/sbin/zabbix_server: alerter #1 started(main+0x4a9) [0x56464c577fd9]
       65043:20231204:131301.609 1: /lib64/libc.so.6(__libc_start_main+0xe5) [0x7f66365e9d85]
       65043:20231204:131301.609 0: /usr/sbin/zabbix_server: alerter #1 started(_start+0x2e) [0x56464c57ee0e]
      

            vso Vladislavs Sokurenko
            zalex_ua Oleksii Zagorskyi
            Team A
            Votes:
            1 Vote for this issue
            Watchers:
            8 Start watching this issue

              Created:
              Updated:
              Resolved: