Uploaded image for project: 'ZABBIX BUGS AND ISSUES'
  1. ZABBIX BUGS AND ISSUES
  2. ZBX-22494

Agent 6.4.0 logs many exceptions on Windows 10, 11

XMLWordPrintable

    • Icon: Problem report Problem report
    • Resolution: Fixed
    • Icon: Trivial Trivial
    • 6.4.3rc1, 7.0.0alpha1, 7.0 (plan)
    • 6.4.0
    • Agent (G)
    • None
    • Windows 10 22H2 19045.2604 and Windows 11 22H2 22621.1265
    • Sprint 99 (Apr 2023), Sprint 100 (May 2023)
    • 1

      Steps to reproduce:

      1. Install Zabbix Agent 6.4.0
      2. Start the agent process (as service or foreground process)
      3. Open the log file
      4. Note many "unhandled exception" messages.

      Result:
      **

      On Windows 11, the initial startup messages followed by ~80 unhandled exceptions with identical backtraces and slightly different register contents. There are no such exceptions with agent 6.2.

       

       18680:20230312:175954.461 Starting Zabbix Agent [...]. Zabbix 6.4.0 (revision 5b2736b6027).
       18680:20230312:175954.461 **** Enabled features ****
       18680:20230312:175954.461 IPv6 support:          YES
       18680:20230312:175954.461 TLS support:            NO
       18680:20230312:175954.462 **************************
       18680:20230312:175954.462 using configuration file: c:\ProgramData\Zabbix\zabbix_agentd_5.win.conf
       18680:20230312:175955.513 agent #0 started [main process]
       12056:20230312:175955.519 agent #1 started [collector]
        8032:20230312:175955.526 agent #2 started [listener #1]
        4256:20230312:175955.531 agent #3 started [listener #2]
        6540:20230312:175955.534 agent #4 started [listener #3]
        3396:20230312:175955.537 agent #5 started active checks #1 
      

       

        3396:20230312:175957.023 Unhandled exception e06d7363 detected at 0x00007FFF03E9051C. Crashing ...
        3396:20230312:175957.023 ====== Fatal information: ======
        3396:20230312:175957.023 Program counter: 0x03e9051c
        3396:20230312:175957.023 === Registers: ===
        3396:20230312:175957.023 r8      =     7ffefbcbea00 =      140733122865664 =      140733122865664
        3396:20230312:175957.023 r9      =                0 =                    0 =                    0
        3396:20230312:175957.023 r10     =          248cc58 =             38325336 =             38325336
        3396:20230312:175957.023 r11     =     7ffefbcbea30 =      140733122865712 =      140733122865712
        3396:20230312:175957.023 r12     =           53d250 =              5493328 =              5493328
        3396:20230312:175957.023 r13     =          24b15c0 =             38475200 =             38475200
        3396:20230312:175957.023 r14     =          248cc60 =             38325344 =             38325344
        3396:20230312:175957.023 r15     =                0 =                    0 =                    0
        3396:20230312:175957.023 rdi     =         19930520 =            429065504 =            429065504
        3396:20230312:175957.024 rsi     =          3dcf2a8 =             64811688 =             64811688
        3396:20230312:175957.024 rbp     =          248cc50 =             38325328 =             38325328
        3396:20230312:175957.024 rbx     =     7ffefbcc97e0 =      140733122910176 =      140733122910176
        3396:20230312:175957.024 rdx     =          24ded08 =             38661384 =             38661384
        3396:20230312:175957.024 rax     =               6c =                  108 =                  108
        3396:20230312:175957.024 rcx     =        1fb400100 =           8510243072 =           8510243072
        3396:20230312:175957.024 rsp     =          3dcf110 =             64811280 =             64811280
        3396:20230312:175957.024 efl     =              206 =                  518 =                  518
        3396:20230312:175957.024 csgsfs  =         332b5300 =            858477312 =            858477312
        3396:20230312:175957.024 === Backtrace: ===
        3396:20230312:175957.080 12: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(RaiseException+0x6c) [0x3e9051c]
        3396:20230312:175957.080 11: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(CxxThrowException+0x9a) [0x42a4ada]
        3396:20230312:175957.080 10: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(EvtOpenPublisherMetadata+0x74a) [0xfbc86aca]
        3396:20230312:175957.081 9: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(EvtOpenPublisherMetadata+0x4d1) [0xfbc86851]
        3396:20230312:175957.081 8: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(EvtOpenPublisherMetadata+0x12c) [0xfbc864ac]
        3396:20230312:175957.081 7: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe() [0x40032e7a]
        3396:20230312:175957.081 6: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe() [0x4003191b]
        3396:20230312:175957.081 5: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe() [0x40030ac1]
        3396:20230312:175957.081 4: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe() [0x4002e350]
        3396:20230312:175957.081 3: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe() [0x4002d31b]
        3396:20230312:175957.081 2: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe() [0x40090898]
        3396:20230312:175957.081 1: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(BaseThreadInitThunk+0x1d) [0x59c26bd]
        3396:20230312:175957.081 0: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(RtlUserThreadStart+0x28) [0x65cdfb8]
        3396:20230312:175957.084 ================================

       

      On Windows 10, some of the initial startup messages followed by three RPC exceptions (one 6d9, two 6ba), then ~10 unhandled exceptions of three types:

        9744:20230312:174420.451 Starting Zabbix Agent [...]. Zabbix 6.4.0 (revision 5b2736b6027).
        9744:20230312:174420.451 **** Enabled features ****
        9744:20230312:174420.452 IPv6 support:          YES
        9744:20230312:174420.452 TLS support:            NO
        9744:20230312:174420.452 **************************
        9744:20230312:174420.453 using configuration file: C:\ProgramData\Zabbix\zabbix_agentd_5.win.conf

      Note the thread start messages are absent here.

       

      Exception type 1, EPT_S_NOT_REGISTERED:

        9744:20230312:174420.886 Unhandled exception 6d9 detected at 0x00007FFC9CEACD29. Crashing ...
        9744:20230312:174420.886 ====== Fatal information: ======
        9744:20230312:174420.886 Program counter: 0x9ceacd29
        9744:20230312:174420.886 === Registers: ===
        9744:20230312:174420.887 r8      =           1a1980 =              1710464 =              1710464
        9744:20230312:174420.887 r9      =                0 =                    0 =                    0
        9744:20230312:174420.887 r10     =           1a0000 =              1703936 =              1703936
        9744:20230312:174420.887 r11     =           1a02cc =              1704652 =              1704652
        9744:20230312:174420.888 r12     =           51bbe0 =              5356512 =              5356512
        9744:20230312:174420.888 r13     =              6d9 =                 1753 =                 1753
        9744:20230312:174420.888 r14     =                0 =                    0 =                    0
        9744:20230312:174420.888 r15     =           e8d420 =             15258656 =             15258656
        9744:20230312:174420.889 rdi     =     7ffc9ed194c8 =      140722973021384 =      140722973021384
        9744:20230312:174420.889 rsi     =                0 =                    0 =                    0
        9744:20230312:174420.889 rbp     =                0 =                    0 =                    0
        9744:20230312:174420.889 rbx     =              6d9 =                 1753 =                 1753
        9744:20230312:174420.890 rdx     =               ea =                  234 =                  234
        9744:20230312:174420.890 rax     =     7ffc9f29b86b =      140722978797675 =      140722978797675
        9744:20230312:174420.890 rcx     =            f000c =               983052 =               983052
        9744:20230312:174420.890 rsp     =           e8d160 =             15257952 =             15257952
        9744:20230312:174420.891 efl     =              206 =                  518 =                  518
        9744:20230312:174420.891 csgsfs  =         332b5300 =            858477312 =            858477312
        9744:20230312:174420.891 === Backtrace: ===
        9744:20230312:174420.926 23: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(RaiseException+0x69) [0x9ceacd29]
        9744:20230312:174420.926 22: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(RpcRaiseException+0x50) [0x9de8c7b0]
        9744:20230312:174420.926 21: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(RpcRaiseException+0x14) [0x9de8c774]
        9744:20230312:174420.927 20: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(Ndr64AsyncServerCallAll+0x1599) [0x9df0c7d9]
        9744:20230312:174420.927 19: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(NdrClientCall3+0xf0) [0x9df0f5b0]
        9744:20230312:174420.927 18: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(PerfRegSetValue+0x4164) [0x9ed07f14]
        9744:20230312:174420.928 17: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(LsaSetForestTrustInformation2+0x5c60) [0x9ecd46a0]
        9744:20230312:174420.928 16: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(InitiateShutdownW+0x898) [0x9ecc9f48]
        9744:20230312:174420.928 15: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(InitiateShutdownW+0x1630) [0x9eccace0]
        9744:20230312:174420.929 14: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(PerfRegQueryValue+0x1a05) [0x9ecbaf35]
        9744:20230312:174420.929 13: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(PerfRegQueryValue+0x3b) [0x9ecb956b]
        9744:20230312:174420.929 12: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(SetProcessDynamicEnforcedCetCompatibleRanges+0xa46) [0x9cf16766]
        9744:20230312:174420.930 11: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(RegQueryValueExW+0x108) [0x9ceb3618]
        9744:20230312:174420.930 10: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(PdhCollectQueryData+0x5f93) [0x8cdd8f43]
        9744:20230312:174420.930 9: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(PdhCollectQueryData+0x6ea7) [0x8cdd9e57]
        9744:20230312:174420.931 8: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(PdhCollectQueryData+0x205af) [0x8cdf355f]
        9744:20230312:174420.931 7: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(PdhEnumObjectsHW+0xa2) [0x8ce051b2]
        9744:20230312:174420.931 6: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(PdhEnumObjectsW+0xeb) [0x8ce052eb]
        9744:20230312:174420.932 5: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe() [0x40039d05]
        9744:20230312:174420.932 4: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe() [0x40039a2f]
        9744:20230312:174420.932 3: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe() [0x4003a561]
        9744:20230312:174420.933 2: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(WaitServiceState+0x328) [0x9d2edf78]
        9744:20230312:174420.933 1: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(BaseThreadInitThunk+0x14) [0x9dd87614]
        9744:20230312:174420.933 0: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(RtlUserThreadStart+0x21) [0x9f2c26a1]
        9744:20230312:174420.935 ================================ 
      

       

      Exception type 2, RPC_S_SERVER_UNAVAILABLE with slightly different backtrace:

        9744:20230312:174421.169 ====== Fatal information: ======
        9744:20230312:174421.170 Program counter: 0x9ceacd29
        9744:20230312:174421.170 === Registers: ===
        9744:20230312:174421.170 r8      =                0 =                    0 =                    0
        9744:20230312:174421.170 r9      =                0 =                    0 =                    0
        9744:20230312:174421.171 r10     =                0 =                    0 =                    0
        9744:20230312:174421.171 r11     =                0 =                    0 =                    0
        9744:20230312:174421.171 r12     =           ea2340 =             15344448 =             15344448
        9744:20230312:174421.171 r13     =              6ba =                 1722 =                 1722
        9744:20230312:174421.172 r14     =                0 =                    0 =                    0
        9744:20230312:174421.172 r15     =           e8d5a0 =             15259040 =             15259040
        9744:20230312:174421.172 rdi     =     7ffc9229b018 =      140722760691736 =      140722760691736
        9744:20230312:174421.172 rsi     =                0 =                    0 =                    0
        9744:20230312:174421.172 rbp     =                5 =                    5 =                    5
        9744:20230312:174421.173 rbx     =              6ba =                 1722 =                 1722
        9744:20230312:174421.173 rdx     =                0 =                    0 =                    0
        9744:20230312:174421.173 rax     =                0 =                    0 =                    0
        9744:20230312:174421.173 rcx     =                0 =                    0 =                    0
        9744:20230312:174421.174 rsp     =           e8d2e0 =             15258336 =             15258336
        9744:20230312:174421.174 efl     =              202 =                  514 =                  514
        9744:20230312:174421.174 csgsfs  =         332b5300 =            858477312 =            858477312
        9744:20230312:174421.174 === Backtrace: ===
        9744:20230312:174421.223 24: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(RaiseException+0x69) [0x9ceacd29]
        9744:20230312:174421.223 23: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(RpcRaiseException+0x50) [0x9de8c7b0]
        9744:20230312:174421.224 22: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(RpcRaiseException+0x14) [0x9de8c774]
        9744:20230312:174421.224 21: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(Ndr64AsyncServerCallAll+0x1599) [0x9df0c7d9]
        9744:20230312:174421.224 20: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(NdrClientCall3+0xf0) [0x9df0f5b0]
        9744:20230312:174421.225 19: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(I_BrowserQueryStatistics+0x3d) [0x922927ad]
        9744:20230312:174421.225 18: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(CloseNetSvcsObject+0x13ba) [0x967e27fa]
        9744:20230312:174421.226 17: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(CollectNetSvcsObjectData+0xf3) [0x967e13e3]
        9744:20230312:174421.226 16: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(InitiateShutdownW+0xa0b) [0x9ecca0bb]
        9744:20230312:174421.226 15: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(InitiateShutdownW+0x1630) [0x9eccace0]
        9744:20230312:174421.226 14: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(PerfRegQueryValue+0x1a05) [0x9ecbaf35]
        9744:20230312:174421.227 13: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(PerfRegQueryValue+0x3b) [0x9ecb956b]
        9744:20230312:174421.227 12: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(SetProcessDynamicEnforcedCetCompatibleRanges+0xa46) [0x9cf16766]
        9744:20230312:174421.228 11: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(RegQueryValueExW+0x108) [0x9ceb3618]
        9744:20230312:174421.228 10: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(PdhCollectQueryData+0x5f93) [0x8cdd8f43]
        9744:20230312:174421.228 9: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(PdhCollectQueryData+0x6ea7) [0x8cdd9e57]
        9744:20230312:174421.229 8: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(PdhCollectQueryData+0x205af) [0x8cdf355f]
        9744:20230312:174421.229 7: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(PdhEnumObjectsHW+0xa2) [0x8ce051b2]
        9744:20230312:174421.229 6: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(PdhEnumObjectsW+0xeb) [0x8ce052eb]
        9744:20230312:174421.230 5: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe() [0x40039d05]
        9744:20230312:174421.230 4: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe() [0x40039a2f]
        9744:20230312:174421.230 3: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe() [0x4003a561]
        9744:20230312:174421.231 2: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(WaitServiceState+0x328) [0x9d2edf78]
        9744:20230312:174421.231 1: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(BaseThreadInitThunk+0x14) [0x9dd87614]
        9744:20230312:174421.231 0: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(RtlUserThreadStart+0x21) [0x9f2c26a1]
        9744:20230312:174421.234 ================================

       

      Then the thread start messages, then several instances of exception type 3, similar to Windows 11 above:

        9744:20230312:174421.693 agent #0 started [main process]
        9324:20230312:174421.694 agent #1 started [collector]
       10488:20230312:174421.694 agent #2 started [listener #1]
        9256:20230312:174421.694 agent #3 started [listener #2]
       10048:20230312:174421.695 agent #4 started [listener #3]
        3340:20230312:174421.695 agent #5 started [active checks #1]
        3340:20230312:174421.883 Unhandled exception e06d7363 detected at 0x00007FFC9CEACD29. Crashing ...
        3340:20230312:174421.883 ====== Fatal information: ======
        3340:20230312:174421.883 Program counter: 0x9ceacd29
        3340:20230312:174421.884 === Registers: ===
        3340:20230312:174421.884 r8      =     7ffc9de7b0e4 =      140722957693156 =      140722957693156
        3340:20230312:174421.884 r9      =               18 =                   24 =                   24
        3340:20230312:174421.885 r10     =          47eea80 =             75426432 =             75426432
        3340:20230312:174421.885 r11     =          23c1b01 =             37493505 =             37493505
        3340:20230312:174421.885 r12     =          2f83710 =             49821456 =             49821456
        3340:20230312:174421.886 r13     =           f80240 =             16253504 =             16253504
        3340:20230312:174421.886 r14     =                0 =                    0 =                    0
        3340:20230312:174421.886 r15     =                0 =                    0 =                    0
        3340:20230312:174421.887 rdi     =          47ef238 =             75428408 =             75428408
        3340:20230312:174421.887 rsi     =          2f85710 =             49829648 =             49829648
        3340:20230312:174421.887 rbp     =          47ef1d0 =             75428304 =             75428304
        3340:20230312:174421.887 rbx     =     7ffc978d8760 =      140722851120992 =      140722851120992
        3340:20230312:174421.888 rdx     =                1 =                    1 =                    1
        3340:20230312:174421.888 rax     =                0 =                    0 =                    0
        3340:20230312:174421.888 rcx     =          2f85748 =             49829704 =             49829704
        3340:20230312:174421.889 rsp     =          47ef090 =             75427984 =             75427984
        3340:20230312:174421.889 efl     =              202 =                  514 =                  514
        3340:20230312:174421.889 csgsfs  =         332b5300 =            858477312 =            858477312
        3340:20230312:174421.890 === Backtrace: ===
        3340:20230312:174421.956 12: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(RaiseException+0x69) [0x9ceacd29]
        3340:20230312:174421.957 11: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(CxxThrowException+0xad) [0x9c99da1d]
        3340:20230312:174421.957 10: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(EvtNext+0x96c) [0x9788553c]
        3340:20230312:174421.957 9: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(EvtNext+0x50e) [0x978850de]
        3340:20230312:174421.958 8: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(EvtOpenPublisherMetadata+0xdf) [0x9788580f]
        3340:20230312:174421.958 7: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe() [0x40032e7a]
        3340:20230312:174421.958 6: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe() [0x4003191b]
        3340:20230312:174421.959 5: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe() [0x40030ac1]
        3340:20230312:174421.959 4: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe() [0x4002e350]
        3340:20230312:174421.959 3: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe() [0x4002d31b]
        3340:20230312:174421.960 2: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe() [0x40090898]
        3340:20230312:174421.960 1: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(BaseThreadInitThunk+0x14) [0x9dd87614]
        3340:20230312:174421.960 0: C:\Program Files\Zabbix\Agent\zabbix_agentd.exe(RtlUserThreadStart+0x21) [0x9f2c26a1]
        3340:20230312:174421.964 ================================ 
      

       

      Expected:
      The agent starts without errors.

            zabbix.dev Zabbix Development Team
            chrullrich Christian Ullrich
            Team C
            Votes:
            6 Vote for this issue
            Watchers:
            15 Start watching this issue

              Created:
              Updated:
              Resolved: