proxy.log
|
Duplicate |
|||
| is duplicated by |
|
Zabbix crashes after upgrading from 6... | Closed |
Team A
[ZBX-22408] zabbix-proxy crash on Ubuntu 22.04 Created: 2023 Feb 23 Updated: 2024 Apr 10 Resolved: 2023 Mar 02 |
|
| Status: | Closed |
| Project: | ZABBIX BUGS AND ISSUES |
| Component/s: | Proxy (P) |
| Affects Version/s: | 6.4.0rc1, 6.4.0rc2 |
| Fix Version/s: | 6.4.0rc3, 6.4 (plan) |
| Type: | Problem report | Priority: | Trivial |
| Reporter: | Stephan A. Klein | Assignee: | Andris Zeila |
| Resolution: | Fixed | Votes: | 1 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Environment: |
Ubuntu 22.04 VM on ESXI 8. |
||
| Attachments: |
proxy.log
|
||||||||
| Issue Links: |
|
||||||||
| Team: | Team A |
||||||||
| Sprint: | Sprint 97 (Feb 2023) | ||||||||
| Story Points: | 0.125 | ||||||||
| Description |
|
Steps to reproduce: Start zabbix proxy and wait, crash appears within 12 hours.
Trace: |
| Comments |
| Comment by Vladislavs Sokurenko [ 2023 Feb 27 ] |
|
It crash when executing preprocessing step with jsonpath right after new configuration is received
1071980:20230222:233530.206 received configuration data from server at "95.216.XXX.XXX", datalen 245952
1071986:20230223:034519.354 [1] Got signal [signal:11(SIGSEGV),reason:1,refaddr:(nil)]. Crashing ... 1071986:20230223:034519.355 [2] === Backtrace: === 1071986:20230223:034519.359 [1] 23: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](zbx_backtrace+0x55) [0x55598c0cc30b] 1071986:20230223:034519.359 [1] 22: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](zbx_log_fatal_info+0x18f) [0x55598c0cc619] 1071986:20230223:034519.359 [1] 21: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](+0x2fa02e) [0x55598c0cd02e] 1071986:20230223:034519.359 [1] 20: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f86bfb8b520] 1071986:20230223:034519.359 [1] 19: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](+0x270104) [0x55598c043104] 1071986:20230223:034519.359 [1] 18: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](+0x270401) [0x55598c043401] 1071986:20230223:034519.359 [1] 17: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](+0x270a36) [0x55598c043a36] 1071986:20230223:034519.359 [1] 16: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](+0x26ed59) [0x55598c041d59] 1071986:20230223:034519.359 [1] 15: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](+0x26ee12) [0x55598c041e12] 1071986:20230223:034519.359 [1] 14: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](+0x26eef6) [0x55598c041ef6] 1071986:20230223:034519.359 [1] 13: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](+0x2704a0) [0x55598c0434a0] 1071986:20230223:034519.359 [1] 12: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](+0x26ed3e) [0x55598c041d3e] 1071986:20230223:034519.359 [1] 11: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](+0x26ee12) [0x55598c041e12] 1071986:20230223:034519.359 [1] 10: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](+0x26eef6) [0x55598c041ef6] 1071986:20230223:034519.359 [1] 9: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](+0x2704a0) [0x55598c0434a0] 1071986:20230223:034519.359 [1] 8: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](zbx_jsonobj_query+0xbd) [0x55598c044842] 1071986:20230223:034519.359 [1] 7: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](+0xd69f3) [0x55598bea99f3] 1071986:20230223:034519.359 [1] 6: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](+0xd6afb) [0x55598bea9afb] 1071986:20230223:034519.359 [1] 5: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](pp_execute_step+0x1cb) [0x55598beaac19] 1071986:20230223:034519.359 [1] 4: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](pp_execute+0x285) [0x55598beab14a] 1071986:20230223:034519.359 [1] 3: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](+0xd107c) [0x55598bea407c] 1071986:20230223:034519.359 [1] 2: /usr/sbin/zabbix_proxy: preprocessing manager #1 [queued 10, processed 10 values, idle 5.059592 sec during 5.059934 sec](+0xd1392) [0x55598bea4392] 1071986:20230223:034519.359 [1] 1: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f86bfbddb43] |
| Comment by Vladislavs Sokurenko [ 2023 Feb 27 ] |
|
Could you please be so kind and provide obj dump or binary: |
| Comment by Stephan A. Klein [ 2023 Feb 27 ] |
|
Seems also to crash whilehousekeeping: 2075271:20230227:080239.030 [3] thread started [preprocessing worker #3] 2075265:20230227:080239.393 received configuration data from server at "95.216.XX.XXX", datalen 245953 2075272:20230227:080412.040 Unable to connect to [95.216.44.114]:10051 [cannot connect to [[95.216.44.114]:10051]: [4] Interrupted system call] 2075272:20230227:080412.040 Will try to reconnect every 1 second(s) 2075272:20230227:080412.123 Connection restored. 2075273:20230227:083239.062 executing housekeeper 2075273:20230227:083239.071 housekeeper [deleted 427 records in 0.008331 sec, idle for 1 hour(s)] 2075273:20230227:093239.078 executing housekeeper 2075273:20230227:093239.205 housekeeper [deleted 55087 records in 0.125890 sec, idle for 1 hour(s)] 2075273:20230227:103239.214 executing housekeeper 2075273:20230227:103239.301 housekeeper [deleted 39225 records in 0.085871 sec, idle for 1 hour(s)] 2075271:20230227:111019.271 [1] Got signal [signal:11(SIGSEGV),reason:1,refaddr:(nil)]. Crashing ... 2075271:20230227:111019.271 [1] ====== Fatal information: ====== 2075271:20230227:111019.271 [1] Program counter: 0x55d9c1d35104 2075271:20230227:111019.271 [1] === Registers: === 2075271:20230227:111019.271 [1] r8 = 7f1fa80fc480 = 139773940319360 = 139773940319360 2075271:20230227:111019.271 [1] r9 = 7f1fb000a500 = 139774073545984 = 139774073545984 2075271:20230227:111019.271 [3] Got signal [signal:11(SIGSEGV),reason:1,refaddr:(nil)]. Crashing ... 2075271:20230227:111019.271 [3] ====== Fatal information: ======
|
| Comment by Vladislavs Sokurenko [ 2023 Feb 27 ] |
|
Maybe configuration was recently changed and if yes then perhaps it’s possible to see what was changed regarding jsonpath |
| Comment by Stephan A. Klein [ 2023 Feb 27 ] |
|
Dump (98MB) exceeds the 15MB file limit. Where can I upload the dump? |
| Comment by Stephan A. Klein [ 2023 Feb 27 ] |
|
No change in the config in the last few days. |
| Comment by Andris Zeila [ 2023 Feb 28 ] |
|
Released
|