[ZBX-7731] One child process died (PID:36456,exitcode/signal:11). Exiting ...Maybe Duplicate of ZBX-4726 Created: 2014 Jan 30  Updated: 2017 May 30  Resolved: 2014 Jan 31

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Proxy (P)
Affects Version/s: 2.2.1
Fix Version/s: None

Type: Incident report Priority: Blocker
Reporter: Wolfgang Alper Assignee: Unassigned
Resolution: Duplicate Votes: 0
Labels: proxy, server
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Zabbix Proxy 32Bit on 64Bit Scientific Linux using 64Bit Mysql DB. Installe 32Bit Oracle client libs for external Database monitoring.
Note: Need to use 32Bit Proxy due to 32Bit OracleDB Client components.

Attachments: Text File crash0.txt     Text File crash1.txt    
Issue Links:
Duplicate
duplicates ZBX-7729 Crash zabbix server on solaris 10 aft... Closed
duplicates ZBX-7665 Zabbix 2.2.1 ODBC monitor crash - in ... Closed

 Description   

Multiple Crashlogs that look similar are available. No real load on proxy.
It seems this is similar to ZBX-4726 from Version 1.8 in 2012

36453:20140122:152706.117 Received configuration data from server. Datalen 57230
36453:20140122:152706.119 [Z3005] query failed: [2006] MySQL server has gone away [begin;]
36456:20140122:152707.413 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x3c]. Crashing ...
...
...
36451:20140122:152707.432 One child process died (PID:36456,exitcode/signal:11). Exiting ...
36451:20140122:152709.434 syncing history data...
36451:20140122:152709.436 syncing history data done
36451:20140122:152709.436 Zabbix Proxy stopped. Zabbix 2.2.1 (revision 40808).

 Comments   
Comment by Wolfgang Alper [ 2014 Jan 30 ]

Added crashlog for test with Version 2.2.2RC1 crash1.txt

Comment by Oleksii Zagorskyi [ 2014 Jan 31 ]

Backtrace from attachments:

 36456:20140122:152707.416 === Backtrace: ===
 36456:20140122:152707.419 19: zabbix_proxy: poller #1 [got 1 values in 0.000550 sec, getting values](print_fatal_info+0x454) [0x80a9d84]
 36456:20140122:152707.419 18: zabbix_proxy: poller #1 [got 1 values in 0.000550 sec, getting values]() [0x80aa5a0]
 36456:20140122:152707.419 17: [0x5b1410]
 36456:20140122:152707.419 16: /opt/u01/app/oracle/product/11.2.0/client/lib/libclntsh.so.11.1(kpuhhaloc+0x334) [0x1307212]
 36456:20140122:152707.419 15: /opt/u01/app/oracle/product/11.2.0/client/lib/libclntsh.so.11.1(kpughndl0+0x214) [0x1349986]
 36456:20140122:152707.419 14: /opt/u01/app/oracle/product/11.2.0/client/lib/libclntsh.so.11.1(OCIHandleAlloc+0x38) [0x1324ec8]
 36456:20140122:152707.419 13: /opt/u01/app/oracle/product/11.2.0/client/lib/libsqora.so.11.1(bcoSQLAllocEnv+0xe2) [0x4ccde5e]
 36456:20140122:152707.419 12: /opt/u01/app/oracle/product/11.2.0/client/lib/libsqora.so.11.1(+0x61c77) [0x4d1cc77]
 36456:20140122:152707.419 11: /opt/u01/app/oracle/product/11.2.0/client/lib/libsqora.so.11.1(SQLAllocHandle+0x33) [0x4d1ce29]
 36456:20140122:152707.419 10: /usr/lib/libodbc.so.2(+0xda83) [0xd36a83]
 36456:20140122:152707.419 9: /usr/lib/libodbc.so.2(SQLConnect+0x186) [0xd37ae6]
 36456:20140122:152707.419 8: zabbix_proxy: poller #1 [got 1 values in 0.000550 sec, getting values](odbc_DBconnect+0x182) [0x80d4d32]
 36456:20140122:152707.419 7: zabbix_proxy: poller #1 [got 1 values in 0.000550 sec, getting values](get_value_db+0xd0) [0x806d9d0]
 36456:20140122:152707.419 6: zabbix_proxy: poller #1 [got 1 values in 0.000550 sec, getting values]() [0x8066d04]
 36456:20140122:152707.419 5: zabbix_proxy: poller #1 [got 1 values in 0.000550 sec, getting values](main_poller_loop+0xa8) [0x80673e8]
 36456:20140122:152707.419 4: zabbix_proxy: poller #1 [got 1 values in 0.000550 sec, getting values](MAIN_ZABBIX_ENTRY+0x713) [0x8057223]
 36456:20140122:152707.419 3: zabbix_proxy: poller #1 [got 1 values in 0.000550 sec, getting values](daemon_start+0x1e0) [0x80a8ed0]
 36456:20140122:152707.419 2: zabbix_proxy: poller #1 [got 1 values in 0.000550 sec, getting values](main+0x30d) [0x80579ed]
 36456:20140122:152707.419 1: /lib/libc.so.6(__libc_start_main+0xe6) [0x931ce6]
 36456:20140122:152707.419 0: zabbix_proxy: poller #1 [got 1 values in 0.000550 sec, getting values]() [0x8056371]
...
 36451:20140122:152709.436 Zabbix Proxy stopped. Zabbix 2.2.1 (revision 40808).

 54534:20140122:153658.369 proxy #5 started [poller #2]
...
 54534:20140122:153700.418 === Backtrace: ===
 54534:20140122:153700.420 19: zabbix_proxy: poller #2 [got 0 values in 0.000007 sec, getting values](print_fatal_info+0x454) [0x80ab2b4]
 54534:20140122:153700.420 18: zabbix_proxy: poller #2 [got 0 values in 0.000007 sec, getting values]() [0x80abad0]
 54534:20140122:153700.420 17: [0xd0c410]
 54534:20140122:153700.420 16: /opt/u01/app/oracle/product/11.2.0/client/lib/libclntsh.so.11.1(kpuhhaloc+0x334) [0x4129212]
 54534:20140122:153700.420 15: /opt/u01/app/oracle/product/11.2.0/client/lib/libclntsh.so.11.1(kpughndl0+0x214) [0x416b986]
 54534:20140122:153700.420 14: /opt/u01/app/oracle/product/11.2.0/client/lib/libclntsh.so.11.1(OCIHandleAlloc+0x38) [0x4146ec8]
 54534:20140122:153700.420 13: /opt/u01/app/oracle/product/11.2.0/client/lib/libsqora.so.11.1(bcoSQLAllocEnv+0xe2) [0x602fe5e]
 54534:20140122:153700.420 12: /opt/u01/app/oracle/product/11.2.0/client/lib/libsqora.so.11.1(+0x61c77) [0x607ec77]
 54534:20140122:153700.421 11: /opt/u01/app/oracle/product/11.2.0/client/lib/libsqora.so.11.1(SQLAllocHandle+0x33) [0x607ee29]
 54534:20140122:153700.421 10: /usr/lib/libodbc.so.2(+0xda83) [0x389a83]
 54534:20140122:153700.421 9: /usr/lib/libodbc.so.2(SQLConnect+0x186) [0x38aae6]
 54534:20140122:153700.421 8: zabbix_proxy: poller #2 [got 0 values in 0.000007 sec, getting values](odbc_DBconnect+0x182) [0x80d5de2]
 54534:20140122:153700.421 7: zabbix_proxy: poller #2 [got 0 values in 0.000007 sec, getting values](get_value_db+0xd0) [0x806dda0]
 54534:20140122:153700.421 6: zabbix_proxy: poller #2 [got 0 values in 0.000007 sec, getting values]() [0x80670cc]
 54534:20140122:153700.421 5: zabbix_proxy: poller #2 [got 0 values in 0.000007 sec, getting values](main_poller_loop+0xa8) [0x80677b8]
 54534:20140122:153700.421 4: zabbix_proxy: poller #2 [got 0 values in 0.000007 sec, getting values](MAIN_ZABBIX_ENTRY+0x713) [0x8057493]
 54534:20140122:153700.421 3: zabbix_proxy: poller #2 [got 0 values in 0.000007 sec, getting values](daemon_start+0x1e0) [0x80aa400]
 54534:20140122:153700.421 2: zabbix_proxy: poller #2 [got 0 values in 0.000007 sec, getting values](main+0x30d) [0x8057c5d]
 54534:20140122:153700.421 1: /lib/libc.so.6(__libc_start_main+0xe6) [0x5d9ce6]
 54534:20140122:153700.421 0: zabbix_proxy: poller #2 [got 0 values in 0.000007 sec, getting values]() [0x8056561]
...
 54528:20140122:153702.443 Zabbix Proxy stopped. Zabbix 2.2.2rc1 (revision 41561).

In second backtrace we can see it's in poller.
It's very similar to ZBX-7665.

Let's close it as duplicate.
Feel free to reopen if you are not agree.

Comment by Glebs Ivanovskis (Inactive) [ 2016 Jun 30 ]

Maybe this information helps someone. Looks like we have same symptoms here: unixODBC 2.3.x (libodbc.so.2 from memory map in attached logs), Oracle 11.2 ODBC driver (libsqora.so.11.1), 64 bit system...

Generated at Fri Apr 19 03:13:07 EEST 2024 using Jira 9.12.4#9120004-sha1:625303b708afdb767e17cb2838290c41888e9ff0.