[ZBX-9758] Zabbix server down in ubuntu 14.04 Created: 2015 Aug 05  Updated: 2017 May 30  Resolved: 2015 Aug 05

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Server (S)
Affects Version/s: None
Fix Version/s: None

Type: Problem report Priority: Blocker
Reporter: Bernardo Silva Assignee: Unassigned
Resolution: Duplicate Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Ubuntu server 14.04 with mysql

Attachments: File objdump.rar     Text File zabbix_server.log.txt    
Issue Links:
Duplicate
duplicates ZBX-8005 crash or error on any HTTPS site - in... Open

 Description   

Got signal [signal:11(SIGSEGV),reason:1,refaddr:(nil)]. Crashing ...

Zabbix server v2.2.2 (revision 42525) (12 February 2014)

 Comments   
Comment by richlv [ 2015 Aug 05 ]

backtrace :

  3683:20150804:223522.260 Starting Zabbix Server. Zabbix 2.2.2 (revision 42525).
  3683:20150804:223522.260 ****** Enabled features ******
  3683:20150804:223522.260 SNMP monitoring:           YES
  3683:20150804:223522.260 IPMI monitoring:           YES
  3683:20150804:223522.260 WEB monitoring:            YES
  3683:20150804:223522.260 VMware monitoring:         YES
  3683:20150804:223522.260 Jabber notifications:      YES
  3683:20150804:223522.260 Ez Texting notifications:  YES
  3683:20150804:223522.260 ODBC:                      YES
  3683:20150804:223522.260 SSH2 support:              YES
  3683:20150804:223522.261 IPv6 support:              YES
  3683:20150804:223522.261 ******************************
  3683:20150804:223522.261 using configuration file: /etc/zabbix/zabbix_server.conf
  3683:20150804:223522.263 current database version (mandatory/optional): 02020000/02020000
  3683:20150804:223522.263 required mandatory version: 02020000
...
  3690:20150804:223522.268 server #4 started [poller #2]
...
  3690:20150804:223530.341 Got signal [signal:11(SIGSEGV),reason:1,refaddr:(nil)]. Crashing ...
  3690:20150804:223530.341 ====== Fatal information: ======
  3690:20150804:223530.341 Program counter: 0x7fe2eff20cef
  3690:20150804:223530.341 === Registers: ===
  3690:20150804:223530.341 r8      =             ff00 =                65280 =                65280
  3690:20150804:223530.341 r9      =     7fe2f3a878d0 =      140612727240912 =      140612727240912
  3690:20150804:223530.341 r10     =     7ffd85c6fdf0 =      140726847864304 =      140726847864304
  3690:20150804:223530.341 r11     =     7fe2eff20cb0 =      140612664954032 =      140612664954032
  3690:20150804:223530.341 r12     =                0 =                    0 =                    0
  3690:20150804:223530.341 r13     =     7fe2f3e6f2f0 =      140612731335408 =      140612731335408
  3690:20150804:223530.341 r14     =                0 =                    0 =                    0
  3690:20150804:223530.341 r15     =     7fe2f3aad050 =      140612727394384 =      140612727394384
  3690:20150804:223530.341 rdi     =     7fe2f3a87a50 =      140612727241296 =      140612727241296
  3690:20150804:223530.341 rsi     =                0 =                    0 =                    0
  3690:20150804:223530.341 rbp     =                0 =                    0 =                    0
  3690:20150804:223530.341 rbx     =     7fe2f3a87a50 =      140612727241296 =      140612727241296
  3690:20150804:223530.341 rdx     =                0 =                    0 =                    0
  3690:20150804:223530.341 rax     =                0 =                    0 =                    0
  3690:20150804:223530.341 rcx     =                0 =                    0 =                    0
  3690:20150804:223530.341 rsp     =     7ffd85c6ffb0 =      140726847864752 =      140726847864752
  3690:20150804:223530.341 rip     =     7fe2eff20cef =      140612664954095 =      140612664954095
  3690:20150804:223530.341 efl     =            10206 =                66054 =                66054
  3690:20150804:223530.341 csgsfs  =               33 =                   51 =                   51
  3690:20150804:223530.341 err     =                4 =                    4 =                    4
  3690:20150804:223530.341 trapno  =                e =                   14 =                   14
  3690:20150804:223530.341 oldmask =                0 =                    0 =                    0
  3690:20150804:223530.341 cr2     =                0 =                    0 =                    0
  3690:20150804:223530.341 === Backtrace: ===
  3690:20150804:223530.342 19: /usr/sbin/zabbix_server: poller #2 [got 0 values in 0.000002 sec, getting values](print_fatal_info+0x27b) [0x7fe2f310b49b]
  3690:20150804:223530.342 18: /usr/sbin/zabbix_server: poller #2 [got 0 values in 0.000002 sec, getting values](+0x77719) [0x7fe2f310b719]
  3690:20150804:223530.342 17: /lib/x86_64-linux-gnu/libc.so.6(+0x36d40) [0x7fe2f05d7d40]
  3690:20150804:223530.342 16: /usr/lib/x86_64-linux-gnu/libgnutls.so.26(gnutls_x509_crt_import+0x3f) [0x7fe2eff20cef]
  3690:20150804:223530.342 15: /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4(+0x49179) [0x7fe2f0dce179]
  3690:20150804:223530.342 14: /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4(+0x49d2a) [0x7fe2f0dced2a]
  3690:20150804:223530.342 13: /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4(+0x4a7f0) [0x7fe2f0dcf7f0]
  3690:20150804:223530.342 12: /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4(+0xe0de) [0x7fe2f0d930de]
  3690:20150804:223530.342 11: /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4(+0x307f1) [0x7fe2f0db57f1]
  3690:20150804:223530.342 10: /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4(curl_multi_perform+0x91) [0x7fe2f0db6441]
  3690:20150804:223530.342 9: /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4(curl_easy_perform+0xe3) [0x7fe2f0dadba3]
  3690:20150804:223530.342 8: /usr/sbin/zabbix_server: poller #2 [got 0 values in 0.000002 sec, getting values](+0x25abc) [0x7fe2f30b9abc]
  3690:20150804:223530.342 7: /usr/sbin/zabbix_server: poller #2 [got 0 values in 0.000002 sec, getting values](check_service+0x766) [0x7fe2f30f02f6]
  3690:20150804:223530.342 6: /usr/sbin/zabbix_server: poller #2 [got 0 values in 0.000002 sec, getting values](get_value_simple+0x167) [0x7fe2f30ccc87]
  3690:20150804:223530.342 5: /usr/sbin/zabbix_server: poller #2 [got 0 values in 0.000002 sec, getting values](+0x372e7) [0x7fe2f30cb2e7]
  3690:20150804:223530.342 4: /usr/sbin/zabbix_server: poller #2 [got 0 values in 0.000002 sec, getting values](main_poller_loop+0x93) [0x7fe2f30cb4a3]
  3690:20150804:223530.342 3: /usr/sbin/zabbix_server: poller #2 [got 0 values in 0.000002 sec, getting values](MAIN_ZABBIX_ENTRY+0x726) [0x7fe2f30c00c6]
  3690:20150804:223530.342 2: /usr/sbin/zabbix_server: poller #2 [got 0 values in 0.000002 sec, getting values](daemon_start+0x1bf) [0x7fe2f310ab3f]
  3690:20150804:223530.342 1: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7fe2f05c2ec5]
  3690:20150804:223530.342 0: /usr/sbin/zabbix_server: poller #2 [got 0 values in 0.000002 sec, getting values](+0x26f11) [0x7fe2f30baf11]
Comment by richlv [ 2015 Aug 05 ]

actual crash log is about zabbix 2.2.2, which is pretty old. could you please upgrade and test whether the issue is till present ?

it might also be same as ZBX-7986

Comment by Aleksandrs Saveljevs [ 2015 Aug 05 ]

According to the backtrace, this looks like a similar problem to ZBX-8005. There it crashes in HTTP poller, but here the reporter probably uses net.tcp.service[https], which uses cURL, too. So the reason is probably the same.

Comment by Bernardo Silva [ 2015 Aug 05 ]

To complement, I know zabbix 2.2.2 is old however 2.2 is the LTS and is ported in ubuntu 14.04.

Regarding ZBX-8005, the second interface is included on the server to locate ESXi to monitor. So it's possible that it can be the same problem.
Only that even after removing the vmwarea server from hosts list the problem persisted.

The problem started when I activated a second network interface, after some changes the problem stopped.

Modifications:

In the /etc/hostname
before:
monitoramento

after:
monitoramento.furg.br

In the /etc/hosts
before:
127.0.0.1 localhost
ff02 :: 1 ip6-allnodes
ff02 :: 2 ip6-allrouters

after:
127.0.0.1 localhost
200.19.254.69 monitoramento.furg.br monitoramento
:: 1 localhost ip6-localhost ip6-loopback
ff02 :: 1 ip6-allnodes
ff02 :: 2 ip6-allrouters

Comment by Aleksandrs Saveljevs [ 2015 Aug 05 ]

Which versions of cURL and GnuTLS are you using?

Comment by Bernardo Silva [ 2015 Aug 05 ]

ii curl 7.35.0-1ubuntu2.5 amd64 command line tool for transferring data with URL syntax
ii libcurl3:amd64 7.35.0-1ubuntu2.5 amd64 easy-to-use client-side URL transfer library (OpenSSL flavour)
ii libcurl3-gnutls:amd64 7.35.0-1ubuntu2.5 amd64 easy-to-use client-side URL transfer library (GnuTLS flavour)
ii php5-curl 5.5.9+dfsg-1ubuntu4.11 amd64 CURL module for php5
ii python3-pycurl 7.19.3-0ubuntu3 amd64 Python 3 bindings to libcurl

ii libcurl3-gnutls:amd64 7.35.0-1ubuntu2.5 amd64 easy-to-use client-side URL transfer library (GnuTLS flavour)
ii libgnutls-openssl27:amd64 2.12.23-12ubuntu2.2 amd64 GNU TLS library - OpenSSL wrapper
ii libgnutls26:amd64 2.12.23-12ubuntu2.2 amd64 GNU TLS library - runtime library

Comment by Aleksandrs Saveljevs [ 2015 Aug 05 ]

Thank you! These versions are the same as specified originally in ZBX-8005. There, upgrading cURL helped to alleviate the problem.

Here, as far as I understand, adding host name entries solved the problem, so let's continue the investigation in ZBX-8005. It seems the problem is with GnuTLS flavor of cURL and particular versions of them.

Comment by richlv [ 2015 Aug 05 ]

for the record, i meant that specifically 2.2.2 is quite old - latest is 2.2.9 and 2.2.10 is coming out any moment now

Generated at Sun Apr 06 20:37:19 EEST 2025 using Jira 9.12.4#9120004-sha1:625303b708afdb767e17cb2838290c41888e9ff0.