-
Incident report
-
Resolution: Duplicate
-
Critical
-
None
-
2.2.1
-
None
-
FreeBSD 10.0-RELEASE amd64
65918:20140208:205013.327 Starting Zabbix Server. Zabbix 2.2.1 (revision 40808).
65918:20140208:205013.327 ****** Enabled features ******
65918:20140208:205013.327 SNMP monitoring: YES
65918:20140208:205013.328 IPMI monitoring: YES
65918:20140208:205013.328 WEB monitoring: YES
65918:20140208:205013.328 VMware monitoring: YES
65918:20140208:205013.328 Jabber notifications: YES
65918:20140208:205013.328 Ez Texting notifications: YES
65918:20140208:205013.329 ODBC: YES
65918:20140208:205013.329 SSH2 support: YES
65918:20140208:205013.329 IPv6 support: YES
65918:20140208:205013.329 ******************************
65918:20140208:205013.329 using configuration file: /usr/local/etc/zabbix22/zabbix_server.conf
65918:20140208:205013.341 current database version (mandatory/optional): 02020000/02020000
65918:20140208:205013.341 required mandatory version: 02020000
65919:20140208:205013.670 server #1 started configuration syncer #1
65920:20140208:205013.670 server #2 started db watchdog #1
65925:20140208:205013.674 server #7 started trapper #1
65926:20140208:205013.674 server #8 started icmp pinger #1
65927:20140208:205013.675 server #9 started icmp pinger #2
65929:20140208:205013.680 server #11 started icmp pinger #4
65928:20140208:205013.680 server #10 started icmp pinger #3
65933:20140208:205013.683 server #15 started http poller #1
65931:20140208:205013.683 server #13 started housekeeper #1
65932:20140208:205013.686 server #14 started timer #1
65931:20140208:205013.686 executing housekeeper
65935:20140208:205013.690 server #17 started history syncer #1
65936:20140208:205013.693 server #18 started history syncer #2
65937:20140208:205013.694 server #19 started history syncer #3
65930:20140208:205013.695 server #12 started alerter #1
65918:20140208:205013.700 server #0 started [main process]
65938:20140208:205013.702 server #20 started history syncer #4
65944:20140208:205013.705 server #26 started java poller #4
65941:20140208:205013.705 server #23 started java poller #1
65946:20140208:205013.705 server #28 started proxy poller #1
65939:20140208:205013.716 server #21 started escalator #1
65945:20140208:205013.718 server #27 started java poller #5
65947:20140208:205013.718 server #29 started self-monitoring #1
65940:20140208:205013.718 server #22 started ipmi poller #1
65943:20140208:205013.719 server #25 started java poller #3
65942:20140208:205013.721 server #24 started java poller #2
65931:20140208:205013.749 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.015593 sec, idle 4 hour(s)]
65930:20140208:205013.760 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x40]. Crashing ...
65930:20140208:205013.761 ====== Fatal information: ======
65930:20140208:205013.762 program counter not available for this architecture
65930:20140208:205013.763 === Registers: ===
65930:20140208:205013.763 register dump not available for this architecture
65930:20140208:205013.764 === Backtrace: ===
65930:20140208:205013.765 1: 0x4604ab <print_fatal_info+0x7b> at /usr/local/sbin/zabbix_server
65930:20140208:205013.765 0: 0x46090c <zbx_set_common_signal_handlers+0x2fc> at /usr/local/sbin/zabbix_server
65930:20140208:205013.766 === Memory map: ===
65930:20140208:205013.767 memory map not available for this platform
65930:20140208:205013.767 ================================
65918:20140208:205013.769 One child process died (PID:65930,exitcode/signal:65280). Exiting ...
Some info from a ktrace on PID 65930 (process alerter #1)
65930 zabbix_server 0.000188 CALL write(0x6,0x81563f000,0x3b)
65930 zabbix_server 0.000087 GIO fd 6 wrote 59 bytes
" 65930:20140208:205013.695 server #12 started [alerter #1]
Connecting to MySQL to get the alerts and media_types
65930 zabbix_server 0.000038 CALL sendto(0x6,0x8080ed000,0x146,0,0,0)
65930 zabbix_server 0.000074 GIO fd 6 wrote 326 bytes
0x0000 4201 0000 0373 656c 6563 7420 612e 616c 6572 7469 642c 612e 6d65 6469 6174 7970 6569 642c 612e 7365 6e64 746f 2c61 2e73 7562 6a65 |B....select a.alertid,a.mediatypeid,a.sendto,a.subje|
0x0034 6374 2c61 2e6d 6573 7361 6765 2c61 2e73 7461 7475 732c 6d74 2e6d 6564 6961 7479 7065 6964 2c6d 742e 7479 7065 2c6d 742e 6465 7363 |ct,a.message,a.status,mt.mediatypeid,mt.type,mt.desc|
0x0068 7269 7074 696f 6e2c 6d74 2e73 6d74 705f 7365 7276 6572 2c6d 742e 736d 7470 5f68 656c 6f2c 6d74 2e73 6d74 705f 656d 6169 6c2c 6d74 |ription,mt.smtp_server,mt.smtp_helo,mt.smtp_email,mt|
0x009c 2e65 7865 635f 7061 7468 2c6d 742e 6773 6d5f 6d6f 6465 6d2c 6d74 2e75 7365 726e 616d 652c 6d74 2e70 6173 7377 642c 612e 7265 7472 |.exec_path,mt.gsm_modem,mt.username,mt.passwd,a.retr|
0x00d0 6965 7320 6672 6f6d 2061 6c65 7274 7320 612c 6d65 6469 615f 7479 7065 206d 7420 7768 6572 6520 612e 6d65 6469 6174 7970 6569 643d |ies from alerts a,media_type mt where a.mediatypeid=|
0x0104 6d74 2e6d 6564 6961 7479 7065 6964 2061 6e64 2061 2e73 7461 7475 733d 3020 616e 6420 612e 616c 6572 7474 7970 653d 3020 6f72 6465 |mt.mediatypeid and a.status=0 and a.alerttype=0 orde|
0x0138 7220 6279 2061 2e61 6c65 7274 6964 |r by a.alertid|
The above query returns several results, two of them are alerts that use jabber as the media type.
Alerter connects to our xmpp server
65930 zabbix_server 0.000096 CALL write(0x7,0x800f3f929,0x33)
65930 zabbix_server 0.000041 GIO fd 7 wrote 51 bytes
"<starttls xmlns='urn:ietf:params:xml:ns:xmpp-tls'/>"
Then it crashes while trying to load p11-kit files
65930 zabbix_server 0.000345 CALL stat(0x808024340,0x7fffffffa660)
65930 zabbix_server 0.000013 NAMI "/usr/local/share/p11-kit/modules/."
65930 zabbix_server 0.000040 STRU struct stat {dev=2379268315, ino=110164, mode=040755, nlink=2, uid=0, gid=0, rdev=4294967295, atime=1389322177, stime=1388759674, ctime=1389322177.269718494, birthtime=1369703652.318606704, size=3, blksize=4096, blocks=3, flags=0x800 }
65930 zabbix_server 0.000023 RET stat 0
65930 zabbix_server 0.000072 CALL stat(0x808024340,0x7fffffffa660)
65930 zabbix_server 0.000027 NAMI "/usr/local/share/p11-kit/modules/.."
65930 zabbix_server 0.000185 STRU struct stat {dev=2379268315, ino=110163, mode=040755, nlink=3, uid=0, gid=0, rdev=4294967295, atime=1389322177, stime=1388759674, ctime=1389322177.269718494, birthtime=1369703652.318606704, size=3, blksize=4096, blocks=3, flags=0x800 }
65930 zabbix_server 0.000083 RET stat 0
65930 zabbix_server 0.000131 CALL stat(0x808016200,0x7fffffffa660)
65930 zabbix_server 0.000042 NAMI "/usr/local/share/p11-kit/modules/p11-kit-trust.module"
65930 zabbix_server 0.000044 STRU struct stat {dev=2379268315, ino=120274, mode=0100444, nlink=1, uid=0, gid=0, rdev=4294967295, atime=1389322177, stime=1388759674, ctime=1389322177.268720199, birthtime=1389322177.268720199, size=693, blksize=4096, blocks=3, flags=0x800 }
65930 zabbix_server 0.000170 RET stat 0
65930 zabbix_server 0.000041 CALL open(0x808016200,0x100000<O_CLOEXEC>,<unused>0x20)
65930 zabbix_server 0.000037 NAMI "/usr/local/share/p11-kit/modules/p11-kit-trust.module"
65930 zabbix_server 0.000049 RET open 10/0xa
65930 zabbix_server 0.000283 CALL mmap(0,0x2b5,0x1<PROT_READ>,0x2<MAP_PRIVATE>,0xa,0)
65930 zabbix_server 0.000021 RET mmap 34367496192/0x800766000
65930 zabbix_server 0.000110 CALL munmap(0x800766000,0x2b5)
65930 zabbix_server 0.000126 RET munmap 0
65930 zabbix_server 0.000313 CALL close(0xa)
65930 zabbix_server 0.000071 RET close 0
65930 zabbix_server 0.000052 CALL getdirentries(0x9,0x8080ff000,0x1000,0x80802c468)
65930 zabbix_server 0.000029 RET getdirentries 0
65930 zabbix_server 0.000100 CALL close(0x9)
65930 zabbix_server 0.000010 RET close 0
65930 zabbix_server 0.000058 CALL open(0x80076df80,0x100000<O_CLOEXEC>,<unused>0x27)
65930 zabbix_server 0.000075 NAMI "/usr/local/lib/pkcs11/p11-kit-trust.so"
65930 zabbix_server 0.000033 RET open 9
65930 zabbix_server 0.000020 CALL fstat(0x9,0x7fffffff9590)
65930 zabbix_server 0.000056 STRU struct stat {dev=2379268315, ino=120233, mode=0100755, nlink=1, uid=0, gid=0, rdev=4294967295, atime=1389322177, stime=1388759674, ctime=1389322177.154719896, birthtime=1389322177.151719772, size=226795, blksize=131072, blocks=517, flags=0x800 }
65930 zabbix_server 0.000056 RET fstat 0
65930 zabbix_server 0.000017 CALL mmap(0,0x1000,0x1<PROT_READ>,0x40002<MAP_PRIVATE|MAP_PREFAULT_READ>,0x9,0)
65930 zabbix_server 0.000051 RET mmap 34367496192/0x800766000
65930 zabbix_server 0.000064 CALL mmap(0,0x237000,0<PROT_NONE>,0x21002<MAP_PRIVATE|MAP_ANON|MAP_NOCORE>,0xffffffff,0)
65930 zabbix_server 0.000013 RET mmap 34712338432/0x815044000
65930 zabbix_server 0.000031 CALL mmap(0x815044000,0x2f000,0x5<PROT_READ|PROT_EXEC>,0x60012<MAP_PRIVATE|MAP_FIXED|MAP_NOCORE|MAP_PREFAULT_READ>,0x9,0)
65930 zabbix_server 0.000029 RET mmap 34712338432/0x815044000
65930 zabbix_server 0.000018 CALL mmap(0x815273000,0x8000,0x3<PROT_READ|PROT_WRITE>,0x40012<MAP_PRIVATE|MAP_FIXED|MAP_PREFAULT_READ>,0x9,0x2f000)
65930 zabbix_server 0.000084 RET mmap 34714628096/0x815273000
65930 zabbix_server 0.000079 CALL munmap(0x800766000,0x1000)
65930 zabbix_server 0.000013 RET munmap 0
65930 zabbix_server 0.000020 CALL mmap(0,0x9000,0x3<PROT_READ|PROT_WRITE>,0x1002<MAP_PRIVATE|MAP_ANON>,0xffffffff,0)
65930 zabbix_server 0.000010 RET mmap 34367750144/0x8007a4000
65930 zabbix_server 0.000017 CALL close(0x9)
65930 zabbix_server 0.000028 RET close 0
65930 zabbix_server 0.001221 PSIG SIGSEGV caught handler=0x460870 mask=0x0 code=SEGV_MAPERR
65930 zabbix_server 0.000115 CALL stat(0x749900,0x7ffffffe9838)
I've been able to make zabbix start disabling the jabber media type and deleting any alert with that media type.
But there's obviously something wrong when trying to use xmpp.
I'm using p11-kit-0.20.1 which is the latest available version in FreeBSD 10
- duplicates
-
-
- Closed
-