Uploaded image for project: 'ZABBIX BUGS AND ISSUES'
  1. ZABBIX BUGS AND ISSUES
  2. ZBX-4278

Zabbix_server crash in zbx_hashset_search

    XMLWordPrintable

Details

    • Incident report
    • Status: Closed
    • Critical
    • Resolution: Cannot Reproduce
    • 1.8.6
    • None
    • Server (S)
    • centos 5.4 (x86_64) Linux zabbixnode2 2.6.18-164.el5

    Description

      Every few days \ weeks zabbix_server drops several times a day with the following error. Runs for a while and then falls.
      ----------------------
      ??? ? ????????? ?????? zabbix_server ?????? ?? ????????? ??? ? ????? ?? ????????? ???????. ???????? ????????? ????? ? ????? ??????.

      23233:20111026:155519.666 Got signal [signal:11(SIGSEGV),reason:128,refaddr:(nil)]. Crashing ...
      23233:20111026:155519.666 ====== Fatal information: ======
      23233:20111026:155519.666 Program counter: 0x43a79b
      23233:20111026:155519.666 === Registers: ===
      23233:20111026:155519.666 r8 = 1 = 1 = 1
      23233:20111026:155519.666 r9 = 1 = 1 = 1
      23233:20111026:155519.666 r10 = 31d8951580 = 214087046528 = 214087046528
      23233:20111026:155519.666 r11 = 206 = 518 = 518
      23233:20111026:155519.666 r12 = 2b668d226160 = 47719454499168 = 47719454499168
      23233:20111026:155519.666 r13 = 7fff78ca3640 = 140735219906112 = 140735219906112
      23233:20111026:155519.666 r14 = 0 = 0 = 0
      23233:20111026:155519.666 r15 = 4ea7e830 = 1319626800 = 1319626800
      23233:20111026:155519.666 rdi = 7fff78ca3640 = 140735219906112 = 140735219906112
      23233:20111026:155519.666 rsi = 8 = 8 = 8
      23233:20111026:155519.666 rbp = bc4be7d2 = 3159091154 = 3159091154
      23233:20111026:155519.666 rbx = 2020202020200a20 = 2314885530818447904 = 2314885530818447904
      23233:20111026:155519.666 rdx = 463a = 17978 = 17978
      23233:20111026:155519.666 rax = 2b669419cba8 = 47719571377064 = 47719571377064
      23233:20111026:155519.667 rcx = 633a0f9f = 1664749471 = 1664749471
      23233:20111026:155519.667 rsp = 7fff78ca3460 = 140735219905632 = 140735219905632
      23233:20111026:155519.667 rip = 43a79b = 4433819 = 4433819
      23233:20111026:155519.667 efl = 10202 = 66050 = 66050
      23233:20111026:155519.667 csgsfs = 33 = 51 = 51
      23233:20111026:155519.667 err = 0 = 0 = 0
      23233:20111026:155519.667 trapno = d = 13 = 13
      23233:20111026:155519.667 oldmask = 0 = 0 = 0
      23233:20111026:155519.667 cr2 = 0 = 0 = 0
      23233:20111026:155519.667 === Backtrace: ===
      23233:20111026:155519.685 9: /usr/local/sbin/zabbix_server(print_fatal_info+0xcd) [0x43bdad]
      23233:20111026:155519.685 8: /usr/local/sbin/zabbix_server [0x43b5e8]
      23233:20111026:155519.685 7: /lib64/libc.so.6 [0x31d86302d0]
      23233:20111026:155519.685 6: /usr/local/sbin/zabbix_server(zbx_hashset_search+0x3b) [0x43a79b]
      23233:20111026:155519.685 5: /usr/local/sbin/zabbix_server(DCsync_history+0xcfe) [0x43302e]
      23233:20111026:155519.685 4: /usr/local/sbin/zabbix_server(main_dbsyncer_loop+0xc9) [0x410f59]
      23233:20111026:155519.685 3: /usr/local/sbin/zabbix_server(MAIN_ZABBIX_ENTRY+0x922) [0x410872]
      23233:20111026:155519.685 2: /usr/local/sbin/zabbix_server(daemon_start+0x235) [0x43b255]
      23233:20111026:155519.685 1: /lib64/libc.so.6(__libc_start_main+0xf4) [0x31d861d994]
      23233:20111026:155519.685 0: /usr/local/sbin/zabbix_server [0x40caf9]
      23233:20111026:155519.685 === Memory map: ===
      23233:20111026:155519.685 00400000-00483000 r-xp 00000000 08:01 3371819 /usr/local/sbin/zabbix_server
      23233:20111026:155519.685 00683000-006a8000 rw-p 00083000 08:01 3371819 /usr/local/sbin/zabbix_server
      23233:20111026:155519.685 006a8000-006af000 rw-p 006a8000 00:00 0
      23233:20111026:155519.685 02617000-02707000 rw-p 02617000 00:00 0 [heap]
      23233:20111026:155519.685 31d8200000-31d821c000 r-xp 00000000 08:01 504 /lib64/ld-2.5.so
      23233:20111026:155519.685 31d841b000-31d841c000 r--p 0001b000 08:01 504 /lib64/ld-2.5.so
      23233:20111026:155519.686 31d841c000-31d841d000 rw-p 0001c000 08:01 504 /lib64/ld-2.5.so
      23233:20111026:155519.686 31d8600000-31d874e000 r-xp 00000000 08:01 505 /lib64/libc-2.5.so
      23233:20111026:155519.686 31d874e000-31d894d000 ---p 0014e000 08:01 505 /lib64/libc-2.5.so
      23233:20111026:155519.686 31d894d000-31d8951000 r--p 0014d000 08:01 505 /lib64/libc-2.5.so
      23233:20111026:155519.686 31d8951000-31d8952000 rw-p 00151000 08:01 505 /lib64/libc-2.5.so
      23233:20111026:155519.686 31d8952000-31d8957000 rw-p 31d8952000 00:00 0
      23233:20111026:155519.686 31d8a00000-31d8a02000 r-xp 00000000 08:01 506 /lib64/libdl-2.5.so
      23233:20111026:155519.686 31d8a02000-31d8c02000 ---p 00002000 08:01 506 /lib64/libdl-2.5.so
      23233:20111026:155519.686 31d8c02000-31d8c03000 r--p 00002000 08:01 506 /lib64/libdl-2.5.so
      23233:20111026:155519.686 31d8c03000-31d8c04000 rw-p 00003000 08:01 506 /lib64/libdl-2.5.so
      23233:20111026:155519.686 31d8e00000-31d8e06000 r-xp 00000000 08:01 17481 /usr/lib64/libgdbm.so.2.0.0
      23233:20111026:155519.686 31d8e06000-31d9005000 ---p 00006000 08:01 17481 /usr/lib64/libgdbm.so.2.0.0
      23233:20111026:155519.686 31d9005000-31d9006000 rw-p 00005000 08:01 17481 /usr/lib64/libgdbm.so.2.0.0
      23233:20111026:155519.686 31d9200000-31d9282000 r-xp 00000000 08:01 228 /lib64/libm-2.5.so
      23233:20111026:155519.686 31d9282000-31d9481000 ---p 00082000 08:01 228 /lib64/libm-2.5.so
      23233:20111026:155519.686 31d9481000-31d9482000 r--p 00081000 08:01 228 /lib64/libm-2.5.so
      23233:20111026:155519.686 31d9482000-31d9483000 rw-p 00082000 08:01 228 /lib64/libm-2.5.so
      23233:20111026:155519.686 31da200000-31da214000 r-xp 00000000 08:01 12434 /usr/lib64/libz.so.1.2.3
      23233:20111026:155519.686 31da214000-31da413000 ---p 00014000 08:01 12434 /usr/lib64/libz.so.1.2.3
      23233:20111026:155519.686 31da413000-31da414000 rw-p 00013000 08:01 12434 /usr/lib64/libz.so.1.2.3
      23233:20111026:155519.686 31da600000-31da603000 r-xp 00000000 08:01 14746 /usr/lib64/libgpg-error.so.0.3.0
      23233:20111026:155519.686 31da603000-31da802000 ---p 00003000 08:01 14746 /usr/lib64/libgpg-error.so.0.3.0
      23233:20111026:155519.686 31da802000-31da803000 rw-p 00002000 08:01 14746 /usr/lib64/libgpg-error.so.0.3.0
      23233:20111026:155519.686 31daa00000-31daa09000 r-xp 00000000 08:01 241 /lib64/libcrypt-2.5.so
      23233:20111026:155519.686 31daa09000-31dac08000 ---p 00009000 08:01 241 /lib64/libcrypt-2.5.so
      23233:20111026:155519.686 31dac08000-31dac09000 r--p 00008000 08:01 241 /lib64/libcrypt-2.5.so
      23233:20111026:155519.686 31dac09000-31dac0a000 rw-p 00009000 08:01 241 /lib64/libcrypt-2.5.so
      23233:20111026:155519.686 31dac0a000-31dac38000 rw-p 31dac0a000 00:00 0
      23233:20111026:155519.686 31dae00000-31dae0d000 r-xp 00000000 08:01 524 /lib64/libgcc_s-4.1.2-20080825.so.1
      23233:20111026:155519.686 31dae0d000-31db00d000 ---p 0000d000 08:01 524 /lib64/libgcc_s-4.1.2-20080825.so.1
      23233:20111026:155519.686 31db00d000-31db00e000 rw-p 0000d000 08:01 524 /lib64/libgcc_s-4.1.2-20080825.so.1
      23233:20111026:155519.686 31db200000-31db211000 r-xp 00000000 08:01 517 /lib64/libresolv-2.5.so
      23233:20111026:155519.686 31db211000-31db411000 ---p 00011000 08:01 517 /lib64/libresolv-2.5.so
      23233:20111026:155519.686 31db411000-31db412000 r--p 00011000 08:01 517 /lib64/libresolv-2.5.so
      23233:20111026:155519.686 31db412000-31db413000 rw-p 00012000 08:01 517 /lib64/libresolv-2.5.so
      23233:20111026:155519.686 31db413000-31db415000 rw-p 31db413000 00:00 0
      23233:20111026:155519.686 31dba00000-31dba02000 r-xp 00000000 08:01 516 /lib64/libkeyutils-1.2.so
      23233:20111026:155519.686 31dba02000-31dbc01000 ---p 00002000 08:01 516 /lib64/libkeyutils-1.2.so
      23233:20111026:155519.686 31dbc01000-31dbc02000 rw-p 00001000 08:01 516 /lib64/libkeyutils-1.2.so
      23233:20111026:155519.686 31dbe00000-31dbe02000 r-xp 00000000 08:01 520 /lib64/libcom_err.so.2.1
      23233:20111026:155519.687 31dbe02000-31dc001000 ---p 00002000 08:01 520 /lib64/libcom_err.so.2.1
      23233:20111026:155519.687 31dc001000-31dc002000 rw-p 00001000 08:01 520 /lib64/libcom_err.so.2.1
      23233:20111026:155519.687 31dce00000-31dce4e000 r-xp 00000000 08:01 15172 /usr/lib64/libncurses.so.5.5
      23233:20111026:155519.687 31dce4e000-31dd04e000 ---p 0004e000 08:01 15172 /usr/lib64/libncurses.so.5.5
      23233:20111026:155519.687 31dd04e000-31dd05c000 rw-p 0004e000 08:01 15172 /usr/lib64/libncurses.so.5.5
      23233:20111026:155519.687 31dd05c000-31dd05d000 rw-p 31dd05c000 00:00 0
      23233:20111026:155519.687 346c400000-346c431000 r-xp 00000000 08:01 15989 /usr/lib64/libidn.so.11.5.19
      23233:20111026:155519.687 346c431000-346c630000 ---p 00031000 08:01 15989 /usr/lib64/libidn.so.11.5.19
      23233:20111026:155519.687 346c630000-346c631000 rw-p 00030000 08:01 15989 /usr/lib64/libidn.so.11.5.19
      23233:20111026:155519.687 346c800000-346c83b000 r-xp 00000000 08:01 15990 /usr/lib64/libcurl.so.3.0.0
      23233:20111026:155519.687 346c83b000-346ca3b000 ---p 0003b000 08:01 15990 /usr/lib64/libcurl.so.3.0.0
      23233:20111026:155519.687 346ca3b000-346ca3d000 rw-p 0003b000 08:01 15990 /usr/lib64/libcurl.so.3.0.0
      23233:20111026:155519.687 36c8c00000-36c8c0c000 r-xp 00000000 08:01 2881069 /usr/lib64/libiksemel.so.3.1.1
      23233:20111026:155519.687 36c8c0c000-36c8e0b000 ---p 0000c000 08:01 2881069 /usr/lib64/libiksemel.so.3.1.1
      23233:20111026:155519.687 36c8e0b000-36c8e0c000 rw-p 0000b000 08:01 2881069 /usr/lib64/libiksemel.so.3.1.1
      23233:20111026:155519.687 36c9000000-36c90e1000 r-xp 00000000 08:01 2881179 /usr/lib64/libOpenIPMI.so.0.0.5
      23233:20111026:155519.687 36c90e1000-36c92e0000 ---p 000e1000 08:01 2881179 /usr/lib64/libOpenIPMI.so.0.0.5
      23233:20111026:155519.687 36c92e0000-36c92fc000 rw-p 000e0000 08:01 2881179 /usr/lib64/libOpenIPMI.so.0.0.5
      23233:20111026:155519.687 36c92fc000-36c9300000 rw-p 36c92fc000 00:00 0
      23233:20111026:155519.687 36c9400000-36c9405000 r-xp 00000000 08:01 2881177 /usr/lib64/libOpenIPMIposix.so.0.0.1
      23233:20111026:155519.687 36c9405000-36c9604000 ---p 00005000 08:01 2881177 /usr/lib64/libOpenIPMIposix.so.0.0.1
      23233:20111026:155519.687 36c9604000-36c9605000 rw-p 00004000 08:01 2881177 /usr/lib64/libOpenIPMIposix.so.0.0.1
      23233:20111026:155519.687 3701400000-3701416000 r-xp 00000000 08:01 6350797 /lib64/libpthread-2.5.so
      23233:20111026:155519.687 3701416000-3701615000 ---p 00016000 08:01 6350797 /lib64/libpthread-2.5.so
      23233:20111026:155519.687 3701615000-3701616000 r--p 00015000 08:01 6350797 /lib64/libpthread-2.5.so
      23233:20111026:155519.687 3701616000-3701617000 rw-p 00016000 08:01 6350797 /lib64/libpthread-2.5.so
      23233:20111026:155519.687 3701617000-370161b000 rw-p 3701617000 00:00 0
      23233:20111026:155519.687 3701800000-370181f000 r-xp 00000000 08:01 2717174 /usr/lib/libpq.so.5.3
      23233:20111026:155519.687 370181f000-3701a1f000 ---p 0001f000 08:01 2717174 /usr/lib/libpq.so.5.3
      23233:20111026:155519.687 3701a1f000-3701a21000 rw-p 0001f000 08:01 2717174 /usr/lib/libpq.so.5.3
      23233:20111026:155519.687 38ef400000-38ef415000 r-xp 00000000 08:01 200 /lib64/libselinux.so.1
      23233:20111026:155519.687 38ef415000-38ef615000 ---p 00015000 08:01 200 /lib64/libselinux.so.1
      23233:20111026:155519.687 38ef615000-38ef617000 rw-p 00015000 08:01 200 /lib64/libselinux.so.1
      23233:20111026:155519.687 38ef617000-38ef618000 rw-p 38ef617000 00:00 0
      23233:20111026:155519.687 38ef800000-38ef83b000 r-xp 00000000 08:01 194 /lib64/libsepol.so.1
      23233:20111026:155519.687 38ef83b000-38efa3b000 ---p 0003b000 08:01 194 /lib64/libsepol.so.1
      23233:20111026:155519.687 38efa3b000-38efa3c000 rw-p 0003b000 08:01 194 /lib64/libsepol.so.1
      23233:20111026:155519.687 38efa3c000-38efa46000 rw-p 38efa3c000 00:00 0
      23233:20111026:155519.687 38efc00000-38efd2d000 r-xp 00000000 08:01 201 /lib64/libcrypto.so.0.9.8e
      23233:20111026:155519.688 38efd2d000-38eff2c000 ---p 0012d000 08:01 201 /lib64/libcrypto.so.0.9.8e
      23233:20111026:155519.688 38eff2c000-38eff4d000 rw-p 0012c000 08:01 201 /lib64/libcrypto.so.0.9.8e
      23233:20111026:155519.688 38eff4d000-38eff51000 rw-p 38eff4d000 00:00 0
      23233:20111026:155519.688 38f0000000-38f0091000 r-xp 00000000 08:01 12372 /usr/lib64/libkrb5.so.3.3
      23233:20111026:155519.688 38f0091000-38f0291000 ---p 00091000 08:01 12372 /usr/lib64/libkrb5.so.3.3
      23233:20111026:155519.688 38f0291000-38f0295000 rw-p 00091000 08:01 12372 /usr/lib64/libkrb5.so.3.3
      23233:20111026:155519.688 38f0400000-38f042c000 r-xp 00000000 08:01 12422 /usr/lib64/libgssapi_krb5.so.2.2
      23233:20111026:155519.688 38f042c000-38f062c000 ---p 0002c000 08:01 12422 /usr/lib64/libgssapi_krb5.so.2.2
      23233:20111026:155519.688 38f062c000-38f062e000 rw-p 0002c000 08:01 12422 /usr/lib64/libgssapi_krb5.so.2.2
      23233:20111026:155519.688 38f0800000-38f0846000 r-xp 00000000 08:01 204 /lib64/libssl.so.0.9.8e
      23233:20111026:155519.688 38f0846000-38f0a46000 ---p 00046000 08:01 204 /lib64/libssl.so.0.9.8e
      23233:20111026:155519.688 38f0a46000-38f0a4c000 rw-p 00046000 08:01 204 /lib64/libssl.so.0.9.8e
      23233:20111026:155519.688 38f0c00000-38f0c24000 r-xp 00000000 08:01 12311 /usr/lib64/libk5crypto.so.3.1
      23233:20111026:155519.688 38f0c24000-38f0e23000 ---p 00024000 08:01 12311 /usr/lib64/libk5crypto.so.3.1
      23233:20111026:155519.688 38f0e23000-38f0e25000 rw-p 00023000 08:01 12311 /usr/lib64/libk5crypto.so.3.1
      23233:20111026:155519.688 38f1000000-38f1008000 r-xp 00000000 08:01 9479 /usr/lib64/libkrb5support.so.0.1
      23233:20111026:155519.688 38f1008000-38f1207000 ---p 00008000 08:01 9479 /usr/lib64/libkrb5support.so.0.1
      23233:20111026:155519.688 38f1207000-38f1208000 rw-p 00007000 08:01 9479 /usr/lib64/libkrb5support.so.0.1
      23233:20111026:155519.688 3c81000000-3c8106f000 r-xp 00000000 08:01 2880910 /usr/lib64/libgcrypt.so.11.5.2
      23233:20111026:155519.688 3c8106f000-3c8126e000 ---p 0006f000 08:01 2880910 /usr/lib64/libgcrypt.so.11.5.2
      23233:20111026:155519.688 3c8126e000-3c81272000 rw-p 0006e000 08:01 2880910 /usr/lib64/libgcrypt.so.11.5.2
      23233:20111026:155519.688 3e85a00000-3e85a90000 r-xp 00000000 08:01 2880841 /usr/lib64/libnetsnmp.so.10.0.3
      23233:20111026:155519.688 3e85a90000-3e85c90000 ---p 00090000 08:01 2880841 /usr/lib64/libnetsnmp.so.10.0.3
      23233:20111026:155519.688 3e85c90000-3e85c94000 rw-p 00090000 08:01 2880841 /usr/lib64/libnetsnmp.so.10.0.3
      23233:20111026:155519.688 3e85c94000-3e85cc8000 rw-p 3e85c94000 00:00 0
      23233:20111026:155519.688 2b668c9d3000-2b668c9d5000 rw-p 2b668c9d3000 00:00 0
      23233:20111026:155519.688 2b668c9e6000-2b668c9eb000 rw-p 2b668c9e6000 00:00 0
      23233:20111026:155519.688 2b668c9eb000-2b668c9f3000 r-xp 00000000 08:01 488 /lib64/libwrap.so.0.7.6
      23233:20111026:155519.688 2b668c9f3000-2b668cbf2000 ---p 00008000 08:01 488 /lib64/libwrap.so.0.7.6
      23233:20111026:155519.688 2b668cbf2000-2b668cbf4000 rw-p 00007000 08:01 488 /lib64/libwrap.so.0.7.6
      23233:20111026:155519.688 2b668cbf4000-2b668cbf8000 rw-p 2b668cbf4000 00:00 0
      23233:20111026:155519.688 2b668cbf8000-2b668cc0d000 r-xp 00000000 08:01 512 /lib64/libnsl-2.5.so
      23233:20111026:155519.688 2b668cc0d000-2b668ce0c000 ---p 00015000 08:01 512 /lib64/libnsl-2.5.so
      23233:20111026:155519.688 2b668ce0c000-2b668ce0d000 r--p 00014000 08:01 512 /lib64/libnsl-2.5.so
      23233:20111026:155519.688 2b668ce0d000-2b668ce0e000 rw-p 00015000 08:01 512 /lib64/libnsl-2.5.so
      23233:20111026:155519.688 2b668ce0e000-2b668ce10000 rw-p 2b668ce0e000 00:00 0
      23233:20111026:155519.688 2b668ce10000-2b668ce17000 r-xp 00000000 08:01 2881176 /usr/lib64/libOpenIPMIutils.so.0.0.1
      23233:20111026:155519.688 2b668ce17000-2b668d016000 ---p 00007000 08:01 2881176 /usr/lib64/libOpenIPMIutils.so.0.0.1
      23233:20111026:155519.688 2b668d016000-2b668d017000 rw-p 00006000 08:01 2881176 /usr/lib64/libOpenIPMIutils.so.0.0.1
      23233:20111026:155519.688 2b668d017000-2b668d01b000 rw-p 2b668d017000 00:00 0
      23233:20111026:155519.688 2b668d01b000-2b668d025000 r-xp 00000000 08:01 216 /lib64/libnss_files-2.5.so
      23233:20111026:155519.688 2b668d025000-2b668d224000 ---p 0000a000 08:01 216 /lib64/libnss_files-2.5.so
      23233:20111026:155519.688 2b668d224000-2b668d225000 r--p 00009000 08:01 216 /lib64/libnss_files-2.5.so
      23233:20111026:155519.688 2b668d225000-2b668d226000 rw-p 0000a000 08:01 216 /lib64/libnss_files-2.5.so
      23233:20111026:155519.688 2b668d226000-2b669364e000 rw-s 00000000 00:09 3440645 /SYSV6801d979 (deleted)
      23233:20111026:155519.688 2b669364e000-2b669404f000 rw-s 00000000 00:09 3473414 /SYSV7801d979 (deleted)
      23233:20111026:155519.688 2b669404f000-2b6694a50000 rw-s 00000000 00:09 3506183 /SYSV7401d979 (deleted)
      23233:20111026:155519.689 2b6694a50000-2b66a23ea000 rw-s 00000000 00:09 3538952 /SYSV6701d979 (deleted)
      23233:20111026:155519.689 2b66a23ea000-2b66a4a51000 rw-s 00000000 00:09 3571721 /SYSV7301d979 (deleted)
      23233:20111026:155519.689 2b66a4a51000-2b66a4a57000 rw-s 00000000 00:09 3604491 /SYSV5301d979 (deleted)
      23233:20111026:155519.689 2b66a4a57000-2b66a4a58000 rw-p 2b66a4a57000 00:00 0
      23233:20111026:155519.689 7fff78c80000-7fff78ca5000 rw-p 7ffffffda000 00:00 0 [stack]
      23233:20111026:155519.689 ffffffffff600000-ffffffffffe00000 ---p 00000000 00:00 0 [vdso]
      23233:20111026:155519.689 ================================
      23233:20111026:155519.689 Please consider attaching a disassembly listing to your bug report.
      23233:20111026:155519.689 This listing can be produced with, e.g., objdump -D -S zabbix_server.
      23233:20111026:155519.689 ================================
      23105:20111026:155519.729 One child process died (PID:23233,exitcode/signal:255). Exiting ...
      23105:20111026:155521.974 Syncing history data...
      23105:20111026:155626.070 Got signal [signal:11(SIGSEGV),reason:128,refaddr:(nil)]. Crashing ...
      23105:20111026:155626.070 ====== Fatal information: ======
      23105:20111026:155626.070 Program counter: 0x43a79b
      23105:20111026:155626.070 === Registers: ===
      23105:20111026:155626.070 r8 = 0 = 0 = 0
      23105:20111026:155626.070 r9 = 0 = 0 = 0
      23105:20111026:155626.070 r10 = 37 = 55 = 55
      23105:20111026:155626.070 r11 = 206 = 518 = 518
      23105:20111026:155626.070 r12 = 2b668d226160 = 47719454499168 = 47719454499168
      23105:20111026:155626.070 r13 = 7fff78ca3130 = 140735219904816 = 140735219904816
      23105:20111026:155626.070 r14 = 4 = 4 = 4
      23105:20111026:155626.070 r15 = 4ea7e830 = 1319626800 = 1319626800
      23105:20111026:155626.070 rdi = 7fff78ca3130 = 140735219904816 = 140735219904816
      23105:20111026:155626.070 rsi = 8 = 8 = 8
      23105:20111026:155626.070 rbp = aa630766 = 2858616678 = 2858616678
      23105:20111026:155626.071 rbx = 494f502050552020 = 5282528987645812768 = 5282528987645812768
      23105:20111026:155626.071 rdx = 3bd7 = 15319 = 15319
      23105:20111026:155626.071 rax = 2b669419cba8 = 47719571377064 = 47719571377064
      23105:20111026:155626.071 rcx = 43221c3 = 70394307 = 70394307
      23105:20111026:155626.071 rsp = 7fff78ca2f50 = 140735219904336 = 140735219904336
      23105:20111026:155626.071 rip = 43a79b = 4433819 = 4433819
      23105:20111026:155626.071 efl = 10202 = 66050 = 66050
      23105:20111026:155626.071 csgsfs = 33 = 51 = 51
      23105:20111026:155626.071 err = 0 = 0 = 0
      23105:20111026:155626.071 trapno = d = 13 = 13
      23105:20111026:155626.071 oldmask = 10000 = 65536 = 65536
      23105:20111026:155626.071 cr2 = 0 = 0 = 0
      23105:20111026:155626.071 === Backtrace: ===
      23105:20111026:155626.085 12: /usr/local/sbin/zabbix_server(print_fatal_info+0xcd) [0x43bdad]
      23105:20111026:155626.085 11: /usr/local/sbin/zabbix_server [0x43b5e8]
      23105:20111026:155626.085 10: /lib64/libc.so.6 [0x31d86302d0]
      23105:20111026:155626.085 9: /usr/local/sbin/zabbix_server(zbx_hashset_search+0x3b) [0x43a79b]
      23105:20111026:155626.086 8: /usr/local/sbin/zabbix_server(DCsync_history+0xcfe) [0x43302e]
      23105:20111026:155626.086 7: /usr/local/sbin/zabbix_server(free_database_cache+0x47) [0x433a57]
      23105:20111026:155626.086 6: /usr/local/sbin/zabbix_server(zbx_on_exit+0xe2) [0x40fb82]
      23105:20111026:155626.086 5: /lib64/libc.so.6 [0x31d86302d0]
      23105:20111026:155626.086 4: /lib64/libc.so.6(wait+0x24) [0x31d8699f24]
      23105:20111026:155626.086 3: /usr/local/sbin/zabbix_server(MAIN_ZABBIX_ENTRY+0x448) [0x410398]
      23105:20111026:155626.086 2: /usr/local/sbin/zabbix_server(daemon_start+0x235) [0x43b255]
      23105:20111026:155626.086 1: /lib64/libc.so.6(__libc_start_main+0xf4) [0x31d861d994]
      23105:20111026:155626.086 0: /usr/local/sbin/zabbix_server [0x40caf9]
      23105:20111026:155626.086 === Memory map: ===
      23105:20111026:155626.086 00400000-00483000 r-xp 00000000 08:01 3371819 /usr/local/sbin/zabbix_server
      23105:20111026:155626.086 00683000-006a8000 rw-p 00083000 08:01 3371819 /usr/local/sbin/zabbix_server
      23105:20111026:155626.086 006a8000-006af000 rw-p 006a8000 00:00 0
      23105:20111026:155626.086 02617000-0271a000 rw-p 02617000 00:00 0 [heap]
      23105:20111026:155626.086 31d8200000-31d821c000 r-xp 00000000 08:01 504 /lib64/ld-2.5.so
      23105:20111026:155626.086 31d841b000-31d841c000 r--p 0001b000 08:01 504 /lib64/ld-2.5.so
      23105:20111026:155626.086 31d841c000-31d841d000 rw-p 0001c000 08:01 504 /lib64/ld-2.5.so
      23105:20111026:155626.086 31d8600000-31d874e000 r-xp 00000000 08:01 505 /lib64/libc-2.5.so
      23105:20111026:155626.086 31d874e000-31d894d000 ---p 0014e000 08:01 505 /lib64/libc-2.5.so
      23105:20111026:155626.086 31d894d000-31d8951000 r--p 0014d000 08:01 505 /lib64/libc-2.5.so
      23105:20111026:155626.086 31d8951000-31d8952000 rw-p 00151000 08:01 505 /lib64/libc-2.5.so
      23105:20111026:155626.086 31d8952000-31d8957000 rw-p 31d8952000 00:00 0
      23105:20111026:155626.086 31d8a00000-31d8a02000 r-xp 00000000 08:01 506 /lib64/libdl-2.5.so
      23105:20111026:155626.086 31d8a02000-31d8c02000 ---p 00002000 08:01 506 /lib64/libdl-2.5.so
      23105:20111026:155626.086 31d8c02000-31d8c03000 r--p 00002000 08:01 506 /lib64/libdl-2.5.so
      23105:20111026:155626.086 31d8c03000-31d8c04000 rw-p 00003000 08:01 506 /lib64/libdl-2.5.so
      23105:20111026:155626.086 31d8e00000-31d8e06000 r-xp 00000000 08:01 17481 /usr/lib64/libgdbm.so.2.0.0
      23105:20111026:155626.086 31d8e06000-31d9005000 ---p 00006000 08:01 17481 /usr/lib64/libgdbm.so.2.0.0
      23105:20111026:155626.086 31d9005000-31d9006000 rw-p 00005000 08:01 17481 /usr/lib64/libgdbm.so.2.0.0
      23105:20111026:155626.086 31d9200000-31d9282000 r-xp 00000000 08:01 228 /lib64/libm-2.5.so
      23105:20111026:155626.086 31d9282000-31d9481000 ---p 00082000 08:01 228 /lib64/libm-2.5.so
      23105:20111026:155626.086 31d9481000-31d9482000 r--p 00081000 08:01 228 /lib64/libm-2.5.so
      23105:20111026:155626.086 31d9482000-31d9483000 rw-p 00082000 08:01 228 /lib64/libm-2.5.so
      23105:20111026:155626.086 31da200000-31da214000 r-xp 00000000 08:01 12434 /usr/lib64/libz.so.1.2.3
      23105:20111026:155626.087 31da214000-31da413000 ---p 00014000 08:01 12434 /usr/lib64/libz.so.1.2.3
      23105:20111026:155626.087 31da413000-31da414000 rw-p 00013000 08:01 12434 /usr/lib64/libz.so.1.2.3
      23105:20111026:155626.087 31da600000-31da603000 r-xp 00000000 08:01 14746 /usr/lib64/libgpg-error.so.0.3.0
      23105:20111026:155626.087 31da603000-31da802000 ---p 00003000 08:01 14746 /usr/lib64/libgpg-error.so.0.3.0
      23105:20111026:155626.087 31da802000-31da803000 rw-p 00002000 08:01 14746 /usr/lib64/libgpg-error.so.0.3.0
      23105:20111026:155626.087 31daa00000-31daa09000 r-xp 00000000 08:01 241 /lib64/libcrypt-2.5.so
      23105:20111026:155626.087 31daa09000-31dac08000 ---p 00009000 08:01 241 /lib64/libcrypt-2.5.so
      23105:20111026:155626.087 31dac08000-31dac09000 r--p 00008000 08:01 241 /lib64/libcrypt-2.5.so
      23105:20111026:155626.087 31dac09000-31dac0a000 rw-p 00009000 08:01 241 /lib64/libcrypt-2.5.so
      23105:20111026:155626.087 31dac0a000-31dac38000 rw-p 31dac0a000 00:00 0
      23105:20111026:155626.087 31dae00000-31dae0d000 r-xp 00000000 08:01 524 /lib64/libgcc_s-4.1.2-20080825.so.1
      23105:20111026:155626.087 31dae0d000-31db00d000 ---p 0000d000 08:01 524 /lib64/libgcc_s-4.1.2-20080825.so.1
      23105:20111026:155626.087 31db00d000-31db00e000 rw-p 0000d000 08:01 524 /lib64/libgcc_s-4.1.2-20080825.so.1
      23105:20111026:155626.087 31db200000-31db211000 r-xp 00000000 08:01 517 /lib64/libresolv-2.5.so
      23105:20111026:155626.087 31db211000-31db411000 ---p 00011000 08:01 517 /lib64/libresolv-2.5.so
      23105:20111026:155626.087 31db411000-31db412000 r--p 00011000 08:01 517 /lib64/libresolv-2.5.so
      23105:20111026:155626.087 31db412000-31db413000 rw-p 00012000 08:01 517 /lib64/libresolv-2.5.so
      23105:20111026:155626.087 31db413000-31db415000 rw-p 31db413000 00:00 0
      23105:20111026:155626.087 31dba00000-31dba02000 r-xp 00000000 08:01 516 /lib64/libkeyutils-1.2.so
      23105:20111026:155626.087 31dba02000-31dbc01000 ---p 00002000 08:01 516 /lib64/libkeyutils-1.2.so
      23105:20111026:155626.087 31dbc01000-31dbc02000 rw-p 00001000 08:01 516 /lib64/libkeyutils-1.2.so
      23105:20111026:155626.087 31dbe00000-31dbe02000 r-xp 00000000 08:01 520 /lib64/libcom_err.so.2.1
      23105:20111026:155626.087 31dbe02000-31dc001000 ---p 00002000 08:01 520 /lib64/libcom_err.so.2.1
      23105:20111026:155626.087 31dc001000-31dc002000 rw-p 00001000 08:01 520 /lib64/libcom_err.so.2.1
      23105:20111026:155626.087 31dce00000-31dce4e000 r-xp 00000000 08:01 15172 /usr/lib64/libncurses.so.5.5
      23105:20111026:155626.087 31dce4e000-31dd04e000 ---p 0004e000 08:01 15172 /usr/lib64/libncurses.so.5.5
      23105:20111026:155626.087 31dd04e000-31dd05c000 rw-p 0004e000 08:01 15172 /usr/lib64/libncurses.so.5.5
      23105:20111026:155626.087 31dd05c000-31dd05d000 rw-p 31dd05c000 00:00 0
      23105:20111026:155626.087 346c400000-346c431000 r-xp 00000000 08:01 15989 /usr/lib64/libidn.so.11.5.19
      23105:20111026:155626.087 346c431000-346c630000 ---p 00031000 08:01 15989 /usr/lib64/libidn.so.11.5.19
      23105:20111026:155626.087 346c630000-346c631000 rw-p 00030000 08:01 15989 /usr/lib64/libidn.so.11.5.19
      23105:20111026:155626.087 346c800000-346c83b000 r-xp 00000000 08:01 15990 /usr/lib64/libcurl.so.3.0.0
      23105:20111026:155626.087 346c83b000-346ca3b000 ---p 0003b000 08:01 15990 /usr/lib64/libcurl.so.3.0.0
      23105:20111026:155626.087 346ca3b000-346ca3d000 rw-p 0003b000 08:01 15990 /usr/lib64/libcurl.so.3.0.0
      23105:20111026:155626.087 36c8c00000-36c8c0c000 r-xp 00000000 08:01 2881069 /usr/lib64/libiksemel.so.3.1.1
      23105:20111026:155626.087 36c8c0c000-36c8e0b000 ---p 0000c000 08:01 2881069 /usr/lib64/libiksemel.so.3.1.1
      23105:20111026:155626.088 36c8e0b000-36c8e0c000 rw-p 0000b000 08:01 2881069 /usr/lib64/libiksemel.so.3.1.1
      23105:20111026:155626.088 36c9000000-36c90e1000 r-xp 00000000 08:01 2881179 /usr/lib64/libOpenIPMI.so.0.0.5
      23105:20111026:155626.088 36c90e1000-36c92e0000 ---p 000e1000 08:01 2881179 /usr/lib64/libOpenIPMI.so.0.0.5
      23105:20111026:155626.088 36c92e0000-36c92fc000 rw-p 000e0000 08:01 2881179 /usr/lib64/libOpenIPMI.so.0.0.5
      23105:20111026:155626.088 36c92fc000-36c9300000 rw-p 36c92fc000 00:00 0
      23105:20111026:155626.088 36c9400000-36c9405000 r-xp 00000000 08:01 2881177 /usr/lib64/libOpenIPMIposix.so.0.0.1
      23105:20111026:155626.088 36c9405000-36c9604000 ---p 00005000 08:01 2881177 /usr/lib64/libOpenIPMIposix.so.0.0.1
      23105:20111026:155626.088 36c9604000-36c9605000 rw-p 00004000 08:01 2881177 /usr/lib64/libOpenIPMIposix.so.0.0.1
      23105:20111026:155626.088 3701400000-3701416000 r-xp 00000000 08:01 6350797 /lib64/libpthread-2.5.so
      23105:20111026:155626.088 3701416000-3701615000 ---p 00016000 08:01 6350797 /lib64/libpthread-2.5.so
      23105:20111026:155626.088 3701615000-3701616000 r--p 00015000 08:01 6350797 /lib64/libpthread-2.5.so
      23105:20111026:155626.088 3701616000-3701617000 rw-p 00016000 08:01 6350797 /lib64/libpthread-2.5.so
      23105:20111026:155626.088 3701617000-370161b000 rw-p 3701617000 00:00 0
      23105:20111026:155626.088 3701800000-370181f000 r-xp 00000000 08:01 2717174 /usr/lib/libpq.so.5.3
      23105:20111026:155626.088 370181f000-3701a1f000 ---p 0001f000 08:01 2717174 /usr/lib/libpq.so.5.3
      23105:20111026:155626.088 3701a1f000-3701a21000 rw-p 0001f000 08:01 2717174 /usr/lib/libpq.so.5.3
      23105:20111026:155626.088 38ef400000-38ef415000 r-xp 00000000 08:01 200 /lib64/libselinux.so.1
      23105:20111026:155626.088 38ef415000-38ef615000 ---p 00015000 08:01 200 /lib64/libselinux.so.1
      23105:20111026:155626.088 38ef615000-38ef617000 rw-p 00015000 08:01 200 /lib64/libselinux.so.1
      23105:20111026:155626.088 38ef617000-38ef618000 rw-p 38ef617000 00:00 0
      23105:20111026:155626.088 38ef800000-38ef83b000 r-xp 00000000 08:01 194 /lib64/libsepol.so.1
      23105:20111026:155626.088 38ef83b000-38efa3b000 ---p 0003b000 08:01 194 /lib64/libsepol.so.1
      23105:20111026:155626.088 38efa3b000-38efa3c000 rw-p 0003b000 08:01 194 /lib64/libsepol.so.1
      23105:20111026:155626.088 38efa3c000-38efa46000 rw-p 38efa3c000 00:00 0
      23105:20111026:155626.088 38efc00000-38efd2d000 r-xp 00000000 08:01 201 /lib64/libcrypto.so.0.9.8e
      23105:20111026:155626.088 38efd2d000-38eff2c000 ---p 0012d000 08:01 201 /lib64/libcrypto.so.0.9.8e
      23105:20111026:155626.088 38eff2c000-38eff4d000 rw-p 0012c000 08:01 201 /lib64/libcrypto.so.0.9.8e
      23105:20111026:155626.088 38eff4d000-38eff51000 rw-p 38eff4d000 00:00 0
      23105:20111026:155626.088 38f0000000-38f0091000 r-xp 00000000 08:01 12372 /usr/lib64/libkrb5.so.3.3
      23105:20111026:155626.088 38f0091000-38f0291000 ---p 00091000 08:01 12372 /usr/lib64/libkrb5.so.3.3
      23105:20111026:155626.088 38f0291000-38f0295000 rw-p 00091000 08:01 12372 /usr/lib64/libkrb5.so.3.3
      23105:20111026:155626.088 38f0400000-38f042c000 r-xp 00000000 08:01 12422 /usr/lib64/libgssapi_krb5.so.2.2
      23105:20111026:155626.088 38f042c000-38f062c000 ---p 0002c000 08:01 12422 /usr/lib64/libgssapi_krb5.so.2.2
      23105:20111026:155626.088 38f062c000-38f062e000 rw-p 0002c000 08:01 12422 /usr/lib64/libgssapi_krb5.so.2.2
      23105:20111026:155626.088 38f0800000-38f0846000 r-xp 00000000 08:01 204 /lib64/libssl.so.0.9.8e
      23105:20111026:155626.088 38f0846000-38f0a46000 ---p 00046000 08:01 204 /lib64/libssl.so.0.9.8e
      23105:20111026:155626.089 38f0a46000-38f0a4c000 rw-p 00046000 08:01 204 /lib64/libssl.so.0.9.8e
      23105:20111026:155626.089 38f0c00000-38f0c24000 r-xp 00000000 08:01 12311 /usr/lib64/libk5crypto.so.3.1
      23105:20111026:155626.089 38f0c24000-38f0e23000 ---p 00024000 08:01 12311 /usr/lib64/libk5crypto.so.3.1
      23105:20111026:155626.089 38f0e23000-38f0e25000 rw-p 00023000 08:01 12311 /usr/lib64/libk5crypto.so.3.1
      23105:20111026:155626.089 38f1000000-38f1008000 r-xp 00000000 08:01 9479 /usr/lib64/libkrb5support.so.0.1
      23105:20111026:155626.089 38f1008000-38f1207000 ---p 00008000 08:01 9479 /usr/lib64/libkrb5support.so.0.1
      23105:20111026:155626.089 38f1207000-38f1208000 rw-p 00007000 08:01 9479 /usr/lib64/libkrb5support.so.0.1
      23105:20111026:155626.089 3c81000000-3c8106f000 r-xp 00000000 08:01 2880910 /usr/lib64/libgcrypt.so.11.5.2
      23105:20111026:155626.089 3c8106f000-3c8126e000 ---p 0006f000 08:01 2880910 /usr/lib64/libgcrypt.so.11.5.2
      23105:20111026:155626.089 3c8126e000-3c81272000 rw-p 0006e000 08:01 2880910 /usr/lib64/libgcrypt.so.11.5.2
      23105:20111026:155626.089 3e85a00000-3e85a90000 r-xp 00000000 08:01 2880841 /usr/lib64/libnetsnmp.so.10.0.3
      23105:20111026:155626.089 3e85a90000-3e85c90000 ---p 00090000 08:01 2880841 /usr/lib64/libnetsnmp.so.10.0.3
      23105:20111026:155626.089 3e85c90000-3e85c94000 rw-p 00090000 08:01 2880841 /usr/lib64/libnetsnmp.so.10.0.3
      23105:20111026:155626.089 3e85c94000-3e85cc8000 rw-p 3e85c94000 00:00 0
      23105:20111026:155626.089 2b668c9d3000-2b668c9d5000 rw-p 2b668c9d3000 00:00 0
      23105:20111026:155626.089 2b668c9e6000-2b668c9eb000 rw-p 2b668c9e6000 00:00 0
      23105:20111026:155626.089 2b668c9eb000-2b668c9f3000 r-xp 00000000 08:01 488 /lib64/libwrap.so.0.7.6
      23105:20111026:155626.089 2b668c9f3000-2b668cbf2000 ---p 00008000 08:01 488 /lib64/libwrap.so.0.7.6
      23105:20111026:155626.089 2b668cbf2000-2b668cbf4000 rw-p 00007000 08:01 488 /lib64/libwrap.so.0.7.6
      23105:20111026:155626.089 2b668cbf4000-2b668cbf8000 rw-p 2b668cbf4000 00:00 0
      23105:20111026:155626.089 2b668cbf8000-2b668cc0d000 r-xp 00000000 08:01 512 /lib64/libnsl-2.5.so
      23105:20111026:155626.089 2b668cc0d000-2b668ce0c000 ---p 00015000 08:01 512 /lib64/libnsl-2.5.so
      23105:20111026:155626.089 2b668ce0c000-2b668ce0d000 r--p 00014000 08:01 512 /lib64/libnsl-2.5.so
      23105:20111026:155626.089 2b668ce0d000-2b668ce0e000 rw-p 00015000 08:01 512 /lib64/libnsl-2.5.so
      23105:20111026:155626.089 2b668ce0e000-2b668ce10000 rw-p 2b668ce0e000 00:00 0
      23105:20111026:155626.089 2b668ce10000-2b668ce17000 r-xp 00000000 08:01 2881176 /usr/lib64/libOpenIPMIutils.so.0.0.1
      23105:20111026:155626.089 2b668ce17000-2b668d016000 ---p 00007000 08:01 2881176 /usr/lib64/libOpenIPMIutils.so.0.0.1
      23105:20111026:155626.089 2b668d016000-2b668d017000 rw-p 00006000 08:01 2881176 /usr/lib64/libOpenIPMIutils.so.0.0.1
      23105:20111026:155626.089 2b668d017000-2b668d01b000 rw-p 2b668d017000 00:00 0
      23105:20111026:155626.089 2b668d01b000-2b668d025000 r-xp 00000000 08:01 216 /lib64/libnss_files-2.5.so
      23105:20111026:155626.089 2b668d025000-2b668d224000 ---p 0000a000 08:01 216 /lib64/libnss_files-2.5.so
      23105:20111026:155626.089 2b668d224000-2b668d225000 r--p 00009000 08:01 216 /lib64/libnss_files-2.5.so
      23105:20111026:155626.089 2b668d225000-2b668d226000 rw-p 0000a000 08:01 216 /lib64/libnss_files-2.5.so
      23105:20111026:155626.089 2b668d226000-2b669364e000 rw-s 00000000 00:09 3440645 /SYSV6801d979 (deleted)
      23105:20111026:155626.089 2b669364e000-2b669404f000 rw-s 00000000 00:09 3473414 /SYSV7801d979 (deleted)
      23105:20111026:155626.089 2b669404f000-2b6694a50000 rw-s 00000000 00:09 3506183 /SYSV7401d979 (deleted)
      23105:20111026:155626.089 2b6694a50000-2b66a23ea000 rw-s 00000000 00:09 3538952 /SYSV6701d979 (deleted)
      23105:20111026:155626.089 2b66a23ea000-2b66a4a51000 rw-s 00000000 00:09 3571721 /SYSV7301d979 (deleted)
      23105:20111026:155626.089 2b66a4a51000-2b66a4a57000 rw-s 00000000 00:09 3604491 /SYSV5301d979 (deleted)
      23105:20111026:155626.089 7fff78c8f000-7fff78ca5000 rw-p 7ffffffe9000 00:00 0 [stack]
      23105:20111026:155626.090 ffffffffff600000-ffffffffffe00000 ---p 00000000 00:00 0 [vdso]
      23105:20111026:155626.090 ================================
      23105:20111026:155626.090 Please consider attaching a disassembly listing to your bug report.
      23105:20111026:155626.090 This listing can be produced with, e.g., objdump -D -S zabbix_server.
      23105:20111026:155626.090 ================================
      RX bytes:15577 (15.2 Kb) TX bytes:23007 (22.4 Kb)

      Attachments

        1. objdump.tar.bz
          4.74 MB
        2. objdump2.tar.bz
          4.64 MB

        Activity

          People

            Unassigned Unassigned
            nightwitch Nata Semenova
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: