[ZBXNEXT-6377] Adding FreeBSD jail name/id for proc.num item Created: 2020 Dec 01  Updated: 2022 Nov 04

Status: Open
Project: ZABBIX FEATURE REQUESTS
Component/s: Agent (G)
Affects Version/s: 5.0.5, 5.2.1
Fix Version/s: None

Type: Change Request Priority: Medium
Reporter: Vyacheslav Terekhov Assignee: Vladislavs Sokurenko
Resolution: Unresolved Votes: 0
Labels: agent, freebsd, items, patch, proc.num
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD 8.0+, zabbix_agent 5.0+


Attachments: Text File proc.c.patch    
Issue Links:
Sub-task
part of ZBXNEXT-1711 New key for discovery rule / LLD to c... Closed

 Description   

The proc.c patch adds FreeBSD 8.0+ jail [1] support for the proc.num[] item.

The item takes a fifth parameter as a jail ID or name.

  • If the parameter is empty, information about all processes on the server is returned.
  • If the parameter contains the name or ID of an existing jail, information about processes inside the jail is returned.
  • If the parameter contains 0, information about processes on the host is returned only, processes inside jails are ignored.

This behavior corresponds to the ps (-J option) [2] and sockstat (-j option) [3] utilities.

This patch requires the libjail [4] library, which was introduced in FreeBSD 8.0, so I added a patch to configure.ac that checks for the libjail library. If the library is not found, the fifth parameter of the proc.num[] item is ignored.
 

[1] https://www.freebsd.org/doc/handbook/jails.html

[2] https://www.freebsd.org/cgi/man.cgi?ps(1)

[3] https://www.freebsd.org/cgi/man.cgi?sockstat(1)

[4] https://www.freebsd.org/cgi/man.cgi?jail_getid(3)



 Comments   
Comment by Vyacheslav Terekhov [ 2022 Jun 09 ]

I updated the patch for proc.c from zabbix-6.2.0rc1. Changes:

  • added fix for building on FreeBSD from 5.0 to 9.0 (tested on FreeBSD 7.4). More details in my comment.
  • proc.mem item: added a sixth parameter that accepts a jail name or jail id. For FreeBSD prior to 8.0, this option is ignored.
  • proc.get item: for each process (mode=process/thread) the "jname" field is displayed, which contains the name of the jail (if the process is running inside the jail) or left blank (if the process is running on the host system). For FreeBSD prior to version 8.0, this field is always blank, which may require additional preprocessing rules for such systems. The alternative ways to populate the "jname" field for FreeBSD prior to 8.0 (use "-1" aka "not supported", or the value of the "jid" field) I found more difficult to automate.
Comment by Vyacheslav Terekhov [ 2022 Sep 08 ]

Starting with zabbix-6.2.2 (ZBXNEXT-1711), configure checks for the presence of the libjail library, so the patch-configure.ac is no longer needed.

I updated the patch for proc.c from zabbix-6.2.2. The patch adds a fifth parameter for proc.num and a sixth parameter for proc.mem, where you can pass jail name or jail id:

  • an empty value will return information about all processes;
  • a value of 0 will return information about the processes in the host;
  • a numeric value will return information about the processes in the jail with the specified id;
  • if the agent is compiled without libjail: the text value of the parameter will return an error;
  • if the agent is compiled with libjail: the text value of the parameter will return information about the processes in the jail with the specified name.

If the agent is compiled on FreeBSD < 5.0 - the parameter is ignored.

Comment by Vyacheslav Terekhov [ 2022 Nov 04 ]

This is the final patch for src/libs/zbxsysinfo/freebsd/proc.c (I hope) for zabbix 6.2.4: proc.c.patch.
This patch leaves full compatibility with existing checks in templates, adding the ability to get extended information about processes.

The patch adds a fifth parameter for proc.num[] and a sixth parameter for proc.mem[], where you can pass jail name or jail id:

  • an empty value will return information about all processes (running both in jails and on the host);
  • a value of 0 will return information about the processes in the host;
  • a numeric value will return information about the processes in the jail with the specified id;
  • if the agent is compiled without libjail: the text value of the parameter will return an error;
  • if the agent is compiled with libjail: the text value of the parameter will return information about the processes in the jail with the specified name;
  • if the agent is compiled on FreeBSD < 5.0, an empty value or 0 can be passed to get information about processes only from the host, because jails are not supported.

Also, the code is formatted in accordance with the "C coding guidelines".
I haven't been able to test the agent on FreeBSD < 7.0, but on 7.4, 8.3, 9.0 and 12.3 the agent works predictably.





[ZBXNEXT-3110] Updated freebsd RC script from zabbix agent Created: 2016 Jan 22  Updated: 2016 Jan 25

Status: Open
Project: ZABBIX FEATURE REQUESTS
Component/s: Agent (G)
Affects Version/s: 2.4.7
Fix Version/s: None

Type: Change Request Priority: Trivial
Reporter: chris scott Assignee: Unassigned
Resolution: Unresolved Votes: 0
Labels: freebsd, init.d, rc.d, startup
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

freebsd systems


Attachments: File zabbix_freebsd_rcd.tgz    

 Description   

Two issues

1. Currently the freebsd rc.d script to start the agent has the config file hardwired in. This is not ideal as when you are managing a heterogeneous enviroment you have to remember where the config file its stored on that particular OS. It would be nice to have a fixed location common to all unix OS's. eg /opt/zabbix/etc/agentd.conf or similar. There is no way to do this on freebsd without hacking the startup script. Linux you can through /etc/sysconfig

2. There is no ability to run a pre script before the agent is started. On RHEL linux you can do this easily with the /etc/sysconfig stuff. It is useful to be able to this as you can standardize the format of things like hostname or programatically determine things like bind interfaces. Therefore please considers the following replacement to the freebsd rc.d script.

Default operation shouldn't be altered. However if you define

#!/bin/sh

# PROVIDE: zabbix_agentd
# REQUIRE: DAEMON
# KEYWORD: shutdown
#
# Add the following lines to /etc/rc.conf.local or /etc/rc.conf to
# enable zabbix_agentd:
#
# zabbix_agentd_enable (bool): Set to NO by default.  Set it to YES to
#         enable zabbix_agentd.
#


. /etc/rc.subr

name="zabbix_agentd"
rcvar=zabbix_agentd_enable
start_precmd="zabbix_precmd"
required_files="/usr/local/etc/zabbix24/zabbix_agentd.conf"


# read configuration and set defaultsc
load_rc_config "$name"
: ${zabbix_agentd_enable="NO"}
#: ${zabbix_agentd_pre:=/usr/local/etc/zabbix24/${name}.pre.sh}


if [ ! -z "$zabbix_agentd_conf" ] ; then
        zabbix_agentd_flags="${zabbix_agentd_flags} -c ${zabbix_agentd_conf}"
        required_files=${zabbix_agentd_conf}
fi

zabbix_precmd()
{
        if [ ! -z "$zabbix_agentd_pre" ] ; then
                if [ -e $zabbix_agentd_pre ] ; then
                        . $zabbix_agentd_pre
                fi
        fi

}


command="/usr/local/sbin/${name}"


run_rc_command "$1"

here is the diff

# diff zabbix_agentd zabbix_agentd.old
13a14
>
17a19,20
> start_precmd="zabbix_precmd"
> required_files="/usr/local/etc/zabbix24/zabbix_agentd.conf"
19,22d21
< command="/usr/local/sbin/${name}"
< required_files="/usr/local/etc/zabbix24/${name}.conf"
<
< load_rc_config $name
23a23,24
> # read configuration and set defaultsc
> load_rc_config "$name"
24a26,46
> #: ${zabbix_agentd_pre:=/usr/local/etc/zabbix24/${name}.pre.sh}
>
>
> if [ ! -z "$zabbix_agentd_conf" ] ; then
>       zabbix_agentd_flags="${zabbix_agentd_flags} -c ${zabbix_agentd_conf}"
>       required_files=${zabbix_agentd_conf}
> fi
>
> zabbix_precmd()
> {
>       if [ ! -z "$zabbix_agentd_pre" ] ; then
>               if [ -e $zabbix_agentd_pre ] ; then
>                       . $zabbix_agentd_pre
>               fi
>       fi
>
> }
>
>
> command="/usr/local/sbin/${name}"
>
26a49
>


 Comments   
Comment by chris scott [ 2016 Jan 22 ]

Sorry forgot to say all the user has to do is define these two variables in their rc.conf files

zabbix_agentd_pre=<location of pre script>
zabbix_agentd_conf=<location_of_config>

not setting them results in standard behaviour

Comment by chris scott [ 2016 Jan 22 ]

files also attached





[ZBXNEXT-2931] Add proper backtrace support on BSD systems when dumping crash data Created: 2015 Aug 31  Updated: 2018 Feb 07

Status: Open
Project: ZABBIX FEATURE REQUESTS
Component/s: Agent (G), Proxy (P), Server (S)
Affects Version/s: None
Fix Version/s: None

Type: Change Request Priority: Minor
Reporter: Andris Zeila Assignee: Unassigned
Resolution: Unresolved Votes: 1
Labels: debugging, freebsd, troubleshooting
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD, NetBSD, OpenBSD


Attachments: File freebsd_backtrace_x64.diff    

 Description   

On BSD systems fatal signal handler is running on its own stack so backtrace() function does not give meaningfull result. To print proper stack trace we should take information from signal context and do manual stack unwinding.

See the attached patch for stack trace prototype on 64 bit BSD systems.



 Comments   
Comment by Oleksii Zagorskyi [ 2015 Sep 01 ]

There were several issues in the past where we could not get backtrace on FreeBSD with the same details on Linux.
Good thing it will be really available now.





[ZBXNEXT-2706] Freebsd packages Created: 2015 Feb 12  Updated: 2018 Apr 18  Resolved: 2015 Mar 03

Status: Closed
Project: ZABBIX FEATURE REQUESTS
Component/s: Installation (I)
Affects Version/s: 2.2.8, 2.4.3
Fix Version/s: None

Type: Change Request Priority: Trivial
Reporter: Michael P Assignee: Unassigned
Resolution: Won't fix Votes: 0
Labels: compile, freebsd, packages
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD (other *NX maybe, didn't check)


Epic Link: DEV-680

 Description   

I don't know who maintains the ports/packages in FreeBSD 9+, but How about a separate package for each SQL front end like under debian?

[root@server:~]apt-cache search zabbix
zabbix-server-mysql - network monitoring solution - server (using MySQL)
zabbix-server-pgsql - network monitoring solution - server (using PostgreSQL)
...
zabbix-proxy-mysql - network monitoring solution - proxy (using MySQL)
zabbix-proxy-pgsql - network monitoring solution - proxy (using PostgreSQL)
zabbix-proxy-sqlite3 - network monitoring solution - proxy (using SQLite3)

But on FreeBSD
[root@beastie:~]pkg search zabbix24
zabbix24-agent-2.4.3
zabbix24-frontend-2.4.3
zabbix24-proxy-2.4.3
zabbix24-server-2.4.3

And as for me, who doesn't like MySQL, I had to compile manually from ports an lock the packed, because otherwise is always get "updated" (Options changed)
Especially for the a small Proxy the sqlite Option is much more interesting than a postgres or a MySQL, and can make updates much easier.



 Comments   
Comment by Michael P [ 2015 Feb 12 ]

so many typos...
sorry

Comment by Aleksandrs Saveljevs [ 2015 Mar 03 ]

Zabbix SIA does not manage Zabbix ports and packages on FreeBSD. This important job is being handled by the community. Please contact Zabbix package maintainer with your suggestions - see "make maintainer".





[ZBXNEXT-1896] Check for libcurl compatability Created: 2013 Sep 09  Updated: 2024 Mar 28

Status: Need info
Project: ZABBIX FEATURE REQUESTS
Component/s: Installation (I)
Affects Version/s: None
Fix Version/s: None

Type: New Feature Request Priority: Trivial
Reporter: Scott Sturdivant Assignee: dimir
Resolution: Unresolved Votes: 0
Labels: cookie, curl, freebsd
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD 9.1, Zabbix 2.0.8



 Description   

Given a default zabbix server installation on FreeBSD, the libcurl depedency is not compiled with support for cookies. When executing a web monitoring scenario, the server's logs has a line like:

web scenario "Main Page" error: could not set cURL option [10031]: An unknown option was passed in to libcurl

1) It would be nice if the command passed to curl was printed to help figure out which option it was being passed that didn't work.
2) Potentially compatibility with libcurl could be checked upon installation to warn the user.



 Comments   
Comment by Scott Sturdivant [ 2013 Sep 09 ]

This post was the one that led me to the solution: http://sourceforge.net/p/zabbix/mailman/message/31200026/

Comment by Oleksii Zagorskyi [ 2013 Sep 10 ]

We had "similar" case in ZBX-4850
I.e. when some external library doesn't support some its feature because of distro maintainers' point of view.

Comment by dimir [ 2024 Jan 05 ]

Related issue: ZBXNEXT-3623

Comment by dimir [ 2024 Mar 28 ]

sirscott
Should have been fixed in ZBXNEXT-3623, please check if the error has gone with 7.0.0beta2.





[ZBXNEXT-1830] FreeBSD: coretemp vs sensor Created: 2013 Jul 22  Updated: 2013 Jul 23

Status: Open
Project: ZABBIX FEATURE REQUESTS
Component/s: Agent (G)
Affects Version/s: None
Fix Version/s: None

Type: Change Request Priority: Trivial
Reporter: Victor Assignee: Unassigned
Resolution: Unresolved Votes: 0
Labels: freebsd, newitemkey
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD 9.x and above



 Description   

Need support FreeBSD coretemp.

kldload coretemp
sysctl -a | grep temp
see temperature sensors.

I think will be cool feature, when zabbix_agent/zabbix_agentd under FreeBSD use same key "sensor.cpu_temp[XXX]", but get data from native coretemp.






[ZBXNEXT-1355] Network Interface discovery missing from freebsd agent Created: 2012 Aug 08  Updated: 2012 Aug 08  Resolved: 2012 Aug 08

Status: Closed
Project: ZABBIX FEATURE REQUESTS
Component/s: Agent (G)
Affects Version/s: 2.0.2
Fix Version/s: None

Type: Change Request Priority: Minor
Reporter: chris scott Assignee: Alexei Vladishev
Resolution: Duplicate Votes: 0
Labels: freebsd, lld, networkdiscovery
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

freebsd agents


Issue Links:
Duplicate
duplicates ZBXNEXT-579 Support 'net.if.discovery' key on Fre... Closed

 Description   

Currently the network autodiscovery key is missing from the freebsd agent. Currently I have to work around with the following

UserParameter=net.if.discovery,ifconfig | awk ' BEGIN { print "

{\"data\":\[" }

/^[a-z0-9]+\:/ { gsub(/\:/,"",$ 1); if ( $ 1 != "lo0" ) print "{ \"

{#IFNAME}\":\"" $ 1"\" }," } END { print "{ \"{#IFNAME}

\":\"lo0\"} \n]}" } '

This works fine but should really be fixed properly with system calls and merged into the code stack. I can help with testing here if needed.






[ZBXNEXT-1024] Add/delete some modes for vm.memory.size key under FreeBSD (or all BSD) and other OS Created: 2011 May 04  Updated: 2013 Apr 30  Resolved: 2011 Nov 23

Status: Closed
Project: ZABBIX FEATURE REQUESTS
Component/s: Agent (G)
Affects Version/s: None
Fix Version/s: 1.9.9 (beta)

Type: Change Request Priority: Trivial
Reporter: Pavel Timofeev Assignee: dimir
Resolution: Fixed Votes: 2
Labels: freebsd, memory
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD


Attachments: PNG File memusage_with_patch.png     PNG File memusage_with_patch_desc.png     Text File patch-src_freebsd_mem.c    
Issue Links:
Duplicate
duplicates ZBXNEXT-144 Please implement support of item key ... Closed
is duplicated by ZBX-4419 Missing memory items FreeBSD 8.2 Closed

 Description   

Now in Zabbix we have many parameters for monitoring memory under FreeBSD: vm.memory.size[<mode>]
<mode> can be:

total
free
used
shared
cached

5 parameters! ('pfree' and 'pused' doesn't work in my servers, and doesn't work correct anyway) Ok, not bad.
But I don't know what does 'shared' and 'used' parameters mean.

If you use FreeBSD go to `top`. At head you can see memory parts:
Active, Inact, Wired, Cache, Buf and Free. You can't see 'shared' and 'used' parameters. And you don't know how to get correct or real free memory!

In order to know REAL FREE MEMory you need:
1. Get from sysctl folowing vars:

"vm.stats.vm.v_inactive_count" * "vm.stats.vm.v_page_size" (lets call it INACT)
"vm.stats.vm.v_cache_count" * "vm.stats.vm.v_page_size" (CACHE)
"vm.stats.vm.v_free_count" * "vm.stats.vm.v_page_size" (FREE)

2. Calculate REAL FREE MEMory:
free_mem = INACT + CACHE + FREE

3. If you want to get REAL USED MEMory:
total_mem = "vm.stats.vm.v_page_count" * "vm.stats.vm.v_page_size" (it defines correct in zabbix)
used_mem = total_mem - free_mem

Conclusion 4 developers:
Please make correct calculation of FreeBSD memory!
You need add INACT (sysclt vm.stats.vm.v_inactive_count) mode to vm.memory.size.
Then make 'pfree' and 'pused' mode calculation as I described below (real free and real used memory).
I think you need to delete 'shared' and 'used' modes for fbsd, because it is not necessary under FreeBSD.

Thanks!

P.S. maybe it right for all BSD systems.

____________

? ????? ?????? Zabbix ????? ?????????? ?? ???- ???????? ??? FreeBSD (? ????? ? ??? ???? BSD) ???????? vm.memory.size:
shared ? used (? ???? ?? ???? ??? ??? ?? ???????? ?????)
? ?? ?? ????? ??????????? ?????????? ???????? inactive ?????? (?? ? active).
? ???? ?? ? ???? ????? ?? ?????????? ?????? pused ? pfree, ?? ? ??? ???? ???????????.

????? ?????? ??????? ????????? ??? ?????????? ????????? ??????, ?.?. ?? ???? ??? ?????? ??????? ?????????????? swap, ????? ?????????? ???????? ????????? ????.
???????!



 Comments   
Comment by Pavel Timofeev [ 2011 May 04 ]

Готов к диалогу
Ready for dialog

Comment by Pavel Timofeev [ 2011 May 05 ]

Алексей, а можно ли дать мне возможность отредактировать тикет? или закрыт его и создать новый? писал в не очень адекватном состоянии и хотел бы переделать его.
Can I edit this ticket? Or creating new ticket will be best solution?

Comment by richlv [ 2011 May 05 ]

just add an updated summary as a new comment here, somebody surely will handle it from there

Comment by Pavel Timofeev [ 2011 May 05 ]

Thank you for fast reply!

Maybe I will repeat myself.

I just want to say: Please, add some new modes for vm.memory.size key and delete useless modes!

It need for FreeBSD and maybe other BSD systems. If you want I'll check it!
Memory organization in FreeBSD is different than in Linux.
Existing modes like 'used', 'shared', 'pfree' and 'pused' don't need under FreeBSD(allBSD?). It useless.

Also we already have 'total', 'free' and 'cached' modes. It usefull under FreeBSD.
As I see in src (src/libs/zbxsysinfo/freebsd/memory.c) 'total' memory calculate as "vm.stats.vm.v_page_count" * "vm.stats.vm.v_page_size".
'free' memory = "vm.stats.vm.v_free_count" * "vm.stats.vm.v_page_size".
'cached' memory = "vm.stats.vm.v_cache_count" * "vm.stats.vm.v_page_size"
This is good and right!

But we also need 'active', 'inactive' and 'wired' modes for vm.memory.size key under FreeBSD(BSD)!
We may calculate 'active' mem as "vm.stats.vm.v_active_count" * "vm.stats.vm.v_page_size"
'inactive' = "vm.stats.vm.v_inactive_count" * "vm.stats.vm.v_page_size"
'wired' = "vm.stats.vm.v_wire_count" * "vm.stats.vm.v_page_size" (sysctl var contains 'wire', not 'wired')

If you add up all this memory you get 'total' memory.
I.e. 'total' = 'active' + 'wired' + 'cache' + 'inactive' + 'free'

In FreeBSD 'free' memory doesn't mean REAL free memory available for programs.
Actually used memory in FreeBSD is 'active' + 'wired'. And real free mem is 'cache' + 'inactive' + 'free'.
Under load 'active' and 'wired' types of memory are growing and other types are decreasing.
When 'cache', 'inactive' and 'free' will be tiny system will be active use swap.

I can provied graphics if you want.
And if you don't have enough time I can try to provide patches for src/libs/zbxsysinfo/freebsd/memory.c, but I have small experience in C programming.

Comment by Oleksii Zagorskyi [ 2011 May 05 ]

forum thread http://www.zabbix.com/forum/showthread.php?t=21826
I think it's created by reporter Pavel Timofeev

Comment by Pavel Timofeev [ 2011 May 05 ]

Yes, it's me.

Comment by Pavel Timofeev [ 2011 May 05 ]

patch that add 3 new modes for vm.memory.size in Zabbix agent under FreeBSD
http://narod.ru/disk/11988360001/zbx_bsd_mem.patch.html
or
http://pastebin.com/e98rru5v

It works good. Just checked!

Comment by Pavel Timofeev [ 2011 May 05 ]

than remove shared and used modes
http://narod.ru/disk/11991925001/zbx_bsd_mem.patch2.html
or
http://pastebin.com/YM3iqdh1

Comment by Pavel Timofeev [ 2011 May 05 ]

than 3rd patch for correct calculation of pfree and pused
http://narod.ru/disk/12077306001/zbx_bsd_mem.patch3.html
or
http://pastebin.com/Ec3D6bja
links was changed: forgot one small '()'

Comment by Oleksii Zagorskyi [ 2011 May 05 ]

Pavel, it better to attach here all your patches
See to "More Actions -> Attach File"

Comment by Pavel Timofeev [ 2011 May 05 ]

Cumulative patch
All patches for Zabbix 1.8.5.
Works on FreeBSD 8.2 RELEASE i386 and amd64.

Comment by Pavel Timofeev [ 2011 May 06 ]

Small change in patch. Forgot one ()

You can test it. Just copy this file to /usr/ports/net-mgmt/zabbix-server/files/ directory and reinstall zabbix_agent

Comment by Pavel Timofeev [ 2011 May 07 ]

This ticket valid only for FreeBSD. Other BSD - other memory.

Comment by Pavel Timofeev [ 2011 May 10 ]

By analogy with 'pfree' and 'pused' and I'll add calculations for 'available' and 'used' memory types.
And I think 'pfree' memory type need to rename to 'pavailable'.

Comment by Pavel Timofeev [ 2011 May 10 ]

Latest patch. Tested under FreeBSD 8.2 RELEASE and Zabbix-1.8.5 from ports tree.
Works fine. Please, test it if you have a time.
For pfree and pused memory types in item menu you need choose - Type of information: Numeric (float), Units: %
other types - Type of information: Numeric (insigned), Units: B.

Comment by Pavel Timofeev [ 2011 May 10 ]

TOTAL RESULT:
Please exam attached patch.
It adds some freebsd specific types of memory for vm.memory.size and makes correct calculation for pused, pfree, etc.

And I think 'pfree' memory type need to rename to 'pavailable'.

Waiting for you marks!

Comment by Pavel Timofeev [ 2011 Aug 10 ]

I'm showing a few screenshots of server that works with my patch.
Can you see that I maybe right?

Comment by Pavel Timofeev [ 2011 Aug 10 ]

Please, talk with me =)

Comment by Pavel Timofeev [ 2011 Aug 18 ]

Please, read http://www.absolutebsd.com/AbsoluteBSD18.pdf

Comment by Pavel Timofeev [ 2011 Aug 31 ]

small correction: don't delete "shared" memory type (like in my patch).
and may be add buffer mem type will be useful.

Comment by Pavel Timofeev [ 2011 Aug 31 ]

When you'll solve this PR I would like to discuss about other OS and their memory types.

Comment by richlv [ 2011 Sep 09 ]

it might be worth attaching latest patch to this issue

Comment by Pavel Timofeev [ 2011 Nov 10 ]

I want to discuss about some thing like common type of memory. It is general problem.
Can I post here my reflections?

Comment by Pavel Timofeev [ 2011 Nov 10 ]

All existing monitoring things (like snmp and monitoring systems) are imbrued with linuxism.

For monitoring purposes:
Linux has some memory types: Used, Free, Shared, Buffers, Cached. And in most cases all monitoring systems oriented to these.

But other UNIX's have similar and different types:
FreeBSD/DragonflyBSD: Active, Inactive, Wired, Cache, Buffer (for UFS only), Free, Shared.
OpenBSD: Real active, Real total, Free, Shared, Buf, Cached.
NetBSD (similar to freebsd): Active, Inactive, Wired, Exec, File, Free, Buff, Shared.
OpenSolaris/OpenIndiana may has own types.

We need to think about it: this types are responsible for different things.
For example, for NetBSD http://www.selonen.org/arto/netbsd/
or for FreeBSD http://www.absolutebsd.com/AbsoluteBSD18.pdf

May be we need to introduce COMMON types like Available and Filled (for example) and specific types for each unix.

Comment by Aleksandrs Saveljevs [ 2011 Nov 23 ]

Pavel, thanks for the inspiration! Below is a list of user-visible changes that were done under this issue.

  • Changed formatting for "system.localtime[local]". It used to return data in the format "2000-1-2,3:4:5.67,+2:0", now it returns data in the format "2000-01-02,03:04:05.067,+02:00" (note the leading zeros).
  • Documented which items are indeed available on Mac OS X. Added support for "net.if.collisions", "net.if.in", "net.if.out", "net.if.total", "system.boottime", "system.cpu.num[online]", "vfs.fs.discovery" for Mac OS X.
  • Added "net.tcp.listen" on Mac OS X. Added "net.udp.listen" on Mac OS X, FreeBSD, and Solaris.
  • Item "vm.memory.size[shared]" always returned 0 on Linux 2.6, removed it. Left it only for Linux 2.4. Dropped support for Linux 2.3 in memory-related modules.
  • Removed items "vm.memory.size[pfree]" on all platforms that supported it for reasons described below.

Now, the main part. As Pavel mentioned, different operating systems use different memory types and different terms to describe them. We have decided that item "vm.memory.size" will support all these specific terms for each platform: for instance, "vm.memory.size[wired]" on FreeBSD and "vm.memory.size[exec]" on NetBSD.

However, sometimes these specific memory types are not needed. What is really needed is a user-level estimate of how much memory is used and how much memory is available. Items "vm.memory.size[used]", "vm.memory.size[pused]" and "vm.memory.size[available]", "vm.memory.size[pavailable]" are intended to provide these estimates. Note that "vm.memory.size[used]" plus "vm.memory.size[available]" do not necessarily equal total. For instance, on FreeBSD active, inactive, wired, cached memories are considered used, because they store some useful information. At the same time inactive, cached, free memories (note that "free" here is a specific memory term, thus "pfree" is not very useful) are considered available, because these kinds of memories can be given instantly to processes that request more memory. So, for example, inactive memory is both used and available simultaneously. Because of this, item "vm.memory.size[used]" is designed for informational purposes only, while item "vm.memory.size[available]" is designed for triggers. These user-level estimate items are available for all platforms.

The full list of supported arguments to "vm.memory.size" is available in the documentation.

What still remains to be done is to figure out the purpose of "vm.memory.size[buffers]", "vm.memory.size[cached]", "vm.memory.size[shared]" on NetBSD and "vm.memory.size[cached]", "vm.memory.size[shared]" on OpenBSD. Another thing is that on OpenBSD the sum of "vm.memory.size[used]" and "vm.memory.size[available]" is less than "vm.memory.size[total]", which is also something that needs to be improved.

Comment by Aleksandrs Saveljevs [ 2011 Nov 23 ]

Available in development branch svn://svn.zabbix.com/branches/dev/ZBXNEXT-1024 .

Comment by Pavel Timofeev [ 2011 Nov 23 ]

Good explanation and solution =) Thank you very much!

Comment by Aleksandrs Saveljevs [ 2011 Nov 29 ]

One of the things I seem to have not done is add division by zero checks in vm.memory.size[pfree] and vm.memory.size[pavailable] for all platforms. I am not sure they are needed, though.

Comment by dimir [ 2011 Dec 01 ]

I guess you meant pused and pavailable. The checks are partly there so I think it makes sense to add the missing ones.

Comment by dimir [ 2011 Dec 05 ]

So, as I mentioned above currently vm.memory.size checks support "pused" instead of "pfree". Let's try to use "pused" on netbsd 5.0:

for i in total used pused; do echo -n "$i : "; bin/zabbix_get -s netbsd50 -k vm.memory.size[$i]; done
total : 251596800
used : 310284288
pused : 123.326007

"used" is greater than "total" so we end up with used 123 %. This is because "used" includes file pages, which are not included in "total". Let's check the description of vm.memory.size[used] in 2.0 manual:

"Note that the sum of vm.memory.size[used] and vm.memory.size[available] does not necessarily equal total. For instance, on FreeBSD active, inactive, wired, cached memories are considered used, because they store some useful information. At the same time inactive, cached, free memories are considered available, because these kinds of memories can be given instantly to processes that request more memory. So inactive memory is both used and available simultaneously. Because of this, item vm.memory.size[used] is designed for informational purposes only, while item vm.memory.size[available] is designed to be used in triggers."

This sounds logical but do we really want to support vm.memory.size[pused]? If "used" is informative, that's OK but I don't see much sense in relating this value to "total".

Opinions?

Comment by dimir [ 2011 Dec 06 ]

(1) "Inactive" in *BSD systems should not be included in "used" calculation. The inactive memory has valid content, but is marked as not used.

<dimir> Now this looks much better:

$ for i in total used pused available pavailable; do echo -n "$i : "; bin/zabbix_get -s netbsd50 -k vm.memory.size[$i]; done
total : 251596800
used : 80326656
pused : 31.926740
available : 176644096
pavailable : 70.209198

RESOLVED in r23816

<dimir> CLOSED, moved to (2)

Comment by dimir [ 2012 Jan 03 ]

(2) Tested successfully. Now someone will have to check my changes from r23601 (including) up to the latest.

<Sasha> CLOSED

Comment by dimir [ 2012 Jan 03 ]

(3) Please review next changes to docs before I publish them:

  • describe vm.memory.size parameters, I propose like this:
    total - Total real memory available.
    free - Memory that is readily available to any entity requesting memory.
    active - Memory currently in use or very recently used, and so it is in RAM.
    inactive - Memory that is marked as not used.
    wired - Memory that is marked to always stay in RAM. It is never moved to disk.
    pinned - Same as wired.
    anon - Memory not associated with a file (can not be re-read from it).
    exec - Executable code, typically from a (program) file.
    file - Cache for contents of recently accessed files.
    buffers - Cache for things like file system metadata.
    cached - Cache for various things.
    shared - Memory that may be simultaneously accessed by multiple processes.
    used - Active + wired memory.
    pused - Active + wired memory in relation to total.
    available - Inactive + free memory.
    pavailable - Inactive + free memory in relation to total.
  • on aix available and free is the same thing
  • on solaris available and free is the same thing
  • add 'active' support for hpux
  • linux/shared works only on kernel 2.4

<richlv> 'real' - how about 'physical' ?
and, of course, proper capitalisation for os names

<dimir> I agree to all above.

<Sasha> added support of vm.memory.size[active] on HPUX
http://www.zabbix.com/documentation/2.0/manual/appendix/items/supported_by_platform

Comment by Pavel Timofeev [ 2012 Jan 04 ]

> available - Inactive + free memory
> pavailable - Inactive + free memory in relation to total

why don't you add cached memory to available calculation?

Comment by dimir [ 2012 Jan 04 ]

Great point, Pavel. It's actually there, I must fix the description. Also I spotted a couple of platforms where this isn't included in available.

Comment by dimir [ 2012 Jan 19 ]

New page added: http://www.zabbix.com/documentation/2.0/manual/appendix/items/vm.memory.size_params

Comment by dimir [ 2012 Jan 19 ]

Fixed in pre-1.9.9 r24902.





[ZBXNEXT-771] item system.sw.packages[] should support other package systems Created: 2011 May 02  Updated: 2013 Jun 06

Status: Open
Project: ZABBIX FEATURE REQUESTS
Component/s: Agent (G)
Affects Version/s: 1.9.4 (alpha)
Fix Version/s: None

Type: Change Request Priority: Minor
Reporter: Aleksandrs Saveljevs Assignee: Unassigned
Resolution: Unresolved Votes: 1
Labels: freebsd, inventory, trivial
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified


 Description   

Issue ZBXNEXT-677 introduces item system.sw.packages[] for listing installed packages. However, issue ZBXNEXT-677 covers only Linux and only a subset of available Linux package systems. This issue is to hold requests for other operating and package systems.



 Comments   
Comment by Oleksii Zagorskyi [ 2011 May 02 ]

In the FreeBSD list of software installed easy to take by command:
ls /var/db/pkg
output format is:
ap22-mod_auth_kerb-5.4_2
samba34-3.4.9
zope29-2.9.9

Maarten B in the ZBXNEXT-677 suggests a well solution for FreeBSD. But he did some typo Right is: 'pkg_info -E *'
Both commands: 'pkg_info -E *' and 'ls /var/db/pkg' works well and very fast under non-root account. They gives identical results.
I think 'pkg_info -E *' is better solution.

Comment by Marc [ 2013 Jun 06 ]

Support for AIX would be great too. Maybe via lslpp.

For RPMs:

# lslpp -L -c | awk -F : '$7 == "R" { print $2 }' | head -n 3
AIX-rpm-6.1.7.15-13
bash-3.0-1
cdrecord-1.9-7

For filesets:

# lslpp -L -c | awk -F : '$7 == "F" { print $2 "-" $3 }' | head -n 3
ICU4C.rte-6.1.7.16
Java5.sdk-5.0.0.430
Java5_64.sdk-5.0.0.430




[ZBXNEXT-579] Support 'net.if.discovery' key on FreeBSD Created: 2010 Dec 12  Updated: 2014 May 14  Resolved: 2013 Apr 09

Status: Closed
Project: ZABBIX FEATURE REQUESTS
Component/s: Agent (G)
Affects Version/s: None
Fix Version/s: 2.1.0

Type: New Feature Request Priority: Major
Reporter: Oleksii Zagorskyi Assignee: Aleksej Ivanov (Inactive)
Resolution: Fixed Votes: 5
Labels: discovery, freebsd, lld, trivial
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: Text File FreeBSD81_fstab.txt     Text File add_FreeBSD_discover_netif.patch    
Issue Links:
Duplicate
is duplicated by ZBXNEXT-1355 Network Interface discovery missing f... Closed
is duplicated by ZBXNEXT-1997 net.if.discovery support for FreeBSD Closed

 Description   

'/etc/fstab' output from my FreeBSD 8.1-RELEASE #0 is attached.
http://www.freebsd.org/doc/handbook/mount-unmount.html

About 'net.if.discovery' - i don't know how to introduce



 Comments   
Comment by Oleksii Zagorskyi [ 2011 Oct 26 ]

support of 'vfs.fs.discovery' for *BSD systems already added in the ZBXNEXT-580

Comment by chris scott [ 2012 Aug 08 ]

workaround for the moment is to add this to you agent config

UserParameter=net.if.discovery,ifconfig | awk ' BEGIN { print "

{\"data\":\[" }

/^[a-z0-9]+\:/ { gsub(/\:/,"",$ 1); if ( $ 1 != "lo0" ) print "{ \"

{#IFNAME}\":\"" $ 1"\" }," } END { print "{ \"{#IFNAME}

\":\"lo0\"} \n]}" } '

Comment by Oleksii Zagorskyi [ 2012 Aug 08 ]

I have to say that it really works, that's cool !

Comment by Evgeny [ 2012 Aug 28 ]

Chris, do you plan to add the core support for net.if.discovery?

Comment by Lasse Bo Larsen [ 2012 Oct 03 ]

Same im using:

UserParameter=net.if.discovery,printf "{\n \"data\":[\n\n" && ifconfig | grep "^[a-z]" | sed -e 's/[0-9]:.*//' | while read a ; do printf ",\n { \"

{#IFNAME}

\",\"$a\" }" ; done | grep "#IFNAME" && printf "\n ]\n}\n"

Hoping for native support in the future.

Comment by Joost Bekkers [ 2013 Jan 13 ]

Here is a patch against 2.0.4 adding the net.if.discover function.

See "add_FreeBSD_discover_netif.patch" in the attachments block above.

Comment by rodion [ 2013 Jan 16 ]

Thanks, the patch helped me.

Comment by Aleksej Ivanov (Inactive) [ 2013 Mar 15 ]

Available in the development branch svn://svn.zabbix.com/branches/dev/ZBXNEXT-579

Comment by richlv [ 2013 Mar 15 ]

(1) default fbsd template should be updated to use network interface discovery like linux & windows templates do (and existing net.if items should be removed)

aleksej RESOLVED in r34854

sasha CLOSED

Comment by richlv [ 2013 Mar 15 ]

(2) when it's finished, the following doc pages should be updated (anywhere else ?) :
https://www.zabbix.com/documentation/2.2/manual/appendix/items/supported_by_platform
https://www.zabbix.com/documentation/2.2/manual/config/items/itemtypes/zabbix_agent - should mention that net.if.discovery supported on fbsd since 2.2
https://www.zabbix.com/documentation/2.2/manual/introduction/whatsnew220#item_improvements and should mention updated fbsd template in a separate section

<Sasha> CLOSED

<richlv> when fbsd template will be updated, it should be listed in whatsnew as well -> REOPENED

aleksej Updated:

sasha CLOSED

Comment by Andris Zeila [ 2013 Mar 15 ]

(3) openbsd and netbsd also do not support net.if.discovery key. Most probably freebsd implementation works also for openbsd/netbsd. Need to check and if it's possible to add net.if.discovery support to openbsd/netbsd.

wiper successfully tested on openbsd/netbsd. CLOSED

Comment by Andris Zeila [ 2013 Mar 15 ]

Successfully tested on freebsd, please review minor updates in r34401, r34404

Comment by Aleksej Ivanov (Inactive) [ 2013 Mar 18 ]

Added support for NetBSD and OpenBSD

Comment by Alexander Vladishev [ 2013 Apr 03 ]

I'm reopening the issue. (1) is not completed.

Comment by Aleksej Ivanov (Inactive) [ 2013 Apr 08 ]

(6) added info about template improvements, please review
https://www.zabbix.com/documentation/2.2/manual/introduction/whatsnew220#template_improvements

sasha CLOSED

Comment by Andrei Tunes Claro [ 2014 May 14 ]

Hey Lasse Bo Larsen! Can you help me with this Parameter?
I tried to use this in my openBSD and it is working but not very well because in my server when the discovery try to mount the items I receive this message:

Cannot create item: item with the same key "net.if.in[

{#IFNAME}

]" already exists.
Cannot create item: item with the same key "ne

What can be wrong?

Comment by Aleksandrs Saveljevs [ 2014 May 14 ]

Andrei, you should check whether you already have item with key "net.if.in[

{#IFNAME}

]" on your host. In general, it would be better to continue this discussion on one of the places mentioned at https://www.zabbix.org/wiki/Getting_help .

Comment by Andrei Tunes Claro [ 2014 May 14 ]

Thanks Aleksandrs Saveljevs, What I want was send a message to Lasse Bo Larsen about this problem but I don't now how. In my server I don't have other item with this key so i can't understand why it is happening.
Can you help me? Here can I discuss about this?

Thank you again.

Comment by Aleksandrs Saveljevs [ 2014 May 14 ]

Ah, I realized that it in "net.if.in[

{#IFNAME}]" the server is complaining about the fact that it is trying to create an item with the same key as the item prototype. A bit confusing, but true. The reason is probably that your discovery returns something that does not have {#IFNAME}

macro defined.

Anyway, this bug tracker is not the proper place to discuss this and sending messages to users is not supported. Please use one of the ways mentioned at https://www.zabbix.org/wiki/Getting_help . Users on #zabbix on Freenode or on the forum would be happy to help.





[ZBX-19708] Compilation on FreeBSD with snmp library fails Created: 2021 Jul 21  Updated: 2021 Jul 21  Resolved: 2021 Jul 21

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Server (S)
Affects Version/s: 6.0.0alpha1
Fix Version/s: 6.0.0alpha1

Type: Incident report Priority: Major
Reporter: Artjoms Rimdjonoks Assignee: Artjoms Rimdjonoks
Resolution: Cannot Reproduce Votes: 0
Labels: freebsd, snmp
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD 11.2-RELEASE-p14, amd64


Issue Links:
Causes
caused by ZBXNEXT-6427 Support for strong encryption protoco... Closed

 Description   
make clean
./bootstrap.sh
./configure --enable-agent --enable-server --with-mysql --with-libcurl --enable-ipv6 --with-libxml2 --with-net-snmp --prefix=$(pwd)
make

results in

Making all in poller
cc -DHAVE_CONFIG_H -I. -I../../../include    -I../../../src/libs/zbxsysinfo/simple  -I../../../src/libs/zbxdbcache  -I/usr/local/include -I/include -I/usr/local/include -I/usr/local/lib/perl5/5.30/mach/CORE -I/usr/include -I. -I/usr/local/include     -I/usr/local/include -g -O2  -I/usr/local/include -MT libzbxpoller_a-checks_snmp.o -MD -MP -MF .deps/libzbxpoller_a-checks_snmp.Tpo -c -o libzbxpoller_a-checks_snmp.o `test -f 'checks_snmp.c' || echo './'`checks_snmp.c
checks_snmp.c:609:35: error: use of undeclared identifier 'usmAES192CiscoPrivProtocol'; did you mean 'usmAES192PrivProtocol'?
                                                session.securityPrivProto = usmAES192CiscoPrivProtocol;
                                                                            ^~~~~~~~~~~~~~~~~~~~~~~~~~
                                                                            usmAES192PrivProtocol
/usr/local/include/net-snmp/library/transform_oids.h:26:26: note: 'usmAES192PrivProtocol' declared here
NETSNMP_IMPORT oid      *usmAES192PrivProtocol; /* backwards compat */
                         ^
checks_snmp.c:610:49: error: use of undeclared identifier 'usmAES192CiscoPrivProtocol'; did you mean 'usmAES192PrivProtocol'?
                                                session.securityPrivProtoLen = OID_LENGTH(usmAES192CiscoPrivProtocol);
                                                                                          ^~~~~~~~~~~~~~~~~~~~~~~~~~
                                                                                          usmAES192PrivProtocol
/usr/local/include/net-snmp/library/asn1.h:48:32: note: expanded from macro 'OID_LENGTH'
#define OID_LENGTH(x)  (sizeof(x)/sizeof(oid))
                               ^
/usr/local/include/net-snmp/library/transform_oids.h:26:26: note: 'usmAES192PrivProtocol' declared here
NETSNMP_IMPORT oid      *usmAES192PrivProtocol; /* backwards compat */
                         ^
checks_snmp.c:614:35: error: use of undeclared identifier 'usmAES256CiscoPrivProtocol'; did you mean 'usmAES256PrivProtocol'?
                                                session.securityPrivProto = usmAES256CiscoPrivProtocol;
                                                                            ^~~~~~~~~~~~~~~~~~~~~~~~~~
                                                                            usmAES256PrivProtocol
/usr/local/include/net-snmp/library/transform_oids.h:27:26: note: 'usmAES256PrivProtocol' declared here
NETSNMP_IMPORT oid      *usmAES256PrivProtocol; /* backwards compat */
                         ^
checks_snmp.c:615:49: error: use of undeclared identifier 'usmAES256CiscoPrivProtocol'; did you mean 'usmAES256PrivProtocol'?
                                                session.securityPrivProtoLen = OID_LENGTH(usmAES256CiscoPrivProtocol);
                                                                                          ^~~~~~~~~~~~~~~~~~~~~~~~~~
                                                                                          usmAES256PrivProtocol
/usr/local/include/net-snmp/library/asn1.h:48:32: note: expanded from macro 'OID_LENGTH'
#define OID_LENGTH(x)  (sizeof(x)/sizeof(oid))
                               ^
/usr/local/include/net-snmp/library/transform_oids.h:27:26: note: 'usmAES256PrivProtocol' declared here
NETSNMP_IMPORT oid      *usmAES256PrivProtocol; /* backwards compat */
                         ^
4 errors generated.
*** Error code 1





[ZBX-12756] configure script fails on FreeBSD with "Unable to use iconv (libiconv check failed)" Created: 2017 Sep 21  Updated: 2019 Feb 16  Resolved: 2018 Apr 16

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Installation (I)
Affects Version/s: 3.2.7
Fix Version/s: 3.4.9rc1, 4.0.0alpha6, 4.0 (plan)

Type: Problem report Priority: Trivial
Reporter: Andris Mednis Assignee: Michael Veksler
Resolution: Fixed Votes: 0
Labels: freebsd, iconv
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD 11


Issue Links:
Duplicate
is duplicated by ZBX-10402 Wrong include and library path for iconv Closed
Team: Team C
Sprint: Sprint 31
Story Points: 1

 Description   

If libiconv package is installed AND --with-libcurl option is specified then configure script fails:

$ CFLAGS="-g -O2 -D_FORTIFY_SOURCE=2" ./configure --enable-server --enable-proxy --enable-agent \
    --enable-ipv6 --with-net-snmp --with-unixodbc --with-libxml2 --with-libcurl --with-ssh2 \
  --with-openipmi --with-ldap --with-mysql --with-openssl --prefix=`pwd` 2>&1 | tee my_configure.out
...
checking whether libcurl is usable... yes
checking for curl_free... yes
checking for curl_easy_escape... yes
checking for ICONV support... configure: error: Unable to use iconv (libiconv check failed)

If libiconv package is removed OR --with-libcurl option is not used then configure script succeeds.

The issue can be worked around by adding --with-iconv=/usr/local to configure options:

$ CFLAGS="-g -O2 -D_FORTIFY_SOURCE=2" ./configure --enable-server --enable-proxy --enable-agent \
    --enable-ipv6 --with-net-snmp --with-unixodbc --with-libxml2 --with-libcurl --with-ssh2 \
  --with-openipmi --with-ldap --with-mysql --with-openssl --with-iconv=/usr/local --prefix=`pwd` 2>&1 | tee my_configure.out


 Comments   
Comment by Andris Mednis [ 2017 Sep 21 ]

Apparently, if libiconv package is not installed, then ICONV functions from FreeBSD LIBC are used. Installing libiconv package brings in /usr/local/lib/libiconv.so.2 which is used for ICONV functions.

Errors in configure.log:

configure:11723: checking for ICONV support
configure:11765: cc -o conftest -I/usr/local/include -g -O2 -D_FORTIFY_SOURCE=2   -rdynamic   conftest.c -lkvm -lm -lexecinfo -ldevstat   >&5
configure:11765: cc -o conftest -I/usr/local/include -g -O2 -D_FORTIFY_SOURCE=2   -rdynamic   conftest.c -lkvm -lm -lexecinfo -ldevstat   >&5
/tmp/conftest-712caa.o: In function `main':
/usr/home/andris/ZBX-12466/3.2.6-1/conftest.c:167: undefined reference to `libiconv_open'   <---- Exists is /usr/local/lib/libiconv.so
/usr/home/andris/ZBX-12466/3.2.6-1/conftest.c:168: undefined reference to `libiconv'        <---- Exists in /usr/local/lib/libiconv.so
/usr/home/andris/ZBX-12466/3.2.6-1/conftest.c:169: undefined reference to `libiconv_close'  <---- Exists in /usr/local/lib/libiconv.so
cc: error: linker command failed with exit code 1 (use -v to see invocation)
configure:11765: $? = 1
Comment by Andris Mednis [ 2017 Sep 21 ]

Files in libiconv package:

$ pkg info -l libiconv-1.14_10
libiconv-1.14_10:
        /usr/local/bin/iconv
        /usr/local/include/iconv.h
        /usr/local/include/libcharset.h
        /usr/local/include/localcharset.h
        /usr/local/lib/charset.alias
        /usr/local/lib/libcharset.a
        /usr/local/lib/libcharset.so
        /usr/local/lib/libcharset.so.1
        /usr/local/lib/libcharset.so.1.0.0
        /usr/local/lib/libiconv.a
        /usr/local/lib/libiconv.so
        /usr/local/lib/libiconv.so.2
        /usr/local/lib/libiconv.so.2.5.1
        /usr/local/man/man1/iconv.1.gz
        /usr/local/man/man3/iconv.3.gz
        /usr/local/man/man3/iconv_close.3.gz
        /usr/local/man/man3/iconv_open.3.gz
        /usr/local/man/man3/iconv_open_into.3.gz
        /usr/local/man/man3/iconvctl.3.gz
        /usr/local/share/doc/libiconv/iconv.1.html
        /usr/local/share/doc/libiconv/iconv.3.html
        /usr/local/share/doc/libiconv/iconv_close.3.html
        /usr/local/share/doc/libiconv/iconv_open.3.html
        /usr/local/share/doc/libiconv/iconv_open_into.3.html
        /usr/local/share/doc/libiconv/iconvctl.3.html
        /usr/local/share/licenses/libiconv-1.14_10/GPLv3
        /usr/local/share/licenses/libiconv-1.14_10/LICENSE
        /usr/local/share/licenses/libiconv-1.14_10/catalog.mk
Comment by Andris Mednis [ 2017 Sep 21 ]

Some related comments in ZBX-12466.

Comment by Sergejs Paskevics [ 2018 Apr 11 ]

Successfully tested





[ZBX-10768] Warnings when compiling agent on FreeBSD Created: 2016 May 09  Updated: 2017 May 30  Resolved: 2016 Aug 05

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Agent (G)
Affects Version/s: 3.2.0alpha1
Fix Version/s: 3.2.0alpha1

Type: Incident report Priority: Trivial
Reporter: Glebs Ivanovskis (Inactive) Assignee: Unassigned
Resolution: Fixed Votes: 0
Labels: compilation, freebsd, warning
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD



 Description   
misc.c:430:15: warning: format string is not a string literal (potentially insecure) [-Wformat-security]
        setproctitle(title);
                     ^~~~~
1 warning generated.
str.c:2702:35: warning: passing 'char **' to parameter of type 'const char **' discards qualifiers in nested pointer types [-Wincompatible-pointer-types-discards-qualifiers]
        while ((size_t)(-1) == iconv(cd, &in, &in_size_left, &p, &out_size_left))
                                         ^~~
/usr/include/iconv.h:56:47: note: passing argument to parameter here
size_t  iconv(iconv_t, const char ** __restrict,
                                               ^
1 warning generated.


 Comments   
Comment by Viktors Tjarve [ 2016 Jun 30 ]

Fixed in development branch svn://svn.zabbix.com/branches/dev/ZBX-10768

It is debatable weather or not introduction of function zbx_iconv() is justified to eliminate 2nd warning from above in description section. Maybe this warning can be ignored because of its insignificance.

Comment by Viktors Tjarve [ 2016 Jul 01 ]

Second warning appears in BSD systems because they are based on an older POSIX standard then Zabbix. That is in newer versions iconv() function prototypes second paremeter is of type 'char **' rather then type 'const char **'.
For more details see section 'STANDARDS' in this manual:
http://netbsd.gw.com/cgi-bin/man-cgi?iconv+3+NetBSD-current

This warning won't be fixed.

Comment by Sandis Neilands (Inactive) [ 2016 Jul 01 ]

Successfully tested.

Comment by Viktors Tjarve [ 2016 Jul 01 ]

Released in:

  • 3.1.0 r60851




[ZBX-10083] 3.0 Alpha 4 - FreeBSD 10.1 - Agent build fails with TLS support Created: 2015 Nov 16  Updated: 2017 May 30  Resolved: 2015 Nov 20

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Agent (G)
Affects Version/s: 3.0.0alpha4
Fix Version/s: None

Type: Incident report Priority: Minor
Reporter: James Lodge Assignee: Unassigned
Resolution: Cannot Reproduce Votes: 0
Labels: compilation, encryption, freebsd
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FREEBSD 10.1-RELEASE-p24



 Description   

As you can see the iconv check fails only when --with-openssl is present. OpenSSL is present as shown in failed ./configure

./configure --enable-agent  ##Successful##

checking for architecture... freebsd (freebsd10.1)
checking size of void *... 8
checking for ICONV support... yes
checking for mkdir -p candidate... ok (./install-sh -c -d)
checking that generated files are newer than configure... done


Configuration:
  Detected OS:           freebsd10.1
  Install path:          /usr/local
  Compilation arch:      freebsd
  Compiler:              cc
  Compiler flags:        -g -O2
  Enable server:         no
  Enable proxy:          no
  Enable agent:          yes
  Agent details:
    TLS:                   no
    Linker flags:          -rdynamic
    Libraries:             -lkvm -lm -lexecinfo -ldevstat
  Enable Java gateway:   no
  LDAP support:          no
  IPv6 support:          no

***********************************************************
*            Now run 'make install'                       *
*                                                         *
*            Thank you for using Zabbix!                  *
*              <http://www.zabbix.com>                    *
***********************************************************
./configure --enable-agent --with-openssl ##Failure##

checking for architecture... freebsd (freebsd10.1)
checking size of void *... 8
checking for OpenSSL support... yes
checking for ICONV support... configure: error: Unable to use iconv (libiconv check failed)


 Comments   
Comment by Aleksandrs Saveljevs [ 2015 Nov 16 ]

Does config.log have more information on the error?

Comment by James Lodge [ 2015 Nov 16 ]
| #define HAVE_OPENSSL 1
| /* end confdefs.h.  */
|
| #include <stdlib.h>
| #include <iconv.h>
|
| int
| main ()
| {
|
|       iconv_t cd = iconv_open("","");
|       iconv(cd, NULL, NULL, NULL, NULL);
|       iconv_close(cd);
|
|   ;
|   return 0;
| }
configure:11804: cc -o conftest -g -O2 -I/usr/local/include     -rdynamic   conftest.c -lkvm -lm -lexecinfo -ldevstat   -liconv >&5
/usr/bin/ld: cannot find -liconv
cc: error: linker command failed with exit code 1 (use -v to see invocation)
configure:11804: $? = 1
configure: failed program was:
| /* confdefs.h */
| #define PACKAGE_NAME "Zabbix"
| #define PACKAGE_TARNAME "zabbix"
| #define PACKAGE_VERSION "3.0.0alpha4"
| #define PACKAGE_STRING "Zabbix 3.0.0alpha4"
| #define PACKAGE_BUGREPORT ""
| #define PACKAGE_URL ""
| #define PACKAGE "zabbix"
| #define VERSION "3.0.0alpha4"
| #define STDC_HEADERS 1
| #define HAVE_SYS_TYPES_H 1
| #define HAVE_SYS_STAT_H 1
| #define HAVE_STDLIB_H 1
| #define HAVE_STRING_H 1
| #define HAVE_MEMORY_H 1
| #define HAVE_STRINGS_H 1
| #define HAVE_INTTYPES_H 1
| #define HAVE_STDINT_H 1
| #define HAVE_UNISTD_H 1
| #define HAVE_STDIO_H 1
| #define HAVE_STDLIB_H 1
| #define HAVE_STRING_H 1
| #define HAVE_UNISTD_H 1
| #define HAVE_NETDB_H 1
| #define HAVE_SIGNAL_H 1
| #define HAVE_SYSLOG_H 1
| #define HAVE_TIME_H 1
| #define HAVE_ERRNO_H 1
| #define HAVE_SYS_TYPES_H 1
| #define HAVE_SYS_STAT_H 1
| #define HAVE_NETINET_IN_H 1
| #define HAVE_MATH_H 1
| #define HAVE_SYS_SOCKET_H 1
| #define HAVE_DIRENT_H 1
| #define HAVE_CTYPE_H 1
| #define HAVE_FCNTL_H 1
| #define HAVE_SYS_PARAM_H 1
| #define HAVE_ARPA_INET_H 1
| #define HAVE_SYS_STATVFS_H 1
| #define HAVE_SYS_SOCKET_H 1
| #define HAVE_ARPA_INET_H 1
| #define HAVE_SYS_VMMETER_H 1
| #define HAVE_STRINGS_H 1
| #define HAVE_VM_VM_PARAM_H 1
| #define HAVE_SYS_TIME_H 1
| #define HAVE_SYS_SYSCALL_H 1
| #define HAVE_STDINT_H 1
| #define HAVE_PWD_H 1
| #define HAVE_ARPA_NAMESER_H 1
| #define HAVE_ASSERT_H 1
| #define HAVE_SYS_DKSTAT_H 1
| #define HAVE_SYS_DISK_H 1
| #define HAVE_SYS_SCHED_H 1
| #define HAVE_NLIST_H 1
| #define HAVE_KVM_H 1
| #define HAVE_SYS_RESOURCE_H 1
| #define HAVE_PTHREAD_H 1
| #define HAVE_SYS_WAIT_H 1
| #define HAVE_REGEX_H 1
| #define HAVE_STDARG_H 1
| #define HAVE_SYS_SEM_H 1
| #define HAVE_SYS_IPC_H 1
| #define HAVE_SYS_SHM_H 1
| #define HAVE_SYS_TIMEB_H 1
| #define HAVE_INTTYPES_H 1
| #define HAVE_SYS_FILE_H 1
| #define HAVE_GRP_H 1
| #define HAVE_EXECINFO_H 1
| #define HAVE_SYS_TIMES_H 1
| #define HAVE_DLFCN_H 1
| #define HAVE_SYS_UTSNAME_H 1
| #define HAVE_RESOLV_H 1
| #define HAVE_NET_IF_H 1
| #define HAVE_NET_IF_MIB_H 1
| #define HAVE_SYS_MOUNT_H 1
| #define HAVE_SYS_PROC_H 1
| #define HAVE_SYS_SYSCTL_H 1
| #define HAVE_SYS_USER_H 1
| #define HAVE_SYS_UCONTEXT_H 1
| #define HAVE_DEVSTAT_H 1
| #define HAVE_LIBDEVSTAT 1
| #define HAVE_LIBEXECINFO 1
| #define HAVE_LIBM 1
| #define HAVE_LIBKVM 1
| #define HAVE_RES_QUERY 1
| #define ZBX_SOCKLEN_T socklen_t
| #define ZBX_SIVAL_INT sival_int
| #define HAVE_SEMUN 1
| #define HAVE_SOCKADDR_STORAGE_SS_FAMILY 1
| #define HAVE_TM_TM_GMTOFF 1
| #define HAVE_FUNCTION_INITGROUPS 1
| #define HAVE_FUNCTION_SETEUID 1
| #define HAVE_FUNCTION_SETPROCTITLE 1
| #define HAVE_FUNCTION_SYSCTLBYNAME 1
| #define HAVE_FUNCTION_SYSCTL_KERN_BOOTTIME 1
| #define HAVE_FUNCTION_SYSCTL_HW_NCPU 1
| #define HAVE_FUNCTION_SYSCTL_KERN_MAXFILES 1
| #define HAVE_FUNCTION_SYSCTL_KERN_MAXPROC 1
| #define HAVE_TIME_CLOCK_GETTIME 1
| #define HAVE___VA_COPY 1
| #define HAVE___VA_ARGS__ 1
| #define RETSIGTYPE void
| #define HAVE_GETLOADAVG 1
| #define HAVE_HSTRERROR 1
| #define HAVE_GETENV 1
| #define HAVE_PUTENV 1
| #define HAVE_SIGQUEUE 1
| #define HAVE_PROC 1
| #define HAVE_LONG_LONG_QU 1
| #define ARCH "freebsd"
| #define SIZEOF_VOID_P 8
| #define HAVE_OPENSSL 1
| /* end confdefs.h.  */
|
| #include <stdlib.h>
| #include <iconv.h>
|
| int
| main ()
| {
|
|       iconv_t cd = iconv_open("","");
|       iconv(cd, NULL, NULL, NULL, NULL);
|       iconv_close(cd);
|
|   ;
|   return 0;
| }
configure:11836: error: Unable to use iconv (libiconv check failed)
Comment by Glebs Ivanovskis (Inactive) [ 2015 Nov 19 ]

We are very glad that you are giving encryption a test!

I've tried to build agent on FreeBSD 10.1 with OpenSSL and it works for me. I've tried both with svn checkout from svn://svn.zabbix.com/tags/3.0.0alpha4 and with source package from our website. Interestingly that in your case ./configure tries to use -liconv flag, in my case it does not. Seems like FreeBSD has its own iconv() and there is no need in linking libiconv to compile the code

#include <stdlib.h>
#include <iconv.h>

int main ()
{
       iconv_t cd = iconv_open("","");
       iconv(cd, NULL, NULL, NULL, NULL);
       iconv_close(cd);

       return 0;
}

Could you please give more details on steps you take to build sources? In particular, where did you get them from?

Comment by James Lodge [ 2015 Nov 19 ]

Hey Glebs,

I should have been more specific. I'm actually trying to compile the agent in a FreeBSD jail, a jail that is a zabbix frontend server (php, nginx). I've just tried on the host and as you suggest, it works correctly, in fact I just tried on a fresh jail and it works correctly. I assumed, due to its present on the failing jail and lack of on the successful jail that libiconv package would be the issue due to FreeBSD having iconv() in base. That said, testing on a fresh jail without libiconv package and then installing libiconv package both time are successful. So I'm not sure where the issues lies.

Package list of failing Zabbix Frontend server

dialog4ports-0.1.5_2           Console Interface to configure ports
freetype2-2.6_1                Free and portable TrueType font rendering engine
gettext-runtime-0.19.6         GNU gettext runtime libraries and programs
indexinfo-0.2.3                Utility to regenerate the GNU info page index
jpeg-turbo-1.4.2               SIMD-accelerated JPEG codec which replaces libjpeg
kbproto-1.0.7                  KB extension headers
libICE-1.0.9_1,1               Inter Client Exchange library for X11
libSM-1.2.2_3,1                Session Management library for X11
libX11-1.6.3,1                 X11 library
libXau-1.0.8_3                 Authentication Protocol library for X11
libXaw-1.0.13,2                X Athena Widgets library
libXdmcp-1.1.2                 X Display Manager Control Protocol library
libXext-1.3.3_1,1              X11 Extension library
libXmu-1.1.2_3,1               X Miscellaneous Utilities libraries
libXp-1.0.3,1                  X print library
libXpm-3.5.11_4                X Pixmap library
libXt-1.1.5,1                  X Toolkit library
libidn-1.31                    Internationalized Domain Names command line tool
libpthread-stubs-0.3_6         This library provides weak aliases for pthread functions
libxcb-1.11.1                  The X protocol C-language Binding (XCB) library
libxml2-2.9.2_3                XML parser library for GNOME
mariadb100-client-10.0.22      Multithreaded SQL database (client)
nano-2.4.2                     Nano's ANOther editor, an enhanced free Pico clone
nginx-1.8.0_3,2                Robust and small WWW server
oniguruma4-4.7.1_1             BSDL Regular Expressions library compatible with POSIX/GNU/Perl
openssl-1.0.2_4                SSL and crypto library
pcre-8.37_4                    Perl Compatible Regular Expressions library
php56-5.6.14                   PHP Scripting Language
php56-bcmath-5.6.14            The bcmath shared extension for php
php56-ctype-5.6.14             The ctype shared extension for php
php56-dom-5.6.14               The dom shared extension for php
php56-filter-5.6.14            The filter shared extension for php
php56-gd-5.6.14                The gd shared extension for php
php56-gettext-5.6.14           The gettext shared extension for php
php56-hash-5.6.14              The hash shared extension for php
php56-json-5.6.14              The json shared extension for php
php56-mbstring-5.6.14          The mbstring shared extension for php
php56-mysql-5.6.14             The mysql shared extension for php
php56-mysqli-5.6.14            The mysqli shared extension for php
php56-opcache-5.6.14           The opcache shared extension for php
php56-pdo-5.6.14               The pdo shared extension for php
php56-pdo_sqlite-5.6.14        The pdo_sqlite shared extension for php
php56-phar-5.6.14              The phar shared extension for php
php56-posix-5.6.14             The posix shared extension for php
php56-session-5.6.14           The session shared extension for php
php56-simplexml-5.6.14         The simplexml shared extension for php
php56-sockets-5.6.14           The sockets shared extension for php
php56-sqlite3-5.6.14           The sqlite3 shared extension for php
php56-tokenizer-5.6.14         The tokenizer shared extension for php
php56-xml-5.6.14               The xml shared extension for php
php56-xmlreader-5.6.14         The xmlreader shared extension for php
php56-xmlwriter-5.6.14         The xmlwriter shared extension for php
pkg-1.6.1_2                    Package manager
png-1.6.18                     Library for manipulating PNG images
printproto-1.0.5               Print extension headers
sqlite3-3.9.2                  SQL database engine in a C library
t1lib-5.1.2_4,1                Type 1 font rasterization library for Unix/X11
wget-1.16.3                    Retrieve files from the Net via HTTP(S) and FTP
xextproto-7.3.0                XExt extension headers
xproto-7.0.28                  X11 protocol headers

source is directly from zabbix.com zabbix-3.0.0alpha4

Comment by Glebs Ivanovskis (Inactive) [ 2015 Nov 19 ]

Thank you for prompt response!

That said, testing on a fresh jail without libiconv package and then installing libiconv package both time are successful.

With or without OpenSSL?

Comment by James Lodge [ 2015 Nov 19 ]

Always with --with-openssl (builds omitting --with-openssl is not an issue) - Though I have restarted the jail that is running the zabbix frontend (php, nginx) after removing libiconv package and now I can build the agent successfully. Let me spend some more time with the issue as I'm creating multiple jails with various zabbix components and versions as they become available.

Comment by Glebs Ivanovskis (Inactive) [ 2015 Nov 20 ]

I close this issue. Please feel free to reopen it if the problem comes back.
And again thank you for the feedback and taking new versions for a spin!





[ZBX-9910] Agent cause reboot VM Freebsd10.1 Created: 2015 Sep 25  Updated: 2017 Oct 26  Resolved: 2017 Oct 26

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Agent (G)
Affects Version/s: 2.4.5
Fix Version/s: None

Type: Incident report Priority: Blocker
Reporter: sysops Assignee: Unassigned
Resolution: Cannot Reproduce Votes: 0
Labels: freebsd, fusion, reboot
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: File pkg.rtf    

 Description   

I Have many VM with freebsd 10.1 without problem but when I added on zabbix server the ITEM log[URL,"Exception|warning"] the VM (running on FUSION 7 on MAC PRO Yosemite) start rebooting every 3-4 min.

Here the log of dmesg -a

Fatal trap 12: page fault while in kernel mode
cpuid = 1; apic id = 02
fault virtual address	= 0x378
fault code	= supervisor read data, page not present
instruction pointer	= 0x20:0xffffffff809303bb
stack pointer	        = 0x28:0xfffffe0235f2ef80
frame pointer	        = 0x28:0xfffffe0235f2f020
code segment	= base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags	= interrupt enabled, resume, IOPL = 0
current process	= 640 (zabbix_agentd)
trap number	= 12
panic: page fault
cpuid = 1
KDB: stack backtrace:
#0 0xffffffff80963000 at kdb_backtrace+0x60
#1 0xffffffff80928125 at panic+0x155
#2 0xffffffff80d258df at trap_fatal+0x38f
#3 0xffffffff80d25bf8 at trap_pfault+0x308
#4 0xffffffff80d2525a at trap+0x47a
#5 0xffffffff80d0b142 at calltrap+0x8
#6 0xffffffff8092ff3d at _sx_xlock+0x5d
#7 0xffffffff819fb19e at zfsctl_snapdir_lookup+0x11e
#8 0xffffffff80e42441 at VOP_LOOKUP_APV+0xa1
#9 0xffffffff809be10c at lookup+0x59c
#10 0xffffffff809bd874 at namei+0x4d4
#11 0xffffffff809ce36d at kern_statfs+0x6d
#12 0xffffffff809ce2bc at sys_statfs+0x2c
#13 0xffffffff80d26211 at amd64_syscall+0x351
#14 0xffffffff80d0b42b at Xfast_syscall+0xfb

I have disabled agent on my rc.conf and VM has stopped rebooting

I know... is very hard to reproduce because it depends on many factor (check on server, running process and so on)



 Comments   
Comment by Aleksandrs Saveljevs [ 2015 Sep 25 ]

You might wish to enable DebugLevel=4 in the agent and ltrace/strace it, and see what the agent was doing prior to the VM reboot. However, Zabbix agent runs in user space, not in kernel mode, so if the VM crashes due to a user space process, it is probably a bug in the VM, rather than Zabbix. Therefore, https://www.zabbix.org/wiki/Getting_help might have been more appropriate.

Anyway, could you please find out what Zabbix agent tries to do when VM panics?

Comment by sysops [ 2015 Nov 19 ]

I have now migrated to another hypervisor (XEN) so I can do more testing.

Comment by Rostislav Palivoda [ 2017 Oct 26 ]

Please reopen if required and you could help us to reproduce.





[ZBX-9734] Wrong memory Freebsd 10.1 Created: 2015 Jul 28  Updated: 2017 May 30  Resolved: 2015 Aug 19

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Agent (G)
Affects Version/s: 2.4.5
Fix Version/s: None

Type: Incident report Priority: Critical
Reporter: sysops Assignee: Unassigned
Resolution: Won't fix Votes: 0
Labels: freebsd, memory
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

freebsd 10.1



 Description   

Agent report errata:
example in FreeBSD 10.1

  1. zabbix_get -s 192.168.77.115 -k 'proc.mem[,zabbix]'
    2506752

example in Oracle Linux (RHEL7)

  1. zabbix_get -s 192.168.77.111 -k 'proc.mem[,zabbix]'
    492810240


 Comments   
Comment by Aleksandrs Saveljevs [ 2015 Jul 28 ]

The issue description does not say what the problem is, but you probably mean that according to "proc.mem[,zabbix]", the agent uses a little memory on FreeBSD and a lot of memory on Linux. By itself, this is no indication of a bug: different methods are used on these operating systems for determining process memory usage and "proc.mem[,zabbix]" is generally not the best way of measuring memory usage for multi-process processes with shared memory, because a lot of common memory will be counted multiple times (at least on Linux).

If you wish this issue to be considered for investigation, you should provide a description of the problem and what the expected output should be.

Comment by sysops [ 2015 Jul 28 ]

Sorry for short description.
Example:
On FreeBSD agent consume 25.5 MB of RAM, BUT the command "'proc.mem" report that agent use only 2.5 MB .

$ zabbix_get -s 192.168.77.105 -k 'proc.mem[,zabbix]'
2506752

Another example:
On FreeBSD my mysql use 600/700 MB of RAM, BUT the command "proc.mem" report only 13.6MB

$ zabbix_get -s 192.168.77.105 -k 'proc.mem[,mysql]'
13647872

So proc.mem on a FreeBSD system report an errata value of consumed RAM for
every process.
On Oracle Linux (RHEL7) all values reported by proc.mem are correct.

ON FREEBSD 10.1

#top | grep zabbix
 1280 zabbix          1   4    0 25512K  3104K select  1   0:07   0.00% zabbix_agentd
 1281 zabbix          1   4    0 25512K  3096K select  1   0:07   0.00% zabbix_agentd
 1279 zabbix          1  23    0 25512K  3096K select  1   0:07   0.00% zabbix_agentd
 1278 zabbix          1  20    0 25512K  2944K nanslp  0   0:03   0.00% zabbix_agentd
 1282 zabbix          1  20    0 25460K  2840K nanslp  0   0:02   0.00% zabbix_agentd

#ps aux | grep zabbix
zabbix      1277   0.0  0.0  25460   2716  -  I    11:11PM    0:00.00 /usr/local/sbin/zabbix_agentd
zabbix      1278   0.0  0.0  25512   2944  -  S    11:11PM    0:02.73 zabbix_agentd: collector [idle 1 sec] (zabbix_agentd)
zabbix      1279   0.0  0.0  25512   3096  -  S    11:11PM    0:07.21 zabbix_agentd: listener #1 [waiting for connection] (zabbix_agentd)
zabbix      1280   0.0  0.0  25512   3104  -  S    11:11PM    0:07.31 zabbix_agentd: listener #2 [waiting for connection] (zabbix_agentd)
zabbix      1281   0.0  0.0  25512   3096  -  S    11:11PM    0:07.24 zabbix_agentd: listener #3 [waiting for connection] (zabbix_agentd)
zabbix      1282   0.0  0.0  25460   2840  -  S    11:11PM    0:01.56 zabbix_agentd: active checks #1 [idle 1 sec] (zabbix_agentd)

#top | grep mysql
35461 mysql          55  20    0   711M   610M uwait   0   0:54   0.00% mysqld

#ps aux | grep mysql
USER         PID  %CPU %MEM    VSZ    RSS TT  STAT STARTED       TIME COMMAND
mysql      35461   0.0  7.5 727564 624552  -  I     7:40AM    0:55.70 /usr/local/libexec/mysqld
mysql      35269   0.0  0.0  17064   2640  -  Is    7:40AM    0:00.01 /bin/sh /usr/local/bin/mysqld_safe
Comment by Aleksandrs Saveljevs [ 2015 Jul 28 ]

Thank you for an elaborate explanation!

Comment by Glebs Ivanovskis (Inactive) [ 2015 Aug 18 ]

Time has come for elaborate explanation from our side!

The problem is more likely to be in the lack of documentation but not in the proc.mem[] item itself. The reason for such huge difference in proc.mem[] output on Linux and FreeBSD is that on the former zabbix agent returns virtual memory size but on the latter it outputs size taken by process code, data and stack. (Call

#ps -o tsiz -o dsiz -o ssiz

and add up columns to get the same result as zabbix agent.)

I don't think it would be a good idea to change behaviour of proc.mem[] on FreeBSD to make it return virtual memory size because it would affect existing installations. Current trunk already has proc.mem[] with broadened functionality (https://support.zabbix.com/browse/ZBXNEXT-1078). There is one more parameter and one can use proc.mem[,,,,vsize] and proc.mem[,,,,rss] to see virtual memory size and resident set size. More information on this can be found here:





[ZBX-9655] Zabbix Server CRASH Created: 2015 Jun 23  Updated: 2017 Oct 25  Resolved: 2017 Oct 25

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Server (S)
Affects Version/s: 2.4.5
Fix Version/s: 2.2.11rc1, 2.4.7rc1, 3.0.0alpha2

Type: Incident report Priority: Major
Reporter: sysops Assignee: Unassigned
Resolution: Duplicate Votes: 0
Labels: crash, freebsd
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

10.1-RELEASE FreeBSD 10.1-RELEASE #0 r274401: [email protected]:/usr/obj/usr/src/sys/GENERIC amd64


Attachments: PNG File Screen Shot 2015-09-29 at 15.08.31.png     File freebsd_backtrace_x64.diff     Text File list.txt     Text File mysql.log     Text File mysql2.log     File mysql_init_check.diff     File mysql_library_init.diff     File mysql_static_conn.diff     Text File mysqld.log     Text File patch_command.txt     Text File pkg.txt     Text File zabbix_server.log     Text File zabbix_server.log     Text File zabbix_server_crash.log     Text File zabbix_server_crash2.log    
Issue Links:
Duplicate
duplicates ZBX-7765 zbx_set_common_signal_handlers crash ... Closed
duplicates ZBX-10962 Crash/exit in poller performing ODBC ... Closed
Sub-task
depends on ZBX-12159 Resolving TNS names via LDAP crash on... Confirmed

 Description   

Suddenly Crashing ...

   526:20150622:172758.659 [Z3005] query failed: [2013] Lost connection to MySQL server during query [select hostid,key_,state,evaltype,formula,error,lifetime from items where itemid=23278]
   526:20150622:172758.659 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x0]. Crashing ...
   526:20150622:172758.659 ====== Fatal information: ======
   526:20150622:172758.659 program counter not available for this architecture
   526:20150622:172758.659 === Registers: ===
   526:20150622:172758.659 register dump not available for this architecture
   526:20150622:172758.660 === Backtrace: ===
   526:20150622:172758.660 1: 0x466fc6 <print_fatal_info+0x86> at /usr/local/sbin/zabbix_server
   526:20150622:172758.660 0: 0x46743c <zbx_set_common_signal_handlers+0x2fc> at /usr/local/sbin/zabbix_server
   526:20150622:172758.660 === Memory map: ===
   526:20150622:172758.660 memory map not available for this platform
   526:20150622:172758.660 ================================
   513:20150622:172758.662 One child process died (PID:526,exitcode/signal:1). Exiting ...
   513:20150622:172800.726 syncing history data...
   513:20150622:172800.726 syncing history data done
   513:20150622:172800.726 syncing trends data...
   513:20150622:172800.735 syncing trends data done
   513:20150622:172800.736 Zabbix Server stopped. Zabbix 2.4.5 (revision 53282).

Zabbix server v2.4.5 (revision 53282) (21 April 2015)
Compilation time: Jun 12 2015 06:53:41



 Comments   
Comment by sysops [ 2015 Jun 24 ]

list of package installed on FreeBSD server (where zabbix server run)

Comment by sysops [ 2015 Jun 24 ]

Another crash...
in the moment of crashing the remote mysql server (where zabbix database reside) has been rebooted, but may be a coincidence.

   539:20150623:233751.082 executing housekeeper
   539:20150623:233751.564 housekeeper [deleted 11745 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.479474 sec, idle 1 hour(s)]
   556:20150624:000002.120 [Z3005] query failed: [1317] Query execution was interrupted [select escalationid,actionid,triggerid,eventid,r_eventid,nextcheck,esc_step,status,itemid from escalations order by actionid,triggerid,itemid,escalationid]
   544:20150624:000002.121 [Z3005] query failed: [2013] Lost connection to MySQL server during query [commit;]
   544:20150624:000002.121 [Z3001] connection to database 'zabbix' failed: [2003] Can't connect to MySQL server on '192.168.77.111' (61)
   544:20150624:000002.121 database is down: reconnecting in 10 seconds
   522:20150624:000002.121 [Z3005] query failed: [2013] Lost connection to MySQL server during query [update hosts set errors_from=1435104002,disable_until=1435104017,error='Get value from agent failed: cannot connect to [[192.168.77.111]:10050]: [61] Connection refused' where hostid=10112]
   522:20150624:000002.122 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x0]. Crashing ...
   522:20150624:000002.122 ====== Fatal information: ======
   522:20150624:000002.122 program counter not available for this architecture
   522:20150624:000002.122 === Registers: ===
   522:20150624:000002.122 register dump not available for this architecture
   522:20150624:000002.122 === Backtrace: ===
   522:20150624:000002.122 1: 0x466fc6 <print_fatal_info+0x86> at /usr/local/sbin/zabbix_server
   522:20150624:000002.122 0: 0x46743c <zbx_set_common_signal_handlers+0x2fc> at /usr/local/sbin/zabbix_server
   522:20150624:000002.122 === Memory map: ===
   522:20150624:000002.122 memory map not available for this platform
   522:20150624:000002.122 ================================
   513:20150624:000002.124 One child process died (PID:522,exitcode/signal:1). Exiting ...
   513:20150624:000004.193 [Z3001] connection to database 'zabbix' failed: [2003] Can't connect to MySQL server on '192.168.77.111' (61)
   513:20150624:000004.193 Cannot connect to the database. Exiting...
Comment by sysops [ 2015 Jun 24 ]

another one crash:

  3048:20150624:080703.419 [Z3005] query failed: [2013] Lost connection to MySQL server during query [select hostid,status from hosts where host='zabbix01.bi-different.intra' and status in (0,1) and flags<>2 and proxy_hostid is null]
  3049:20150624:081459.419 [Z3005] query failed: [2013] Lost connection to MySQL server during query [select hostid,status from hosts where host='kirk01' and status in (0,1) and flags<>2 and proxy_hostid is null]
  3055:20150624:081643.479 executing housekeeper
  3055:20150624:081644.608 housekeeper [deleted 46463 hist/trends, 15 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 1.126811 sec, idle 1 hour(s)]
  3051:20150624:081659.609 [Z3005] query failed: [2013] Lost connection to MySQL server during query [select hostid,status from hosts where host='kirk01' and status in (0,1) and flags<>2 and proxy_hostid is null]
  3050:20150624:082504.109 [Z3005] query failed: [2013] Lost connection to MySQL server during query [select hostid,status from hosts where host='zabbix01.bi-different.intra' and status in (0,1) and flags<>2 and proxy_hostid is null]
  3043:20150624:082758.105 [Z3005] query failed: [2013] Lost connection to MySQL server during query [select hostid,key_,state,evaltype,formula,error,lifetime from items where itemid=23278]
  3043:20150624:082758.105 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x0]. Crashing ...
  3043:20150624:082758.105 ====== Fatal information: ======
  3043:20150624:082758.105 program counter not available for this architecture
  3043:20150624:082758.105 === Registers: ===
  3043:20150624:082758.105 register dump not available for this architecture
  3043:20150624:082758.105 === Backtrace: ===
  3043:20150624:082758.106 1: 0x466fc6 <print_fatal_info+0x86> at /usr/local/sbin/zabbix_server
  3043:20150624:082758.106 0: 0x46743c <zbx_set_common_signal_handlers+0x2fc> at /usr/local/sbin/zabbix_server
  3043:20150624:082758.106 === Memory map: ===
  3043:20150624:082758.106 memory map not available for this platform
  3043:20150624:082758.106 ================================
  3039:20150624:082758.109 One child process died (PID:3043,exitcode/signal:1). Exiting ...
  3039:20150624:082800.137 syncing history data...
  3039:20150624:082800.141 syncing history data done
  3039:20150624:082800.141 syncing trends data...
  3039:20150624:082800.209 syncing trends data done
  3039:20150624:082800.209 Zabbix Server stopped. Zabbix 2.4.5 (revision 53282).
Comment by sysops [ 2015 Jun 24 ]

I was be able to reproduce crash:
HOST A : 192.168.77.222 server with installed and running zabbix24-server-2.4.5
HOST B : 192.168.77.111 server with installed and running mysql server (with zabbix database)

… start zabbix server on HOST (A)

 13758:20150624:083400.035 server #13 started [trapper #5]
 13763:20150624:083400.036 server #18 started [http poller #1]
 13766:20150624:083400.036 server #21 started [history syncer #2]
 13767:20150624:083400.038 server #22 started [history syncer #3]
 13765:20150624:083400.039 server #20 started [history syncer #1]
 13770:20150624:083400.040 server #25 started [proxy poller #1]
 13764:20150624:083400.041 server #19 started [discoverer #1]
 13771:20150624:083400.041 server #26 started [self-monitoring #1]
 13769:20150624:083400.042 server #24 started [escalator #1]
 13768:20150624:083400.042 server #23 started [history syncer #4]

.. everything is ok…

.. manual stopping mysql server on remote host (B) where zabbix database is stored [[systemctl stop mysql.service]]

 13762:20150624:091631.778 [Z3005] query failed: [2013] Lost connection to MySQL server during query [commit;]
 13762:20150624:091631.779 [Z3001] connection to database 'zabbix' failed: [2003] Can't connect to MySQL server on '192.168.77.111' (61)
 13762:20150624:091631.779 database is down: reconnecting in 10 seconds
 13754:20150624:091738.040 [Z3001] connection to database 'zabbix' failed: [2003] Can't connect to MySQL server on '192.168.77.111' (61)
 13754:20150624:091738.040 database is down: reconnecting in 10 seconds

..after one minute….manual start mysql service on remote host (B) where zabbix database is stored
(systemctl start mysql.service)

 13768:20150624:091741.745 database connection re-established
 13754:20150624:091748.073 database connection re-established

..after a while log of zabbix server (on host A) is populate with :

 13755:20150624:091750.370 [Z3005] query failed: [2013] Lost connection to MySQL server during query [select hostid,status from hosts where host='hanzo.bi-different.intra' and status in (0,1) and flags<>2 and proxy_hostid is null]
 13757:20150624:091806.090 [Z3005] query failed: [2013] Lost connection to MySQL server during query [select hostid,status from hosts where host='zabbix01.bi-different.intra' and status in (0,1) and flags<>2 and proxy_hostid is null]
 13758:20150624:092151.090 [Z3005] query failed: [2013] Lost connection to MySQL server during query [select hostid,status from hosts where host='hanzo.bi-different.intra' and status in (0,1) and flags<>2 and proxy_hostid is null]

..and ten minutes later without other logs zabbix server (on host A) crash:

13752:20150624:092758.041 [Z3005] query failed: [2013] Lost connection to MySQL server during query [select hostid,key_,state,evaltype,formula,error,lifetime from items where itemid=23278]
 13752:20150624:092758.042 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x0]. Crashing ...
 13752:20150624:092758.042 ====== Fatal information: ======
 13752:20150624:092758.042 program counter not available for this architecture
 13752:20150624:092758.042 === Registers: ===
 13752:20150624:092758.042 register dump not available for this architecture
 13752:20150624:092758.042 === Backtrace: ===
 13752:20150624:092758.043 1: 0x466fc6 <print_fatal_info+0x86> at /usr/local/sbin/zabbix_server
 13752:20150624:092758.043 0: 0x46743c <zbx_set_common_signal_handlers+0x2fc> at /usr/local/sbin/zabbix_server
 13752:20150624:092758.043 === Memory map: ===
 13752:20150624:092758.043 memory map not available for this platform
 13752:20150624:092758.043 ================================
 13745:20150624:092758.047 One child process died (PID:13752,exitcode/signal:1). Exiting ...
 13745:20150624:092800.089 syncing history data...
 13745:20150624:092800.091 syncing history data done
 13745:20150624:092800.091 syncing trends data...
 13745:20150624:092800.171 syncing trends data done
 13745:20150624:092800.171 Zabbix Server stopped. Zabbix 2.4.5 (revision 53282).
Comment by sysops [ 2015 Jun 24 ]

One hour later after restart of mysql (see attachment) zabbix server crash (see log with debug level=4)

Comment by Aleksandrs Saveljevs [ 2015 Jun 25 ]

This looks like a duplicate of ZBX-7765, but this task has a nice description and a way to reproduce the problem.

Comment by Andris Zeila [ 2015 Jun 30 ]

I've been trying to reproduce it without any luck. My setup was two virtual machines running 10.1-RELEASE FreeBSD 10.1-RELEASE #0 r274401. I tried running zabbix server from the default package and also one compiled from sources. It had default configuration monitoring one host. On the other system I was running mysql server from the default mysql56-server package.

So the setup was as close as I could get to the described one, but no stopping/starting mysql server caused any zabbix server crashes.

What I noticed you had mysql56-client-5.6.24 package listed, while on my installations I had mysql56-client-5.6.24_1. Could not find anything about fixed crashes in changelog - so I doubt it was the reason. Still maybe you could upgrade your mysql package and try to reproduce the crash again?

Comment by sysops [ 2015 Jun 30 ]

Reproduced.
[root@k.......]# date
Tue Jun 30 15:34:27 UTC 2015
[root@k.......]]# systemctl stop mysql.service

[root@k.......]]# date
Tue Jun 30 15:37:25 UTC 2015
[root@.......]# systemctl start mysql.service

root@zabbix# cat /var/log/zabbix_server.log | grep stopped
59902:20150630:153935.199 Zabbix Server stopped. Zabbix 2.4.5 (revision 53282).

Comment by sysops [ 2015 Jun 30 ]

I have upgraded mysql56-client-5.6.24_1 of zabbix server via source ports
but crash persist:

stopped mysqlserver (on Oracle Linux ) for 3 min
then zabbix (on freebsd 10.1) crashed few minutes later (view log with debug level=4)

Comment by Andris Zeila [ 2015 Jul 02 ]

Thanks, but still can't reproduce it. Nothing really suspicious in DB connection code.

Would it be possible to build Zabbix server from sources with the attached patch (freebsd_backtrace_x64.diff) and reproduce the crash? It should give proper stack trace. (Note that the patch will work only on 64 bit freebsd systems).

Comment by sysops [ 2015 Jul 09 ]

..the problem persist after each mysql down
Have you installed mysql-server on "Oracle Linux" distributiuon as my enviroment ?

I tried your patch but I am unable to complie:

root@zabbix01:/usr/home/user/zabbix-2.4.5 # tar -xvf zabbix-2.4.5.tar.gz

root@zabbix01:/usr/home/user # patch zabbix-2.4.5/src/libs/zbxnix/fatal.c freebsd_backtrace_x64.diff
Hmm...  Looks like a unified diff to me...
The text leading up to this was:
--------------------------
|Index: src/libs/zbxnix/fatal.c
|===================================================================
|--- src/libs/zbxnix/fatal.c	(revision 54194)
|+++ src/libs/zbxnix/fatal.c	(working copy)
--------------------------
Patching file zabbix-2.4.5/src/libs/zbxnix/fatal.c using Plan A...
Hunk #1 succeeded at 66.
Hunk #2 succeeded at 231.
Hunk #3 succeeded at 311.
done

root@zabbix01:/usr/home/user# cd zabbix-2.4.5

root@zabbix01:/usr/home/user/zabbix-2.4.5 # ./configure --enable-server --with-mysql --with-libcurl --with-libxml2


***********************************************************
*            Now run 'make install'                       *
*                                                         *
*            Thank you for using Zabbix!                  *
*              <http://www.zabbix.com>                    *
***********************************************************

root@zabbix01:/usr/home/user/zabbix-2.4.5 # make install
Making install in src
Making install in libs
Making install in zbxcrypto
cc -DHAVE_CONFIG_H -I. -I../../../include      -g -O2  -I/usr/local/include/mysql -pipe  -fstack-protector -fno-strict-aliasing  -g -fno-omit-frame-pointer -fno-strict-aliasing     -I/usr/local/include/libxml2 -I/usr/include -MT md5.o -MD -MP -MF .deps/md5.Tpo -c -o md5.o md5.c
In file included from md5.c:54:
In file included from ../../../include/common.h:23:
In file included from ../../../include/sysinc.h:372:
/usr/include/sys/timeb.h:42:2: warning: "this file includes <sys/timeb.h> which is deprecated" [-W#warnings]
#warning "this file includes <sys/timeb.h> which is deprecated"
 ^
In file included from md5.c:54:
In file included from ../../../include/common.h:23:
../../../include/sysinc.h:381:11: fatal error: 'curl/curl.h' file not found
#       include <curl/curl.h>
                ^
1 warning and 1 error generated.
*** Error code 1

Stop.
make[3]: stopped in /usr/home/user/zabbix-2.4.5/src/libs/zbxcrypto
*** Error code 1

Stop.
make[2]: stopped in /usr/home/user/zabbix-2.4.5/src/libs
*** Error code 1

Stop.
make[1]: stopped in /usr/home/user/zabbix-2.4.5/src
*** Error code 1

Stop.
make: stopped in /usr/home/user/zabbix-2.4.5
Comment by Aleksandrs Saveljevs [ 2015 Jul 09 ]

The compilation error you see is not because of the patch (it is not related to cURL functionality is any way). Was the ./configure step successful? What was ./configure's output?

Comment by sysops [ 2015 Jul 20 ]

Sorry for late responde ... I was on holiday

OK I have done configure without curl:
/usr/local/etc/rc.d/zabbix_server stop

./configure --enable-server --with-mysql

then
make install

then
/usr/local/etc/rc.d/zabbix_server start
Starting zabbix_server.

After that to run zabbix server I have to copy my conf in another path:
cp /usr/local/etc/zabbix24/zabbix_server.conf /usr/local/etc/zabbix_server.conf

/usr/local/etc/rc.d/zabbix_server start

Do you need debug level 3 or 4 ?

Comment by Andris Zeila [ 2015 Jul 27 ]

Sorry for late responde ... I was on holiday

No problem, so was I

4 would be better (though 3 should be enough if the crash originates from the place I thought).

Comment by sysops [ 2015 Jul 27 ]

So,
installing from source (with your patch) with this configure:
./configure --enable-server --enable-agent --with-mysql
I wasn't able to reproduce the problem.
But I need ODBC, SSH and other..
so I reinstalled from ports with this config:
CURL=on: Support for web monitoring
FPING=on: Build/install fping for ping checks
IPMI=off: Support for IPMI checks
IPV6=off: IPv6 protocol support
JABBER=off: Support for Jabber media type
JAVAGW=off: Support for Java gateway
LDAP=off: Support for LDAP server checks
LIBXML2=on: Support for libxml2 (required by monitoring VMware)
NMAP=off: Build/install nmap for o/s detection
SSH=on: Support for SSH-based checks
====> Options available for the single DB: you have to select exactly one of them
MYSQL=on: MySQL database support
PGSQL=off: PostgreSQL database support
SQLITE=off: SQLite database support
ORACLE=off: Oracle database support
====> Support for database checks via ODBC: you have to select exactly one of them
IODBC=off: ODBC backend via iODBC
UNIXODBC=on: ODBC backend via unixODBC

and I reproduced the problem simply turning off mysqld service and leave it down.
Could you suggest me the way to installing zabbix server from source with
CURL,FPING,LIBXML2,MYSQL,UNIXODBC

Comment by Andris Zeila [ 2015 Jul 27 ]

You should try configure with the following parameters:

./configure --enable-server --enable-agent --with-mysql --with-libcurl --with-libxml2 --with-unixodbc --with-ssh2

There are no specific fping build options in Zabbix, so I'm not sure what FPING=on means in ports, probably access rights confguration.

Comment by sysops [ 2015 Jul 27 ]

error:

checking for SSH2 support... yes
checking for gawk... (cached) nawk
checking for curl-config... /usr/local/bin/curl-config
checking for the version of libcurl... 7.43.0
checking for libcurl >= version 7.13.1... yes
checking for main in -lcurl... yes
checking whether libcurl is usable... yes
checking for curl_free... yes
checking for curl_easy_escape... yes
checking for ICONV support... configure: error: Unable to use iconv (libiconv check failed)

Comment by Andris Zeila [ 2015 Jul 27 ]

Strange, 10.1 should have native iconv support. Could you why libiconv check failed by running the following in zabbix build directory:
grep -A20 'checking for ICONV' config.log

Comment by sysops [ 2015 Jul 27 ]

/home/bid12/zabbix-2.4.5 # grep -A20 'checking for ICONV' config.log

configure:11064: checking for ICONV support
configure:11106: cc -o conftest -g -O2  -I/usr/local/include/mysql -fstack-protector -fno-strict-aliasing  -g -fno-omit-frame-pointer -fno-strict-aliasing     -I/usr/local/include/libxml2 -I/usr/include -I/usr/local/include  -I/usr/local/include      -rdynamic   conftest.c -lkvm -lm -lexecinfo -ldevstat   >&5
/tmp/conftest-b7e05b.o: In function `main':
/home/user/zabbix-2.4.5/conftest.c:126: undefined reference to `libiconv_open'
/home/user/zabbix-2.4.5/conftest.c:127: undefined reference to `libiconv'
/home/user/zabbix-2.4.5/conftest.c:128: undefined reference to `libiconv_close'
cc: error: linker command failed with exit code 1 (use -v to see invocation)
configure:11106: $? = 1
configure: failed program was:
| /* confdefs.h */
| #define PACKAGE_NAME "Zabbix"
| #define PACKAGE_TARNAME "zabbix"
| #define PACKAGE_VERSION "2.4.5"
| #define PACKAGE_STRING "Zabbix 2.4.5"
| #define PACKAGE_BUGREPORT ""
| #define PACKAGE_URL ""
| #define PACKAGE "zabbix"
| #define VERSION "2.4.5"
| #define STDC_HEADERS 1
| #define HAVE_SYS_TYPES_H 1
| #define HAVE_SYS_STAT_H 1
# freebsd-version 
10.1-RELEASE-p15
# pkg info | grep libiconv
libiconv-1.14_8                Character set conversion library
Comment by Andris Zeila [ 2015 Jul 27 ]

Then you can try specifying the iconv installation directory:

If you want to specify iconv installation directories:
  --with-iconv=[DIR]      use iconv from given base install directory (DIR),
                          default is to search through a number of common
                          places for the iconv files.
  --with-iconv-include=[DIR]
                          use iconv include headers from given path.
  --with-iconv-lib=[DIR]  use iconv libraries from given path.

You should be able to find the installation directories with pkg info -l libiconv-1.14_8 (or just grep filesystem for libiconv.so/iconv.h).

Comment by sysops [ 2015 Jul 27 ]

Always fail:

./configure --enable-server --enable-agent --with-mysql --with-libxml2 --with-unixodbc --with-ssh2 --with-iconv=/usr/local/include/iconv.h

or

./configure --enable-server --enable-agent --with-mysql --with-libxml2 --with-unixodbc --with-ssh2 --with-iconv-include=/usr/local/include/iconv.h

or

./configure --enable-server --enable-agent --with-mysql --with-libxml2 --with-unixodbc --with-ssh2 --with-iconv-lib=/usr/local/include/iconv.h
/home/user/zabbix-2.4.5 # grep -A20 'checking for ICONV' config.log
configure:11064: checking for ICONV support
configure:11106: cc -o conftest -g -O2  -I/usr/local/include/mysql -fstack-protector -fno-strict-aliasing  -g -fno-omit-frame-pointer -fno-strict-aliasing     -I/usr/local/include/libxml2 -I/usr/include -I/usr/local/include  -I/usr/local/include    -I//usr/local/include/iconv.h/include  -rdynamic  -L//usr/local/include/iconv.h/lib conftest.c -lkvm -lm -lexecinfo -ldevstat   >&5
/tmp/conftest-dcc6c6.o: In function `main':
/home/user/zabbix-2.4.5/conftest.c:126: undefined reference to `libiconv_open'
/home/user/zabbix-2.4.5/conftest.c:127: undefined reference to `libiconv'
/home/user/zabbix-2.4.5/conftest.c:128: undefined reference to `libiconv_close'
cc: error: linker command failed with exit code 1 (use -v to see invocation)
configure:11106: $? = 1
configure: failed program was:
| /* confdefs.h */
| #define PACKAGE_NAME "Zabbix"
| #define PACKAGE_TARNAME "zabbix"
| #define PACKAGE_VERSION "2.4.5"
| #define PACKAGE_STRING "Zabbix 2.4.5"
| #define PACKAGE_BUGREPORT ""
| #define PACKAGE_URL ""
| #define PACKAGE "zabbix"
| #define VERSION "2.4.5"
| #define STDC_HEADERS 1
| #define HAVE_SYS_TYPES_H 1
| #define HAVE_SYS_STAT_H 1
# pkg info -l libiconv
libiconv-1.14_8:
	/usr/local/bin/iconv
	/usr/local/include/iconv.h
	/usr/local/include/libcharset.h
	/usr/local/include/localcharset.h
	/usr/local/lib/charset.alias
	/usr/local/lib/libcharset.a
	/usr/local/lib/libcharset.so
	/usr/local/lib/libcharset.so.1
	/usr/local/lib/libcharset.so.1.0.0
	/usr/local/lib/libiconv.a
	/usr/local/lib/libiconv.so
	/usr/local/lib/libiconv.so.2
	/usr/local/lib/libiconv.so.2.5.1
	/usr/local/lib/libiconv.so.3
	/usr/local/man/man1/iconv.1.gz
	/usr/local/man/man3/iconv.3.gz
	/usr/local/man/man3/iconv_close.3.gz
	/usr/local/man/man3/iconv_open.3.gz
	/usr/local/man/man3/iconv_open_into.3.gz
	/usr/local/man/man3/iconvctl.3.gz
	/usr/local/share/doc/libiconv/iconv.1.html
	/usr/local/share/doc/libiconv/iconv.3.html
	/usr/local/share/doc/libiconv/iconv_close.3.html
	/usr/local/share/doc/libiconv/iconv_open.3.html
	/usr/local/share/doc/libiconv/iconv_open_into.3.html
	/usr/local/share/doc/libiconv/iconvctl.3.html
# find / -name iconv.h
/usr/local/include/iconv.h
/usr/include/iconv.h
/usr/include/sys/iconv.h
Comment by Andris Zeila [ 2015 Jul 27 ]

Oh, try then

LDFLAGS=-liconv ./configure --enable-server --enable-agent --with-mysql --with-libxml2 --with-unixodbc --with-ssh2
Comment by sysops [ 2015 Jul 27 ]

Ok
rm config.log

 ./configure CFLAGS="-I/usr/local/include" LDFLAGS="-L/usr/local/lib" --enable-server --enable-agent --with-mysql --with-libxml2 --with-unixodbc --with-ssh2

BUT AFTEER THIS:

Configuration:

  Detected OS:           freebsd10.1
  Install path:          /usr/local
  Compilation arch:      freebsd

  Compiler:              cc
  Compiler flags:        -I/usr/local/include  -I/usr/local/include/mysql -fstack-protector -fno-strict-aliasing  -g -fno-omit-frame-pointer -fno-strict-aliasing     -I/usr/local/include/libxml2 -I/usr/include -I/usr/local/include  -I/usr/local/include    

  Enable server:         yes
  Server details:
    With database:         MySQL
    WEB Monitoring:        no
    Native Jabber:         no
    SNMP:                  no
    IPMI:                  no
    SSH:                   yes
    ODBC:                  yes
    Linker flags:          -rdynamic -L/usr/local/lib     -L/usr/local/lib/mysql      -L/usr/local/lib -L/usr/lib -L/usr/local/lib  -L/usr/local/lib   
    Libraries:             -lkvm -lm -lexecinfo -ldevstat   -liconv   -lmysqlclient      -lxml2  -lodbc  -lssh2   

  Enable proxy:          no

  Enable agent:          yes
  Agent details:
    Linker flags:          -rdynamic -L/usr/local/lib    
    Libraries:             -lkvm -lm -lexecinfo -ldevstat   -liconv   

  Enable Java gateway:   no

  LDAP support:          no
  IPv6 support:          no

***********************************************************
*            Now run 'make install'                       *
*                                                         *
*            Thank you for using Zabbix!                  *
*              <http://www.zabbix.com>                    *
***********************************************************

I found error in confi log file:

 grep -A20 'checking for ICONV' config.log
configure:11064: checking for ICONV support
configure:11106: cc -o conftest -I/usr/local/include  -I/usr/local/include/mysql -fstack-protector -fno-strict-aliasing  -g -fno-omit-frame-pointer -fno-strict-aliasing     -I/usr/local/include/libxml2 -I/usr/include -I/usr/local/include  -I/usr/local/include      -rdynamic -L/usr/local/lib  conftest.c -lkvm -lm -lexecinfo -ldevstat   >&5
/tmp/conftest-85ee20.o: In function `main':
/home/bid12/zabbix-2.4.5/conftest.c:127: undefined reference to `libiconv_open'
/home/bid12/zabbix-2.4.5/conftest.c:128: undefined reference to `libiconv'
/home/bid12/zabbix-2.4.5/conftest.c:129: undefined reference to `libiconv_close'
cc: error: linker command failed with exit code 1 (use -v to see invocation)
configure:11106: $? = 1
configure: failed program was:
| /* confdefs.h */
| #define PACKAGE_NAME "Zabbix"
| #define PACKAGE_TARNAME "zabbix"
| #define PACKAGE_VERSION "2.4.5"
| #define PACKAGE_STRING "Zabbix 2.4.5"
| #define PACKAGE_BUGREPORT ""
| #define PACKAGE_URL ""
| #define PACKAGE "zabbix"
| #define VERSION "2.4.5"
| #define STDC_HEADERS 1
| #define HAVE_SYS_TYPES_H 1
| #define HAVE_SYS_STAT_H 1

Should I run 'make install' anyway?

Comment by Andris Zeila [ 2015 Jul 27 ]

Maybe it was the old config.log file? The final configure output looks ok and it would not finish if there were any errors. Also -liconv has been added to the server and agent libraries. Try making it.

Comment by sysops [ 2015 Jul 27 ]

ok I do make install,
but it was a new config.log (see the first line of my previous post: rm config.log.
So, it wasn't old config.log file.

make install
stoopped mysql on another server
150727 14:27:02 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended

... no crashing ....

Comment by sysops [ 2015 Jul 27 ]

restarted mysql 15:16:03

zabbix server stopped 15:28:00
see attach.

Comment by Andris Zeila [ 2015 Jul 28 ]

Thanks!

As I suspeceted it crashed in mysql_real_connect(), which almost certanly means that mysql_init() returned NULL. From MYSQL documentation it can return NULL only if there was insufficient memory to allocate a new object, which sounds unlikely.

Would you be up to trying few more patches while I'm trying to poke around this issue? I have few ideas which might or might not work, but nothing certain.

Comment by sysops [ 2015 Jul 28 ]

OK,
send me your patches

Comment by Andris Zeila [ 2015 Jul 28 ]

Thanks!

I attached 3 small patches:

  • mysql_init_check.diff - adds a check if mysql_init() really returned NULL. In this case server would log a critical error and exit.
  • mysql_library_init.diff - adds explicit mysql library initialization in main process. The mysql_library_init() is automatically called from mysql_init(), but in this case some thread related data would be initialized only on the next mysql_init() call. Zabbix does not use threads, so in therory it should not make any difference. But best is to check to be certain.
  • mysql_static_conn.diff - instead of alocation connection object for each mysql_init() call it will define a static connection object and reuse it.

You can apply all 4 patches (the backtrace patch included) first to check if it fixes the crash. If everything is okay then you could remove either mysql_library_init.diff or mysql_static_conn.diff to find the fix.

The patches should be applied in the following order:

  • mysql_static_conn.diff
  • mysql_init_check.diff
  • mysql_library_init.diff
  • mysql_static_conn.diff
Comment by sysops [ 2015 Jul 29 ]

Crash again...
I have applied all patches in the following order:

patch < mysql_static_conn.diff
patch < mysql_static_conn.diff mysql_init_check.diff
patch < mysql_static_conn.diffmysql_library_init.diff

but, when I shutdown mysql on another server:
2015-07-29 07:38:17 25153 [Note] /usr/sbin/mysqld: Shutdown complete
150729 07:38:17 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended

..20 sec after, zabbix server died:
13668:20150729:073836.205 [Z3001] connection to database 'zabbix' failed: [2003] Can't connect to MySQL server on '192.168.77.111' (61)
13668:20150729:073836.205 database is down: reconnecting in 10 seconds
13651:20150729:073836.394 [Z3001] connection to database 'zabbix' failed: [2003] Can't connect to MySQL server on '192.168.77.111' (61)
13651:20150729:073836.394 database is down: reconnecting in 10 seconds
13665:20150729:073836.394 [Z3001] connection to database 'zabbix' failed: [2003] Can't connect to MySQL server on '192.168.77.111' (61)
13665:20150729:073836.394 database is down: reconnecting in 10 seconds
13663:20150729:073838.078 [Z3001] connection to database 'zabbix' failed: [2003] Can't connect to MySQL server on '192.168.77.111' (61)
13663:20150729:073838.078 database is down: reconnecting in 10 seconds
13658:20150729:073839.195 [Z3001] connection to database 'zabbix' failed: [2003] Can't connect to MySQL server on '192.168.77.111' (61)
13658:20150729:073839.195 database is down: reconnecting in 10 seconds
13655:20150729:073839.787 [Z3005] query failed: [2013] Lost connection to MySQL server during query [select hostid,key_,state,evaltype,formula,error,lifetime from items where itemid=23919]
13655:20150729:073839.787 cannot initialize MYSQL connection object
13650:20150729:073839.788 One child process died (PID:13655,exitcode/signal:1). Exiting ...
13650:20150729:073841.821 [Z3001] connection to database 'zabbix' failed: [2003] Can't connect to MySQL server on '192.168.77.111' (61)
13650:20150729:073841.821 Cannot connect to the database. Exiting...

Comment by sysops [ 2015 Jul 29 ]

See attachment"patch_command.txt" for Command History used for patching

Comment by sysops [ 2015 Jul 29 ]

again 15minutes after mysql down with debug level=4
2015-07-29 08:13:11 12724 [Note] /usr/sbin/mysqld: Shutdown complete

See attachment "zabbix_server_crash2.log "

Comment by Andris Zeila [ 2015 Jul 29 ]

Yes, Thanks

It's clear where the crash happens, but why mysql_init() might return NULL - currently have no idea. Will keep digging around.

Comment by Andris Zeila [ 2015 Aug 31 ]

At the end there is nothing much we can do if mysql connection initialization fails with what is supposed to be 'out of memory' error. It would be better to gracefully terminate the process, but the end result would be the same - the rest of processes would exit too.

If the default configuration is working fine it must be something with the shared libraries. You could try enabling zabbix features one by one to find out which library causes zabbix to crash. Maybe updating/rebuilding it would fix things.

Comment by Andris Zeila [ 2015 Aug 31 ]

Added check for mysql_init() returning NULL in development branch svn://svn.zabbix.com/branches/dev/ZBX-9655

Comment by dimir [ 2015 Sep 04 ]

Please review r55391

wiper reviewed, thanks

Comment by Andris Zeila [ 2015 Sep 04 ]

Released in:

  • pre-2.2.11rc1 r55405
  • pre-2.4.7rc1 r55406
  • pre-3.0.0alpha2 r55407
Comment by sysops [ 2015 Sep 29 ]

I moved mysql server on the same server where zabbix server run. NO problem for many days.
But this morning, 58 min after adding a zabbix agent on the same server (so in one server there is mysql, zabbix server and zabbix agent) zabbix server suddenly crash.
Mysql is always up and running without reboot.

77512:20150929:102758.179 [Z3005] query failed: [2006] MySQL server has gone away [select hostid,key_,state,evaltype,formula,error,lifetime from items where itemid=23278]
 77512:20150929:102758.179 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x0]. Crashing ...
 77512:20150929:102758.179 ====== Fatal information: ======
 77512:20150929:102758.179 program counter not available for this architecture
 77512:20150929:102758.179 === Registers: ===
 77512:20150929:102758.179 register dump not available for this architecture
 77512:20150929:102758.179 === Backtrace: ===
 77512:20150929:102758.184 3: 0x456046 <print_fatal_info+0x86> at /usr/local/sbin/zabbix_server
 77512:20150929:102758.184 2: 0x4564bc <zbx_set_common_signal_handlers+0x2fc> at /usr/local/sbin/zabbix_server
 77512:20150929:102758.184 1: 0x802c94997 <pthread_sigmask+0x497> at /lib/libthr.so.3
 77512:20150929:102758.184 0: 0x802c941a8 <pthread_getspecific+0xdd8> at /lib/libthr.so.3
 77512:20150929:102758.185 === Memory map: ===
 77512:20150929:102758.185 memory map not available for this platform
 77512:20150929:102758.185 ================================
 77497:20150929:102758.200 One child process died (PID:77512,exitcode/signal:1). Exiting ...
 77497:20150929:102800.211 syncing history data...
 77497:20150929:102800.215 syncing history data done
 77497:20150929:102800.215 syncing trends data...
 77497:20150929:102800.361 syncing trends data done
 77497:20150929:102800.361 Zabbix Server stopped. Zabbix 2.4.6 (revision 54796).

zabbix agent log (on the same server)

root@monitor001:/usr/ports/net-mgmt/zabbix24-agent # cat /var/log/zabbix_agentd.log
 36905:20150929:093133.368 Starting Zabbix Agent [monitor001.myserver.intra]. Zabbix 2.4.6 (revision 54796).
 36905:20150929:093133.368 using configuration file: /usr/local/etc/zabbix24/zabbix_agentd.conf
 36905:20150929:093133.368 agent #0 started [main process]
 36906:20150929:093133.369 agent #1 started [collector]
 36907:20150929:093133.369 agent #2 started [listener #1]
 36908:20150929:093133.370 agent #3 started [listener #2]
 36909:20150929:093133.370 agent #4 started [listener #3]
 36910:20150929:093133.370 agent #5 started [active checks #1]
 36910:20150929:102838.372 active check data upload to [zabbix.myserver.intra:10051] started to fail ([connect] cannot connect to [[zabbix.yourewardyourlife.intra]:10051]: [61] Connection refused)
 36910:20150929:102937.536 active check configuration update from [zabbix.myserver.intra:10051] started to fail (cannot connect to [[zabbix.yourewardyourlife.intra]:10051]: [61] Connection refused)
root@monitor001:/usr/ports/net-mgmt/zabbix24-agent # 
Comment by sysops [ 2015 Sep 29 ]

Mysql status

Comment by Glebs Ivanovskis (Inactive) [ 2016 Jul 01 ]

An observation. This:

77512:20150929:102758.179 [Z3005] query failed: [2006] MySQL server has gone away [select hostid,key_,state,evaltype,formula,error,lifetime from items where itemid=23278]
 77512:20150929:102758.179 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x0]. Crashing ...

looks like processing of LLD rule id lld_process_discovery_rule() and this:

   522:20150624:000002.121 [Z3005] query failed: [2013] Lost connection to MySQL server during query [update hosts set errors_from=1435104002,disable_until=1435104017,error='Get value from agent failed: cannot connect to [[192.168.77.111]:10050]: [61] Connection refused' where hostid=10112]
   522:20150624:000002.122 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x0]. Crashing ...

looks like a query from db_host_update_availability() - the only two occasions when poller accesses our DB directly. Also, I see that unixODBC is involved (monitoring MySQL databases?) making it very similar to ZBX-9082.

Wild guess... Is it possible that during our ODBC check cycle (connect - select - fetch - close connection) under certain circumstances ODBC driver requests a too deep clean from DB client library and it cleans Zabbix DB handle too without poller noticing it?

Comment by Glebs Ivanovskis (Inactive) [ 2016 Jul 01 ]

So... When we perform ODBC check it ends with a cleanup. In odbc_DBclose() we free environment handle with unixODBC function SQLFreeHandle(), it hands the work over to MySQL ODBC Connector's my_SQLFreeEnv() (mysql-connector-odbc-5.3.6-src/driver/handle.c):

SQLRETURN SQL_API my_SQLFreeEnv(SQLHENV henv)
{
    ENV *env= (ENV *) henv;
    myodbc_mutex_destroy(&env->lock);
#ifndef _UNIX_
    GlobalUnlock(GlobalHandle((HGLOBAL) henv));
    GlobalFree(GlobalHandle((HGLOBAL) henv));
#else
    x_free(henv);
    myodbc_end();
#endif /* _UNIX_ */
    return(SQL_SUCCESS);
}

myodbc_end() (mysql-connector-odbc-5.3.6-src/driver/dll.c) calls my_end() (mysql-5.6/mysys/my_init.c) which does my_thread_end(); and my_thread_global_end(); amongst everything else.

When poller loses connection to backend DB and attempts to reconnect it calls mysql_init() and as we see in attached logs for some reason it returns NULL. MySQL documentation says this could only be due to insufficient memory, but (mysql-5.6/sql-common/client.c):

MYSQL * STDCALL
mysql_init(MYSQL *mysql)
{
  if (mysql_server_init(0, NULL, NULL))
    return 0;
  ...
}

mysql_server_init() may return non-zero value is several cases (mysql-5.6/libmysql/libmysql.c):

int STDCALL mysql_server_init(int argc __attribute__((unused)),
			      char **argv __attribute__((unused)),
			      char **groups __attribute__((unused)))
{
  int result= 0;
  if (!mysql_client_init)
  {
    ...
    if (my_init())				/* Will init threads */
      return 1;
    ...
    if (mysql_client_plugin_init())
      return 1;
    ...
  }
  else
    result= (int)my_thread_init();         /* Init if new thread */
  return result;
}

I will not comment on first two, but the last one seems to be what doctor ordered (mysql-5.6/mysys/my_thr_init.c):

my_bool my_thread_init(void)
{
  struct st_my_thread_var *tmp;
  my_bool error=0;

  if (!my_thread_global_init_done)
    return 1; /* cannot proceed with unintialized library */
  ...

Follow up. wiper asked a legitimate question whether mysql_client_init flag is reset in my_end(). Seems like it is not. It is reset only in mysql_server_end() (mysql-5.6/libmysql/libmysql.c) and mysql_server_end() is not called from my_end().

Actually, I'm not that sure about what I just said after I found this funny thing (mysql-5.6/sql/client_settings.h):

#define mysql_server_init(a,b,c) mysql_client_plugin_init()
#define mysql_server_end()       mysql_client_plugin_deinit()

This makes life more complicated

Comment by Glebs Ivanovskis (Inactive) [ 2016 Jul 01 ]

Managed to reproduce! Created a separate ZBX-10962 with detailed instructions.

Comment by Andris Mednis [ 2017 Sep 20 ]

By the way, the ICONV detection bug on FreeBSD was observed also in ZBX-12466.
The bug occurs if libiconv package is installed AND --with-libcurl configure option is used.
Workaround - add --with-iconv=/usr/local to configure options.

Comment by Rostislav Palivoda [ 2017 Sep 20 ]

Investigation continues for supported versions in ZBX-10962





[ZBX-9166] zabbix server poller crashes Created: 2014 Dec 24  Updated: 2017 Oct 25  Resolved: 2014 Dec 29

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Server (S)
Affects Version/s: 2.2.8
Fix Version/s: None

Type: Incident report Priority: Critical
Reporter: Pavel Timofeev Assignee: Unassigned
Resolution: Duplicate Votes: 0
Labels: crash, freebsd
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD octans 10.1-RELEASE FreeBSD 10.1-RELEASE #0 r274401: Tue Nov 11 21:02:49 UTC 2014 [email protected]:/usr/obj/usr/src/sys/GENERIC amd64


Attachments: File zabbix_server.log.0     File zabbix_server.log.1    
Issue Links:
Duplicate
duplicates ZBX-7765 zbx_set_common_signal_handlers crash ... Closed
duplicates ZBX-10962 Crash/exit in poller performing ODBC ... Closed
duplicates ZBX-12159 Resolving TNS names via LDAP crash on... Confirmed

 Description   

I use zabbix 2.2.8 with mysql-5.5.41, FreeBSD 10.1 amd64.
Zabbix server crashes about two time per day.
Here is log file with DebugLevel=4.
Seems like such crashes started from 2.2.7 version.
Looks like it occurs after '[Z3005] query failed: [2006] MySQL server has gone away' message in log. Meanwhile mysql server is ok.



 Comments   
Comment by Pavel Timofeev [ 2014 Dec 24 ]

Hmm, it's not zbxnext, it's probably a bug. Don't know how to change the category.

Comment by richlv [ 2014 Dec 24 ]

relevant log snippet :

 50877:20141223:183534.741 poller #19 [got 0 values in 0.023074 sec, getting values]
...
 50877:20141223:183534.805 In lld_process_discovery_rule() itemid:27334
 50877:20141223:183534.805 query [txnlev:0] [select hostid,key_,state,filter,error,lifetime from items where itemid=27334]
 50877:20141223:183534.805 [Z3005] query failed: [2006] MySQL server has gone away [select hostid,key_,state,filter,error,lifetime from items where itemid=27334]
 50877:20141223:183534.805 In DBconnect() flag:0
 50877:20141223:183534.805 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x0]. Crashing ...
 50877:20141223:183534.805 ====== Fatal information: ======
 50877:20141223:183534.805 program counter not available for this architecture
 50877:20141223:183534.805 === Registers: ===
 50877:20141223:183534.805 register dump not available for this architecture
 50877:20141223:183534.805 === Backtrace: ===
 50877:20141223:183534.822 1: 0x468496 <print_fatal_info+0x86> at /usr/local/sbin/zabbix_server
 50877:20141223:183534.822 0: 0x46890c <zbx_set_common_signal_handlers+0x2fc> at /usr/local/sbin/zabbix_server
 50877:20141223:183534.822 === Memory map: ===
 50877:20141223:183534.822 memory map not available for this platform
 50877:20141223:183534.822 ================================
 50856:20141223:183534.829 One child process died (PID:50877,exitcode/signal:255). Exiting ...
Comment by Pavel Timofeev [ 2014 Dec 24 ]

I could recompile zabbix_server with some additional flags if it's needed.

Comment by Aleksandrs Saveljevs [ 2014 Dec 29 ]

Based on the backtrace and the OS, it looks like a duplicate of ZBX-7765. Let's continue the discussion there.

Comment by Pavel Timofeev [ 2014 Dec 29 ]

Wow, the problem is known almost a year and still not fixed. :-/

Comment by Glebs Ivanovskis (Inactive) [ 2017 Oct 25 ]

To me this looks more like ZBX-10962 rather than ZBX-7765 which talks about crash in alerter.

Comment by Rostislav Palivoda [ 2017 Oct 25 ]

We are actively looking for solution of ZBX-10962. If you are impacted and watching, please switch to the linked issue.





[ZBX-8755] compiling on FreeBSD gives warnings about deprecated usage of sys/timeb.h Created: 2014 Sep 15  Updated: 2017 May 30  Resolved: 2016 Jan 13

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Installation (I)
Affects Version/s: 2.2.6
Fix Version/s: 3.0.0alpha6

Type: Incident report Priority: Minor
Reporter: Aleksandrs Saveljevs Assignee: Unassigned
Resolution: Fixed Votes: 1
Labels: compilation, freebsd, warning
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD 9.2-RELEASE



 Description   
$ uname -or
FreeBSD 9.2-RELEASE

$ make > /dev/null
In file included from ../../../include/sysinc.h:378,
                 from ../../../include/common.h:23,
                 from md5.c:54:
/usr/include/sys/timeb.h:42:2: warning: #warning "this file includes <sys/timeb.h> which is deprecated"
In file included from ../../../include/sysinc.h:378,
                 from ../../../include/common.h:23,
                 from base64.c:20:
/usr/include/sys/timeb.h:42:2: warning: #warning "this file includes <sys/timeb.h> which is deprecated"
In file included from ../../../include/sysinc.h:378,
                 from ../../../include/common.h:23,
                 from misc.c:20:
/usr/include/sys/timeb.h:42:2: warning: #warning "this file includes <sys/timeb.h> which is deprecated"
In file included from ../../../include/sysinc.h:378,
                 from ../../../include/common.h:23,
                 from xml.c:20:
/usr/include/sys/timeb.h:42:2: warning: #warning "this file includes <sys/timeb.h> which is deprecated"
In file included from ../../../include/sysinc.h:378,
                 from ../../../include/common.h:23,
                 from comms.c:20:
/usr/include/sys/timeb.h:42:2: warning: #warning "this file includes <sys/timeb.h> which is deprecated"
In file included from ../../../include/sysinc.h:378,
                 from ../../../include/common.h:23,
                 from str.c:20:
/usr/include/sys/timeb.h:42:2: warning: #warning "this file includes <sys/timeb.h> which is deprecated"
...


 Comments   
Comment by zentarim [ 2014 Sep 15 ]

Version 2.4.0 have the same problem

Comment by Viktors Tjarve [ 2015 Dec 29 ]

Fixed in development branch svn://svn.zabbix.com/branches/dev/ZBX-8755

Comment by Sandis Neilands (Inactive) [ 2016 Jan 07 ]

(1) Please review. Removed configure check for sys/timeb.h. On Windows we ask for the header explicitly in build/win32/include/config.h. Also fixed definition of a variable which is only used in Windows by putting it in ifdefs. RESOLVED in r57466.

viktors.tjarve Looks good. Successfully tested.

Comment by Viktors Tjarve [ 2016 Jan 07 ]

Released in:

  • pre-3.0.0alpha6 r57475, r57478




[ZBX-8733] Zabbix22-server won't run with-snmp on FreeBSD Created: 2014 Sep 10  Updated: 2017 May 30  Resolved: 2014 Oct 02

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Server (S)
Affects Version/s: 2.2.5
Fix Version/s: None

Type: Incident report Priority: Trivial
Reporter: Rene van Lieshout Assignee: Unassigned
Resolution: Duplicate Votes: 0
Labels: crash, freebsd, webmonitoring
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD 9.2-RELEASE-p10


Attachments: PNG File Schermafbeelding 2014-09-17 om 11.00.32.png     PNG File Schermafbeelding 2014-09-17 om 11.00.42.png     PNG File Schermafbeelding 2014-09-17 om 13.31.49.png     PNG File Schermafbeelding 2014-09-17 om 13.33.47.png     File debug-info.patch     Text File ldd_libcurl.txt     Text File ldd_libcurl.txt     File libcurl.so.7     File libnetsnmp.so.30     File libnetsnmpagent.so.30     File libnetsnmpmibs.so.30     File libnetsnmptrapd.so.30     Text File make_zabbix_server.log     Text File pkg_info_curl.txt     Text File pkg_info_curl.txt     File zabbix_server.conf     Text File zabbix_server.log     Text File zabbix_server.log     Text File zabbix_server.log     Text File zabbix_server.log     Text File zabbix_server.log     Text File zabbix_server.log     Text File zabbix_server.log    
Issue Links:
Duplicate
duplicates ZBX-8849 redundant unconditional linking -lcry... Closed

 Description   

I've installed net-mngt/zabbix22-server using ports because the pkg-version depends on MySQL and we use Postgres. It compiles just fine and all seems good until it crashes. I've narrowed this down to changing --with-snmp to --without-snmp.

I don't have any experience in debugging on FreeBSD systems. I'll provide information needed. Attached the log and config file.



 Comments   
Comment by Aleksandrs Saveljevs [ 2014 Sep 10 ]

According to the following lines in the log, the process that crashed was HTTP poller:

 ...
 92537:20140910:082322.699 server #25 started [http poller #1]
 ...
 92537:20140910:082339.791 Got signal [signal:11(SIGSEGV),reason:2,refaddr:0x8020f0120]. Crashing ...
 ...

Would it be possible for you to run Zabbix server with DebugLevel=4, so that we see what exactly HTTP poller was doing?

Also, could you please check whether this issue is the same as ZBX-8005, which is a problem with GnuTLS flavor of libcurl?

Comment by Rene van Lieshout [ 2014 Sep 10 ]

Sure can. The issue ZBX-8005 is related to a GnuTLS libcurl and we're not using that:

[root@cosmo ~]# ldd /usr/local/sbin/zabbix_server | grep curl
libcurl.so.7 => /usr/local/lib/libcurl.so.7 (0x801a8d000)

I'll add a log using DebugLevel 4. Strange part is that http things seem to work properly though

Comment by Aleksandrs Saveljevs [ 2014 Sep 10 ]

Thanks for the quick response! The HTTP poller crashes when accessing an HTTPS website. Which version of libcurl do you have?

Comment by Rene van Lieshout [ 2014 Sep 10 ]

No problem. Thanks for the help in trying to find out what's wrong.

[root@cosmo ~]# pkg info | grep curl
curl-7.37.1_2 Non-interactive tool to get files from FTP, GOPHER, HTTP(S) servers

Comment by Rene van Lieshout [ 2014 Sep 10 ]

Does it even matter that it actually runs without problems when --with-snmp is changed to --without-snmp? It won't do snmp-things, but that's expected then.

Comment by Aleksandrs Saveljevs [ 2014 Sep 11 ]

There are two ways we can try moving forward with this issue:

(1) If the crash in HTTP poller depends on SNMP, the SNMP library might be exporting symbols that are used by cURL library or the libraries it depends on. In that way, this issue might be similar to ZBX-8629.

Could you please post the output of "readelf -Ws ..." on the SNMP library and the cURL library? Although that may not give us the full picture, because conflicting symbols might be in different libraries.

(2) Could you please try "curl https://insight2.lico.nl/" from the command line? Is it successful?

Comment by Rene van Lieshout [ 2014 Sep 11 ]

Attached output of readelf -Ws for the libraries. A curl for that url runs without any problems and returns the proper HTML

Comment by Aleksandrs Saveljevs [ 2014 Sep 11 ]

Regarding (2), what if you do "LD_PRELOAD=<snmp-library> curl https://insight2.lico.nl/"?

Comment by Rene van Lieshout [ 2014 Sep 11 ]

a LD_PRELOAD=/usr/local/lib/libnetsnmp.so.30 curl https://insight2.lico.nl/ gives me the same (correct) result

Comment by Aleksandrs Saveljevs [ 2014 Sep 11 ]

As far as I remember, Zabbix printed backtrace on FreeBSD, but you needed to install libexecinfo. Could you please install libexecinfo, reconfigure Zabbix, recompile, make it crash and send the new DebugLevel=4 log?

Comment by Rene van Lieshout [ 2014 Sep 11 ]

I've already had libexecinfo installed. The port zabbix22-server depends on it. Reconfigured, compiled and attached log. It doesn't seem to actually use the libexecinfo.

Comment by Aleksandrs Saveljevs [ 2014 Sep 11 ]

Issue ZBX-2946 was where we dealt with libexecinfo on FreeBSD.

If you are building from sources, could you please try specifying -I and -L directories to configure so that it knows where to look for libexecinfo header and library, like so:

$ ./configure CPPFLAGS='-I/usr/local/include' LDFLAGS='-L/usr/local/lib' --enable-server --with-mysql --with-libcurl --with-net-snmp ...

If you do it like that, does it use libexecinfo?

Comment by Rene van Lieshout [ 2014 Sep 11 ]

Added:

CONFIGURE_ARGS+= CPPFLAGS='-I/usr/local/include' LDFLAGS='-L/usr/local/lib'

to Makefile. It does not seem to use the libexecinfo-thingy. Configure output and new server_log attached.

Comment by Aleksandrs Saveljevs [ 2014 Sep 11 ]

Actually, it seems to use libexecinfo, but the following is the most it can get for some reason:

 65015:20140911:145201.412 === Backtrace: ===
 65015:20140911:145201.412 0: 0x7fffffff9d10

As the last try, could you please add "-g" for debug information to CPPFLAGS?

If that does not work, I shall install FreeBSD 9.2 next week (after the conference) and try to reproduce the issue.

Comment by Rene van Lieshout [ 2014 Sep 11 ]

I don't mind trying. New log is attached, but does not seem te produce extra backtrace.

Comment by Aleksandrs Saveljevs [ 2014 Sep 15 ]

Rene, I have installed FreeBSD 9.2, but its ports collection only has Zabbix 2.0.6 (see http://ftp.freebsd.org/pub/FreeBSD/ports/amd64/packages-9.2-release/net-mgmt/) and cURL 7.31.0 (see http://ftp.freebsd.org/pub/FreeBSD/ports/amd64/packages-9.2-release/www/). Could you please guide me through the necessary steps to obtain an environment as close as possible to yours?

Comment by Rene van Lieshout [ 2014 Sep 15 ]

You don't have a net-mgmt/zabbix22-server port? I run portupgrade weekly, so I assume it was updated there.

Comment by Aleksandrs Saveljevs [ 2014 Sep 15 ]

No, I don't. Here are the ports that I have:

/usr/ports/net-mgmt/zabbix2-agent
/usr/ports/net-mgmt/zabbix2-frontend
/usr/ports/net-mgmt/zabbix2-proxy
/usr/ports/net-mgmt/zabbix2-server

Perhaps, I should specify a different port source?

Comment by Rene van Lieshout [ 2014 Sep 15 ]

I didn't specify a different port source. I run 'portsnap fetch && portsnap update' weekly before installing updates'. Maybe that helps

Comment by Aleksandrs Saveljevs [ 2014 Sep 15 ]

Thank you! Running "portsnap" as you suggested made a difference.

Comment by Aleksandrs Saveljevs [ 2014 Sep 17 ]

Currently, HTTP pollers on the server seem to work well for your URL on my machine.

Could you please go to /usr/ports/ftp/curl and /usr/ports/net-mgmt/net-snmp, and post screenshots of "make config"?

Comment by Rene van Lieshout [ 2014 Sep 17 ]

Screenshots of both. Note that zabbix22_server is the only thing we've installed using ports. Everything else is installed using packages. The reason for installing zabbix22_server using ports is that the pkg version uses MySQL and we use Postgres.

Comment by Rene van Lieshout [ 2014 Sep 17 ]

The strange part is that the http poller works correctly when compiled --without-snmp.

Comment by Aleksandrs Saveljevs [ 2014 Sep 17 ]

So the attached screenshots are not relevant then.

I can make it crash as in ZBX-8770 if I install cURL from ports with GnuTLS, but that is a different case.

Would be possible for you to somehow find out which configuration the installed cURL and Net-SNMP packages were built with?

Comment by Rene van Lieshout [ 2014 Sep 17 ]

Would it help if we install both of these using ports? If so, what configuration would it want?

Comment by Aleksandrs Saveljevs [ 2014 Sep 17 ]

If I have an OpenSSL version of cURL with cookie support from ports, then it works well. If I have a GnuTLS version, it crashes in curl_easy_init(), as mentioned above.

However, what I need is to reproduce your case, so I should create an environment that is as close as possible to yours. Thus, it would probably not help if you would reinstall them from ports, but you can try. I shall now try installing both from packages and retry.

Comment by Aleksandrs Saveljevs [ 2014 Sep 17 ]

With cURL and Net-SNMP installed from packages, it works well. However, I then have versions of these libraries that are different from yours:

$ curl-config --version
libcurl 7.31.0
$ net-snmp-config --version
5.7.2

What should I do to install version curl-7.37.1_2, as you have done?

Comment by Rene van Lieshout [ 2014 Sep 17 ]

What if you run 'pkg install curl'? That gives me:

  Updating FreeBSD repository catalogue...
  FreeBSD repository is up-to-date.
  All repositories are up-to-date.
  Checking integrity... done (0 conflicting)
  The following 1 packages will be affected (of 0 checked):

  Installed packages to be UPGRADED:
    curl: 7.37.1_2 -> 7.37.1_4

  Proceed with this action? [y/N]:

We run 'pkg upgrade' weekly to update them all.

Comment by Aleksandrs Saveljevs [ 2014 Sep 17 ]
# pkg install curl
No valid repository found.
# pkg upgrade
No valid repository found.
Comment by Rene van Lieshout [ 2014 Sep 17 ]
[root@cosmo ~]# cat /etc/pkg/FreeBSD.conf
# $FreeBSD$
#
# To disable this repository, instead of modifying or removing this file,
# create a /usr/local/etc/pkg/repos/FreeBSD.conf file:
#
#   mkdir -p /usr/local/etc/pkg/repos
#   echo "FreeBSD: { enabled: no }" > /usr/local/etc/pkg/repos/FreeBSD.conf
#

FreeBSD: {
  url: "pkg+http://pkg.FreeBSD.org/${ABI}/latest",
  mirror_type: "srv",
  signature_type: "fingerprints",
  fingerprints: "/usr/share/keys/pkg",
  enabled: yes
}

Maybe that helps? It has been a while since we've switched to packages in favor of ports where possible. Sorry for making this something hard to solve. I hope we can create a similar environment for you there.

Comment by Aleksandrs Saveljevs [ 2014 Sep 17 ]

Thanks to your hint and the help of Google, I have converted the packaging system to pkgng and now I have the exact same version of libcurl and Net-SNMP as you do.

However, my server still does not crash if I access https://insight2.lico.nl/ with Web monitoring. Could you please give the exact ./configure command line that you are using to configure Zabbix server? Alternatively, if "make config" screenshot is more relevant, please post that instead.

Comment by Rene van Lieshout [ 2014 Sep 17 ]

Hmm. i see curl isn't even activated. I've added a second screenshot where it shows the current web scenario where the server is compiled --without-snmp. The host where this web action is set isn't monitored by a proxy.

Couldn't it be something else that is failing here?

Comment by Aleksandrs Saveljevs [ 2014 Sep 17 ]

The fact that cURL is not activated in "make config" is suspicious. If I do the same, then Web monitoring is not performed: server says that it was compiled without cURL support.

Anyway, maybe it does not crash in libcurl after all.

Could you please execute the following queries? These should give information about the configuration of your Web scenario and I shall set it to be exactly the same locally:

\x on
select h.hostid,h.host,h.name,t.httptestid,t.name,t.variables,t.agent,t.authentication,t.http_user,t.http_password,t.http_proxy,t.retries from httptest t,hosts h where t.hostid=h.hostid and t.nextcheck<=1420441712 and mod(t.httptestid,2)=0 and t.status=0 and h.proxy_hostid is null and h.status=0 and (h.maintenance_status=0 or h.maintenance_type=0);
select httpstepid,no,name,url,timeout,posts,required,status_codes,variables from httpstep where httptestid=2 order by no;
Comment by Rene van Lieshout [ 2014 Sep 17 ]

Sure can. It's only one step

zabbix=# select h.hostid,h.host,h.name,t.httptestid,t.name,t.variables,t.agent,t.authentication,t.http_user,t.http_password,t.http_proxy,t.retries from httptest t,hosts h where t.hostid=h.hostid and t.nextcheck<=1420441712 and mod(t.httptestid,2)=0 and t.status=0 and h.proxy_hostid is null and h.status=0 and (h.maintenance_status=0 or h.maintenance_type=0);
-[ RECORD 1 ]--+-----------------------------------------------------------------
hostid         | 10087
host           | private.lico.nl
name           | private.lico.nl
httptestid     | 2
name           | insight2.lico.nl
variables      |
agent          | Mozilla/5.0 (X11; Linux i686; rv:8.0) Gecko/20100101 Firefox/8.0
authentication | 0
http_user      |
http_password  |
http_proxy     |
retries        | 1
-[ RECORD 2 ]--+-----------------------------------------------------------------
hostid         | 10154
host           | schoudercom.bluerail.nl
name           | schoudercom.bluerail.nl
httptestid     | 4
name           | Accounttypes
variables      |
agent          | Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.1; Trident/6.0)
authentication | 0
http_user      |
http_password  |
http_proxy     |
retries        | 1
zabbix=# select httpstepid,no,name,url,timeout,posts,required,status_codes,variables from httpstep where httptestid=2 order by no;
-[ RECORD 1 ]+--------------------------
httpstepid   | 2
no           | 1
name         | Voorpagina
url          | https://insight2.lico.nl/
timeout      | 30
posts        |
required     | Welkom bij Buzz
status_codes | 200
variables    |
Comment by Aleksandrs Saveljevs [ 2014 Sep 17 ]

Still works perfectly for me. I have attached a patch, "debug-info.patch", that adds a bit more debugging information to Web monitoring. This way we will find out whether it crashes in libcurl or somewhere else. Would it be possible for you to run server with this patch?

Also, could you please do "ldd /usr/local/lib/libcurl.so" to make sure once again that we are not using a GnuTLS version of libcurl.so?

Comment by Rene van Lieshout [ 2014 Sep 17 ]

Sure can. I would have to dig into how one applies a patch to a port. I'm afraid it'll be friday during 'regular' business hours (CEST) before I can do that though. I'll keep you posted.

Comment by Aleksandrs Saveljevs [ 2014 Sep 17 ]

Not sure whether that is the best way, but I have followed a suggestion on https://www.freebsd.org/doc/en_US.ISO8859-1/books/porters-handbook/slow-patch.html : put the attached patch into files/ directory and name it beginning with "patch-", say, "patch-debug-info.c". Running "make clean" and "make install" yields a server with the patch applied.

Comment by Rene van Lieshout [ 2014 Sep 19 ]

And we're back.. attached log with patch applied

Comment by Aleksandrs Saveljevs [ 2014 Sep 22 ]

According to the log, it indeed crashes in curl_easy_perform().

Comment by Aleksandrs Saveljevs [ 2014 Sep 22 ]

Could you please post the output of "pkg info curl" and "ldd /usr/local/lib/libcurl.so"?

Comment by Rene van Lieshout [ 2014 Sep 23 ]

Attached

Comment by Oleksii Zagorskyi [ 2014 Sep 23 ]

in ZBX-8770 upgrade of libcurl helped to avoid some crash.
As I recall in freebsd it's easy to manually edit corresponding file (bump version number from 7.37 to 7.38) and try to reinstall the package.
Maybe would worth to try the same, just in case ?

Comment by Rene van Lieshout [ 2014 Sep 23 ]

Upgraded curl to 7.38, 'nothing' changed. Attached new pkg info, ldd and server log files

Comment by Aleksandrs Saveljevs [ 2014 Sep 23 ]

I seem to have the same environment (the same cURL, at least), but it still does not crash.

Could it be that https://insight2.lico.nl/ yields a different response when accessed from your location than from Zabbix office?

For me, it first gives the following:

$ curl -D - https://insight2.lico.nl/
HTTP/1.1 301 Moved Permanently
Date: Tue, 23 Sep 2014 08:22:12 GMT
Server: Apache
Location: https://buzz.lico.nl/
Vary: Accept-Encoding
Content-Length: 296
Connection: close
Content-Type: text/html; charset=iso-8859-1

<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>301 Moved Permanently</title>
</head><body>
<h1>Moved Permanently</h1>
<p>The document has moved <a href="https://buzz.lico.nl/">here</a>.</p>
<hr>
<address>Apache Server at insight2.lico.nl Port 443</address>
</body></html>

After that it follows the redirect to https://buzz.lico.nl/ , where there is a proper Web page.

Comment by Rene van Lieshout [ 2014 Sep 23 ]

That output is similar to mine. Strange... I don't know what we should do to get your environment similar to mine. Could I get your SSH public key? I can create a user on this system so you can check certain things yourself.

Comment by Aleksandrs Saveljevs [ 2014 Sep 23 ]

Please send me an email at my first name, dot, my last name, @zabbix.com, and we will arrange something.

Comment by Aleksandrs Saveljevs [ 2014 Sep 23 ]

Investigation on Rene's server showed that when Zabbix server is compiled with Net-SNMP, the binary is linked to two versions of libcrypto library: libcrypto.so.6 and libcrypto.so.8. When compiled without Net-SNMP, it is linked to only one: libcrypto.so.6. We shall see whether resolving that fixes the crash.

Comment by Rene van Lieshout [ 2014 Sep 26 ]

Waiting for https://github.com/freebsd/pkg/issues/936 in attempt to get everything clean

Comment by Aleksandrs Saveljevs [ 2014 Sep 29 ]

As described above, the problem does not seem to be on Zabbix side. Closing with "Won't fix" for now, please reopen if it turns out otherwise.

Comment by Oleksii Zagorskyi [ 2014 Oct 02 ]

I've just created ZBX-8849.
My case I believe is the same as current one.

I'm reopening and closing current case as duplicate.





[ZBX-7608] Server crash. [signal:11(SIGSEGV),reason:1,refaddr:0x0] - in "zabbix trapper" Created: 2014 Jan 04  Updated: 2017 May 30  Resolved: 2014 Jan 21

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Server (S)
Affects Version/s: 2.2.1
Fix Version/s: 2.2.2rc1, 2.3.0

Type: Incident report Priority: Major
Reporter: Vekli Sergey Assignee: Unassigned
Resolution: Fixed Votes: 1
Labels: crash, freebsd
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

8.1-RELEASE FreeBSD 8.1-RELEASE #0: Mon Jul 19 02:36:49 UTC 2010 [email protected]:/usr/obj/usr/src/sys/GENERIC amd64
amd64
Intel(R) Xeon(R) CPU X3430 @ 2.40GHz

24GB RAM


Issue Links:
Duplicate
is duplicated by ZBX-7522 server crash in trapper Closed

 Description   

7225:20140104:111350.830 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x0]. Crashing ...
7225:20140104:111350.830 ====== Fatal information: ======
7225:20140104:111350.830 program counter not available for this architecture
7225:20140104:111350.830 === Registers: ===
7225:20140104:111350.830 register dump not available for this architecture
7225:20140104:111350.830 === Backtrace: ===
7225:20140104:111350.830 backtrace not available for this platform
7225:20140104:111350.830 === Memory map: ===
7225:20140104:111350.843 memory map not available for this platform
7225:20140104:111350.844 ================================
7180:20140104:111350.885 One child process died (PID:7225,exitcode/signal:65280). Exiting ...
7180:20140104:111352.895 syncing history data...
7180:20140104:111352.944 syncing history data done
7180:20140104:111352.944 syncing trends data...
7180:20140104:111355.495 syncing trends data done
7180:20140104:111355.495 Zabbix Server stopped. Zabbix 2.2.1 (revision 40808).



 Comments   
Comment by Oleksii Zagorskyi [ 2014 Jan 05 ]

Would be good to know at least what process type was for PID 7225.
You can find it in start of server log.

Comment by Oleksii Zagorskyi [ 2014 Jan 05 ]

There was one crash fixed for 2.2.2 in ZBX-7521
Would be good to retest on latest snapshot Pre-2.2.2rc1 (stable) http://www.zabbix.com/developers.php

And is another crash in ZBX-7579 (also on FeeBSD)

Comment by Alexander Vladishev [ 2014 Jan 06 ]

It's reproducible?

Please attach log with debug level 4. Otherwise we won't be able to help you.

Comment by Vekli Sergey [ 2014 Jan 06 ]

Problem is not repeated after zabbix restart. We can't now change debug level because server in production. We will change it after holidays or after next server fail. Please keep case opened.

Comment by Oleksii Zagorskyi [ 2014 Jan 06 ]

In any case you could find and post here what process type was for crashed PID 7225.

Comment by Vekli Sergey [ 2014 Jan 09 ]

Today crash repeated. We can't find info about PID 7225 because default log size was 1M. Now we changed size to 1GB and wait for next crash.

Comment by Vekli Sergey [ 2014 Jan 09 ]

Crash again. Last log

  3885:20140109:152706.279 query [txnlev:1] [insert into trends_uint (itemid,clock,num,value_min,value_avg,value_max) values (52970,1389261600,1,3086,3086,3086),(53295,1389261600,1,1,1,1),(53176,1389261600,1,1,1,1),(52002,1389261600,1,1,1,1),(53824,1389261600,1,1,1,1),(53733,1389261600,1,1,1,1),(52999,1389261600,1,2575,2575,2575),(52431,1389261600,1,81,81,81),(53316,1389261600,1,1,1,1),(52694,1389261600,1,28,28,28),(53072,1389261600,1,214,214,214),(52823,1389261600,1,1,1,1),(53240,1389261600,1,3063,3063,3063),(52722,1389261600,1,28,28,28),(51413,1389261600,1,3043,3043,3043),(52086,1389261600,1,1,1,1),(53429,1389261600,1,1,1,1),(53076,1389261600,1,1,1,1),(52278,1389261600,1,1,1,1),(51709,1389261600,1,1,1,1),(53073,1389261600,1,1,1,1),(51793,1389261600,1,1,1,1),(52228,1389261600,1,1,1,1),(52761,1389261600,1,3013,3013,3013),(53527,1389261600,1,1,1,1),(52570,1389261600,1,1,1,1),(51744,1389261600,1,3117,3117,3117),(53489,1389261600,1,1,1,1),(51461,1389261600,1,3004,3004,3004),(52307,1389261600,1,1,1,1),(53815,1389261600,1,1,1,1),(52887,1389261600,1,3162,3162,3162),(53953,1389261600,1,1,1,1),(53782,1389261600,1,1,1,1),(53163,1389261600,1,3053,3053,3053),(53547,1389261600,1,1,1,1),(53419,1389261600,1,1,1,1),(51730,1389261600,1,1,1,1),(52356,1389261600,1,1,1,1),(51728,1389261600,1,1,1,1),(53445,1389261600,1,1,1,1),(53615,1389261600,1,1,1,1),(53876,1389261600,1,1,1,1),(52567,1389261600,1,1,1,1),(51746,1389261600,1,1,1,1),(51505,1389261600,1,60,60,60),(51578,1389261600,1,1,1,1),(52227,1389261600,1,1,1,1),(53386,1389261600,1,3115,3115,3115),(53353,1389261600,1,1,1,1),(51508,1389261600,1,1,1,1),(52924,1389261600,1,2589,2589,2589),(52290,1389261600,1,1,1,1),(52878,1389261600,1,3142,3142,3142),(52001,1389261600,1,1,1,1),(52792,1389261600,1,1,1,1),(53790,1389261600,1,1,1,1),(53880,1389261600,1,1,1,1),(53635,1389261600,1,1,1,1),(52400,1389261600,1,1,1,1),(52829,1389261600,1,2574,2574,2574),(51632,1389261600,1,1,1,1),(51879,1389261600,1,1,1,1),(53389,1389261600,1,1,1,1),(53472,1389261600,1,1,1,1),(52347,1389261600,1,1,1,1),(51748,1389261600,1,1,1,1),(51951,1389261600,1,83,83,83),(51523,1389261600,1,1,1,1),(51400,1389261600,1,3025,3025,3025),(51698,1389261600,1,1,1,1),(52183,1389261600,1,1,1,1),(51949,1389261600,1,62,62,62),(52325,1389261600,1,1,1,1),(51988,1389261600,1,1,1,1),(53467,1389261600,1,3047,3047,3047),(52880,1389261600,1,3046,3046,3046),(51833,1389261600,1,1,1,1),(52502,1389261600,1,1,1,1),(53870,1389261600,1,1,1,1),(52383,1389261600,1,1,1,1),(52125,1389261600,1,1,1,1),(53642,1389261600,1,1,1,1),(53823,1389261600,1,1,1,1),(53215,1389261600,1,3036,3036,3036),(52428,1389261600,1,87,87,87),(52446,1389261600,1,60,60,60),(52785,1389261600,1,3019,3019,3019),(52610,1389261600,1,1,1,1),(53105,1389261600,1,3138,3138,3138),(53428,1389261600,1,3005,3005,3005),(53996,1389261600,1,1,1,1),(51652,1389261600,1,1,1,1),(52053,1389261600,1,3056,3056,3056),(53907,1389261600,1,1,1,1),(52119,1389261600,1,3020,3020,3020),(53620,1389261600,1,1,1,1),(53440,1389261600,1,1,1,1),(51614,1389261600,1,1,1,1),(52767,1389261600,1,3015,3015,3015),(52109,1389261600,1,1,1,1),(53027,1389261600,1,259,259,259),(51990,1389261600,1,1,1,1),(52574,1389261600,1,1,1,1),(51625,1389261600,1,83,83,83),(52317,1389261600,1,60,60,60),(53473,1389261600,1,1,1,1),(51453,1389261600,1,1,1,1),(53814,1389261600,1,3072,3072,3072),(52348,1389261600,1,1,1,1),(53923,1389261600,1,1,1,1),(52008,1389261600,1,1412,1412,1412),(52435,1389261600,1,62,62,62),(53903,1389261600,1,1,1,1),(53426,1389261600,1,3053,3053,3053),(53536,1389261600,1,1,1,1),(51937,1389261600,1,60,60,60),(51973,1389261600,1,1,1,1),(53321,1389261600,1,3060,3060,3060),(52297,1389261600,1,1,1,1),(52854,1389261600,1,3040,3040,3040),(52975,1389261600,1,3015,3015,3015),(52545,1389261600,1,1,1,1),(53723,1389261600,1,1,1,1),(52004,1389261600,1,1,1,1),(52443,1389261600,1,60,60,60),(53866,1389261600,1,1,1,1),(53326,1389261600,1,1,1,1),(53075,1389261600,1,3133,3133,3133),(52170,1389261600,1,3176,3176,3176),(52612,1389261600,1,1,1,1),(52903,1389261600,1,3015,3015,3015),(53689,1389261600,1,1,1,1),(53183,1389261600,1,1,1,1),(52419,1389261600,1,83,83,83),(51573,1389261600,1,1,1,1),(53137,1389261600,1,3011,3011,3011),(51552,1389261600,1,3086,3086,3086),(53080,1389261600,1,3067,3067,3067),(53998,1389261600,1,1,1,1),(52894,1389261600,1,3050,3050,3050),(52179,1389261600,1,1,1,1),(53786,1389261600,1,1,1,1),(51483,1389261600,1,1,1,1),(52794,1389261600,1,3022,3022,3022),(53361,1389261600,1,3006,3006,3006),(53351,1389261600,1,1,1,1),(51835,1389261600,1,1,1,1),(52920,1389261600,1,2583,2583,2583),(52864,1389261600,1,3032,3032,3032),(52839,1389261600,1,3074,3074,3074),(51504,1389261600,1,83,83,83),(53112,1389261600,1,3002,3002,3002),(52346,1389261600,1,1,1,1),(53431,1389261600,1,1,1,1),(53340,1389261600,1,1,1,1),(52462,1389261600,1,80,80,80),(52413,1389261600,1,1,1,1),(53468,1389261600,1,1,1,1),(53833,1389261600,1,1,1,1),(27514,1389261600,1,31193542656,31193542656,31193542656),(53368,1389261600,1,3018,3018,3018),(27500,1389261600,1,31193542656,31193542656,31193542656),(53257,1389261600,1,3046,3046,3046),(53171,1389261600,1,3008,3008,3008),(53465,1389261600,1,1,1,1),(52917,1389261600,1,3025,3025,3025),(51524,1389261600,1,1,1,1),(53066,1389261600,1,2813,2813,2813),(51724,1389261600,1,1,1,1),(52650,1389261600,1,25,25,25),(53634,1389261600,1,1,1,1),(51761,1389261600,1,1,1,1),(53416,1389261600,1,1,1,1),(51470,1389261600,1,1,1,1),(52198,1389261600,1,3054,3054,3054),(52646,1389261600,1,25,25,25),(53470,1389261600,1,1,1,1),(52919,1389261600,1,1,1,1),(52529,1389261600,1,1,1,1),(53269,1389261600,1,3069,3069,3069),(51875,1389261600,1,1,1,1),(52045,1389261600,1,3136,3136,3136),(52448,1389261600,1,83,83,83),(52958,1389261600,1,401,401,401),(53087,1389261600,1,3107,3107,3107),(53250,1389261600,1,1,1,1),(53346,1389261600,1,1,1,1),(53774,1389261600,1,1,1,1),(53362,1389261600,1,1,1,1),(51694,1389261600,1,3021,3021,3021),(53083,1389261600,1,3098,3098,3098),(52077,1389261600,1,3035,3035,3035),(53494,1389261600,1,3042,3042,3042),(52967,1389261600,1,1,1,1),(52338,1389261600,1,3068,3068,3068),(53607,1389261600,1,1,1,1),(51477,1389261600,1,1,1,1),(51826,1389261600,1,1,1,1),(52047,1389261600,1,3048,3048,3048),(51600,1389261600,1,3094,3094,3094),(51834,1389261600,1,1,1,1),(53716,1389261600,1,1,1,1),(51521,1389261600,1,1,1,1),(51738,1389261600,1,1,1,1),(53497,1389261600,1,1,1,1),(52921,1389261600,1,3017,3017,3017),(53701,1389261600,1,1,1,1),(52161,1389261600,1,1,1,1),(53271,1389261600,1,1,1,1),(53698,1389261600,1,1,1,1),(52855,1389261600,1,3062,3062,3062),(51691,1389261600,1,1,1,1),(53233,1389261600,1,3037,3037,3037),(52966,1389261600,1,3047,3047,3047),(52834,1389261600,1,3055,3055,3055),(53666,1389261600,1,1,1,1),(53718,1389261600,1,1,1,1),(52424,1389261600,1,83,83,83),(51634,1389261600,1,1,1,1),(53488,1389261600,1,1,1,1),(27493,1389261600,1,3956734,3956734,3956734),(53325,1389261600,1,1,1,1),(53449,1389261600,1,1,1,1),(52445,1389261600,1,1,1,1),(52094,1389261600,1,2815,2815,2815),(51920,1389261600,1,50,50,50),(51992,1389261600,1,1,1,1),(51564,1389261600,1,3089,3089,3089),(52756,1389261600,1,1,1,1),(52207,1389261600,1,1,1,1),(53335,1389261600,1,1,1,1),(53569,1389261600,1,1,1,1),(52219,1389261600,1,1,1,1),(53918,1389261600,1,1,1,1),(53293,1389261600,1,3007,3007,3007),(52973,1389261600,1,1,1,1),(51506,1389261600,1,89,89,89),(53868,1389261600,1,1,1,1),(52752,1389261600,1,3010,3010,3010),(52331,1389261600,1,1,1,1),(52266,1389261600,1,1,1,1),(53892,1389261600,1,1,1,1),(51893,1389261600,1,1,1,1),(53751,1389261600,1,1,1,1),(51664,1389261600,1,1,1,1),(52660,1389261600,1,80,80,80),(53725,1389261600,1,1,1,1),(52261,1389261600,1,1,1,1),(53799,1389261600,1,1,1,1),(53909,1389261600,1,1,1,1),(52370,1389261600,1,1,1,1),(53576,1389261600,1,1,1,1),(53764,1389261600,1,1,1,1),(53699,1389261600,1,1,1,1),(51821,1389261600,1,1,1,1),(53392,1389261600,1,1,1,1),(51414,1389261600,1,3063,3063,3063),(51403,1389261600,1,2808,2808,2808),(52513,1389261600,1,1,1,1),(52541,1389261600,1,1,1,1),(52899,1389261600,1,3100,3100,3100),(51919,1389261600,1,1,1,1),(51443,1389261600,1,3045,3045,3045),(52138,1389261600,1,1,1,1),(52535,1389261600,1,1,1,1),(52507,1389261600,1,1,1,1),(53820,1389261600,1,1,1,1),(53749,1389261600,1,1,1,1),(53550,1389261600,1,1,1,1),(52514,1389261600,1,1,1,1),(53485,1389261600,1,1,1,1),(53297,1389261600,1,1,1,1),(51409,1389261600,1,3004,3004,3004),(51971,1389261600,1,1,1,1),(53366,1389261600,1,1,1,1),(51853,1389261600,1,1,1,1),(52031,1389261600,1,1,1,1),(53311,1389261600,1,1,1,1),(52390,1389261600,1,1,1,1),(53618,1389261600,1,1,1,1),(51503,1389261600,1,81,81,81),(52218,1389261600,1,1,1,1),(52930,1389261600,1,1,1,1),(53259,1389261600,1,1,1,1),(53721,1389261600,1,1,1,1),(53119,1389261600,1,1,1,1),(53885,1389261600,1,1,1,1),(51438,1389261600,1,1,1,1),(53768,1389261600,1,1,1,1),(52396,1389261600,1,1,1,1),(52058,1389261600,1,3038,3038,3038),(53791,1389261600,1,1,1,1),(53004,1389261600,1,2578,2578,2578),(52415,1389261600,1,83,83,83),(53954,1389261600,1,1,1,1),(52401,1389261600,1,60,60,60),(53691,1389261600,1,1,1,1),(53886,1389261600,1,1,1,1),(53695,1389261600,1,3059,3059,3059),(51621,1389261600,1,1,1,1),(53897,1389261600,1,1,1,1),(53936,1389261600,1,1,1,1),(51736,1389261600,1,1,1,1),(51636,1389261600,1,1,1,1),(51589,1389261600,1,1,1,1),(53014,1389261600,1,1,1,1),(52530,1389261600,1,1,1,1),(52029,1389261600,1,3137,3137,3137),(51979,1389261600,1,1,1,1),(52896,1389261600,1,3002,3002,3002),(52571,1389261600,1,1,1,1),(51936,1389261600,1,86,86,86),(53566,1389261600,1,1,1,1),(53359,1389261600,1,1,1,1),(53741,1389261600,1,1,1,1),(53432,1389261600,1,3005,3005,3005),(52644,1389261600,1,401,401,401),(52061,1389261600,1,3062,3062,3062),(53765,1389261600,1,1,1,1),(52209,1389261600,1,1,1,1),(53726,1389261600,1,1,1,1),(51963,1389261600,1,1,1,1),(52800,1389261600,1,60,60,60),(51727,1389261600,1,1,1,1),(52100,1389261600,1,3086,3086,3086),(53141,1389261600,1,3096,3096,3096),(51870,1389261600,1,1,1,1),(53846,1389261600,1,1,1,1),(53286,1389261600,1,1,1,1),(53690,1389261600,1,1,1,1),(51787,1389261600,1,1,1,1),(51944,1389261600,1,81,81,81),(52952,1389261600,1,3008,3008,3008),(53994,1389261600,1,1,1,1),(52056,1389261600,1,3064,3064,3064),(53219,1389261600,1,1,1,1),(52960,1389261600,1,3000,3000,3000),(53659,1389261600,1,1,1,1),(51827,1389261600,1,1,1,1),(51442,1389261600,1,1,1,1),(52479,1389261600,1,1,1,1),(53803,1389261600,1,1,1,1),(52518,1389261600,1,1,1,1),(51677,1389261600,1,3000,3000,3000),(51465,1389261600,1,1,1,1),(27519,1389261600,1,31193542656,31193542656,31193542656),(53122,1389261600,1,3051,3051,3051),(52662,1389261600,1,21,21,21),(52122,1389261600,1,1,1,1),(53772,1389261600,1,1,1,1),(53188,1389261600,1,1,1,1),(52113,1389261600,1,3000,3000,3000),(52744,1389261600,1,1,1,1),(53964,1389261600,1,3177,3177,3177),(51481,1389261600,1,1,1,1),(52402,1389261600,1,1,1,1),(51407,1389261600,1,3083,3083,3083),(51500,1389261600,1,1,1,1),(51644,1389261600,1,60,60,60),(51852,1389261600,1,1,1,1),(51537,1389261600,1,1,1,1),(53276,1389261600,1,2573,2573,2573),(52362,1389261600,1,1,1,1),(51448,1389261600,1,1,1,1),(51513,1389261600,1,1,1,1),(52531,1389261600,1,1,1,1),(51476,1389261600,1,60,60,60),(51478,1389261600,1,1,1,1),(53310,1389261600,1,3020,3020,3020),(53199,1389261600,1,1,1,1),(51593,1389261600,1,1,1,1),(53549,1389261600,1,1,1,1),(53737,1389261600,1,1,1,1),(52285,1389261600,1,1,1,1),(53200,1389261600,1,3004,3004,3004),(53230,1389261600,1,1,1,1),(52352,1389261600,1,1,1,1),(53962,1389261600,1,1,1,1),(51487,1389261600,1,1,1,1),(53769,1389261600,1,1,1,1),(53800,1389261600,1,1,1,1),(53969,1389261600,1,1,1,1),(51446,1389261600,1,3003,3003,3003),(53773,1389261600,1,1,1,1),(51570,1389261600,1,1,1,1),(52124,1389261600,1,1,1,1),(52776,1389261600,1,3017,3017,3017),(53654,1389261600,1,3175,3175,3175),(53744,1389261600,1,1,1,1),(52804,1389261600,1,1,1,1),(53692,1389261600,1,1,1,1),(52264,1389261600,1,1,1,1),(51795,1389261600,1,1,1,1),(53977,1389261600,1,1,1,1),(53070,1389261600,1,3095,3095,3095),(53395,1389261600,1,1,1,1),(53667,1389261600,1,1,1,1),(51922,1389261600,1,1,1,1),(52508,1389261600,1,1,1,1),(52160,1389261600,1,1,1,1),(52521,1389261600,1,1,1,1),(51462,1389261600,1,1,1,1),(51900,1389261600,1,1,1,1),(51687,1389261600,1,3001,3001,3001),(53623,1389261600,1,1,1,1),(52648,1389261600,1,80,80,80),(53631,1389261600,1,1,1,1),(51772,1389261600,1,1,1,1),(51752,1389261600,1,1,1,1),(51880,1389261600,1,1,1,1),(53730,1389261600,1,1,1,1),(52277,1389261600,1,1,1,1),(51474,1389261600,1,1,1,1),(52032,1389261600,1,3040,3040,3040),(52075,1389261600,1,3102,3102,3102),(52204,1389261600,1,1,1,1),(52238,1389261600,1,1,1,1),(52840,1389261600,1,3025,3025,3025),(53951,1389261600,1,1,1,1),(52134,1389261600,1,1,1,1),(53059,1389261600,1,3005,3005,3005),(51699,1389261600,1,3013,3013,3013),(52885,1389261600,1,3124,3124,3124),(51399,1389261600,1,3068,3068,3068),(53573,1389261600,1,1,1,1),(53327,1389261600,1,3004,3004,3004),(53719,1389261600,1,1,1,1),(52120,1389261600,1,1,1,1),(51813,1389261600,1,1,1,1),(52630,1389261600,1,1,1,1),(53405,1389261600,1,1,1,1),(53847,1389261600,1,1,1,1),(52565,1389261600,1,1,1,1),(51542,1389261600,1,3003,3003,3003),(51954,1389261600,1,83,83,83),(53711,1389261600,1,1,1,1),(51784,1389261600,1,1,1,1),(53084,1389261600,1,3030,3030,3030),(53597,1389261600,1,1,1,1),(52254,1389261600,1,1,1,1),(53266,1389261600,1,3034,3034,3034),(53496,1389261600,1,1,1,1),(52395,1389261600,1,60,60,60),(52816,1389261600,1,1,1,1),(53557,1389261600,1,1,1,1),(53323,1389261600,1,1,1,1),(53225,1389261600,1,1,1,1),(52762,1389261600,1,1,1,1),(52771,1389261600,1,1,1,1),(53211,1389261600,1,3007,3007,3007),(52251,1389261600,1,1,1,1),(52734,1389261600,1,3005,3005,3005),(52044,1389261600,1,3026,3026,3026),(51771,1389261600,1,3070,3070,3070),(52459,1389261600,1,1,1,1),(51511,1389261600,1,1,1,1),(51714,1389261600,1,1,1,1),(52144,1389261600,1,1,1,1),(53614,1389261600,1,1,1,1),(53959,1389261600,1,1,1,1),(53483,1389261600,1,1,1,1),(53303,1389261600,1,1,1,1),(52271,1389261600,1,3102,3102,3102),(52283,1389261600,1,1,1,1),(52048,1389261600,1,3152,3152,3152),(52335,1389261600,1,1,1,1),(52836,1389261600,1,3067,3067,3067),(52837,1389261600,1,3008,3008,3008),(53872,1389261600,1,1,1,1),(53378,1389261600,1,401,401,401),(52888,1389261600,1,1,1,1),(51606,1389261600,1,1,1,1),(53117,1389261600,1,3050,3050,3050),(52366,1389261600,1,60,60,60),(51923,1389261600,1,1,1,1),(51783,1389261600,1,1,1,1),(51710,1389261600,1,1,1,1),(53588,1389261600,1,1,1,1),(53609,1389261600,1,1,1,1),(52902,1389261600,1,2575,2575,2575),(53890,1389261600,1,3073,3073,3073),(52485,1389261600,1,1,1,1),(52304,1389261600,1,3065,3065,3065),(51924,1389261600,1,1,1,1),(53331,1389261600,1,1,1,1),(51733,1389261600,1,1,1,1),(52955,1389261600,1,3049,3049,3049),(52059,1389261600,1,3066,3066,3066),(52996,1389261600,1,2521,2521,2521),(51801,1389261600,1,1,1,1),(51696,1389261600,1,3001,3001,3001),(51904,1389261600,1,1,1,1),(52997,1389261600,1,2582,2582,2582),(52547,1389261600,1,1,1,1),(52477,1389261600,1,1,1,1),(51910,1389261600,1,1,1,1),(53908,1389261600,1,1,1,1),(53198,1389261600,1,1,1,1),(53193,1389261600,1,3059,3059,3059),(51715,1389261600,1,1,1,1),(53036,1389261600,1,3001,3001,3001),(52950,1389261600,1,3141,3141,3141),(53747,1389261600,1,1,1,1),(53097,1389261600,1,1,1,1),(53981,1389261600,1,1,1,1),(53946,1389261600,1,1,1,1),(52073,1389261600,1,1433,1433,1433),(52714,1389261600,1,23,23,23),(53110,1389261600,1,1,1,1),(53517,1389261600,1,1,1,1),(52509,1389261600,1,1,1,1),(53646,1389261600,1,1,1,1),(51762,1389261600,1,1,1,1),(53901,1389261600,1,1,1,1),(52148,1389261600,1,3083,3083,3083),(53238,1389261600,1,3079,3079,3079),(51997,1389261600,1,1,1,1),(52883,1389261600,1,3013,3013,3013),(53694,1389261600,1,1,1,1),(53459,1389261600,1,1,1,1),(53320,1389261600,1,1,1,1),(52922,1389261600,1,206,206,206),(52017,1389261600,1,3042,3042,3042),(51528,1389261600,1,1,1,1),(51867,1389261600,1,1,1,1),(53142,1389261600,1,1,1,1),(52258,1389261600,1,1,1,1),(52475,1389261600,1,1,1,1),(53982,1389261600,1,1,1,1),(52551,1389261600,1,1,1,1),(53688,1389261600,1,1,1,1),(53462,1389261600,1,1,1,1),(53491,1389261600,1,1,1,1),(53347,1389261600,1,1,1,1),(52355,1389261600,1,83,83,83),(52634,1389261600,1,25,25,25),(53784,1389261600,1,1,1,1),(52062,1389261600,1,3018,3018,3018),(51485,1389261600,1,1,1,1),(51925,1389261600,1,1,1,1),(53146,1389261600,1,1,1,1),(53371,1389261600,1,1,1,1),(51782,1389261600,1,1,1,1),(52901,1389261600,1,3020,3020,3020),(53143,1389261600,1,1,1,1),(53857,1389261600,1,1,1,1),(52436,1389261600,1,1,1,1),(52289,1389261600,1,1,1,1),(53871,1389261600,1,1,1,1),(51974,1389261600,1,1,1,1),(52368,1389261600,1,1,1,1),(52503,1389261600,1,1,1,1),(52006,1389261600,1,1,1,1),(52853,1389261600,1,1,1,1),(52563,1389261600,1,1,1,1),(53732,1389261600,1,1,1,1),(52586,1389261600,1,3104,3104,3104),(53818,1389261600,1,1,1,1),(53334,1389261600,1,507,507,507),(52215,1389261600,1,1,1,1),(53862,1389261600,1,1,1,1),(53302,1389261600,1,401,401,401),(53879,1389261600,1,1,1,1),(51876,1389261600,1,1,1,1),(53187,1389261600,1,1,1,1),(51742,1389261600,1,3090,3090,3090),(51914,1389261600,1,1,1,1),(51497,1389261600,1,1,1,1),(52472,1389261600,1,1,1,1),(53414,1389261600,1,1,1,1),(52442,1389261600,1,81,81,81),(53755,1389261600,1,1,1,1),(53438,1389261600,1,1,1,1),(53663,1389261600,1,1,1,1),(52636,1389261600,1,80,80,80),(52412,1389261600,1,60,60,60),(53556,1389261600,1,1,1,1),(51613,1389261600,1,3030,3030,3030),(51745,1389261600,1,3158,3158,3158),(52882,1389261600,1,3023,3023,3023),(53633,1389261600,1,1,1,1),(53942,1389261600,1,1,1,1),(53454,1389261600,1,401,401,401),(51554,1389261600,1,3001,3001,3001),(53439,1389261600,1,258,258,258),(53128,1389261600,1,3001,3001,3001),(53252,1389261600,1,1,1,1),(53787,1389261600,1,1,1,1),(53047,1389261600,1,3000,3000,3000),(53967,1389261600,1,1,1,1),(52361,1389261600,1,60,60,60),(52197,1389261600,1,1,1,1),(52146,1389261600,1,3170,3170,3170),(53878,1389261600,1,1,1,1),(53212,1389261600,1,1,1,1),(52553,1389261600,1,1,1,1),(53180,1389261600,1,3010,3010,3010),(51464,1389261600,1,1,1,1),(53486,1389261600,1,1,1,1),(52881,1389261600,1,3020,3020,3020),(53630,1389261600,1,1,1,1),(52155,1389261600,1,1,1,1),(53544,1389261600,1,1,1,1),(53948,1389261600,1,1,1,1),(52747,1389261600,1,1,1,1),(52248,1389261600,1,1,1,1),(52850,1389261600,1,3091,3091,3091),(53363,1389261600,1,3008,3008,3008),(52293,1389261600,1,1,1,1),(51896,1389261600,1,1,1,1),(53669,1389261600,1,1,1,1),(53565,1389261600,1,3026,3026,3026),(51440,1389261600,1,1,1,1),(51790,1389261600,1,1,1,1),(51576,1389261600,1,3091,3091,3091),(52287,1389261600,1,1,1,1),(53874,1389261600,1,1,1,1),(53632,1389261600,1,1,1,1),(53679,1389261600,1,1,1,1),(53678,1389261600,1,1,1,1),(53479,1389261600,1,1,1,1),(52700,1389261600,1,1,1,1),(51629,1389261600,1,1,1,1),(52890,1389261600,1,3163,3163,3163),(53532,1389261600,1,1,1,1),(52116,1389261600,1,1,1,1),(52569,1389261600,1,1,1,1),(52054,1389261600,1,1,1,1),(51804,1389261600,1,1,1,1),(53350,1389261600,1,3052,3052,3052),(51848,1389261600,1,1,1,1),(51814,1389261600,1,1,1,1),(52841,1389261600,1,3024,3024,3024),(51907,1389261600,1,50,50,50),(52906,1389261600,1,1,1,1),(52328,1389261600,1,1,1,1),(53135,1389261600,1,3006,3006,3006),(52079,1389261600,1,1,1,1),(53807,1389261600,1,1,1,1),(52151,1389261600,1,1,1,1),(53896,1389261600,1,1,1,1),(52830,1389261600,1,2574,2574,2574),(53079,1389261600,1,3030,3030,3030),(53840,1389261600,1,1,1,1),(52954,1389261600,1,1,1,1),(53304,1389261600,1,1,1,1),(53134,1389261600,1,1,1,1),(51473,1389261600,1,3047,3047,3047),(51412,1389261600,1,2576,2576,2576),(51667,1389261600,1,2516,2516,2516),(51662,1389261600,1,3014,3014,3014),(52195,1389261600,1,1,1,1),(51863,1389261600,1,1,1,1),(53095,1389261600,1,3089,3089,3089),(53960,1389261600,1,1,1,1),(53100,1389261600,1,401,401,401),(52425,1389261600,1,1,1,1),(53608,1389261600,1,1,1,1),(51602,1389261600,1,1,1,1),(52482,1389261600,1,1,1,1),(53702,1389261600,1,1,1,1),(52205,1389261600,1,3084,3084,3084),(51444,1389261600,1,1,1,1),(53526,1389261600,1,1,1,1),(52959,1389261600,1,3020,3020,3020),(51753,1389261600,1,1,1,1),(52354,1389261600,1,1,1,1),(52174,1389261600,1,557,557,557),(51455,1389261600,1,1,1,1),(51475,1389261600,1,1,1,1),(53792,1389261600,1,1,1,1),(51934,1389261600,1,60,60,60),(53972,1389261600,1,1,1,1),(53046,1389261600,1,3104,3104,3104),(53602,1389261600,1,1,1,1),(53377,1389261600,1,1,1,1),(52875,1389261600,1,3138,3138,3138),(53148,1389261600,1,3016,3016,3016),(53226,1389261600,1,3010,3010,3010),(51957,1389261600,1,1,1,1),(52490,1389261600,1,1,1,1),(53164,1389261600,1,3151,3151,3151),(52191,1389261600,1,1,1,1),(52460,1389261600,1,83,83,83),(51775,1389261600,1,1,1,1),(53767,1389261600,1,1,1,1),(53313,1389261600,1,1,1,1),(53270,1389261600,1,1,1,1),(52267,1389261600,1,1,1,1),(53139,1389261600,1,3035,3035,3035),(52892,1389261600,1,2572,2572,2572),(53453,1389261600,1,1,1,1),(51882,1389261600,1,1,1,1),(52206,1389261600,1,1,1,1),(53808,1389261600,1,1,1,1),(52991,1389261600,1,3081,3081,3081),(52895,1389261600,1,2577,2577,2577),(53622,1389261600,1,1,1,1),(51707,1389261600,1,60,60,60),(53401,1389261600,1,1,1,1),(52150,1389261600,1,1,1,1),(53940,1389261600,1,1,1,1),(51605,1389261600,1,1,1,1),(52560,1389261600,1,1,1,1),(51679,1389261600,1,3032,3032,3032),(51673,1389261600,1,3011,3011,3011),(52345,1389261600,1,1,1,1),(52343,1389261600,1,1,1,1),(53855,1389261600,1,1,1,1),(53752,1389261600,1,1,1,1),(53884,1389261600,1,1,1,1),(51756,1389261600,1,1,1,1),(52104,1389261600,1,1,1,1),(51802,1389261600,1,1,1,1),(53660,1389261600,1,1,1,1),(53413,1389261600,1,3168,3168,3168),(53776,1389261600,1,1,1,1),(52033,1389261600,1,3097,3097,3097),(51800,1389261600,1,1,1,1),(52060,1389261600,1,203,203,203),(51436,1389261600,1,1,1,1),(51445,1389261600,1,1,1,1),(51425,1389261600,1,1,1,1),(53900,1389261600,1,1,1,1),(51939,1389261600,1,1,1,1),(52268,1389261600,1,1,1,1),(51978,1389261600,1,1,1,1),(53051,1389261600,1,3048,3048,3048),(52915,1389261600,1,2579,2579,2579),(53436,1389261600,1,1,1,1),(52990,1389261600,1,3010,3010,3010),(53748,1389261600,1,1,1,1),(52525,1389261600,1,1,1,1),(53098,1389261600,1,3008,3008,3008),(53853,1389261600,1,1,1,1),(53570,1389261600,1,1,1,1),(52101,1389261600,1,1,1,1),(51720,1389261600,1,1,1,1),(53039,1389261600,1,2571,2571,2571),(52440,1389261600,1,83,83,83),(53444,1389261600,1,1,1,1),(51805,1389261600,1,1,1,1),(51661,1389261600,1,3000,3000,3000),(53587,1389261600,1,1,1,1),(52420,1389261600,1,81,81,81),(52163,1389261600,1,1,1,1),(53837,1389261600,1,1,1,1),(52937,1389261600,1,3111,3111,3111),(52280,1389261600,1,1,1,1),(53513,1389261600,1,1,1,1),(52042,1389261600,1,3019,3019,3019),(53736,1389261600,1,1,1,1),(51562,1389261600,1,1,1,1),(51998,1389261600,1,1,1,1),(51541,1389261600,1,2515,2515,2515),(53151,1389261600,1,1,1,1),(52081,1389261600,1,1,1,1),(51498,1389261600,1,1,1,1),(52827,1389261600,1,3019,3019,3019),(53592,1389261600,1,1,1,1),(51818,1389261600,1,1,1,1),(51883,1389261600,1,1,1,1),(53352,1389261600,1,1,1,1),(52164,1389261600,1,3061,3061,3061),(53448,1389261600,1,3026,3026,3026),(53673,1389261600,1,1,1,1),(52550,1389261600,1,1,1,1),(52012,1389261600,1,3074,3074,3074),(51823,1389261600,1,1,1,1),(53604,1389261600,1,1,1,1),(53037,1389261600,1,3022,3022,3022),(53272,1389261600,1,1,1,1),(51626,1389261600,1,81,81,81),(53952,1389261600,1,1,1,1),(53849,1389261600,1,1,1,1),(52552,1389261600,1,1,1,1),(52791,1389261600,1,3021,3021,3021),(52074,1389261600,1,3120,3120,3120),(52272,1389261600,1,1,1,1),(52214,1389261600,1,3088,3088,3088),(52384,1389261600,1,60,60,60),(53735,1389261600,1,1,1,1),(53804,1389261600,1,1,1,1),(53650,1389261600,1,1,1,1),(53203,1389261600,1,1,1,1),(52818,1389261600,1,2577,2577,2577),(52030,1389261600,1,3077,3077,3077),(52642,1389261600,1,25,25,25),(52941,1389261600,1,3040,3040,3040),(53031,1389261600,1,1,1,1),(53867,1389261600,1,1,1,1),(52315,1389261600,1,1,1,1),(53126,1389261600,1,3005,3005,3005),(51975,1389261600,1,1,1,1),(53424,1389261600,1,1,1,1),(53383,1389261600,1,3177,3177,3177),(53380,1389261600,1,1,1,1),(53251,1389261600,1,3007,3007,3007),(53746,1389261600,1,1,1,1),(53504,1389261600,1,3006,3006,3006),(51806,1389261600,1,1,1,1),(53484,1389261600,1,3014,3014,3014),(53738,1389261600,1,3071,3071,3071),(52057,1389261600,1,1,1,1),(52336,1389261600,1,1,1,1),(53686,1389261600,1,1,1,1),(53034,1389261600,1,1,1,1),(51418,1389261600,1,2578,2578,2578),(52730,1389261600,1,1,1,1),(53053,1389261600,1,3013,3013,3013),(52538,1389261600,1,1,1,1),(52498,1389261600,1,1,1,1),(52326,1389261600,1,1,1,1),(51458,1389261600,1,3046,3046,3046),(53899,1389261600,1,1,1,1),(53978,1389261600,1,1,1,1),(51556,1389261600,1,3087,3087,3087),(53061,1389261600,1,3009,3009,3009),(52270,1389261600,1,1,1,1),(52684,1389261600,1,62,62,62),(52418,1389261600,1,83,83,83),(52034,1389261600,1,3123,3123,3123),(52884,1389261600,1,2570,2570,2570),(53190,1389261600,1,3033,3033,3033),(51887,1389261600,1,1,1,1),(53130,1389261600,1,3029,3029,3029),(53643,1389261600,1,1,1,1),(52447,1389261600,1,1,1,1),(53985,1389261600,1,1,1,1),(53442,1389261600,1,1,1,1),(51966,1389261600,1,1,1,1),(52851,1389261600,1,3027,3027,3027),(53262,1389261600,1,1,1,1),(51844,1389261600,1,1,1,1),(53873,1389261600,1,1,1,1),(52478,1389261600,1,1,1,1),(52961,1389261600,1,3023,3023,3023),(52159,1389261600,1,1,1,1),(53085,1389261600,1,2579,2579,2579),(52849,1389261600,1,2574,2574,2574),(51913,1389261600,1,1,1,1),(53916,1389261600,1,1,1,1),(52758,1389261600,1,2574,2574,2574),(52726,1389261600,1,1,1,1),(53945,1389261600,1,3135,3135,3135),(51654,1389261600,1,730,730,730),(52451,1389261600,1,81,81,81),(52136,1389261600,1,1,1,1),(53753,1389261600,1,1,1,1),(53213,1389261600,1,3010,3010,3010),(52398,1389261600,1,60,60,60),(53289,1389261600,1,3012,3012,3012),(53210,1389261600,1,1,1,1),(53545,1389261600,1,1,1,1),(51463,1389261600,1,1,1,1),(51561,1389261600,1,535,535,535),(53980,1389261600,1,1,1,1),(53812,1389261600,1,3139,3139,3139),(53433,1389261600,1,3016,3016,3016),(52169,1389261600,1,1,1,1),(52750,1389261600,1,1,1,1),(53548,1389261600,1,1,1,1),(53756,1389261600,1,1,1,1),(53558,1389261600,1,1,1,1),(52367,1389261600,1,62,62,62),(51672,1389261600,1,1,1,1),(52417,1389261600,1,82,82,82),(51965,1389261600,1,1,1,1),(53396,1389261600,1,1,1,1),(53906,1389261600,1,1,1,1),(53507,1389261600,1,1,1,1),(53054,1389261600,1,3030,3030,3030),(51608,1389261600,1,62,62,62),(52324,1389261600,1,60,60,60),(53372,1389261600,1,3041,3041,3041),(53394,1389261600,1,1,1,1),(52869,1389261600,1,3011,3011,3011),(52927,1389261600,1,3028,3028,3028),(51766,1389261600,1,1,1,1),(51856,1389261600,1,1,1,1),(52995,1389261600,1,3002,3002,3002),(53279,1389261600,1,1,1,1),(53078,1389261600,1,3033,3033,3033),(52929,1389261600,1,3034,3034,3034),(52118,1389261600,1,1,1,1),(52867,1389261600,1,3122,3122,3122),(52455,1389261600,1,81,81,81),(53935,1389261600,1,1,1,1),(53580,1389261600,1,3049,3049,3049),(53049,1389261600,1,1,1,1),(51819,1389261600,1,1,1,1),(52162,1389261600,1,1,1,1),(52156,1389261600,1,1,1,1),(53370,1389261600,1,1,1,1),(51397,1389261600,1,1,1,1),(52232,1389261600,1,1,1,1),(53208,1389261600,1,1,1,1),(53508,1389261600,1,3006,3006,3006),(52308,1389261600,1,1,1,1),(51457,1389261600,1,1,1,1),(53307,1389261600,1,3070,3070,3070),(51976,1389261600,1,1,1,1),(53533,1389261600,1,1,1,1),(53067,1389261600,1,1,1,1),(53375,1389261600,1,3022,3022,3022),(53831,1389261600,1,1,1,1),(53381,1389261600,1,1,1,1),(52449,1389261600,1,60,60,60),(52046,1389261600,1,3050,3050,3050),(53477,1389261600,1,1,1,1),(52282,1389261600,1,1,1,1),(52378,1389261600,1,1,1,1),(52825,1389261600,1,241,241,241),(53827,1389261600,1,1,1,1),(52871,1389261600,1,3002,3002,3002),(52737,1389261600,1,3006,3006,3006),(52249,1389261600,1,3128,3128,3128),(53794,1389261600,1,1,1,1),(53877,1389261600,1,1,1,1),(51830,1389261600,1,1,1,1),(53863,1389261600,1,1,1,1),(53231,1389261600,1,27,27,27),(52945,1389261600,1,3012,3012,3012),(53520,1389261600,1,1,1,1),(52870,1389261600,1,3000,3000,3000),(52532,1389261600,1,1,1,1),(52519,1389261600,1,1,1,1),(52224,1389261600,1,3064,3064,3064),(51658,1389261600,1,3031,3031,3031),(52145,1389261600,1,1,1,1),(52389,1389261600,1,83,83,83),(51842,1389261600,1,1,1,1),(52309,1389261600,1,1,1,1),(52302,1389261600,1,60,60,60),(52786,1389261600,1,1,1,1),(52188,1389261600,1,1,1,1),(53789,1389261600,1,1,1,1),(52082,1389261600,1,1,1,1),(53490,1389261600,1,1,1,1),(52898,1389261600,1,3016,3016,3016),(52084,1389261600,1,1,1,1),(53675,1389261600,1,1,1,1),(53843,1389261600,1,1,1,1),(52087,1389261600,1,532,532,532),(51540,1389261600,1,3083,3083,3083),(53579,1389261600,1,1,1,1),(53357,1389261600,1,3181,3181,3181),(53290,1389261600,1,1,1,1),(52911,1389261600,1,3034,3034,3034),(51650,1389261600,1,2576,2576,2576),(52815,1389261600,1,1,1,1),(53770,1389261600,1,1,1,1),(52688,1389261600,1,23,23,23),(52510,1389261600,1,1,1,1),(52003,1389261600,1,1,1,1),(53637,1389261600,1,1,1,1),(52770,1389261600,1,3140,3140,3140),(53025,1389261600,1,1,1,1),(53542,1389261600,1,1,1,1),(53706,1389261600,1,1,1,1),(53417,1389261600,1,1,1,1),(51705,1389261600,1,3027,3027,3027),(52562,1389261600,1,1,1,1),(53107,1389261600,1,1,1,1),(52779,1389261600,1,3018,3018,3018),(53925,1389261600,1,1,1,1),(52376,1389261600,1,60,60,60),(52925,1389261600,1,1,1,1),(52350,1389261600,1,1,1,1),(52091,1389261600,1,3082,3082,3082),(53125,1389261600,1,1,1,1),(53717,1389261600,1,3031,3031,3031),(52986,1389261600,1,2582,2582,2582),(27504,1389261600,1,31193542656,31193542656,31193542656),(52115,1389261600,1,2819,2819,2819),(51788,1389261600,1,1,1,1),(52923,1389261600,1,2576,2576,2576),(51751,1389261600,1,1,1,1),(52196,1389261600,1,1,1,1),(51836,1389261600,1,1,1,1),(52536,1389261600,1,1,1,1),(53595,1389261600,1,1,1,1),(53287,1389261600,1,3056,3056,3056),(52303,1389261600,1,3008,3008,3008),(53332,1389261600,1,3012,3012,3012),(51630,1389261600,1,1,1,1),(53543,1389261600,1,3057,3057,3057),(52379,1389261600,1,1,1,1),(52137,1389261600,1,3043,3043,3043),(53069,1389261600,1,1,1,1),(53116,1389261600,1,1,1,1),(53177,1389261600,1,1,1,1),(53810,1389261600,1,1,1,1),(53759,1389261600,1,1,1,1),(51927,1389261600,1,1,1,1),(51678,1389261600,1,1,1,1),(51582,1389261600,1,1,1,1),(52246,1389261600,1,3160,3160,3160),(53796,1389261600,1,1,1,1),(53777,1389261600,1,1,1,1),(51885,1389261600,1,1,1,1),(52886,1389261600,1,241,241,241),(53341,1389261600,1,3178,3178,3178),(52963,1389261600,1,2583,2583,2583);
  3885:20140109:152706.291 End of DCflush_trends()
  3885:20140109:152706.291 In DCflush_trends() trends_num:263
  3885:20140109:152706.291 query [txnlev:1] [select distinct itemid from trends_uint where clock>=1389261600 and itemid in (51402,51405,51406,51408,51420,51428,51432,51452,51459,51489,51491,51492,51499,51510,51519,51527,51530,51544,51553,51568,51577,51592,51597,51616,51618,51624,51633,51646,51648,51651,51665,51674,51675,51676,51681,51685,51701,51703,51704,51712,51716,51729,51741,51778,51796,51808,51809,51816,51837,51846,51854,51868,51886,51888,51897,51901,51911,51915,51918,51930,51931,51940,51947,51950,51956,51960,51977,51983,51987,51989,52014,52021,52027,52040,52041,52063,52085,52095,52097,52107,52108,52114,52126,52140,52152,52165,52166,52167,52171,52172,52176,52192,52193,52202,52212,52221,52236,52252,52262,52269,52273,52281,52291,52313,52330,52340,52363,52374,52381,52385,52392,52393,52430,52437,52457,52470,52474,52480,52484,52488,52492,52493,52497,52499,52500,52501,52505,52523,52557,52596,52598,52656,52666,52670,52704,52706,52708,52741,52743,52753,52797,52801,52833,52835,52842,52874,52876,52905,52939,52949,52953,52957,52962,52968,52972,52974,52977,52981,52982,52985,52989,53001,53005,53006,53007,53035,53038,53040,53074,53077,53081,53090,53106,53109,53113,53152,53158,53160,53179,53185,53191,53195,53196,53209,53217,53234,53235,53241,53264,53268,53282,53292,53300,53301,53308,53312,53314,53318,53328,53330,53344,53354,53355,53374,53379,53387,53391,53407,53409,53420,53446,53450,53455,53463,53464,53487,53503,53510,53511,53512,53516,53518,53522,53535,53540,53562,53581,53582,53596,53599,53611,53656,53658,53664,53671,53672,53685,53693,53700,53709,53715,53720,53775,53779,53798,53811,53832,53858,53859,53864,53891,53914,53922,53930,53931,53941,53943,53949,53958,53988,53995)]
  3885:20140109:152706.295 query [txnlev:1] [insert into trends_uint (itemid,clock,num,value_min,value_avg,value_max) values (51499,1389261600,1,1,1,1),(53387,1389261600,1,1,1,1),(51809,1389261600,1,1,1,1),(52236,1389261600,1,1,1,1),(51459,1389261600,1,1,1,1),(52212,1389261600,1,1,1,1),(51778,1389261600,1,1,1,1),(52753,1389261600,1,1,1,1),(51646,1389261600,1,2578,2578,2578),(53217,1389261600,1,3009,3009,3009),(53596,1389261600,1,1,1,1),(51553,1389261600,1,3027,3027,3027),(53209,1389261600,1,3005,3005,3005),(52014,1389261600,1,3118,3118,3118),(52269,1389261600,1,1,1,1),(52165,1389261600,1,1,1,1),(53001,1389261600,1,3001,3001,3001),(53312,1389261600,1,1,1,1),(52192,1389261600,1,3051,3051,3051),(52974,1389261600,1,1,1,1),(51703,1389261600,1,1,1,1),(53234,1389261600,1,3048,3048,3048),(52167,1389261600,1,3063,3063,3063),(53409,1389261600,1,1,1,1),(52874,1389261600,1,2585,2585,2585),(52488,1389261600,1,1,1,1),(52126,1389261600,1,1,1,1),(51701,1389261600,1,1,1,1),(53599,1389261600,1,1,1,1),(52281,1389261600,1,3066,3066,3066),(53464,1389261600,1,1,1,1),(51712,1389261600,1,3038,3038,3038),(51616,1389261600,1,3095,3095,3095),(52480,1389261600,1,1,1,1),(51420,1389261600,1,3038,3038,3038),(51530,1389261600,1,1,1,1),(53264,1389261600,1,1,1,1),(51940,1389261600,1,60,60,60),(52393,1389261600,1,1,1,1),(51911,1389261600,1,1,1,1),(52097,1389261600,1,2586,2586,2586),(52457,1389261600,1,81,81,81),(52273,1389261600,1,1,1,1),(51408,1389261600,1,3064,3064,3064),(51452,1389261600,1,1,1,1),(52706,1389261600,1,81,81,81),(51405,1389261600,1,3039,3039,3039),(53487,1389261600,1,1,1,1),(51960,1389261600,1,1,1,1),(53318,1389261600,1,1,1,1),(52021,1389261600,1,3048,3048,3048),(53268,1389261600,1,1,1,1),(53540,1389261600,1,1,1,1),(53658,1389261600,1,3036,3036,3036),(52972,1389261600,1,3002,3002,3002),(51432,1389261600,1,2572,2572,2572),(53455,1389261600,1,1,1,1),(51886,1389261600,1,1,1,1),(51956,1389261600,1,1,1,1),(53081,1389261600,1,1,1,1),(52876,1389261600,1,3007,3007,3007),(53922,1389261600,1,1,1,1),(53995,1389261600,1,1,1,1),(52493,1389261600,1,1,1,1),(51527,1389261600,1,1,1,1),(52114,1389261600,1,1,1,1),(51704,1389261600,1,1,1,1),(53811,1389261600,1,1,1,1),(52095,1389261600,1,1,1,1),(53693,1389261600,1,1,1,1),(51648,1389261600,1,3006,3006,3006),(53040,1389261600,1,1,1,1),(52842,1389261600,1,3093,3093,3093),(51592,1389261600,1,3093,3093,3093),(51846,1389261600,1,1,1,1),(53282,1389261600,1,3065,3065,3065),(53158,1389261600,1,3019,3019,3019),(51837,1389261600,1,1,1,1),(53109,1389261600,1,3022,3022,3022),(53931,1389261600,1,1,1,1),(53798,1389261600,1,1,1,1),(52392,1389261600,1,1,1,1),(52977,1389261600,1,3017,3017,3017),(53463,1389261600,1,1,1,1),(52262,1389261600,1,3176,3176,3176),(53562,1389261600,1,1,1,1),(51633,1389261600,1,1,1,1),(52363,1389261600,1,60,60,60),(52385,1389261600,1,60,60,60),(51989,1389261600,1,1,1,1),(52962,1389261600,1,3020,3020,3020),(51977,1389261600,1,1,1,1),(52040,1389261600,1,3112,3112,3112),(52982,1389261600,1,1,1,1),(52085,1389261600,1,1,1,1),(52598,1389261600,1,1,1,1),(51808,1389261600,1,1,1,1),(53007,1389261600,1,3051,3051,3051),(53300,1389261600,1,3109,3109,3109),(52957,1389261600,1,2576,2576,2576),(51665,1389261600,1,1,1,1),(52557,1389261600,1,1,1,1),(53891,1389261600,1,1,1,1),(52437,1389261600,1,83,83,83),(53407,1389261600,1,1,1,1),(53035,1389261600,1,1,1,1),(53374,1389261600,1,1,1,1),(52291,1389261600,1,1,1,1),(53308,1389261600,1,1,1,1),(52905,1389261600,1,1,1,1),(52797,1389261600,1,3023,3023,3023),(52193,1389261600,1,1,1,1),(51729,1389261600,1,3130,3130,3130),(51931,1389261600,1,60,60,60),(53518,1389261600,1,1,1,1),(52470,1389261600,1,1,1,1),(52656,1389261600,1,25,25,25),(52501,1389261600,1,1,1,1),(53512,1389261600,1,1,1,1),(51947,1389261600,1,83,83,83),(53510,1389261600,1,3067,3067,3067),(53775,1389261600,1,1,1,1),(52989,1389261600,1,287,287,287),(53709,1389261600,1,1,1,1),(53160,1389261600,1,3059,3059,3059),(53152,1389261600,1,1,1,1),(51597,1389261600,1,1,1,1),(52949,1389261600,1,1,1,1),(52041,1389261600,1,3161,3161,3161),(53685,1389261600,1,1,1,1),(53949,1389261600,1,1,1,1),(53330,1389261600,1,1,1,1),(52340,1389261600,1,1,1,1),(53191,1389261600,1,1,1,1),(52172,1389261600,1,1,1,1),(51674,1389261600,1,1,1,1),(52741,1389261600,1,3140,3140,3140),(51519,1389261600,1,1,1,1),(53185,1389261600,1,3023,3023,3023),(51651,1389261600,1,3013,3013,3013),(52027,1389261600,1,3128,3128,3128),(51618,1389261600,1,1,1,1),(53864,1389261600,1,1,1,1),(51428,1389261600,1,3044,3044,3044),(53522,1389261600,1,1,1,1),(52981,1389261600,1,3004,3004,3004),(53943,1389261600,1,1,1,1),(51544,1389261600,1,3084,3084,3084),(51897,1389261600,1,1,1,1),(53196,1389261600,1,1,1,1),(53113,1389261600,1,3081,3081,3081),(53988,1389261600,1,1,1,1),(53344,1389261600,1,1,1,1),(53354,1389261600,1,3007,3007,3007),(53195,1389261600,1,1,1,1),(52835,1389261600,1,3033,3033,3033),(53328,1389261600,1,1,1,1),(53611,1389261600,1,1,1,1),(52497,1389261600,1,1,1,1),(51716,1389261600,1,3002,3002,3002),(52833,1389261600,1,2520,2520,2520),(52743,1389261600,1,3044,3044,3044),(53077,1389261600,1,3002,3002,3002),(53671,1389261600,1,1,1,1),(51983,1389261600,1,1,1,1),(52330,1389261600,1,1,1,1),(51816,1389261600,1,1,1,1),(53450,1389261600,1,1,1,1),(53446,1389261600,1,1,1,1),(53858,1389261600,1,1,1,1),(52985,1389261600,1,2560,2560,2560),(51681,1389261600,1,2513,2513,2513),(52666,1389261600,1,81,81,81),(52484,1389261600,1,1,1,1),(53292,1389261600,1,3017,3017,3017),(52474,1389261600,1,1,1,1),(52523,1389261600,1,1,1,1),(51741,1389261600,1,1,1,1),(53503,1389261600,1,1,1,1),(53090,1389261600,1,1,1,1),(51675,1389261600,1,1,1,1),(52430,1389261600,1,81,81,81),(52176,1389261600,1,1,1,1),(53006,1389261600,1,3017,3017,3017),(52596,1389261600,1,1,1,1),(53715,1389261600,1,1,1,1),(51915,1389261600,1,1,1,1),(52313,1389261600,1,1,1,1),(53859,1389261600,1,1,1,1),(51492,1389261600,1,1,1,1),(52968,1389261600,1,3044,3044,3044),(53832,1389261600,1,1,1,1),(52063,1389261600,1,3026,3026,3026),(52107,1389261600,1,3060,3060,3060),(51868,1389261600,1,1,1,1),(53914,1389261600,1,1,1,1),(27484,1389261600,1,3956734,3956734,3956734),(53930,1389261600,1,1,1,1),(53314,1389261600,1,3080,3080,3080),(53005,1389261600,1,3035,3035,3035),(51950,1389261600,1,87,87,87),(53241,1389261600,1,3173,3173,3173),(52166,1389261600,1,1,1,1),(53700,1389261600,1,1,1,1),(52221,1389261600,1,3103,3103,3103),(53516,1389261600,1,1,1,1),(51489,1389261600,1,1,1,1),(53720,1389261600,1,1,1,1),(53779,1389261600,1,1,1,1),(52492,1389261600,1,1,1,1),(51930,1389261600,1,1,1,1),(52670,1389261600,1,81,81,81),(53535,1389261600,1,1,1,1),(53420,1389261600,1,1,1,1),(51987,1389261600,1,1,1,1),(53106,1389261600,1,3160,3160,3160),(51918,1389261600,1,1,1,1),(52202,1389261600,1,1,1,1),(51510,1389261600,1,81,81,81),(51676,1389261600,1,1,1,1),(53664,1389261600,1,1,1,1),(51685,1389261600,1,1,1,1),(52381,1389261600,1,60,60,60),(53179,1389261600,1,1,1,1),(53958,1389261600,1,1,1,1),(53391,1389261600,1,3056,3056,3056),(53235,1389261600,1,1,1,1),(53581,1389261600,1,1,1,1),(52140,1389261600,1,1,1,1),(51624,1389261600,1,83,83,83),(52499,1389261600,1,1,1,1),(53038,1389261600,1,3017,3017,3017),(52171,1389261600,1,1,1,1),(52704,1389261600,1,1,1,1),(52252,1389261600,1,1,1,1),(53074,1389261600,1,2812,2812,2812),(52374,1389261600,1,60,60,60),(52801,1389261600,1,1,1,1),(51491,1389261600,1,60,60,60),(51568,1389261600,1,1,1,1),(52505,1389261600,1,1,1,1),(51888,1389261600,1,1,1,1),(52939,1389261600,1,1,1,1),(51901,1389261600,1,1,1,1),(51796,1389261600,1,1,1,1),(53941,1389261600,1,1,1,1),(53582,1389261600,1,3009,3009,3009),(53379,1389261600,1,1,1,1),(52708,1389261600,1,1,1,1),(52500,1389261600,1,1,1,1),(51406,1389261600,1,3003,3003,3003),(53301,1389261600,1,1,1,1),(51577,1389261600,1,1,1,1),(51854,1389261600,1,1,1,1),(53656,1389261600,1,1,1,1),(51402,1389261600,1,3036,3036,3036),(27496,1389261600,1,3956734,3956734,3956734),(52108,1389261600,1,1,1,1),(53672,1389261600,1,1,1,1),(53355,1389261600,1,1,1,1),(53511,1389261600,1,1,1,1),(52953,1389261600,1,2811,2811,2811),(52152,1389261600,1,1,1,1);
  3885:20140109:152706.298 End of DCflush_trends()
  3885:20140109:152706.298 query [txnlev:1] [commit;]
  3885:20140109:152706.313 syncing trends data done
  3885:20140109:152706.313 End of DCsync_trends()
  3885:20140109:152706.313 End of DCsync_all()
  3885:20140109:152706.313 In zbx_mem_destroy() descr:'history cache'
  3885:20140109:152706.313 End of zbx_mem_destroy()
  3885:20140109:152706.313 In zbx_mem_destroy() descr:'history text cache'
  3885:20140109:152706.313 End of zbx_mem_destroy()
  3885:20140109:152706.314 In zbx_mem_destroy() descr:'trend cache'
  3885:20140109:152706.314 End of zbx_mem_destroy()
  3885:20140109:152706.314 End of free_database_cache()
  3885:20140109:152706.314 In free_configuration_cache()
  3885:20140109:152706.314 In zbx_mem_destroy() descr:'configuration cache'
  3885:20140109:152706.314 End of zbx_mem_destroy()
  3885:20140109:152706.314 In zbx_strpool_destroy()
  3885:20140109:152706.314 In zbx_mem_destroy() descr:'string pool'
  3885:20140109:152706.314 End of zbx_mem_destroy()
  3885:20140109:152706.314 End of zbx_strpool_destroy()
  3885:20140109:152706.314 End of free_configuration_cache()
  3885:20140109:152706.314 In zbx_vc_destroy()
  3885:20140109:152706.314 In zbx_mem_destroy() descr:'value cache size'
  3885:20140109:152706.314 End of zbx_mem_destroy()
  3885:20140109:152706.314 End of zbx_vc_destroy()
  3885:20140109:152706.314 In free_ipmi_handler()
  3885:20140109:152706.314 End of free_ipmi_handler()
  3885:20140109:152706.314 In free_selfmon_collector() collector:0x80065b000
  3885:20140109:152706.314 End of free_selfmon_collector()
  3885:20140109:152706.314 In unload_modules()
  3885:20140109:152706.314 Zabbix Server stopped. Zabbix 2.2.1 (revision 40808).
Comment by Vekli Sergey [ 2014 Jan 09 ]
 37468:20140109:163304.558 One child process died (PID:37511,exitcode/signal:65280). Exiting ...
 37474:20140109:163304.558 In get_values()
 37479:20140109:163304.558 get_value_snmp() standard processing
 37501:20140109:163304.558 In substitute_simple_macros() data:'161'
 37472:20140109:163304.558 In activate_host() hostid:10291 itemid:39514 type:4
 37500:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.1'
 37493:20140109:163304.558 In substitute_simple_macros() data:'public'
 37473:20140109:163304.558 End of activate_host()
 37476:20140109:163304.558 In activate_host() hostid:10327 itemid:41134 type:4
 37490:20140109:163304.558 In substitute_simple_macros() data:'161'
 37481:20140109:163304.558 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10121'
 37475:20140109:163304.558 End of get_value():SUCCEED
 37475:20140109:163304.558 In activate_host() hostid:10248 itemid:36964 type:4
 37477:20140109:163304.558 In get_values()
 37468:20140109:163304.558 zbx_on_exit() called
 37488:20140109:163304.558 zbx_snmp_get_value() snmp_synch_response():0
 37485:20140109:163304.558 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10003'
 37489:20140109:163304.558 End of zbx_snmp_get_value():SUCCEED
 37481:20140109:163304.558 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.10121'
 37501:20140109:163304.558 In substitute_simple_macros() data:'public'
 37497:20140109:163304.558 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.2'
 37474:20140109:163304.558 In DCconfig_get_poller_items() poller_type:0
 37488:20140109:163304.558 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37507:20140109:163304.559 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37479:20140109:163304.559 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37499:20140109:163304.558 In DCconfig_get_poller_items() poller_type:0
 37504:20140109:163304.558 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37503:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37538:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37544:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37495:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37493:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37494:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37485:20140109:163304.563 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37497:20140109:163304.563 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37472:20140109:163304.566 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37482:20140109:163304.563 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37476:20140109:163304.567 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37480:20140109:163304.568 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37484:20140109:163304.568 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37483:20140109:163304.568 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37475:20140109:163304.568 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37470:20140109:163304.569 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37474:20140109:163304.570 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37498:20140109:163304.570 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37489:20140109:163304.571 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37501:20140109:163304.572 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37550:20140109:163304.572 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37506:20140109:163304.573 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37499:20140109:163304.574 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37542:20140109:163304.574 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37500:20140109:163304.575 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37527:20140109:163304.575 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37516:20140109:163304.577 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37523:20140109:163304.578 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37551:20140109:163304.579 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37490:20140109:163304.579 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37502:20140109:163304.580 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37533:20140109:163304.582 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37509:20140109:163304.582 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37534:20140109:163304.582 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37508:20140109:163304.582 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37528:20140109:163304.583 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37546:20140109:163304.584 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37514:20140109:163304.584 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37532:20140109:163304.585 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37529:20140109:163304.586 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37471:20140109:163304.586 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37536:20140109:163304.586 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37526:20140109:163304.587 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37521:20140109:163304.587 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37522:20140109:163304.588 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37481:20140109:163304.589 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37478:20140109:163304.589 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37541:20140109:163304.590 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37496:20140109:163304.591 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37517:20140109:163304.591 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37548:20140109:163304.591 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37518:20140109:163304.592 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37520:20140109:163304.593 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37492:20140109:163304.593 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37512:20140109:163304.593 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37540:20140109:163304.594 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37525:20140109:163304.594 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37515:20140109:163304.595 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37513:20140109:163304.595 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37531:20140109:163304.596 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37487:20140109:163304.596 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37519:20140109:163304.596 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37473:20140109:163304.597 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37530:20140109:163304.597 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37543:20140109:163304.598 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37539:20140109:163304.598 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37547:20140109:163304.599 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37545:20140109:163304.599 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37477:20140109:163304.602 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37491:20140109:163304.603 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37552:20140109:163304.604 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37486:20140109:163304.604 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37535:20140109:163304.605 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37505:20140109:163304.605 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37524:20140109:163304.606 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37537:20140109:163304.607 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37549:20140109:163304.607 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37510:20140109:163304.783 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
Comment by Vekli Sergey [ 2014 Jan 09 ]
 37481:20140109:163304.554 End of get_value():SUCCEED
 37486:20140109:163304.554 End of zbx_snmp_close_session()
 37501:20140109:163304.554 End of get_value_snmp():SUCCEED
 37495:20140109:163304.554 SNMP [public@10.16.1.2:161]
 37491:20140109:163304.554 End of get_value():SUCCEED
 37477:20140109:163304.554 zbx_snmp_get_value() snmp_synch_response():0
 37511:20140109:163304.554 ====== Fatal information: ======
 37485:20140109:163304.554 In activate_host() hostid:10121 itemid:48934 type:4
 37478:20140109:163304.554 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.7'
 37494:20140109:163304.554 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10015'
 37511:20140109:163304.554 program counter not available for this architecture
 37497:20140109:163304.554 End of activate_host()
 37474:20140109:163304.554 zbx_snmp_get_value() snmp_synch_response():0
 37499:20140109:163304.554 End of zbx_snmp_set_result():SUCCEED
 37480:20140109:163304.554 In activate_host() hostid:10339 itemid:41944 type:4
 37493:20140109:163304.554 End of get_value():SUCCEED
 37491:20140109:163304.554 In activate_host() hostid:10131 itemid:49454 type:4
 37500:20140109:163304.554 In activate_host() hostid:10103 itemid:24904 type:4
 37497:20140109:163304.554 End of get_values():1
 37482:20140109:163304.554 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.6'
 37485:20140109:163304.554 End of activate_host()
 37480:20140109:163304.554 End of activate_host()
 37494:20140109:163304.554 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.10015'
 37477:20140109:163304.554 In zbx_snmp_set_result()
 37481:20140109:163304.554 In activate_host() hostid:10403 itemid:45814 type:4
 37486:20140109:163304.554 End of get_value_snmp():SUCCEED
 37492:20140109:163304.554 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.20'
 37478:20140109:163304.554 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.7'
 37496:20140109:163304.554 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.10001'
 37479:20140109:163304.554 End of DCconfig_get_poller_items():1
 37480:20140109:163304.554 End of get_values():1
 37495:20140109:163304.554 End of zbx_snmp_open_session()
 37491:20140109:163304.554 End of activate_host()
 37493:20140109:163304.554 In activate_host() hostid:10326 itemid:41224 type:4
 37485:20140109:163304.554 End of get_values():1
 37474:20140109:163304.554 In zbx_snmp_set_result()
 37511:20140109:163304.554 === Registers: ===
 37481:20140109:163304.554 End of activate_host()
 37490:20140109:163304.554 End of get_value():SUCCEED
 37501:20140109:163304.554 End of get_value():SUCCEED
 37496:20140109:163304.554 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.10.10001' oid:'.1.3.6.1.2.1.2.2.1.10.10001'
 37478:20140109:163304.554 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.7'
 37497:20140109:163304.554 In DCconfig_get_poller_nextcheck() poller_type:0
 37478:20140109:163304.554 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.10.7' oid:'.1.3.6.1.2.1.2.2.1.10.7'
 37499:20140109:163304.554 End of zbx_snmp_get_value():SUCCEED
 37492:20140109:163304.554 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.20'
 37511:20140109:163304.554 register dump not available for this architecture
 37494:20140109:163304.554 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.10.10015' oid:'.1.3.6.1.2.1.2.2.1.10.10015'
 37482:20140109:163304.554 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.6'
 37493:20140109:163304.554 End of activate_host()
 37479:20140109:163304.554 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.10044'
 37481:20140109:163304.554 End of get_values():1
 37477:20140109:163304.554 End of zbx_snmp_set_result():SUCCEED
 37500:20140109:163304.554 End of activate_host()
 37497:20140109:163304.554 End of DCconfig_get_poller_nextcheck():1389270784
 37496:20140109:163304.554 In zbx_snmp_open_session()
 37485:20140109:163304.554 In DCconfig_get_poller_nextcheck() poller_type:0
 37480:20140109:163304.554 In DCconfig_get_poller_nextcheck() poller_type:0
 37479:20140109:163304.554 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.10044'
 37495:20140109:163304.554 get_value_snmp() standard processing
 37481:20140109:163304.554 In DCconfig_get_poller_nextcheck() poller_type:0
 37490:20140109:163304.554 In activate_host() hostid:10480 itemid:50044 type:4
 37477:20140109:163304.554 End of zbx_snmp_get_value():SUCCEED
 37496:20140109:163304.554 SNMP [public@10.16.18.2:161]
 37493:20140109:163304.554 End of get_values():1
 37499:20140109:163304.554 In zbx_snmp_close_session()
 37501:20140109:163304.554 In activate_host() hostid:10097 itemid:40694 type:4
 37474:20140109:163304.554 End of zbx_snmp_set_result():SUCCEED
 37478:20140109:163304.554 In zbx_snmp_open_session()
 37474:20140109:163304.554 End of zbx_snmp_get_value():SUCCEED
 37511:20140109:163304.554 === Backtrace: ===
 37495:20140109:163304.554 In zbx_snmp_translate() oid:'.1.3.6.1.2.1.2.2.1.16.10002'
 37472:20140109:163304.554 zbx_snmp_get_value() snmp_synch_response():0
 37499:20140109:163304.554 End of zbx_snmp_close_session()
Comment by richlv [ 2014 Jan 09 ]

last output does not seem to be very useful because you have cut off the backtrace part

Comment by richlv [ 2014 Jan 09 ]

for the record, the weird exit code 65280 might be related to ZBX-2196

Comment by Vekli Sergey [ 2014 Jan 09 ]
 37511:20140109:163304.554 === Backtrace: ===
 37486:20140109:163304.555 End of get_value():SUCCEED
 37495:20140109:163304.554 In zbx_snmp_translate() oid:'.1.3.6.1.2.1.2.2.1.16.10002'
 37490:20140109:163304.555 End of activate_host()
 37472:20140109:163304.554 zbx_snmp_get_value() snmp_synch_response():0
 37499:20140109:163304.554 End of zbx_snmp_close_session()
 37482:20140109:163304.555 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.6'
 37491:20140109:163304.555 End of get_values():1
 37482:20140109:163304.555 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.10.6' oid:'.1.3.6.1.2.1.2.2.1.10.6'
 37479:20140109:163304.555 In substitute_simple_macros() data:'161'
 37475:20140109:163304.555 zbx_snmp_get_value() snmp_synch_response():0
 37474:20140109:163304.555 In zbx_snmp_close_session()
 37491:20140109:163304.555 In DCconfig_get_poller_nextcheck() poller_type:0
 37501:20140109:163304.555 End of activate_host()
 37480:20140109:163304.555 End of DCconfig_get_poller_nextcheck():1389270784
 37497:20140109:163304.555 In get_values()
 37485:20140109:163304.555 End of DCconfig_get_poller_nextcheck():1389270784
 37499:20140109:163304.555 End of get_value_snmp():SUCCEED
 37499:20140109:163304.555 End of get_value():SUCCEED
 37492:20140109:163304.555 In substitute_simple_macros() data:'161'
 37482:20140109:163304.555 In zbx_snmp_open_session()
 37500:20140109:163304.555 End of get_values():1
 37493:20140109:163304.555 In DCconfig_get_poller_nextcheck() poller_type:0
 37499:20140109:163304.555 In activate_host() hostid:10092 itemid:24724 type:4
 37486:20140109:163304.555 In activate_host() hostid:10473 itemid:49684 type:4
 37478:20140109:163304.555 SNMP [public@10.16.3.12:161]
 37472:20140109:163304.555 In zbx_snmp_set_result()
 37501:20140109:163304.555 End of get_values():1
 37485:20140109:163304.555 In get_values()
 37497:20140109:163304.555 In DCconfig_get_poller_items() poller_type:0
 37473:20140109:163304.555 zbx_snmp_get_value() snmp_synch_response():0
 37496:20140109:163304.555 End of zbx_snmp_open_session()
 37474:20140109:163304.555 End of zbx_snmp_close_session()
 37494:20140109:163304.555 In zbx_snmp_open_session()
 37511:20140109:163304.555 backtrace not available for this platform
 37481:20140109:163304.555 End of DCconfig_get_poller_nextcheck():1389270784
 37500:20140109:163304.555 In DCconfig_get_poller_nextcheck() poller_type:0
 37475:20140109:163304.555 In zbx_snmp_set_result()
 37480:20140109:163304.555 In get_values()
 37482:20140109:163304.555 SNMP [public@10.16.1.40:161]
 37485:20140109:163304.555 In DCconfig_get_poller_items() poller_type:0
 37479:20140109:163304.555 In substitute_simple_macros() data:'public'
 37492:20140109:163304.555 In substitute_simple_macros() data:'public'
 37474:20140109:163304.555 End of get_value_snmp():SUCCEED
 37490:20140109:163304.555 End of get_values():1
 37477:20140109:163304.555 In zbx_snmp_close_session()
 37472:20140109:163304.555 End of zbx_snmp_set_result():SUCCEED
 37473:20140109:163304.555 In zbx_snmp_set_result()
 37501:20140109:163304.555 In DCconfig_get_poller_nextcheck() poller_type:0
 37499:20140109:163304.555 End of activate_host()
 37511:20140109:163304.555 === Memory map: ===
 37486:20140109:163304.555 End of activate_host()
 37493:20140109:163304.555 End of DCconfig_get_poller_nextcheck():1389270784
 37492:20140109:163304.555 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.20'
 37478:20140109:163304.555 End of zbx_snmp_open_session()
 37495:20140109:163304.555 End of zbx_snmp_translate() oid_translated:'.1.3.6.1.2.1.2.2.1.16.10002'
 37490:20140109:163304.555 In DCconfig_get_poller_nextcheck() poller_type:0
 37485:20140109:163304.555 End of DCconfig_get_poller_items():1
 37494:20140109:163304.555 SNMP [public@10.16.10.2:161]
 37481:20140109:163304.555 In get_values()
 37479:20140109:163304.555 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.10044'
 37476:20140109:163304.555 zbx_snmp_get_value() snmp_synch_response():0
 37480:20140109:163304.555 In DCconfig_get_poller_items() poller_type:0
 37493:20140109:163304.555 In get_values()
 37495:20140109:163304.555 In zbx_snmp_get_value() oid:'.1.3.6.1.2.1.2.2.1.16.10002'
 37477:20140109:163304.555 End of zbx_snmp_close_session()
 37472:20140109:163304.555 End of zbx_snmp_get_value():SUCCEED
 37497:20140109:163304.555 End of DCconfig_get_poller_items():1
 37482:20140109:163304.555 End of zbx_snmp_open_session()
 37473:20140109:163304.555 End of zbx_snmp_set_result():SUCCEED
 37494:20140109:163304.555 End of zbx_snmp_open_session()
 37496:20140109:163304.555 get_value_snmp() standard processing
 37482:20140109:163304.555 get_value_snmp() standard processing
 37486:20140109:163304.556 End of get_values():1
 37511:20140109:163304.556 memory map not available for this platform
 37501:20140109:163304.556 End of DCconfig_get_poller_nextcheck():1389270784
 37477:20140109:163304.556 End of get_value_snmp():SUCCEED
 37492:20140109:163304.556 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.20'
 37499:20140109:163304.556 End of get_values():1
 37472:20140109:163304.556 In zbx_snmp_close_session()
 37479:20140109:163304.556 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.10044'
 37476:20140109:163304.556 In zbx_snmp_set_result()
 37485:20140109:163304.556 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.10003'
 37493:20140109:163304.556 In DCconfig_get_poller_items() poller_type:0
 37481:20140109:163304.556 In DCconfig_get_poller_items() poller_type:0
 37478:20140109:163304.556 get_value_snmp() standard processing
 37475:20140109:163304.556 End of zbx_snmp_set_result():SUCCEED
 37474:20140109:163304.556 End of get_value():SUCCEED
 37491:20140109:163304.556 End of DCconfig_get_poller_nextcheck():1389270784
 37473:20140109:163304.556 End of zbx_snmp_get_value():SUCCEED
 37490:20140109:163304.556 End of DCconfig_get_poller_nextcheck():1389270784
 37480:20140109:163304.556 End of DCconfig_get_poller_items():1
 37481:20140109:163304.556 End of DCconfig_get_poller_items():1
 37476:20140109:163304.556 End of zbx_snmp_set_result():SUCCEED
 37479:20140109:163304.556 In get_value() key:'.1.3.6.1.2.1.2.2.1.16.10044'
 37477:20140109:163304.556 End of get_value():SUCCEED
 37500:20140109:163304.556 End of DCconfig_get_poller_nextcheck():1389270784
 37492:20140109:163304.556 In get_value() key:'.1.3.6.1.2.1.2.2.1.16.20'
 37496:20140109:163304.556 In zbx_snmp_translate() oid:'.1.3.6.1.2.1.2.2.1.10.10001'
 37474:20140109:163304.556 In activate_host() hostid:10469 itemid:49504 type:4
 37475:20140109:163304.556 End of zbx_snmp_get_value():SUCCEED
 37489:20140109:163304.556 zbx_snmp_get_value() snmp_synch_response():0
 37485:20140109:163304.556 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10003'
 37480:20140109:163304.556 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.10111'
 37499:20140109:163304.556 In DCconfig_get_poller_nextcheck() poller_type:0
 37482:20140109:163304.556 In zbx_snmp_translate() oid:'.1.3.6.1.2.1.2.2.1.10.6'
 37477:20140109:163304.556 In activate_host() hostid:10228 itemid:36304 type:4
 37474:20140109:163304.556 End of activate_host()
 37481:20140109:163304.556 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.10121'
 37473:20140109:163304.556 In zbx_snmp_close_session()
 37479:20140109:163304.556 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.16.10044' oid:'.1.3.6.1.2.1.2.2.1.16.10044'
 37494:20140109:163304.556 get_value_snmp() standard processing
 37501:20140109:163304.556 In get_values()
 37511:20140109:163304.556 ================================
 37493:20140109:163304.556 End of DCconfig_get_poller_items():1
 37486:20140109:163304.556 In DCconfig_get_poller_nextcheck() poller_type:0
 37500:20140109:163304.556 In get_values()
 37476:20140109:163304.556 End of zbx_snmp_get_value():SUCCEED
 37478:20140109:163304.556 In zbx_snmp_translate() oid:'.1.3.6.1.2.1.2.2.1.10.7'
 37497:20140109:163304.556 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.2'
 37490:20140109:163304.556 In get_values()
 37472:20140109:163304.556 End of zbx_snmp_close_session()
 37491:20140109:163304.556 In get_values()
 37477:20140109:163304.556 End of activate_host()
 37492:20140109:163304.556 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.16.20' oid:'.1.3.6.1.2.1.2.2.1.16.20'
 37490:20140109:163304.556 In DCconfig_get_poller_items() poller_type:0
 37497:20140109:163304.556 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.2'
 37490:20140109:163304.556 End of DCconfig_get_poller_items():1
 37497:20140109:163304.556 In substitute_simple_macros() data:'161'
 37493:20140109:163304.556 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.10007'
 37477:20140109:163304.556 End of get_values():1
 37500:20140109:163304.556 In DCconfig_get_poller_items() poller_type:0
 37486:20140109:163304.556 End of DCconfig_get_poller_nextcheck():1389270784
 37485:20140109:163304.556 In substitute_simple_macros() data:'161'
 37489:20140109:163304.556 In zbx_snmp_set_result()
 37499:20140109:163304.556 End of DCconfig_get_poller_nextcheck():1389270784
 37496:20140109:163304.556 End of zbx_snmp_translate() oid_translated:'.1.3.6.1.2.1.2.2.1.10.10001'
 37478:20140109:163304.556 End of zbx_snmp_translate() oid_translated:'.1.3.6.1.2.1.2.2.1.10.7'
 37479:20140109:163304.556 In zbx_snmp_open_session()
 37491:20140109:163304.556 In DCconfig_get_poller_items() poller_type:0
 37476:20140109:163304.557 In zbx_snmp_close_session()
 37474:20140109:163304.557 End of get_values():1
 37501:20140109:163304.557 In DCconfig_get_poller_items() poller_type:0
 37480:20140109:163304.557 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.10111'
 37486:20140109:163304.557 In get_values()
 37473:20140109:163304.557 End of zbx_snmp_close_session()
 37492:20140109:163304.557 In zbx_snmp_open_session()
 37475:20140109:163304.557 In zbx_snmp_close_session()
 37481:20140109:163304.557 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10121'
 37490:20140109:163304.557 In substitute_key_macros() data:'1.3.6.1.2.1.31.1.1.1.6.10103'
 37493:20140109:163304.557 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.10007'
 37497:20140109:163304.557 In substitute_simple_macros() data:'public'
 37491:20140109:163304.557 End of DCconfig_get_poller_items():1
 37494:20140109:163304.557 In zbx_snmp_translate() oid:'.1.3.6.1.2.1.2.2.1.10.10015'
 37486:20140109:163304.557 In DCconfig_get_poller_items() poller_type:0
 37476:20140109:163304.557 End of zbx_snmp_close_session()
 37480:20140109:163304.557 In substitute_simple_macros() data:'161'
 37482:20140109:163304.557 End of zbx_snmp_translate() oid_translated:'.1.3.6.1.2.1.2.2.1.10.6'
 37476:20140109:163304.557 End of get_value_snmp():SUCCEED
 37497:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.2'
 37475:20140109:163304.557 End of zbx_snmp_close_session()
 37478:20140109:163304.557 In zbx_snmp_get_value() oid:'.1.3.6.1.2.1.2.2.1.10.7'
 37485:20140109:163304.557 In substitute_simple_macros() data:'public'
 37496:20140109:163304.557 In zbx_snmp_get_value() oid:'.1.3.6.1.2.1.2.2.1.10.10001'
 37491:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.10101'
 37494:20140109:163304.558 End of zbx_snmp_translate() oid_translated:'.1.3.6.1.2.1.2.2.1.10.10015'
 37501:20140109:163304.557 End of DCconfig_get_poller_items():1
 37489:20140109:163304.557 End of zbx_snmp_set_result():SUCCEED
 37479:20140109:163304.558 SNMP [public@10.16.0.131:161]
 37500:20140109:163304.558 End of DCconfig_get_poller_items():1
 37481:20140109:163304.558 In substitute_simple_macros() data:'161'
 37477:20140109:163304.558 In DCconfig_get_poller_nextcheck() poller_type:0
 37474:20140109:163304.558 In DCconfig_get_poller_nextcheck() poller_type:0
 37473:20140109:163304.558 End of get_value_snmp():SUCCEED
 37485:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.10003'
 37472:20140109:163304.558 End of get_value_snmp():SUCCEED
 37492:20140109:163304.558 SNMP [public@10.16.17.13:161]
 37499:20140109:163304.558 In get_values()
 37475:20140109:163304.558 End of get_value_snmp():SUCCEED
 37494:20140109:163304.558 In zbx_snmp_get_value() oid:'.1.3.6.1.2.1.2.2.1.10.10015'
 37486:20140109:163304.558 End of DCconfig_get_poller_items():1
 37473:20140109:163304.558 End of get_value():SUCCEED
 37493:20140109:163304.558 In substitute_simple_macros() data:'161'
 37482:20140109:163304.558 In zbx_snmp_get_value() oid:'.1.3.6.1.2.1.2.2.1.10.6'
 37474:20140109:163304.558 End of DCconfig_get_poller_nextcheck():1389270784
 37501:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.10015'
 37480:20140109:163304.558 In substitute_simple_macros() data:'public'
 37476:20140109:163304.558 End of get_value():SUCCEED
 37479:20140109:163304.558 End of zbx_snmp_open_session()
 37481:20140109:163304.558 In substitute_simple_macros() data:'public'
 37490:20140109:163304.558 End of substitute_key_macros():SUCCEED data:'1.3.6.1.2.1.31.1.1.1.6.10103'
 37481:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.10121'
 37477:20140109:163304.558 End of DCconfig_get_poller_nextcheck():1389270784
 37486:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.10012'
 37501:20140109:163304.558 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.10015'
 37497:20140109:163304.558 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.2'
 37472:20140109:163304.558 End of get_value():SUCCEED
 37491:20140109:163304.558 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.10101'
 37492:20140109:163304.558 End of zbx_snmp_open_session()
 37473:20140109:163304.558 In activate_host() hostid:10122 itemid:34504 type:4
 37480:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.10111'
 37468:20140109:163304.558 One child process died (PID:37511,exitcode/signal:65280). Exiting ...
 37474:20140109:163304.558 In get_values()
 37479:20140109:163304.558 get_value_snmp() standard processing
 37501:20140109:163304.558 In substitute_simple_macros() data:'161'
 37472:20140109:163304.558 In activate_host() hostid:10291 itemid:39514 type:4
 37500:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.1'
 37493:20140109:163304.558 In substitute_simple_macros() data:'public'
 37473:20140109:163304.558 End of activate_host()
 37476:20140109:163304.558 In activate_host() hostid:10327 itemid:41134 type:4
 37490:20140109:163304.558 In substitute_simple_macros() data:'161'
 37481:20140109:163304.558 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10121'
 37475:20140109:163304.558 End of get_value():SUCCEED
 37475:20140109:163304.558 In activate_host() hostid:10248 itemid:36964 type:4
 37477:20140109:163304.558 In get_values()
 37468:20140109:163304.558 zbx_on_exit() called
 37488:20140109:163304.558 zbx_snmp_get_value() snmp_synch_response():0
 37485:20140109:163304.558 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10003'
 37489:20140109:163304.558 End of zbx_snmp_get_value():SUCCEED
 37481:20140109:163304.558 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.10121'
 37501:20140109:163304.558 In substitute_simple_macros() data:'public'
 37497:20140109:163304.558 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.2'
 37474:20140109:163304.558 In DCconfig_get_poller_items() poller_type:0
 37488:20140109:163304.558 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37507:20140109:163304.559 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37479:20140109:163304.559 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37499:20140109:163304.558 In DCconfig_get_poller_items() poller_type:0
 37504:20140109:163304.558 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37503:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37538:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37544:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37495:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37493:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37494:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37485:20140109:163304.563 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37497:20140109:163304.563 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37472:20140109:163304.566 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37482:20140109:163304.563 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37476:20140109:163304.567 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37480:20140109:163304.568 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37484:20140109:163304.568 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37483:20140109:163304.568 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37475:20140109:163304.568 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37470:20140109:163304.569 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37474:20140109:163304.570 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37498:20140109:163304.570 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37489:20140109:163304.571 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37501:20140109:163304.572 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37550:20140109:163304.572 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37506:20140109:163304.573 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37499:20140109:163304.574 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37542:20140109:163304.574 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37500:20140109:163304.575 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37527:20140109:163304.575 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37516:20140109:163304.577 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37523:20140109:163304.578 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37551:20140109:163304.579 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37490:20140109:163304.579 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37502:20140109:163304.580 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37533:20140109:163304.582 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37509:20140109:163304.582 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37534:20140109:163304.582 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37508:20140109:163304.582 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37528:20140109:163304.583 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37546:20140109:163304.584 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37514:20140109:163304.584 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37532:20140109:163304.585 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37529:20140109:163304.586 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37471:20140109:163304.586 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37536:20140109:163304.586 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37526:20140109:163304.587 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37521:20140109:163304.587 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37522:20140109:163304.588 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37481:20140109:163304.589 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37478:20140109:163304.589 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37541:20140109:163304.590 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37496:20140109:163304.591 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37517:20140109:163304.591 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37548:20140109:163304.591 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37518:20140109:163304.592 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37520:20140109:163304.593 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37492:20140109:163304.593 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37512:20140109:163304.593 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37540:20140109:163304.594 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37525:20140109:163304.594 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37515:20140109:163304.595 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37513:20140109:163304.595 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37531:20140109:163304.596 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37487:20140109:163304.596 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37519:20140109:163304.596 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37473:20140109:163304.597 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37530:20140109:163304.597 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37543:20140109:163304.598 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37539:20140109:163304.598 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37547:20140109:163304.599 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37545:20140109:163304.599 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37477:20140109:163304.602 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37491:20140109:163304.603 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37552:20140109:163304.604 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37486:20140109:163304.604 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
 37535:20140109:163304.605 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
Comment by Oleksii Zagorskyi [ 2014 Jan 09 ]

Vekli, please use formating tags to show long listing, for example {code} tag.

Comment by Vekli Sergey [ 2014 Jan 09 ]

Ok.

Comment by Oleksii Zagorskyi [ 2014 Jan 09 ]

Crash related lines are mixed with other process activity and there is still:

 37511:20140109:163304.555 backtrace not available for this platform

Comments above have duplicated log parts.
There no crashed process (PID 37511) activity visible.

The same exit code 65280 we can see in already mentioned ZBX-7579 (which is also on freebsd where crash is in "history syncer").

Vekli, if you see line like:

37468:20140109:163304.558 One child process died (PID:37511,exitcode/signal:65280). Exiting ...

then take crashed PID there and try

# grep -A10 "37511" zabbix_server.log

and show its end where we can see the process activity.

Comment by Vekli Sergey [ 2014 Jan 09 ]
grep -A10 "37511" zabbix_server.log
 37539:20140109:162800.733 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:162800.733 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:162800.733 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:162800.733 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:162800.733 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:162800.733 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:162800.733 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:162800.733 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:162800.733 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:162800.733 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:162800.733 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
 37539:20140109:162800.733 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
--
 37539:20140109:162800.775 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0'
 37542:20140109:162800.775 End of __get_function_parameter_uint31():SUCCEED
 37539:20140109:162800.775 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0'
 37542:20140109:162800.775 In zbx_vc_get_value_range() itemid:46370 value_type:0 seconds:0 count:1 timestamp:1389270480
 37539:20140109:162800.775 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0'
 37542:20140109:162800.775 End of zbx_vc_get_value_range():SUCCEED count:1 cached:1
 37539:20140109:162800.775 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0'
 37542:20140109:162800.775 End of evaluate_NODATA():SUCCEED
 37542:20140109:162800.775 End of evaluate_function():SUCCEED value:'0'
 37539:20140109:162800.775 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0'
 37542:20140109:162800.775 In evaluate_function() function:'1.8a.i.ups.1.local:.1.3.6.1.4.1.318.1.1.1.2.1.2.0.last(0)'
--
 37511:20140109:162802.956 trapper #5 [processing data]
 37511:20140109:162802.959 Trapper got [{"request":"command","nodeid":0,"scriptid":"4","hostid":"10352"}] len 64
 37511:20140109:162802.959 In node_process_command()
 37511:20140109:162802.959 In execute_script() scriptid:4 hostid:10352
 37511:20140109:162802.959 In zbx_execute_script()
 37511:20140109:162802.959 In DBget_script_by_scriptid()
 37511:20140109:162802.959 query [txnlev:0] [select type,execute_on,command,groupid from scripts where scriptid=4]
 37511:20140109:162802.959 End of DBget_script_by_scriptid():SUCCEED
 37511:20140109:162802.959 In check_script_permissions() groupid:0 hostid:10352
 37511:20140109:162802.959 End of check_script_permissions():SUCCEED
 37511:20140109:162802.959 In substitute_simple_macros() data:'/data/scripts/zabbix/show_ports.pl {HOST.CONN}  | /usr/bin/column -t'
 37511:20140109:162802.959 query [txnlev:0] [select type,useip,ip,dns from interface where hostid=10352 and type in (1,2,3,4) and main=1]
 37511:20140109:162802.959 End substitute_simple_macros() data:'/data/scripts/zabbix/show_ports.pl 10.16.6.26  | /usr/bin/column -t'
 37511:20140109:162802.959 In zbx_execute_script()
 37511:20140109:162802.959 In zbx_popen() command:'/data/scripts/zabbix/show_ports.pl 10.16.6.26  | /usr/bin/column -t'
 37511:20140109:162802.960 End of zbx_popen():7
 50338:20140109:162802.960 zbx_popen(): executing script
 37533:20140109:162802.961 icmp pinger #17 [getting values]
 37533:20140109:162802.963 In get_pinger_hosts()
 37533:20140109:162802.963 In DCconfig_get_poller_items() poller_type:3
 37528:20140109:162802.974 icmp pinger #12 [getting values]
 37533:20140109:162802.974 End of DCconfig_get_poller_items():0
 37528:20140109:162802.975 In get_pinger_hosts()
 37533:20140109:162802.975 End of get_pinger_hosts():0
 37528:20140109:162802.975 In DCconfig_get_poller_items() poller_type:3
 37533:20140109:162802.975 In process_pinger_hosts()
--
 37539:20140109:162830.959 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:162830.959 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:162830.959 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:162830.959 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:162830.959 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:162830.959 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:162830.959 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:162830.959 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:162830.959 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:162830.959 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:162830.959 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
 37539:20140109:162830.959 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
--
 37539:20140109:162830.998 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0'
 37542:20140109:162830.998 In evaluate_LAST()
 37542:20140109:162830.998 In __get_function_parameter_uint31() parameters:'#2' Nparam:1
 37539:20140109:162830.998 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0'
 37542:20140109:162830.998 In substitute_simple_macros() data:'#2'
 37539:20140109:162830.998 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0'
 37542:20140109:162830.998 __get_function_parameter_uint31() flag:1 value:2
 37539:20140109:162830.998 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0'
 37542:20140109:162830.998 End of __get_function_parameter_uint31():SUCCEED
 37539:20140109:162830.998 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0'
 37542:20140109:162830.998 In zbx_vc_get_value_range() itemid:41417 value_type:0 seconds:0 count:2 timestamp:1389270510
--
 37539:20140109:162900.176 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:162900.176 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:162900.176 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:162900.176 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:162900.176 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:162900.176 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:162900.176 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:162900.176 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:162900.176 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:162900.176 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:162900.176 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
 37539:20140109:162900.176 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
--
 37539:20140109:162900.211 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0'
 37542:20140109:162900.211 In evaluate_LAST()
 37542:20140109:162900.211 In __get_function_parameter_uint31() parameters:'#2' Nparam:1
 37505:20140109:162900.211 In get_values()
 37539:20140109:162900.211 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0'
 37505:20140109:162900.211 In DCconfig_get_poller_items() poller_type:1
 37542:20140109:162900.211 In substitute_simple_macros() data:'#2'
 37539:20140109:162900.211 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0'
 37539:20140109:162900.211 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0'
 37542:20140109:162900.211 __get_function_parameter_uint31() flag:1 value:2
 37505:20140109:162900.211 End of DCconfig_get_poller_items():0
--
 37539:20140109:162930.375 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:162930.375 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:162930.375 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:162930.375 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:162930.375 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:162930.375 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:162930.375 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:162930.375 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:162930.375 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:162930.375 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:162930.375 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
 37539:20140109:162930.375 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
--
 37539:20140109:162930.410 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0'
 37542:20140109:162930.410 In substitute_simple_macros() data:'{43681}=1&{43682}=0'
 37539:20140109:162930.410 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0'
 37542:20140109:162930.410 End substitute_simple_macros() data:'{43681}=1&{43682}=0'
 37539:20140109:162930.410 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0'
 37542:20140109:162930.410 In substitute_simple_macros() data:'{43691}=1&{43692}=0'
 37539:20140109:162930.410 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0'
 37542:20140109:162930.410 End substitute_simple_macros() data:'{43691}=1&{43692}=0'
 37539:20140109:162930.410 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0'
 37542:20140109:162930.410 In substitute_simple_macros() data:'{43711}=1&{43712}=0'
 37539:20140109:162930.410 zbx_substitute_functions_results() expression[18]:'({37601}#0&{37602}#0)|{37603}#0' => '(0#0&0#0)|0#0'
--
 37539:20140109:163000.579 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:163000.579 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:163000.579 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:163000.579 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:163000.579 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:163000.579 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:163000.579 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:163000.579 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:163000.579 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:163000.579 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:163000.579 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
 37539:20140109:163000.579 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
--
 37539:20140109:163000.612 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0'
 37539:20140109:163000.612 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163000.612 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163000.612 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163000.612 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163000.612 zbx_substitute_functions_results() expression[18]:'({37601}#0&{37602}#0)|{37603}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163000.612 zbx_substitute_functions_results() expression[19]:'({37616}#0&{37617}#0)|{37618}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163000.612 zbx_substitute_functions_results() expression[20]:'({37631}#0&{37632}#0)|{37633}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163000.612 zbx_substitute_functions_results() expression[21]:'({37646}#0&{37647}#0)|{37648}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163000.612 zbx_substitute_functions_results() expression[22]:'({37661}#0&{37662}#0)|{37663}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163000.612 zbx_substitute_functions_results() expression[23]:'({37676}#0&{37677}#0)|{37678}#0' => '(0#0&0#0)|0#0'
--
 37548:20140109:163018.287 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37548:20140109:163018.287 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37548:20140109:163018.287 In substitute_simple_macros() data:'({37688}#0&{37689}#0)|{37690}#0'
 37548:20140109:163018.287 End substitute_simple_macros() data:'({37688}#0&{37689}#0)|{37690}#0'
 37548:20140109:163018.287 In substitute_simple_macros() data:'({37691}#0&{37692}#0)|{37693}#0'
 37548:20140109:163018.287 End substitute_simple_macros() data:'({37691}#0&{37692}#0)|{37693}#0'
 37548:20140109:163018.287 In substitute_simple_macros() data:'({37694}#0&{37695}#0)|{37696}#0'
 37548:20140109:163018.287 End substitute_simple_macros() data:'({37694}#0&{37695}#0)|{37696}#0'
 37548:20140109:163018.287 In substitute_simple_macros() data:'({37697}#0&{37698}#0)|{37699}#0'
 37548:20140109:163018.287 End substitute_simple_macros() data:'({37697}#0&{37698}#0)|{37699}#0'
 37548:20140109:163018.287 In substitute_simple_macros() data:'{37753}#1'
 37548:20140109:163018.287 End substitute_simple_macros() data:'{37753}#1'
--
 37548:20140109:163018.409 zbx_substitute_functions_results() expression[39]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0'
 37548:20140109:163018.409 zbx_substitute_functions_results() expression[40]:'({37688}#0&{37689}#0)|{37690}#0' => '(0#0&0#0)|0#0'
 37548:20140109:163018.409 zbx_substitute_functions_results() expression[41]:'({37691}#0&{37692}#0)|{37693}#0' => '(0#0&0#0)|0#0'
 37548:20140109:163018.410 zbx_substitute_functions_results() expression[42]:'({37694}#0&{37695}#0)|{37696}#0' => '(0#0&0#0)|0#0'
 37548:20140109:163018.410 zbx_substitute_functions_results() expression[43]:'({37697}#0&{37698}#0)|{37699}#0' => '(0#0&0#0)|0#0'
 37548:20140109:163018.410 zbx_substitute_functions_results() expression[44]:'{37753}#1' => '1#1'
 37548:20140109:163018.410 zbx_substitute_functions_results() expression[45]:'{37755}#1' => '1#1'
 37548:20140109:163018.410 zbx_substitute_functions_results() expression[46]:'{37757}#1' => '1#1'
 37548:20140109:163018.410 zbx_substitute_functions_results() expression[47]:'{37851}#1' => '1#1'
 37548:20140109:163018.410 zbx_substitute_functions_results() expression[48]:'{38185}>60M' => '2039424>60M'
 37548:20140109:163018.410 zbx_substitute_functions_results() expression[49]:'{38189}>60M' => '2607992>60M'
--
 37539:20140109:163030.763 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:163030.763 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:163030.763 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:163030.763 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:163030.763 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:163030.763 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:163030.763 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:163030.763 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:163030.763 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:163030.763 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:163030.763 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
 37539:20140109:163030.763 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
--
 37539:20140109:163030.796 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0'
 37539:20140109:163030.796 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163030.796 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163030.796 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163030.796 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163030.796 zbx_substitute_functions_results() expression[18]:'({37601}#0&{37602}#0)|{37603}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163030.796 zbx_substitute_functions_results() expression[19]:'({37616}#0&{37617}#0)|{37618}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163030.796 zbx_substitute_functions_results() expression[20]:'({37631}#0&{37632}#0)|{37633}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163030.796 zbx_substitute_functions_results() expression[21]:'({37646}#0&{37647}#0)|{37648}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163030.796 zbx_substitute_functions_results() expression[22]:'({37661}#0&{37662}#0)|{37663}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163030.796 zbx_substitute_functions_results() expression[23]:'({37676}#0&{37677}#0)|{37678}#0' => '(0#0&0#0)|0#0'
--
 37539:20140109:163100.980 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:163100.980 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:163100.980 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:163100.980 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:163100.980 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:163100.980 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:163100.980 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:163100.980 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:163100.980 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:163100.980 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:163100.980 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
 37539:20140109:163100.980 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
--
 37539:20140109:163101.014 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0'
 37539:20140109:163101.014 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163101.014 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163101.014 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163101.014 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163101.014 zbx_substitute_functions_results() expression[18]:'({37601}#0&{37602}#0)|{37603}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163101.014 zbx_substitute_functions_results() expression[19]:'({37616}#0&{37617}#0)|{37618}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163101.014 zbx_substitute_functions_results() expression[20]:'({37631}#0&{37632}#0)|{37633}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163101.014 zbx_substitute_functions_results() expression[21]:'({37646}#0&{37647}#0)|{37648}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163101.014 zbx_substitute_functions_results() expression[22]:'({37661}#0&{37662}#0)|{37663}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163101.014 zbx_substitute_functions_results() expression[23]:'({37676}#0&{37677}#0)|{37678}#0' => '(0#0&0#0)|0#0'
--
 37539:20140109:163130.148 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:163130.148 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:163130.148 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:163130.148 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:163130.148 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:163130.148 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:163130.148 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:163130.148 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:163130.148 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:163130.149 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:163130.149 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
 37539:20140109:163130.149 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
--
 37539:20140109:163130.185 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0'
 37539:20140109:163130.185 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163130.185 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163130.185 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163130.185 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163130.185 zbx_substitute_functions_results() expression[18]:'({37601}#0&{37602}#0)|{37603}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163130.185 zbx_substitute_functions_results() expression[19]:'({37616}#0&{37617}#0)|{37618}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163130.185 zbx_substitute_functions_results() expression[20]:'({37631}#0&{37632}#0)|{37633}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163130.185 zbx_substitute_functions_results() expression[21]:'({37646}#0&{37647}#0)|{37648}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163130.185 zbx_substitute_functions_results() expression[22]:'({37661}#0&{37662}#0)|{37663}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163130.185 zbx_substitute_functions_results() expression[23]:'({37676}#0&{37677}#0)|{37678}#0' => '(0#0&0#0)|0#0'
--
 37539:20140109:163200.365 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:163200.365 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:163200.365 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:163200.365 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:163200.365 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:163200.365 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:163200.365 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:163200.365 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:163200.365 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:163200.365 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:163200.365 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
 37539:20140109:163200.365 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
--
 37539:20140109:163200.460 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0'
 37542:20140109:163200.460 In __get_function_parameter_uint31() parameters:'600' Nparam:1
 37539:20140109:163200.460 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0'
 37542:20140109:163200.460 In substitute_simple_macros() data:'600'
 37539:20140109:163200.460 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0'
 37542:20140109:163200.460 __get_function_parameter_uint31() flag:0 value:600
 37539:20140109:163200.460 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0'
 37542:20140109:163200.460 End of __get_function_parameter_uint31():SUCCEED
 37539:20140109:163200.460 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0'
 37542:20140109:163200.460 In zbx_vc_get_value_range() itemid:44668 value_type:0 seconds:0 count:1 timestamp:1389270720
 37539:20140109:163200.460 zbx_substitute_functions_results() expression[18]:'({37601}#0&{37602}#0)|{37603}#0' => '(0#0&0#0)|0#0'
--
insert into history_uint (itemid,clock,ns,value) values (50776,1389270736,216547444,0),(41866,1389270736,218283977,156),(40096,1389270736,218680396,130344),(51316,1389270736,221803698,65288),(24166,1389270736,222678111,119536),(38296,1389270736,223005248,0),(35956,1389270736,223225387,0),(36796,1389270736,223452232,0),(41536,1389270736,223636334,176),(24856,1389270736,223779089,160),(44956,1389270736,224420511,0),(48676,1389270736,225006340,0),(49446,1389270736,225477070,2),(41896,1389270736,226250074,0),(39826,1389270736,226216829,0),(43876,1389270736,226632804,203856),(35056,1389270736,226681693,11000),(50656,1389270736,227073642,0),(45076,1389270736,227448270,0),(45416,1389270736,227558620,2),(36946,1389270736,227109680,0),(37216,1389270736,228895382,0),(33436,1389270736,230322379,0),(39136,1389270736,230848703,1),(48856,1389270736,230923014,0),(51256,1389270736,231254900,0),(37666,1389270736,231608017,0),(32716,1389270736,230668233,34496),(45976,1389270736,231940462,0),(38116,1389270736,232076792,0),(29656,1389270736,229882658,536),(43936,1389270736,231793236,1),(35686,1389270736,234583535,0),(49636,1389270736,235476386,0),(24796,1389270736,235424424,0),(24736,1389270736,236374824,0),(42916,1389270736,236786887,56416968),(48936,1389270736,236738278,2),(34516,1389270736,237776399,1),(49996,1389270736,237791764,0),(24916,1389270736,237311535,0),(24076,1389270736,238241821,0),(26416,1389270736,237991789,0),(36316,1389270736,238480958,0),(37486,1389270736,238277300,0),(39466,1389270736,238715904,0),(26656,1389270736,238782393,0),(45256,1389270736,239276310,776),(29536,1389270736,240124183,16),(41836,1389270736,239630824,2),(44356,1389270736,241770761,0),(48316,1389270736,242533428,26912),(48196,1389270736,243574342,378240),(46336,1389270736,242347371,1),(55576,1389270736,244129441,0),(48496,1389270736,242203218,776),(37576,1389270736,244651854,0),(24976,1389270736,244551562,4218112),(45496,1389270736,244438419,0),(37006,1389270736,244447079,1),(39736,1389270736,245862063,616),(37546,1389270736,246530305,5895344),(37156,1389270736,247403600,72),(47746,1389270736,247988590,0),(46996,1389270736,249327588,0),(48106,1389270736,249795524,0),(48256,1389270736,250095003,464),(39286,1389270736,250090534,56352),(26146,1389270736,250647588,0),(48526,1389270736,250691727,157116320),(50176,1389270736,250792578,19647016),(55756,1389270736,250883651,0),(49456,1389270736,251254369,2),(41476,1389270736,252243042,0),(26506,1389270736,252870496,0),(48376,1389270736,253809163,104),(46816,1389270736,254244972,256696),(50116,1389270736,251988820,80),(26596,1389270736,254243855,0),(49816,1389270736,254666814,0),(40736,1389270736,254834153,2),(37036,1389270736,255799080,0),(24556,1389270736,256664833,0),(45426,1389270736,256968503,2),(46696,1389270736,258211398,11449072),(24676,1389270736,258194916,0),(44176,1389270736,258508084,26584),(37846,1389270736,259548160,0),(36676,1389270736,259790091,2520072),(40676,1389270736,259798751,2),(29686,1389270736,260076160,691792208),(26236,1389270736,260388211,0),(48916,1389270736,260415030,21904),(50716,1389270736,260476490,0),(49336,1389270736,261018459,475072),(44536,1389270736,261096402,776),(40706,1389270736,262605811,2),(52336,1389270736,262654142,1),(44686,1389270736,262359132,0),(47176,1389270736,263534700,5828272),(43156,1389270736,264187577,0),(27526,1389270736,264378383,853078016),(36736,1389270736,264906662,0),(42646,1389270736,265251678,21973272),(51376,1389270736,265632733,0),(37096,1389270736,265689444,2),(47416,1389270736,265665698,0),(25036,1389270736,266139780,0),(45136,1389270736,266418028,160),(48946,1389270736,266430320,2),(33616,1389270736,267055818,20928),(50296,1389270736,267186561,123024),(39796,1389270736,267364517,0),(37336,1389270736,267542472,31314280),(33496,1389270736,268295641,13),(43336,1389270736,269118371,0),(42976,1389270736,270136098,1),(26776,1389270736,270150625,0),(48956,1389270736,272919134,2),(55336,1389270736,274937267,29),(35416,1389270736,276130715,5992),(46096,1389270736,279740671,70216),(39646,1389270736,292105091,200),(46817,1389270737,275045102,186144),(27527,1389270737,275114384,664936448),(40097,1389270737,275991870,290912),(39827,1389270737,276362308,0),(45077,1389270737,276715426,0),(49997,1389270737,277386461,0),(41867,1389270737,278275121,284),(50777,1389270737,280724595,0),(44537,1389270737,280966804,48080),(43157,1389270737,280979376,0),(36797,1389270737,281675833,0),(40427,1389270737,281993471,140592),(49457,1389270737,282546893,2),(38297,1389270737,283725255,0),(26657,1389270737,283850411,0),(46697,1389270737,284252976,30823440),(48497,1389270737,284832938,237288),(39137,1389270737,284991059,8),(46997,1389270737,285080735,0),(45497,1389270737,285128227,0),(48437,1389270737,286033091,8),(42647,1389270737,286372240,71141104),(51137,1389270737,287543897,13800),(37097,1389270737,287617091,2),(48937,1389270737,287929700,2),(37007,1389270737,288078323,1),(40517,1389270737,288306564,1),(37487,1389270737,288290361,0),(24167,1389270737,288758577,90288),(44687,1389270737,289142424,0),(55757,1389270737,289119516,0),(47747,1389270737,289135999,0),(50537,1389270737,290239491,100),(48197,1389270737,290882590,0),(45257,1389270737,290919745,138936),(26237,1389270737,291079542,5381736),(40727,1389270737,291387402,2),(24977,1389270737,293250209,0),(37217,1389270737,293275072,2166424),(33437,1389270737,293501358,0),(39467,1389270737,293334857,0),(24857,1389270737,293957841,0),(41477,1389270737,294000863,0),(24137,1389270737,293869282,65203488),(47177,1389270737,293828215,0),(24917,1389270737,294636419,0),(48317,1389270737,294704305,2),(34277,1389270737,296510959,1),(26597,1389270737,297397943,0),(48257,1389270737,297978743,145992),(48377,1389270737,298066184,184),(24077,1389270737,298269841,0),(40697,1389270737,298447238,2),(44177,1389270737,298706769,0),(24677,1389270737,299204038,0),(42977,1389270737,299949664,1),(44357,1389270737,300879111,0),(24797,1389270737,300612318,0),(46337,1389270737,300664280,1),(41837,1389270737,301285588,2),(32597,1389270737,301294807,0),(42917,1389270737,301636470,0),(45977,1389270737,302122566,0),(49637,1389270737,302543569,0),(37337,1389270737,302821258,44416),(51377,1389270737,303054248,0),(39737,1389270737,303176890,0),(26417,1389270737,303642591,0),(37037,1389270737,303970287,0),(36677,1389270737,304978795,0),(37847,1389270737,305667430,3040),(45427,1389270737,306235658,2),(46217,1389270737,306464179,8),(45767,1389270737,306976814,8),(48107,1389270737,307745906,0),(39287,1389270737,308967290,0),(26507,1389270737,309131836,0),(50717,1389270737,309782757,0),(34637,1389270737,310103748,4245368),(34517,1389270737,310261310,1),(49817,1389270737,310647951,0),(29687,1389270737,310814732,4960),(51257,1389270737,310759697,0),(36947,1389270737,311240484,0),(26147,1389270737,311514262,0),(47417,1389270737,311796980,21160),(32717,1389270737,312383646,4935616),(50657,1389270737,312966961,0),(35687,1389270737,313529043,0),(40487,1389270737,313564802,0),(35057,1389270737,313883837,0),(43877,1389270737,314407926,10169888),(44957,1389270737,316248942,0),(50297,1389270737,316123507,0),(39797,1389270737,316265145,0),(37157,1389270737,316913552,0),(35417,1389270737,317240409,0),(41537,1389270737,317926530,11746632),(40577,1389270737,317929882,2),(24737,1389270737,318460396,0),(29537,1389270737,318906822,32),(48857,1389270737,318911850,0),(32687,1389270737,319270555,6),(55577,1389270737,321200968,0),(52337,1389270737,321187279,1),(25037,1389270737,321221641,6570816),(24347,1389270737,321814733,1),(29657,1389270737,321678124,23160),(27497,1389270737,321676727,15315396608),(37577,1389270737,321781489,0),(38117,1389270737,323301794,0),(40637,1389270737,322889172,1),(49447,1389270737,323303470,2),(45417,1389270737,324167826,2),(45137,1389270737,324063064,5803768),(37667,1389270737,325473299,0),(33617,1389270737,325521908,2166992),(48677,1389270737,325559623,343360),(35957,1389270737,325828093,0),(48947,1389270737,326201883,1),(37547,1389270737,326437108,1497752),(55337,1389270737,326546620,30),(43337,1389270737,327023216,0),(50117,1389270737,327241121,0),(36317,1389270737,327515737,0),(41897,1389270737,330160766,0),(34697,1389270737,332744614,0),(34877,1389270737,333177909,1056),(48957,1389270737,333751166,2),(26777,1389270737,334443433,176),(36737,1389270737,335064182,0),(50778,1389270738,336712996,0),(49818,1389270738,337621212,0),(45498,1389270738,338368513,0),(26418,1389270738,338583345,0),(36948,1389270738,338828907,0),(47748,1389270738,339340424,0),(35688,1389270738,340252551,0),(46308,1389270738,340334405,292872),(32808,1389270738,340844526,3760),(40718,1389270738,340816031,2),(26508,1389270738,341353250,0),(25038,1389270738,341780399,40368248),(43878,1389270738,341817834,0),(48498,1389270738,342075968,2),(41838,1389270738,342932501,2),(29658,1389270738,343143701,536),(36318,1389270738,343265784,0),(37938,1389270738,345157644,133864),(47418,1389270738,345332527,464),(39828,1389270738,345393428,0),(37848,1389270738,345610495,200),(46158,1389270738,346701974,9552560),(24978,1389270738,346723206,0),(51258,1389270738,347112083,0),(44688,1389270738,347925873,0),(41898,1389270738,348512540,0),(55578,1389270738,348880743,0),(37488,1389270738,349819410,0),(39468,1389270738,350329810,0),(41538,1389270738,350979893,38585512),(26598,1389270738,351390839,0),(49998,1389270738,352143728,0),(50298,1389270738,352561099,0),(27468,1389270738,352562217,1389270738),(24798,1389270738,352892985,0),(40688,1389270738,353011156,1),(43338,1389270738,353628274,0),(41478,1389270738,354125264,2783640),(48318,1389270738,354518331,1),(48198,1389270738,354780096,0),(49458,1389270738,354999398,2),(48528,1389270738,356752693,282087560),(45418,1389270738,356821138,2),(50118,1389270738,356823093,1240),(45858,1389270738,356874217,0),(42648,1389270738,357313658,122185384),(49448,1389270738,357688566,2),(37218,1389270738,358277468,192),(50538,1389270738,358604325,1),(34278,1389270738,358838713,1),(26658,1389270738,358980071,168),(35958,1389270738,359273963,0),(48948,1389270738,359363919,1),(24858,1389270738,360896237,0),(27528,1389270738,360759906,97771520),(37158,1389270738,361138167,0),(50718,1389270738,361742992,0),(51378,1389270738,361840491,0),(39738,1389270738,361879881,15224),(33618,1389270738,362478002,432),(39798,1389270738,363054891,0),(26778,1389270738,363407729,709496),(55818,1389270738,363379513,7984),(45428,1389270738,363836555,2),(29538,1389270738,364552847,16760),(46998,1389270738,364940885,0),(45978,1389270738,364557316,0),(46398,1389270738,364801482,0),(36018,1389270738,364843666,11507760),(37098,1389270738,366453088,2),(55758,1389270738,367695425,0),(34518,1389270738,367658549,1),(47178,1389270738,368094637,0),(48938,1389270738,368376517,2),(37008,1389270738,368657000,1),(48738,1389270738,369374968,93080084),(48678,1389270738,369790943,2),(41388,1389270738,370554168,7),(24138,1389270738,370786879,3152536),(48378,1389270738,370995844,28144192),(32688,1389270738,371117927,10),(42918,1389270738,371358740,0),(51138,1389270738,371628886,0),(26148,1389270738,371887298,0),(33438,1389270738,372044302,0),(44358,1389270738,373091641,0),(24678,1389270738,373702334,0),(52338,1389270738,374279781,3068),(32718,1389270738,374823984,0),(40038,1389270738,375050550,1),(44958,1389270738,375269851,0),(35058,1389270738,375533572,0),(40338,1389270738,375701470,432504),(24168,1389270738,376605216,0),(24918,1389270738,377444429,0),(39288,1389270738,377500302,1646424),(38118,1389270738,377780226,0),(50658,1389270738,379029267,0),(44538,1389270738,379283769,2),(45078,1389270738,379873788,0),(38298,1389270738,380242271,0),(29688,1389270738,380548734,0),(48258,1389270738,380714118,2),(43158,1389270738,380909395,0),(26238,1389270738,381647198,54712),(44178,1389270738,381961204,0),(45258,1389270738,381963998,1),(46818,1389270738,382079376,9624),(24078,1389270738,382286944,0),(42978,1389270738,382588100,2),(49638,1389270738,382602347,0),(37668,1389270738,382908531,0),(48108,1389270738,383089281,0),(32598,1389270738,384479402,168),(37038,1389270738,385579541,0),(55338,1389270738,386118437,23),(40098,1389270738,396790463,11920),(37578,1389270738,398092305,7531472),(35418,1389270738,399309778,0),(37548,1389270738,875417775,5196296),(37538,1389270738,875409394,10893096),(55759,1389270739,288554920,176),(34699,1389270739,294619377,118704),(26779,1389270739,295926806,0),(48109,1389270739,301871416,0),(34519,1389270739,307939785,1),(40739,1389270739,312117691,2),(48499,1389270739,314904078,1),(35419,1389270739,318729984,0),(45079,1389270739,321111571,0),(48919,1389270739,326404143,0),(37219,1389270739,329166785,7413856),(41899,1389270739,329556499,0),(24859,1389270739,331307281,32300504),(46339,1389270739,332240639,8),(55579,1389270739,338700399,0),(40339,1389270739,356169099,0),(32719,1389270739,359020859,2168632),(51139,1389270739,361289583,0),(27469,1389270739,361658345,10737336320),(39799,1389270739,363514167,0),(45979,1389270739,364176542,0),(24349,1389270739,365175831,56852504),(26419,1389270739,366703120,31720),(41839,1389270739,368731869,2),(36949,1389270739,371471603,0),(43339,1389270739,371959095,0),(46999,1389270739,374074727,0),(39289,1389270739,374729000,36976),(48199,1389270739,376804683,0),(50779,1389270739,378296772,0),(44539,1389270739,381291846,1),(48859,1389270739,383095147,24),(26239,1389270739,383249916,304),(40429,1389270739,385718106,0),(37489,1389270739,389458247,0),(48379,1389270739,392042095,4514912),(24679,1389270739,392525396,0),(35059,1389270739,393774158,0),(43159,1389270739,395010908,0),(35689,1389270739,395479682,0),(29539,1389270739,395540863,31136),(24169,1389270739,395600647,0),(36319,1389270739,395697587,0),(26209,1389270739,395823022,7),(38119,1389270739,395737257,0),(44959,1389270739,396422260,0),(44359,1389270739,396677600,0),(40679,1389270739,396950819,2),(37099,1389270739,398175276,2),(49459,1389270739,398583708,2),(48739,1389270739,398729537,171154054),(37789,1389270739,398293448,9),(40009,1389270739,398954984,9),(37549,1389270739,400007353,5400768),(46309,1389270739,400118540,0),(36079,1389270739,400650451,428872),(34639,1389270739,400744597,4247912),(26149,1389270739,401115315,0),(47419,1389270739,402230540,18720),(37539,1389270739,403561994,722117640),(39469,1389270739,403475671,0),(44179,1389270739,403611163,14344),(50719,1389270739,403945283,0),(33619,1389270739,404462109,11753376),(50119,1389270739,404441995,62264),(51259,1389270739,405002122,0),(40399,1389270739,405184826,0),(35959,1389270739,406224903,0),(48259,1389270739,406927227,1),(42649,1389270739,407073893,35330304),(51319,1389270739,407389017,1),(37009,1389270739,407875671,1),(32689,1389270739,408183252,6),(45259,1389270739,410009462,1),(55339,1389270739,411765551,36),(51379,1389270739,412051341,0),(47179,1389270739,412291875,0),(40709,1389270739,412304167,2),(45419,1389270739,412240192,2),(39829,1389270739,412532408,0),(50659,1389270739,413646237,0),(44689,1389270739,413667748,0),(49999,1389270739,413626123,0),(37939,1389270739,413813018,0),(46399,1389270739,414299951,0),(24919,1389270739,414777666,0),(26509,1389270739,415066529,0),(36619,1389270739,415187215,0),(26659,1389270739,416045424,0),(39109,1389270739,415961894,976112),(24079,1389270739,416195164,0),(36019,1389270739,416855304,21242592),(27439,1389270739,419024295,1),(34279,1389270739,419611800,1),(40489,1389270739,419444460,0),(29659,1389270739,419759304,3156280),(49639,1389270739,420017717,0),(50299,1389270739,420114377,0),(45429,1389270739,420027774,2),(40099,1389270739,420454086,2392),(45889,1389270739,420761387,8),(48949,1389270739,420867825,1),(24979,1389270739,421482428,17791992),(49449,1389270739,421646416,2),(26599,1389270739,422071051,0),(32809,1389270739,422765273,0),(46819,1389270739,423099114,179880),(41239,1389270739,423669019,437656),(46159,1389270739,424044486,47241912),(32599,1389270739,424558797,0),(25039,1389270739,425457515,16128),(40519,1389270739,426322708,2),(55819,1389270739,426964410,0),(38299,1389270739,427277858,0),(45499,1389270739,427321718,0),(52339,1389270739,427446036,1),(29689,1389270739,427812563,10976856),(48679,1389270739,427856423,1),(45859,1389270739,428441693,0),(42979,1389270739,429583458,2),(49819,1389270739,429764766,0),(47749,1389270739,430041896,0),(33439,1389270739,430049439,184),(34879,1389270739,430666836,211656),(37159,1389270739,430680246,0),(39739,1389270739,431156004,0),(37579,1389270739,432247763,1),(37669,1389270739,432841693,0),(43879,1389270739,433802989,0),(48939,1389270739,434594151,2),(40999,1389270739,447962610,429224),(37039,1389270739,468127463,0),(26840,1389270740,338945961,36),(24080,1389270740,342557034,0),(41240,1389270740,343870609,0),(45080,1389270740,345557136,0),(44690,1389270740,350770648,0),(49640,1389270740,353451994,0),(48860,1389270740,353668782,14160),(26510,1389270740,357545811,0),(44360,1389270740,360253138,376),(36680,1389270740,361603868,0),(44180,1389270740,363101545,255408),(38120,1389270740,364457862,0);
insert into history_text (id,itemid,clock,ns,value) values (11803150,50508,1389270737,351981417,'0'),(11803151,50533,1389270738,606272674,'SNMPv2-SMI::enterprises.9.9.41.2.0.1'),(11803152,26815,1389270739,955943373,'SNMPv2-SMI::enterprises.9.9.194.2.0.3');
]
 37495:20140109:163220.386 zbx_snmp_get_value() snmp_synch_response():0
 37495:20140109:163220.386 In zbx_snmp_set_result()
 37495:20140109:163220.386 End of zbx_snmp_set_result():SUCCEED
 37495:20140109:163220.386 End of zbx_snmp_get_value():SUCCEED
 37495:20140109:163220.386 In zbx_snmp_close_session()
 37495:20140109:163220.386 End of zbx_snmp_close_session()
 37495:20140109:163220.386 End of get_value_snmp():SUCCEED
 37495:20140109:163220.386 End of get_value():SUCCEED
--
 37547:20140109:163220.425 In zbx_vc_add_value() itemid:48957 value_type:3 timestamp:1389270737.333751166
 37547:20140109:163220.426 End of zbx_vc_add_value():FAIL
 37547:20140109:163220.426 In zbx_vc_add_value() itemid:26777 value_type:3 timestamp:1389270737.334443433
 37547:20140109:163220.426 End of zbx_vc_add_value():FAIL
 37547:20140109:163220.426 In zbx_vc_add_value() itemid:36737 value_type:3 timestamp:1389270737.335064182
 37547:20140109:163220.426 End of zbx_vc_add_value():FAIL
 37547:20140109:163220.426 In zbx_vc_add_value() itemid:50508 value_type:4 timestamp:1389270737.351981417
 37547:20140109:163220.426 End of zbx_vc_add_value():FAIL
 37547:20140109:163220.426 In zbx_vc_add_value() itemid:46410 value_type:0 timestamp:1389270735.254488299
 37547:20140109:163220.426 End of zbx_vc_add_value():SUCCEED
 37547:20140109:163220.426 In zbx_vc_add_value() itemid:32805 value_type:0 timestamp:1389270735.254488299
--
 37539:20140109:163230.638 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37549:20140109:163230.638 In evaluate_function() function:'17.3b.i.sw.1.local:icmppingsec[ ].max(120)'
 37539:20140109:163230.638 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37549:20140109:163230.638 In evaluate_MAX()
 37539:20140109:163230.638 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37549:20140109:163230.638 In __get_function_parameter_uint31() parameters:'120' Nparam:1
 37539:20140109:163230.638 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37549:20140109:163230.638 In substitute_simple_macros() data:'120'
 37539:20140109:163230.638 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37549:20140109:163230.638 __get_function_parameter_uint31() flag:0 value:120
 37539:20140109:163230.638 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37549:20140109:163230.638 End of __get_function_parameter_uint31():SUCCEED
 37539:20140109:163230.638 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
--
 37539:20140109:163230.697 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0'
 37539:20140109:163230.697 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0'
 37542:20140109:163230.697 In __get_function_parameter_uint31() parameters:'#2' Nparam:1
 37549:20140109:163230.697 End of evaluate_function():SUCCEED value:'1'
 37542:20140109:163230.697 In substitute_simple_macros() data:'#2'
 37539:20140109:163230.697 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0'
 37542:20140109:163230.697 __get_function_parameter_uint31() flag:1 value:2
 37549:20140109:163230.697 In evaluate_function() function:'3.16.i.sw.1.local:.1.3.6.1.2.1.2.2.1.4.10001.last(0)'
 37539:20140109:163230.697 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0'
 37549:20140109:163230.697 In evaluate_LAST()
 37539:20140109:163230.697 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0'
--
 37539:20140109:163300.853 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:163300.853 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0'
 37539:20140109:163300.853 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:163300.853 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0'
 37539:20140109:163300.853 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:163300.853 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0'
 37539:20140109:163300.853 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:163300.853 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0'
 37539:20140109:163300.853 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:163300.853 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0'
 37539:20140109:163300.853 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
 37539:20140109:163300.853 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0'
--
 37539:20140109:163300.886 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0'
 37539:20140109:163300.886 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163300.886 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163300.886 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163300.886 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163300.886 zbx_substitute_functions_results() expression[18]:'({37601}#0&{37602}#0)|{37603}#0' => '(0#0&0#0)|0#0'
 37539:20140109:163300.886 zbx_substitute_functions_results() expression[19]:'({37616}#0&{37617}#0)|{37618}#0' => '(0#0&0#0)|0#0'
 37542:20140109:163300.886 timer #4 [processed 92 triggers, 0 events in 0.082713 sec, processing time functions]
 37539:20140109:163300.886 zbx_substitute_functions_results() expression[20]:'({37631}#0&{37632}#0)|{37633}#0' => '(0#0&0#0)|0#0'
 37542:20140109:163300.886 In process_time_functions()
 37539:20140109:163300.886 zbx_substitute_functions_results() expression[21]:'({37646}#0&{37647}#0)|{37648}#0' => '(0#0&0#0)|0#0'
--
 37511:20140109:163304.551 In zbx_waitpid()
 37497:20140109:163304.551 zbx_snmp_get_value() snmp_synch_response():0
 37479:20140109:163304.551 In activate_host() hostid:10444 itemid:47704 type:4
 37499:20140109:163304.551 In zbx_snmp_get_value() oid:'.1.3.6.1.2.1.2.2.1.16.22'
 37492:20140109:163304.551 End of activate_host()
 37473:20140109:163304.551 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.8.26' oid:'.1.3.6.1.2.1.2.2.1.8.26'
 37494:20140109:163304.551 In DCconfig_get_poller_items() poller_type:0
 37491:20140109:163304.551 zbx_snmp_get_value() snmp_synch_response():0
 37480:20140109:163304.552 In zbx_snmp_set_result()
 37478:20140109:163304.551 End of DCconfig_get_poller_nextcheck():1389270784
 37485:20140109:163304.551 End of zbx_snmp_set_result():SUCCEED
--
 37511:20140109:163304.552 zbx_waitpid() killed by signal 15
 37473:20140109:163304.552 In zbx_snmp_open_session()
 37497:20140109:163304.552 In zbx_snmp_set_result()
 37493:20140109:163304.552 In zbx_snmp_set_result()
 37500:20140109:163304.552 End of zbx_snmp_set_result():SUCCEED
 37476:20140109:163304.552 End of zbx_snmp_open_session()
 37481:20140109:163304.552 zbx_snmp_get_value() snmp_synch_response():0
 37480:20140109:163304.552 End of zbx_snmp_set_result():SUCCEED
 37489:20140109:163304.552 get_value_snmp() standard processing
 37485:20140109:163304.552 End of zbx_snmp_get_value():SUCCEED
 37490:20140109:163304.552 In zbx_snmp_set_result()
--
 37511:20140109:163304.552 End of zbx_waitpid():50338
 37500:20140109:163304.552 End of zbx_snmp_get_value():SUCCEED
 37494:20140109:163304.552 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.10015'
 37488:20140109:163304.552 In zbx_snmp_translate() oid:'.1.3.6.1.2.1.2.2.1.10.4'
 37495:20140109:163304.552 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.10002'
 37484:20140109:163304.552 In zbx_snmp_get_value() oid:'.1.3.6.1.2.1.2.2.1.16.6'
 37485:20140109:163304.552 In zbx_snmp_close_session()
 37473:20140109:163304.552 SNMP [public@10.16.19.38:161]
 37481:20140109:163304.552 In zbx_snmp_set_result()
 37493:20140109:163304.552 End of zbx_snmp_set_result():SUCCEED
 37491:20140109:163304.552 End of zbx_snmp_set_result():SUCCEED
--
 37511:20140109:163304.552 End of zbx_execute_script():TIMEOUT_ERROR
 37480:20140109:163304.553 In zbx_snmp_close_session()
 37496:20140109:163304.552 In substitute_simple_macros() data:'public'
 37494:20140109:163304.553 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10015'
 37482:20140109:163304.552 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.6'
 37479:20140109:163304.552 End of get_values():1
 37486:20140109:163304.553 In zbx_snmp_set_result()
 37485:20140109:163304.552 End of zbx_snmp_close_session()
 37492:20140109:163304.553 End of DCconfig_get_poller_nextcheck():1389270784
 37478:20140109:163304.553 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.7'
 37501:20140109:163304.553 zbx_snmp_get_value() snmp_synch_response():0
--
 37511:20140109:163304.553 End of zbx_execute_script():TIMEOUT_ERROR
 37486:20140109:163304.553 End of zbx_snmp_set_result():SUCCEED
 37501:20140109:163304.553 In zbx_snmp_set_result()
 37480:20140109:163304.553 End of zbx_snmp_close_session()
 37492:20140109:163304.553 In get_values()
 37493:20140109:163304.553 In zbx_snmp_close_session()
 37486:20140109:163304.553 End of zbx_snmp_get_value():SUCCEED
 37501:20140109:163304.553 End of zbx_snmp_set_result():SUCCEED
 37494:20140109:163304.553 In substitute_simple_macros() data:'161'
 37476:20140109:163304.553 In zbx_snmp_get_value() oid:'.1.3.6.1.2.1.2.2.1.16.10023'
 37473:20140109:163304.553 get_value_snmp() standard processing
--
 37511:20140109:163304.553 End of execute_script():TIMEOUT_ERROR
 37492:20140109:163304.553 End of DCconfig_get_poller_items():1
 37501:20140109:163304.553 In zbx_snmp_close_session()
 37497:20140109:163304.553 In activate_host() hostid:10095 itemid:55384 type:4
 37478:20140109:163304.553 In substitute_simple_macros() data:'public'
 37499:20140109:163304.553 In zbx_snmp_set_result()
 37496:20140109:163304.553 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10001'
 37479:20140109:163304.553 In DCconfig_get_poller_items() poller_type:0
 37473:20140109:163304.553 End of zbx_snmp_translate() oid_translated:'.1.3.6.1.2.1.2.2.1.8.26'
 37491:20140109:163304.553 End of get_value_snmp():SUCCEED
 37500:20140109:163304.553 End of get_value():SUCCEED
--
 37511:20140109:163304.553 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x0]. Crashing ...
 37481:20140109:163304.554 End of get_value():SUCCEED
 37486:20140109:163304.554 End of zbx_snmp_close_session()
 37501:20140109:163304.554 End of get_value_snmp():SUCCEED
 37495:20140109:163304.554 SNMP [public@10.16.1.2:161]
 37491:20140109:163304.554 End of get_value():SUCCEED
 37477:20140109:163304.554 zbx_snmp_get_value() snmp_synch_response():0
 37511:20140109:163304.554 ====== Fatal information: ======
 37485:20140109:163304.554 In activate_host() hostid:10121 itemid:48934 type:4
 37478:20140109:163304.554 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.7'
 37494:20140109:163304.554 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10015'
 37511:20140109:163304.554 program counter not available for this architecture
 37497:20140109:163304.554 End of activate_host()
 37474:20140109:163304.554 zbx_snmp_get_value() snmp_synch_response():0
 37499:20140109:163304.554 End of zbx_snmp_set_result():SUCCEED
 37480:20140109:163304.554 In activate_host() hostid:10339 itemid:41944 type:4
 37493:20140109:163304.554 End of get_value():SUCCEED
 37491:20140109:163304.554 In activate_host() hostid:10131 itemid:49454 type:4
 37500:20140109:163304.554 In activate_host() hostid:10103 itemid:24904 type:4
 37497:20140109:163304.554 End of get_values():1
 37482:20140109:163304.554 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.6'
 37485:20140109:163304.554 End of activate_host()
--
 37511:20140109:163304.554 === Registers: ===
 37481:20140109:163304.554 End of activate_host()
 37490:20140109:163304.554 End of get_value():SUCCEED
 37501:20140109:163304.554 End of get_value():SUCCEED
 37496:20140109:163304.554 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.10.10001' oid:'.1.3.6.1.2.1.2.2.1.10.10001'
 37478:20140109:163304.554 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.7'
 37497:20140109:163304.554 In DCconfig_get_poller_nextcheck() poller_type:0
 37478:20140109:163304.554 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.10.7' oid:'.1.3.6.1.2.1.2.2.1.10.7'
 37499:20140109:163304.554 End of zbx_snmp_get_value():SUCCEED
 37492:20140109:163304.554 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.20'
 37511:20140109:163304.554 register dump not available for this architecture
 37494:20140109:163304.554 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.10.10015' oid:'.1.3.6.1.2.1.2.2.1.10.10015'
 37482:20140109:163304.554 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.6'
 37493:20140109:163304.554 End of activate_host()
 37479:20140109:163304.554 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.10044'
 37481:20140109:163304.554 End of get_values():1
 37477:20140109:163304.554 End of zbx_snmp_set_result():SUCCEED
 37500:20140109:163304.554 End of activate_host()
 37497:20140109:163304.554 End of DCconfig_get_poller_nextcheck():1389270784
 37496:20140109:163304.554 In zbx_snmp_open_session()
 37485:20140109:163304.554 In DCconfig_get_poller_nextcheck() poller_type:0
--
 37511:20140109:163304.554 === Backtrace: ===
 37486:20140109:163304.555 End of get_value():SUCCEED
 37495:20140109:163304.554 In zbx_snmp_translate() oid:'.1.3.6.1.2.1.2.2.1.16.10002'
 37490:20140109:163304.555 End of activate_host()
 37472:20140109:163304.554 zbx_snmp_get_value() snmp_synch_response():0
 37499:20140109:163304.554 End of zbx_snmp_close_session()
 37482:20140109:163304.555 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.6'
 37491:20140109:163304.555 End of get_values():1
 37482:20140109:163304.555 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.10.6' oid:'.1.3.6.1.2.1.2.2.1.10.6'
 37479:20140109:163304.555 In substitute_simple_macros() data:'161'
 37475:20140109:163304.555 zbx_snmp_get_value() snmp_synch_response():0
--
 37511:20140109:163304.555 backtrace not available for this platform
 37481:20140109:163304.555 End of DCconfig_get_poller_nextcheck():1389270784
 37500:20140109:163304.555 In DCconfig_get_poller_nextcheck() poller_type:0
 37475:20140109:163304.555 In zbx_snmp_set_result()
 37480:20140109:163304.555 In get_values()
 37482:20140109:163304.555 SNMP [public@10.16.1.40:161]
 37485:20140109:163304.555 In DCconfig_get_poller_items() poller_type:0
 37479:20140109:163304.555 In substitute_simple_macros() data:'public'
 37492:20140109:163304.555 In substitute_simple_macros() data:'public'
 37474:20140109:163304.555 End of get_value_snmp():SUCCEED
 37490:20140109:163304.555 End of get_values():1
--
 37511:20140109:163304.555 === Memory map: ===
 37486:20140109:163304.555 End of activate_host()
 37493:20140109:163304.555 End of DCconfig_get_poller_nextcheck():1389270784
 37492:20140109:163304.555 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.20'
 37478:20140109:163304.555 End of zbx_snmp_open_session()
 37495:20140109:163304.555 End of zbx_snmp_translate() oid_translated:'.1.3.6.1.2.1.2.2.1.16.10002'
 37490:20140109:163304.555 In DCconfig_get_poller_nextcheck() poller_type:0
 37485:20140109:163304.555 End of DCconfig_get_poller_items():1
 37494:20140109:163304.555 SNMP [public@10.16.10.2:161]
 37481:20140109:163304.555 In get_values()
 37479:20140109:163304.555 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.10044'
--
 37511:20140109:163304.556 memory map not available for this platform
 37501:20140109:163304.556 End of DCconfig_get_poller_nextcheck():1389270784
 37477:20140109:163304.556 End of get_value_snmp():SUCCEED
 37492:20140109:163304.556 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.20'
 37499:20140109:163304.556 End of get_values():1
 37472:20140109:163304.556 In zbx_snmp_close_session()
 37479:20140109:163304.556 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.10044'
 37476:20140109:163304.556 In zbx_snmp_set_result()
 37485:20140109:163304.556 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.10003'
 37493:20140109:163304.556 In DCconfig_get_poller_items() poller_type:0
 37481:20140109:163304.556 In DCconfig_get_poller_items() poller_type:0
--
 37511:20140109:163304.556 ================================
 37493:20140109:163304.556 End of DCconfig_get_poller_items():1
 37486:20140109:163304.556 In DCconfig_get_poller_nextcheck() poller_type:0
 37500:20140109:163304.556 In get_values()
 37476:20140109:163304.556 End of zbx_snmp_get_value():SUCCEED
 37478:20140109:163304.556 In zbx_snmp_translate() oid:'.1.3.6.1.2.1.2.2.1.10.7'
 37497:20140109:163304.556 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.2'
 37490:20140109:163304.556 In get_values()
 37472:20140109:163304.556 End of zbx_snmp_close_session()
 37491:20140109:163304.556 In get_values()
 37477:20140109:163304.556 End of activate_host()
--
 37468:20140109:163304.558 One child process died (PID:37511,exitcode/signal:65280). Exiting ...
 37474:20140109:163304.558 In get_values()
 37479:20140109:163304.558 get_value_snmp() standard processing
 37501:20140109:163304.558 In substitute_simple_macros() data:'161'
 37472:20140109:163304.558 In activate_host() hostid:10291 itemid:39514 type:4
 37500:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.1'
 37493:20140109:163304.558 In substitute_simple_macros() data:'public'
 37473:20140109:163304.558 End of activate_host()
 37476:20140109:163304.558 In activate_host() hostid:10327 itemid:41134 type:4
 37490:20140109:163304.558 In substitute_simple_macros() data:'161'
 37481:20140109:163304.558 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10121'
Comment by Oleksii Zagorskyi [ 2014 Jan 09 ]

Only useful info from the comment above:

# grep " 37511"
 37511:20140109:162802.956 trapper #5 [processing data]
 37511:20140109:162802.959 Trapper got [{"request":"command","nodeid":0,"scriptid":"4","hostid":"10352"}] len 64
 37511:20140109:162802.959 In node_process_command()
 37511:20140109:162802.959 In execute_script() scriptid:4 hostid:10352
 37511:20140109:162802.959 In zbx_execute_script()
 37511:20140109:162802.959 In DBget_script_by_scriptid()
 37511:20140109:162802.959 query [txnlev:0] [select type,execute_on,command,groupid from scripts where scriptid=4]
 37511:20140109:162802.959 End of DBget_script_by_scriptid():SUCCEED
 37511:20140109:162802.959 In check_script_permissions() groupid:0 hostid:10352
 37511:20140109:162802.959 End of check_script_permissions():SUCCEED
 37511:20140109:162802.959 In substitute_simple_macros() data:'/data/scripts/zabbix/show_ports.pl {HOST.CONN}  | /usr/bin/column -t'
 37511:20140109:162802.959 query [txnlev:0] [select type,useip,ip,dns from interface where hostid=10352 and type in (1,2,3,4) and main=1]
 37511:20140109:162802.959 End substitute_simple_macros() data:'/data/scripts/zabbix/show_ports.pl 10.16.6.26  | /usr/bin/column -t'
 37511:20140109:162802.959 In zbx_execute_script()
 37511:20140109:162802.959 In zbx_popen() command:'/data/scripts/zabbix/show_ports.pl 10.16.6.26  | /usr/bin/column -t'
 37511:20140109:162802.960 End of zbx_popen():7
 37511:20140109:163304.551 In zbx_waitpid()
 37511:20140109:163304.552 zbx_waitpid() killed by signal 15
 37511:20140109:163304.552 End of zbx_waitpid():50338
 37511:20140109:163304.552 End of zbx_execute_script():TIMEOUT_ERROR
 37511:20140109:163304.553 End of zbx_execute_script():TIMEOUT_ERROR
 37511:20140109:163304.553 End of execute_script():TIMEOUT_ERROR
 37511:20140109:163304.553 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x0]. Crashing ...
 37511:20140109:163304.554 ====== Fatal information: ======
 37511:20140109:163304.554 program counter not available for this architecture
 37511:20140109:163304.554 === Registers: ===
 37511:20140109:163304.554 register dump not available for this architecture
 37511:20140109:163304.554 === Backtrace: ===
 37511:20140109:163304.555 backtrace not available for this platform
 37511:20140109:163304.555 === Memory map: ===
 37511:20140109:163304.556 memory map not available for this platform
 37511:20140109:163304.556 ================================
 37468:20140109:163304.558 One child process died (PID:37511,exitcode/signal:65280). Exiting ...

This is a trapper !

Comment by Vekli Sergey [ 2014 Jan 09 ]

And what we can do with it? Can you explain why trapper is interact with /data/scripts/zabbix/show_ports.pl.
show_ports.pl used only in context menus on maps.

Comment by richlv [ 2014 Jan 09 ]

you are using global script (defined in administration -> scripts)

Comment by Vekli Sergey [ 2014 Jan 09 ]

I try repeat action /data/scripts/zabbix/show_ports.pl 10.16.6.26 but no errors. Last hour i updated net-snmp to 5.7 can it impact on problem?

Comment by Vekli Sergey [ 2014 Jan 10 ]

what next? Did you need more info about trouble?

Comment by Vekli Sergey [ 2014 Jan 12 ]

Anybody can answer me?

Comment by Arli [ 2014 Jan 13 ]

My 2.2.1 (on Oracle Linux 6) also crashed 4 times this weekend. I'll enable debug logging and hopefully can provide more information if it should happen again. I have objdump with log level 3 logs though - would it help, if I attach those?

Comment by Vekli Sergey [ 2014 Jan 13 ]

What net-snmp version you have?

Comment by Arli [ 2014 Jan 13 ]

I have net-snmp 5.5(release 44.0.1.el6_4.4).

Comment by Vekli Sergey [ 2014 Jan 13 ]

try update to 5.7 and reinstall zabbix.

Comment by Oleksii Zagorskyi [ 2014 Jan 13 ]

Vekli, I think your last crash in trapper (with DebugLevel=4) is not related to SNMP version.

As you can see there was a trapper timeout (default is 300 seconds) for extremal script execution invoked as GUI script.
Theoretically it could be possible to emulate that case - try to reproduce it using simple "sleep 305" in the script.

Comment by Vekli Sergey [ 2014 Jan 13 ]

Why all server down then one script is timed out, is it normal? We use same scripts on 2.0.8 and no errors. And after update net-snmp server work without errors.

Comment by Oleksii Zagorskyi [ 2014 Jan 13 ]

Why all server down then one script is timed out, is it normal?

World is not free of bugs, and not only in zabbix
In any case your script worked longer than allowed !

I'm not very sure that net-snmp upgrade had some impact on the crash possibility.
Continue to watch !

Comment by Arli [ 2014 Jan 15 ]

I think maybe I should create another ticket, since my crash looks a bit different.
It says [signal:11(SIGSEGV),reason:128,refaddr:(nil)] and the first process to go down is a history syncer.

Comment by Vekli Sergey [ 2014 Jan 16 ]

Crash again. Same symptoms.
End of zbx_execute_script():TIMEOUT_ERROR
We found why script take too much time.
How we can change timeout in zabbix to bigger value?
And every starting after crash server work 10-15 min and stop collect data form hosts so after crash we restart server twice.

Comment by Oleksii Zagorskyi [ 2014 Jan 16 ]

300 is maximum for trapper timeout
https://www.zabbix.com/documentation/2.2/manual/appendix/config/zabbix_server

stop collecting data - it's another topic, closer to a support area.

Comment by Sergey Ganenko [ 2014 Jan 17 ]

I have seen this problem
server crashes after the end of the script after a timeout
here is the process

37961 ? ? I 0:00.11 zabbix_server: trapper # 1 [processing data] (zabbix_server)

38597 ? ? I 0:00.02 / usr / local / bin / sudo / usr / local / bin / nmap-O 127.0.0.1
38598 ? ? Is 0:00.00 / usr / local / bin / sudo / usr / local / bin / nmap-O 127.0.0.1
38599 ? ? S 0:01.02 / usr / local / bin / nmap-O 127.0.0.1

and log

after 300s

37961:20140117:164634.277 failed to kill [/ usr / local / bin / sudo / usr / local / bin / nmap-O 127.0.0.1 2> & 1 ] [ 1 ] Operation not permitted

and after running the script server crashes

37961:20140117:170305.443 Got signal [signal: 11 (SIGSEGV), reason: 1 , refaddr: 0x0]. Crashing ...
37961:20140117:170305.443 ====== Fatal information: ======
37961:20140117:170305.443 program counter not available for this architecture
37961:20140117:170305.443 === Registers: ===
37961:20140117:170305.443 register dump not available for this architecture
37961:20140117:170305.443 === Backtrace: ===
37961:20140117:170305.443 backtrace not available for this platform
37961:20140117:170305.443 === Memory map: ===
37961:20140117:170305.443 memory map not available for this platform
37961:20140117:170305.443 ================================
37950:20140117:170305.450 One child process died (PID: 37961 , exitcode / signal: 65280 ) . Exiting ...
37950:20140117:170307.468 syncing history data ...
37950:20140117:170307.469 syncing history data done
37950:20140117:170307.469 syncing trends data ...
37950:20140117:170307.472 syncing trends data done
37950:20140117:170307.473 Zabbix Server stopped. Zabbix 2.2.1 (revision 40808 ) .

P.S. FreeBSD Zabbix 9.2-RELEASE FreeBSD 9.2-RELEASE # 0 r255898: Thu Sep 26 22:50:31 UTC 2013 root @ bak
e.isc.freebsd.org :/ usr / obj / usr / src / sys / GENERIC amd64

Comment by Andris Zeila [ 2014 Jan 21 ]

The crash is fixed in development branch svn://svn.zabbix.com/branches/dev/ZBX-7608

Comment by Andris Zeila [ 2014 Jan 30 ]

Released in:
pre-2.2.2rc1 r41969
pre-2.3.0 r41970

Comment by Aleksandrs Saveljevs [ 2016 Mar 29 ]

This seems to have also fixed ZBX-7522.





[ZBX-7579] zabbix_server v2.2.1 crashing, Got signal [signal:10(SIGBUS),reason:3,refaddr:0x803f9d317] - in "history syncer" Created: 2013 Dec 24  Updated: 2017 Nov 29  Resolved: 2017 Nov 29

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Server (S)
Affects Version/s: 2.2.1
Fix Version/s: None

Type: Incident report Priority: Blocker
Reporter: Stefan Sabolowitsch Assignee: Unassigned
Resolution: Fixed Votes: 1
Labels: crash, freebsd
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD 9.2-RELEASE-p1 FreeBSD 9.2-RELEASE-p1 amd64


Attachments: Zip Archive zabbix_server_2.2.2_dumpfile_17.04.14.txt.zip     Zip Archive zabbix_server_2.2.2rc3_revision_42433_dumpfile.txt.zip    

 Description   

Zabbix Server crashing with this Error message in zabbix_server.log

60143:20131224:083932.101 Got signal [signal:10(SIGBUS),reason:3,refaddr:0x803f9d317]. Crashing ...
60143:20131224:083932.101 ====== Fatal information: ======
60143:20131224:083932.101 program counter not available for this architecture
60143:20131224:083932.101 === Registers: ===
60143:20131224:083932.101 register dump not available for this architecture
60143:20131224:083932.101 === Backtrace: ===
60143:20131224:083932.106 0: 0x8041efc27 <__stack_chk_guard+72775> at /lib/libc.so.7
60143:20131224:083932.106 === Memory map: ===
60143:20131224:083932.106 memory map not available for this platform
60143:20131224:083932.106 ================================
60018:20131224:083932.130 One child process died (PID:60143,exitcode/signal:65280). Exiting ...
60018:20131224:083934.144 syncing history data...
60018:20131224:083934.151 Got signal [signal:10(SIGBUS),reason:3,refaddr:0x803f9d317]. Crashing ...
60018:20131224:083934.151 ====== Fatal information: ======
60018:20131224:083934.152 program counter not available for this architecture
60018:20131224:083934.152 === Registers: ===
60018:20131224:083934.152 register dump not available for this architecture
60018:20131224:083934.152 === Backtrace: ===

Info about zabbix_server version:

60018:20131223:223234.567 Starting Zabbix Server. Zabbix 2.2.1 (revision 40808).
60018:20131223:223234.567 ****** Enabled features ******
60018:20131223:223234.567 SNMP monitoring: YES
60018:20131223:223234.567 IPMI monitoring: YES
60018:20131223:223234.567 WEB monitoring: YES
60018:20131223:223234.567 VMware monitoring: NO
60018:20131223:223234.567 Jabber notifications: YES
60018:20131223:223234.567 Ez Texting notifications: YES
60018:20131223:223234.567 ODBC: NO
60018:20131223:223234.567 SSH2 support: NO
60018:20131223:223234.567 IPv6 support: NO
60018:20131223:223234.567 ******************************
60018:20131223:223234.567 using configuration file: /usr/local/etc/zabbix22/zabbix_server.conf
60018:20131223:223234.582 current database version (mandatory/optional): 02020000/02020000
60018:20131223:223234.582 required mandatory version: 02020000



 Comments   
Comment by Stefan Sabolowitsch [ 2013 Dec 24 ]

i see exact the same problem here:
https://www.zabbix.com/forum/showpost.php?p=142171&postcount=1

Comment by richlv [ 2013 Dec 24 ]

that forum thread seems to be different (about ZBX-7521), in this case it crashes with SIGBUS even.

please attach all startup messages before the crash (including the ones about all started internal processes)

Comment by Stefan Sabolowitsch [ 2013 Dec 24 ]

Ok here is the startup messages:

 60018:20131223:223234.567 Starting Zabbix Server. Zabbix 2.2.1 (revision 40808).
 60018:20131223:223234.567 ****** Enabled features ******
 60018:20131223:223234.567 SNMP monitoring:           YES
 60018:20131223:223234.567 IPMI monitoring:           YES
 60018:20131223:223234.567 WEB monitoring:            YES
 60018:20131223:223234.567 VMware monitoring:          NO
 60018:20131223:223234.567 Jabber notifications:      YES
 60018:20131223:223234.567 Ez Texting notifications:  YES
 60018:20131223:223234.567 ODBC:                       NO
 60018:20131223:223234.567 SSH2 support:               NO
 60018:20131223:223234.567 IPv6 support:               NO
 60018:20131223:223234.567 ******************************
 60018:20131223:223234.567 using configuration file: /usr/local/etc/zabbix22/zabbix_server.conf
 60018:20131223:223234.582 current database version (mandatory/optional): 02020000/02020000
 60018:20131223:223234.582 required mandatory version: 02020000
 60022:20131223:223234.663 server #1 started [configuration syncer #1]
 60023:20131223:223234.663 server #2 started [db watchdog #1]
 60026:20131223:223234.700 server #5 started [poller #3]
 60025:20131223:223234.706 server #4 started [poller #2]
 60024:20131223:223234.707 server #3 started [poller #1]
 60027:20131223:223234.709 server #6 started [poller #4]
 60035:20131223:223234.731 server #14 started [poller #12]
 60028:20131223:223234.733 server #7 started [poller #5]
 60029:20131223:223234.735 server #8 started [poller #6]
 60030:20131223:223234.765 server #9 started [poller #7]
 60031:20131223:223234.769 server #10 started [poller #8]
 60037:20131223:223234.770 server #16 started [poller #14]
 60032:20131223:223234.781 server #11 started [poller #9]
 60038:20131223:223234.790 server #17 started [poller #15]
 60036:20131223:223234.792 server #15 started [poller #13]
 60040:20131223:223234.794 server #19 started [poller #17]
 60033:20131223:223234.798 server #12 started [poller #10]
 60041:20131223:223234.817 server #20 started [poller #18]
 60034:20131223:223234.819 server #13 started [poller #11]
 60039:20131223:223234.822 server #18 started [poller #16]
 60042:20131223:223234.822 server #21 started [poller #19]
 60043:20131223:223234.836 server #22 started [poller #20]
 60047:20131223:223234.851 server #26 started [poller #24]
 60050:20131223:223234.854 server #29 started [poller #27]
 60045:20131223:223234.864 server #24 started [poller #22]
 60044:20131223:223234.883 server #23 started [poller #21]
 60046:20131223:223234.884 server #25 started [poller #23]
 60067:20131223:223234.888 server #46 started [trapper #3]
 60066:20131223:223234.890 server #45 started [trapper #2]
 60071:20131223:223234.890 server #50 started [icmp pinger #2]
 60048:20131223:223234.895 server #27 started [poller #25]
 60049:20131223:223234.910 server #28 started [poller #26]
 60054:20131223:223234.913 server #33 started [poller #31]
 60056:20131223:223234.916 server #35 started [poller #33]
 60065:20131223:223234.917 server #44 started [trapper #1]
 60069:20131223:223234.918 server #48 started [trapper #5]
 60070:20131223:223234.921 server #49 started [icmp pinger #1]
 60059:20131223:223234.921 server #38 started [poller #36]
 60051:20131223:223234.932 server #30 started [poller #28]
 60068:20131223:223234.932 server #47 started [trapper #4]
 60063:20131223:223234.942 server #42 started [poller #40]
 60116:20131223:223234.945 server #60 started [icmp pinger #12]
 60120:20131223:223234.946 server #64 started [icmp pinger #16]
 60124:20131223:223234.946 server #68 started [icmp pinger #20]
 60126:20131223:223234.947 server #70 started [icmp pinger #22]
 60058:20131223:223234.948 server #37 started [poller #35]
 60121:20131223:223234.950 server #65 started [icmp pinger #17]
 60125:20131223:223234.950 server #69 started [icmp pinger #21]
 60133:20131223:223234.951 server #77 started [icmp pinger #29]
 60135:20131223:223234.951 server #79 started [alerter #1]
 60136:20131223:223234.952 server #80 started [housekeeper #1]
 60136:20131223:223234.952 executing housekeeper
 60138:20131223:223234.955 server #82 started [http poller #1]
 60130:20131223:223234.956 server #74 started [icmp pinger #26]
 60122:20131223:223234.956 server #66 started [icmp pinger #18]
 60129:20131223:223234.956 server #73 started [icmp pinger #25]
 60123:20131223:223234.956 server #67 started [icmp pinger #19]
 60134:20131223:223234.956 server #78 started [icmp pinger #30]
 60131:20131223:223234.956 server #75 started [icmp pinger #27]
 60115:20131223:223234.956 server #59 started [icmp pinger #11]
 60143:20131223:223234.956 server #87 started [history syncer #2]
 60112:20131223:223234.956 server #56 started [icmp pinger #8]
 60132:20131223:223234.956 server #76 started [icmp pinger #28]
 60108:20131223:223234.956 server #52 started [icmp pinger #4]
 60119:20131223:223234.957 server #63 started [icmp pinger #15]
 60110:20131223:223234.957 server #54 started [icmp pinger #6]
 60113:20131223:223234.957 server #57 started [icmp pinger #9]
 60118:20131223:223234.957 server #62 started [icmp pinger #14]
 60140:20131223:223234.957 server #84 started [http poller #3]
 60128:20131223:223234.957 server #72 started [icmp pinger #24]
 60107:20131223:223234.957 server #51 started [icmp pinger #3]
 60142:20131223:223234.958 server #86 started [history syncer #1]
 60137:20131223:223234.958 server #81 started [timer #1]
 60117:20131223:223234.962 server #61 started [icmp pinger #13]
 60145:20131223:223234.962 server #89 started [history syncer #4]
 60127:20131223:223234.963 server #71 started [icmp pinger #23]
 60057:20131223:223234.977 server #36 started [poller #34]
 60062:20131223:223234.978 server #41 started [poller #39]
 60146:20131223:223234.979 server #90 started [escalator #1]
 60139:20131223:223234.980 server #83 started [http poller #2]
 60060:20131223:223234.991 server #39 started [poller #37]
 60053:20131223:223234.999 server #32 started [poller #30]
 60141:20131223:223235.001 server #85 started [discoverer #1]
 60111:20131223:223235.004 server #55 started [icmp pinger #7]
 60149:20131223:223235.062 server #93 started [self-monitoring #1]
 60148:20131223:223235.063 server #92 started [proxy poller #1]
 60114:20131223:223235.063 server #58 started [icmp pinger #10]
 60052:20131223:223235.064 server #31 started [poller #29]
 60055:20131223:223235.064 server #34 started [poller #32]
 60144:20131223:223235.064 server #88 started [history syncer #3]
 60064:20131223:223235.068 server #43 started [unreachable poller #1]
 60018:20131223:223235.068 server #0 started [main process]
 60109:20131223:223235.069 server #53 started [icmp pinger #5]
 60061:20131223:223235.069 server #40 started [poller #38]
 60147:20131223:223235.072 server #91 started [snmp trapper #1]
 60136:20131223:223235.142 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.033836 sec, idle 1 hour(s)]
 60068:20131223:223305.588 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131223:223505.857 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131223:223705.128 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131223:223905.398 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131223:224105.674 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131223:224305.944 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131223:224314.439 sending configuration data to proxy "zabbix-p01", datalen 130915
 60066:20131223:224505.754 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131223:224706.014 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131223:224905.290 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131223:225105.565 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131223:225305.835 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131223:225506.117 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131223:225706.395 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131223:225826.792 sending configuration data to proxy "zabbix-p01", datalen 130915
 60066:20131223:225906.665 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131223:230106.936 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131223:230306.205 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131223:230506.475 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131223:230706.744 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131223:230907.015 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131223:231106.283 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131223:231306.560 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131223:231339.288 sending configuration data to proxy "zabbix-p01", datalen 130915
 60069:20131223:231506.825 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131223:231707.094 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131223:231907.365 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131223:232107.636 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131223:232307.907 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131223:232507.175 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131223:232707.444 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131223:232851.711 sending configuration data to proxy "zabbix-p01", datalen 130915
 60069:20131223:232907.716 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131223:233107.985 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60136:20131223:233235.149 executing housekeeper
 60136:20131223:233235.167 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012366 sec, idle 1 hour(s)]
 60065:20131223:233307.244 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131223:233507.514 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131223:233707.785 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131223:233908.055 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131223:234108.325 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131223:234308.595 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131223:234404.197 sending configuration data to proxy "zabbix-p01", datalen 130915
 60066:20131223:234508.864 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131223:234708.124 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60042:20131223:234720.521 Zabbix agent item "net.if.out[lo0,bytes]" on host "ns2" failed: first network error, wait for 15 seconds
 60064:20131223:234735.035 resuming Zabbix agent checks on host "ns2": connection restored
 60066:20131223:234908.396 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131223:235108.666 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131223:235308.937 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131223:235508.204 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131223:235708.475 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131223:235908.746 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131223:235916.590 sending configuration data to proxy "zabbix-p01", datalen 130915
 60065:20131224:000109.016 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:000308.285 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:000508.554 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:000708.824 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:000909.096 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:001109.375 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:001309.645 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:001428.918 sending configuration data to proxy "zabbix-p01", datalen 130915
 60069:20131224:001509.915 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:001709.184 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:001909.455 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:002109.726 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:002309.995 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:002509.264 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:002709.536 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:002909.806 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:002941.409 sending configuration data to proxy "zabbix-p01", datalen 130915
 60065:20131224:003110.085 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60136:20131224:003235.169 executing housekeeper
 60136:20131224:003235.188 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012883 sec, idle 1 hour(s)]
 60068:20131224:003310.365 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:003510.634 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:003710.906 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:003910.175 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:004110.455 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:004310.725 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:004453.627 sending configuration data to proxy "zabbix-p01", datalen 130915
 60066:20131224:004510.995 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:004710.264 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:004910.536 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:005110.805 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:005311.075 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:005511.345 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:005711.615 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:005911.885 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:010005.854 sending configuration data to proxy "zabbix-p01", datalen 130915
 60067:20131224:010112.158 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:010312.434 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:010512.705 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:010712.974 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:010912.235 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:011112.506 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:011312.776 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:011513.046 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:011518.210 sending configuration data to proxy "zabbix-p01", datalen 130915
 60067:20131224:011712.314 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:011912.586 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:012112.855 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:012313.125 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:012513.405 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:012713.674 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:012913.955 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:013030.699 sending configuration data to proxy "zabbix-p01", datalen 130915
 60068:20131224:013113.226 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60136:20131224:013235.189 executing housekeeper
 60136:20131224:013235.205 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011076 sec, idle 1 hour(s)]
 60068:20131224:013313.506 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:013513.781 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:013714.065 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:013914.334 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:014114.605 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:014314.874 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:014515.150 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:014543.065 sending configuration data to proxy "zabbix-p01", datalen 130915
 60068:20131224:014715.425 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:014915.696 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:015115.966 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:015315.234 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:015515.505 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:015715.774 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:015916.045 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:020055.255 sending configuration data to proxy "zabbix-p01", datalen 130915
 60069:20131224:020115.315 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:020315.584 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:020515.855 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:020716.124 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:020916.394 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:021116.666 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:021316.935 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:021516.204 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:021607.797 sending configuration data to proxy "zabbix-p01", datalen 130915
 60067:20131224:021716.475 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:021916.745 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:022117.024 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:022316.294 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:022516.566 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:022716.846 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:022917.115 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:023117.385 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:023120.198 sending configuration data to proxy "zabbix-p01", datalen 130915
 60136:20131224:023235.209 executing housekeeper
 60136:20131224:023235.226 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010983 sec, idle 1 hour(s)]
 60065:20131224:023317.655 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:023517.945 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:023717.215 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:023917.495 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:024117.766 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:024318.035 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:024517.304 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:024632.344 sending configuration data to proxy "zabbix-p01", datalen 130915
 60068:20131224:024717.575 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:024917.844 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:025118.121 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:025318.385 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:025518.663 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:025718.935 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:025918.204 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:030118.477 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:030144.715 sending configuration data to proxy "zabbix-p01", datalen 130915
 60069:20131224:030318.755 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:030519.031 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:030718.295 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:030918.564 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:031118.835 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:031319.105 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:031519.380 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:031657.065 sending configuration data to proxy "zabbix-p01", datalen 130915
 60065:20131224:031719.655 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:031919.925 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:032119.196 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:032320.065 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:032520.335 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:032720.534 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:032920.815 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:033121.084 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:033209.413 sending configuration data to proxy "zabbix-p01", datalen 130915
 60136:20131224:033235.229 executing housekeeper
 60136:20131224:033235.247 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011753 sec, idle 1 hour(s)]
 60068:20131224:033321.355 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:033521.625 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:033721.895 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:033921.167 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:034121.435 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:034321.705 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:034521.974 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:034721.245 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:034721.587 sending configuration data to proxy "zabbix-p01", datalen 130915
 60037:20131224:034834.322 Zabbix agent item "system.cpu.util[,system,avg1]" on host "ns2" failed: first network error, wait for 15 seconds
 60064:20131224:034849.054 resuming Zabbix agent checks on host "ns2": connection restored
 60065:20131224:034921.515 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:035121.786 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:035322.066 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:035522.541 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:035722.875 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:035922.168 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:040122.475 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:040233.864 sending configuration data to proxy "zabbix-p01", datalen 130915
 60067:20131224:040322.744 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:040523.015 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:040722.286 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:040922.566 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:041122.836 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:041323.106 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:041523.374 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:041723.645 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:041746.344 sending configuration data to proxy "zabbix-p01", datalen 130915
 60068:20131224:041923.925 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:042123.196 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:042323.474 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:042523.757 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:042724.026 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:042923.295 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:043123.573 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60136:20131224:043235.249 executing housekeeper
 60136:20131224:043235.267 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012273 sec, idle 1 hour(s)]
 60069:20131224:043258.447 sending configuration data to proxy "zabbix-p01", datalen 130915
 60069:20131224:043323.846 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:043524.114 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:043724.384 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:043924.655 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:044124.925 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:044324.195 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:044524.466 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:044724.735 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:044810.746 sending configuration data to proxy "zabbix-p01", datalen 130915
 60067:20131224:044924.414 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:045124.684 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:045324.955 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:045524.225 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:045724.495 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:045924.765 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:050125.045 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:050322.699 sending configuration data to proxy "zabbix-p01", datalen 130915
 60066:20131224:050324.314 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:050524.614 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:050724.885 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:050924.155 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:051124.426 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:051324.694 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:051524.966 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:051724.235 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:051835.088 sending configuration data to proxy "zabbix-p01", datalen 130915
 60068:20131224:051924.545 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:052124.822 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:052325.085 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:052525.366 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:052725.634 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:052925.905 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:053125.175 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60136:20131224:053235.269 executing housekeeper
 60136:20131224:053235.288 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012744 sec, idle 1 hour(s)]
 60065:20131224:053325.446 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:053347.603 sending configuration data to proxy "zabbix-p01", datalen 130915
 60069:20131224:053525.715 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:053725.990 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:053925.255 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:054125.525 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:054325.794 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:054526.064 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:054726.335 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:054900.027 sending configuration data to proxy "zabbix-p01", datalen 130915
 60068:20131224:054926.625 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:055126.908 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:055326.175 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:055526.455 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:055726.724 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:055926.995 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:060126.279 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:060326.554 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:060412.194 sending configuration data to proxy "zabbix-p01", datalen 130915
 60065:20131224:060526.843 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:060727.114 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:060927.384 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:061127.654 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:061327.926 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:061527.195 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:061727.475 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:061924.333 sending configuration data to proxy "zabbix-p01", datalen 130915
 60068:20131224:061927.744 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:062128.015 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:062327.284 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:062527.564 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:062727.834 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:062928.104 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:063128.376 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60136:20131224:063235.289 executing housekeeper
 60136:20131224:063235.305 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010193 sec, idle 1 hour(s)]
 60069:20131224:063328.646 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:063436.605 sending configuration data to proxy "zabbix-p01", datalen 130915
 60069:20131224:063528.915 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:063728.185 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:063928.454 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:064128.725 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:064329.001 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:064528.266 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:064728.534 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:064928.804 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:064948.898 sending configuration data to proxy "zabbix-p01", datalen 130915
 60067:20131224:065129.075 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:065329.345 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:065529.615 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:065729.885 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:065929.155 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60036:20131224:070109.701 Zabbix agent item "perf_counter[\234(_Total)\208]" on host "SFG06" failed: first network error, wait for 15 seconds
 60064:20131224:070124.490 resuming Zabbix agent checks on host "SFG06": connection restored
 60068:20131224:070129.426 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:070329.694 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:070501.094 sending configuration data to proxy "zabbix-p01", datalen 130915
 60068:20131224:070529.965 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:070729.234 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:070929.515 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:071129.786 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:071330.055 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:071529.325 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:071729.595 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:071929.875 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60027:20131224:071952.372 Zabbix agent item "net.if.out[em0,bytes]" on host "helpdesk01" failed: first network error, wait for 15 seconds
 60064:20131224:072007.764 resuming Zabbix agent checks on host "helpdesk01": connection restored
 60067:20131224:072013.504 sending configuration data to proxy "zabbix-p01", datalen 130915
 60068:20131224:072130.145 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:072330.415 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:072530.686 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:072730.955 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:072930.224 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:073130.497 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60136:20131224:073235.309 executing housekeeper
 60136:20131224:073235.326 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010964 sec, idle 1 hour(s)]
 60069:20131224:073330.777 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:073526.014 sending configuration data to proxy "zabbix-p01", datalen 130915
 60069:20131224:073531.053 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:073730.324 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:073930.594 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:074130.864 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:074331.136 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:074531.405 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:074731.675 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:074931.945 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:075038.488 sending configuration data to proxy "zabbix-p01", datalen 130915
 60066:20131224:075131.215 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:075331.485 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:075531.765 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:075732.035 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:075931.305 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:080131.575 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:080331.866 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:080532.137 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:080551.138 sending configuration data to proxy "zabbix-p01", datalen 130915
 60068:20131224:080732.405 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:080932.675 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:081132.945 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:081332.215 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:081532.486 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60067:20131224:081732.756 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:081933.025 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:082103.528 sending configuration data to proxy "zabbix-p01", datalen 130915
 60066:20131224:082132.295 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60066:20131224:082332.565 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:082532.835 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:082733.105 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:082933.375 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60065:20131224:083133.646 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60136:20131224:083235.329 executing housekeeper
 60136:20131224:083235.343 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.009464 sec, idle 1 hour(s)]
 60066:20131224:083333.925 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60069:20131224:083533.195 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60068:20131224:083615.864 sending configuration data to proxy "zabbix-p01", datalen 130915
 60068:20131224:083733.465 cannot send list of active checks to [192.168.1.79]: host [Marvin] not found
 60143:20131224:083932.101 Got signal [signal:10(SIGBUS),reason:3,refaddr:0x803f9d317]. Crashing ...
 60143:20131224:083932.101 ====== Fatal information: ======
 60143:20131224:083932.101 program counter not available for this architecture
 60143:20131224:083932.101 === Registers: ===
 60143:20131224:083932.101 register dump not available for this architecture
 60143:20131224:083932.101 === Backtrace: ===
 60143:20131224:083932.106 0: 0x8041efc27 <__stack_chk_guard+72775> at /lib/libc.so.7
 60143:20131224:083932.106 === Memory map: ===
 60143:20131224:083932.106 memory map not available for this platform
 60143:20131224:083932.106 ================================
 60018:20131224:083932.130 One child process died (PID:60143,exitcode/signal:65280). Exiting ...
 60018:20131224:083934.144 syncing history data...
 60018:20131224:083934.151 Got signal [signal:10(SIGBUS),reason:3,refaddr:0x803f9d317]. Crashing ...
 60018:20131224:083934.151 ====== Fatal information: ======
 60018:20131224:083934.152 program counter not available for this architecture
 60018:20131224:083934.152 === Registers: ===
 60018:20131224:083934.152 register dump not available for this architecture
Comment by richlv [ 2013 Dec 24 ]

just in case it is related to that same issue, can you please try current 2.2 svn head (or development snapshot) and see whether it helps ?

Comment by Stefan Sabolowitsch [ 2013 Dec 24 ]

yes i will do after Christmas celebration.

Aš linkiu tau visa geriausio su Kalėdomis!

greetings from germany

Comment by Stefan Sabolowitsch [ 2014 Jan 02 ]

Hi richlv,
Zabbix 2.2.2rc1 (revision 41161) also crashing, but with another error message:

short version:

 91637:20140101:165055.647 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x3039333630]. Crashing ...
 91637:20140101:165055.648 ====== Fatal information: ======
 91637:20140101:165055.648 program counter not available for this architecture
 91637:20140101:165055.648 === Registers: ===
 91637:20140101:165055.648 register dump not available for this architecture
 91637:20140101:165055.648 === Backtrace: ===
 91637:20140101:165055.655 === Memory map: ===
 91637:20140101:165055.655 memory map not available for this platform
 91637:20140101:165055.655 ================================
 91548:20140101:165055.676 One child process died (PID:91637,exitcode/signal:65280). Exiting ...
 91548:20140101:165057.683 syncing history data...
 91548:20140101:165057.707 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x3039333630]. Crashing ...
-#-#-#-#-#-

long version:

 91548:20131230:172904.739 Starting Zabbix Server. Zabbix 2.2.2rc1 (revision 41161).
 91548:20131230:172904.739 ****** Enabled features ******
 91548:20131230:172904.739 SNMP monitoring:           YES
 91548:20131230:172904.739 IPMI monitoring:           YES
 91548:20131230:172904.739 WEB monitoring:            YES
 91548:20131230:172904.739 VMware monitoring:          NO
 91548:20131230:172904.739 Jabber notifications:       NO
 91548:20131230:172904.739 Ez Texting notifications:  YES
 91548:20131230:172904.739 ODBC:                       NO
 91548:20131230:172904.739 SSH2 support:              YES
 91548:20131230:172904.739 IPv6 support:               NO
 91548:20131230:172904.739 ******************************
 91548:20131230:172904.739 using configuration file: /usr/local/etc/zabbix22/zabbix_server.conf
 91548:20131230:172904.749 current database version (mandatory/optional): 02020000/02020000
 91548:20131230:172904.749 required mandatory version: 02020000
 91551:20131230:172904.829 server #1 started [configuration syncer #1]
 91552:20131230:172904.829 server #2 started [db watchdog #1]
 91548:20131230:172904.860 server #0 started [main process]
 91558:20131230:172904.873 server #7 started [poller #5]
 91556:20131230:172904.874 server #5 started [poller #3]
 91614:20131230:172904.883 server #63 started [icmp pinger #15]
 91618:20131230:172904.884 server #67 started [icmp pinger #19]
 91623:20131230:172904.884 server #72 started [icmp pinger #24]
 91625:20131230:172904.885 server #74 started [icmp pinger #26]
 91630:20131230:172904.885 server #79 started [alerter #1]
 91566:20131230:172904.896 server #15 started [poller #13]
 91569:20131230:172904.909 server #18 started [poller #16]
 91571:20131230:172904.916 server #20 started [poller #18]
 91561:20131230:172904.923 server #10 started [poller #8]
 91640:20131230:172904.923 server #89 started [history syncer #4]
 91644:20131230:172904.924 server #93 started [self-monitoring #1]
 91564:20131230:172904.934 server #13 started [poller #11]
 91599:20131230:172904.935 server #48 started [trapper #5]
 91553:20131230:172904.944 server #3 started [poller #1]
 91602:20131230:172904.944 server #51 started [icmp pinger #3]
 91609:20131230:172904.945 server #58 started [icmp pinger #10]
 91622:20131230:172904.949 server #71 started [icmp pinger #23]
 91642:20131230:172904.951 server #91 started [snmp trapper #1]
 91573:20131230:172904.951 server #22 started [poller #20]
 91595:20131230:172904.957 server #44 started [trapper #1]
 91610:20131230:172904.958 server #59 started [icmp pinger #11]
 91634:20131230:172904.958 server #83 started [http poller #2]
 91638:20131230:172904.958 server #87 started [history syncer #2]
 91607:20131230:172904.959 server #56 started [icmp pinger #8]
 91613:20131230:172904.965 server #62 started [icmp pinger #14]
 91629:20131230:172904.966 server #78 started [icmp pinger #30]
 91633:20131230:172904.966 server #82 started [http poller #1]
 91643:20131230:172904.966 server #92 started [proxy poller #1]
 91598:20131230:172904.969 server #47 started [trapper #4]
 91606:20131230:172904.973 server #55 started [icmp pinger #7]
 91635:20131230:172904.973 server #84 started [http poller #3]
 91611:20131230:172904.976 server #60 started [icmp pinger #12]
 91619:20131230:172904.976 server #68 started [icmp pinger #20]
 91626:20131230:172904.976 server #75 started [icmp pinger #27]
 91637:20131230:172904.976 server #86 started [history syncer #1]
 91600:20131230:172904.983 server #49 started [icmp pinger #1]
 91601:20131230:172904.986 server #50 started [icmp pinger #2]
 91560:20131230:172905.013 server #9 started [poller #7]
 91608:20131230:172905.014 server #57 started [icmp pinger #9]
 91591:20131230:172905.016 server #40 started [poller #38]
 91612:20131230:172905.018 server #61 started [icmp pinger #13]
 91620:20131230:172905.019 server #69 started [icmp pinger #21]
 91632:20131230:172905.019 server #81 started [timer #1]
 91604:20131230:172905.024 server #53 started [icmp pinger #5]
 91624:20131230:172905.025 server #73 started [icmp pinger #25]
 91628:20131230:172905.031 server #77 started [icmp pinger #29]
 91562:20131230:172905.032 server #11 started [poller #9]
 91596:20131230:172905.033 server #45 started [trapper #2]
 91616:20131230:172905.033 server #65 started [icmp pinger #17]
 91597:20131230:172905.034 server #46 started [trapper #3]
 91603:20131230:172905.037 server #52 started [icmp pinger #4]
 91567:20131230:172904.961 server #16 started [poller #14]
 91639:20131230:172904.981 server #88 started [history syncer #3]
 91615:20131230:172905.045 server #64 started [icmp pinger #16]
 91621:20131230:172905.052 server #70 started [icmp pinger #22]
 91631:20131230:172905.053 server #80 started [housekeeper #1]
 91627:20131230:172904.967 server #76 started [icmp pinger #28]
 91641:20131230:172905.059 server #90 started [escalator #1]
 91559:20131230:172905.067 server #8 started [poller #6]
 91636:20131230:172905.069 server #85 started [discoverer #1]
 91582:20131230:172905.087 server #31 started [poller #29]
 91605:20131230:172905.088 server #54 started [icmp pinger #6]
 91617:20131230:172905.093 server #66 started [icmp pinger #18]
 91587:20131230:172905.119 server #36 started [poller #34]
 91579:20131230:172905.139 server #28 started [poller #26]
 91575:20131230:172905.144 server #24 started [poller #22]
 91631:20131230:172905.154 executing housekeeper
 91592:20131230:172905.168 server #41 started [poller #39]
 91583:20131230:172905.203 server #32 started [poller #30]
 91565:20131230:172905.207 server #14 started [poller #12]
 91631:20131230:172905.214 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.016840 sec, idle 1 hour(s)]
 91593:20131230:172905.231 server #42 started [poller #40]
 91574:20131230:172905.232 server #23 started [poller #21]
 91585:20131230:172905.252 server #34 started [poller #32]
 91578:20131230:172905.285 server #27 started [poller #25]
 91570:20131230:172905.295 server #19 started [poller #17]
 91590:20131230:172905.321 server #39 started [poller #37]
 91589:20131230:172905.326 server #38 started [poller #36]
 91588:20131230:172905.334 server #37 started [poller #35]
 91594:20131230:172905.336 server #43 started [unreachable poller #1]
 91586:20131230:172905.337 server #35 started [poller #33]
 91580:20131230:172905.349 server #29 started [poller #27]
 91568:20131230:172905.353 server #17 started [poller #15]
 91557:20131230:172905.359 server #6 started [poller #4]
 91576:20131230:172905.364 server #25 started [poller #23]
 91554:20131230:172905.376 server #4 started [poller #2]
 91584:20131230:172905.378 server #33 started [poller #31]
 91581:20131230:172905.381 server #30 started [poller #28]
 91563:20131230:172905.386 server #12 started [poller #10]
 91572:20131230:172905.389 server #21 started [poller #19]
 91577:20131230:172905.407 server #26 started [poller #24]
 91560:20131230:172926.682 Zabbix agent item "system.swap.size[,pfree]" on host "zabbix-m01" failed: first network error, wait for 15 seconds
 91594:20131230:172941.424 Zabbix agent item "proc.num[postgres,,,]" on host "zabbix-m01" failed: another network error, wait for 15 seconds
 91594:20131230:172956.451 Zabbix agent item "vfs.fs.size[/tmp,pused]" on host "zabbix-m01" failed: another network error, wait for 15 seconds
 91594:20131230:173011.481 temporarily disabling Zabbix agent checks on host "zabbix-m01": host unavailable
 91595:20131230:173609.412 sending configuration data to proxy "zabbix-p01", datalen 129581
 91594:20131230:173712.371 enabling Zabbix agent checks on host "zabbix-m01": host became available
 91638:20131230:173714.827 item [zabbix-m01:vfs.fs.size[/home,pfree]] became supported
 91640:20131230:173840.715 item [zabbix-m01:vfs.fs.size[/,pused]] became supported
 91640:20131230:174715.475 item [zabbix-m01:vfs.fs.size[/,pfree]] became supported
 91637:20131230:174936.625 item [zabbix-p01:vfs.fs.size[/tmp,pused]] became not supported: Type of received value [-3958792124306348.000000] is not suitable for value type [Numeric (float)]
 91639:20131230:174941.678 item [zabbix-p01:vfs.fs.size[/tmp,pfree]] became not supported: Type of received value [3958792124306448.000000] is not suitable for value type [Numeric (float)]
 91637:20131230:175037.275 item [zabbix-p01:vfs.fs.size[/tmp,pused]] became supported
 91638:20131230:175042.329 item [zabbix-p01:vfs.fs.size[/tmp,pfree]] became supported
 91599:20131230:175118.848 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131230:180418.471 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131230:181931.857 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131230:182905.219 executing housekeeper
 91631:20131230:182905.235 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011592 sec, idle 1 hour(s)]
 91597:20131230:183445.174 sending configuration data to proxy "zabbix-p01", datalen 129581
 91599:20131230:184958.848 sending configuration data to proxy "zabbix-p01", datalen 129581
 91638:20131230:185448.705 item [logger01:vm.memory.size[buffers]] became supported
 91638:20131230:185619.696 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 91599:20131230:190512.537 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20131230:192025.918 sending configuration data to proxy "zabbix-p01", datalen 129581
 91637:20131230:192450.825 item [logger01:vm.memory.size[buffers]] became supported
 91638:20131230:192817.655 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 91631:20131230:192905.239 executing housekeeper
 91631:20131230:192905.258 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012705 sec, idle 1 hour(s)]
 91639:20131230:193451.186 item [logger01:vm.memory.size[buffers]] became supported
 91598:20131230:193539.500 sending configuration data to proxy "zabbix-p01", datalen 129581
 91638:20131230:194119.698 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 91587:20131230:194156.142 Zabbix agent item "system.cpu.load[,avg5]" on host "helpdesk01" failed: first network error, wait for 15 seconds
 91594:20131230:194211.345 resuming Zabbix agent checks on host "helpdesk01": connection restored
 91595:20131230:195053.110 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20131230:200606.754 sending configuration data to proxy "zabbix-p01", datalen 129581
 91599:20131230:202120.257 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131230:202905.259 executing housekeeper
 91631:20131230:202905.278 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012940 sec, idle 1 hour(s)]
 91599:20131230:203633.494 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131230:205146.865 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131230:210700.174 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131230:212213.869 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131230:212905.279 executing housekeeper
 91631:20131230:212905.299 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.013402 sec, idle 1 hour(s)]
 91599:20131230:213727.444 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20131230:215240.914 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20131230:220754.286 sending configuration data to proxy "zabbix-p01", datalen 129581
 91579:20131230:221708.778 Zabbix agent item "net.if.in[lo0,bytes]" on host "ns2" failed: first network error, wait for 15 seconds
 91594:20131230:221723.935 resuming Zabbix agent checks on host "ns2": connection restored
 91598:20131230:222307.943 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131230:222905.309 executing housekeeper
 91631:20131230:222905.324 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010156 sec, idle 1 hour(s)]
 91597:20131230:223821.585 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131230:225335.388 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131230:230849.025 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20131230:232402.716 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131230:232905.329 executing housekeeper
 91631:20131230:232905.344 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010193 sec, idle 1 hour(s)]
 91597:20131230:233916.204 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20131230:235429.765 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131231:000943.288 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:002456.756 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:002905.349 executing housekeeper
 91631:20131231:002905.368 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012372 sec, idle 1 hour(s)]
 91596:20131231:004010.365 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20131231:005523.910 sending configuration data to proxy "zabbix-p01", datalen 129581
 91638:20131231:010449.138 item [logger01:vm.memory.size[buffers]] became supported
 91638:20131231:010851.536 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 91597:20131231:011037.530 sending configuration data to proxy "zabbix-p01", datalen 129581
 91599:20131231:012550.865 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:012905.369 executing housekeeper
 91631:20131231:012905.386 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012278 sec, idle 1 hour(s)]
 91598:20131231:014104.399 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20131231:015617.739 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20131231:021131.455 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131231:022645.186 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:022905.389 executing housekeeper
 91631:20131231:022905.407 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011759 sec, idle 1 hour(s)]
 91596:20131231:024158.947 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20131231:025712.478 sending configuration data to proxy "zabbix-p01", datalen 129581
 91599:20131231:031225.956 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131231:032739.414 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:032905.409 executing housekeeper
 91631:20131231:032905.425 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010812 sec, idle 1 hour(s)]
 91598:20131231:034252.974 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131231:035806.358 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131231:041319.934 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20131231:042833.405 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:042905.429 executing housekeeper
 91631:20131231:042905.444 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010322 sec, idle 1 hour(s)]
 91596:20131231:044346.999 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:045900.405 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:051413.944 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:052905.449 executing housekeeper
 91631:20131231:052905.464 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010443 sec, idle 1 hour(s)]
 91595:20131231:052927.559 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131231:054441.294 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131231:055955.099 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131231:061508.795 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:062905.469 executing housekeeper
 91631:20131231:062905.490 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.014300 sec, idle 1 hour(s)]
 91598:20131231:063022.405 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131231:064535.607 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20131231:070048.916 sending configuration data to proxy "zabbix-p01", datalen 129581
 91561:20131231:070110.565 Zabbix agent item "perf_counter[\234(_Total)\210]" on host "SFG06" failed: first network error, wait for 15 seconds
 91594:20131231:070126.705 resuming Zabbix agent checks on host "SFG06": connection restored
 91599:20131231:071602.093 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:072905.499 executing housekeeper
 91631:20131231:072905.514 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010370 sec, idle 1 hour(s)]
 91599:20131231:073115.526 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:074629.237 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20131231:080142.728 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:081656.235 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:082905.519 executing housekeeper
 91631:20131231:082905.534 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010697 sec, idle 1 hour(s)]
 91598:20131231:083209.701 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:084723.185 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20131231:090236.685 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:091750.346 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:092905.539 executing housekeeper
 91631:20131231:092905.558 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012640 sec, idle 1 hour(s)]
 91599:20131231:093303.984 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20131231:094817.744 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:100331.658 sending configuration data to proxy "zabbix-p01", datalen 129581
 91599:20131231:101845.544 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:102905.559 executing housekeeper
 91631:20131231:102905.578 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012565 sec, idle 1 hour(s)]
 91595:20131231:103359.127 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20131231:104912.680 sending configuration data to proxy "zabbix-p01", datalen 129581
 91599:20131231:110425.874 sending configuration data to proxy "zabbix-p01", datalen 129581
 91639:20131231:110447.290 item [logger01:vm.memory.size[buffers]] became supported
 91640:20131231:110547.868 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 91599:20131231:111939.348 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:112905.579 executing housekeeper
 91631:20131231:112905.594 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010289 sec, idle 1 hour(s)]
 91597:20131231:113452.717 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131231:115006.405 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:120519.900 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20131231:122033.644 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:122905.599 executing housekeeper
 91631:20131231:122905.615 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010509 sec, idle 1 hour(s)]
 91598:20131231:123547.154 sending configuration data to proxy "zabbix-p01", datalen 129581
 91599:20131231:125100.614 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20131231:130614.089 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:132127.814 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:132905.619 executing housekeeper
 91631:20131231:132905.636 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010938 sec, idle 1 hour(s)]
 91596:20131231:133641.157 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131231:135154.469 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131231:140707.974 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:142221.467 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:142905.639 executing housekeeper
 91631:20131231:142905.654 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010174 sec, idle 1 hour(s)]
 91595:20131231:143734.911 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:145248.324 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20131231:150801.848 sending configuration data to proxy "zabbix-p01", datalen 129581
 91599:20131231:152315.078 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:152905.659 executing housekeeper
 91631:20131231:152905.678 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012733 sec, idle 1 hour(s)]
 91599:20131231:153828.466 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20131231:155341.884 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:160855.389 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20131231:162409.115 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:162905.679 executing housekeeper
 91631:20131231:162905.698 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.013079 sec, idle 1 hour(s)]
 91595:20131231:163922.954 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131231:165436.556 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20131231:170950.314 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20131231:172504.269 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:172905.699 executing housekeeper
 91631:20131231:172905.714 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010393 sec, idle 1 hour(s)]
 91598:20131231:174018.047 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:175531.757 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131231:181045.584 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:182559.384 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:182905.719 executing housekeeper
 91631:20131231:182905.734 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010512 sec, idle 1 hour(s)]
 91599:20131231:184112.969 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131231:185626.278 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:191139.514 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:192652.724 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:192905.739 executing housekeeper
 91631:20131231:192905.757 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012081 sec, idle 1 hour(s)]
 91598:20131231:194206.124 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20131231:195719.854 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20131231:201233.345 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20131231:202746.767 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:202905.759 executing housekeeper
 91631:20131231:202905.775 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011359 sec, idle 1 hour(s)]
 91598:20131231:204300.127 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20131231:205813.484 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:211326.810 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20131231:212840.028 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:212905.779 executing housekeeper
 91631:20131231:212905.794 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010521 sec, idle 1 hour(s)]
 91597:20131231:214353.754 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131231:215907.266 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20131231:221420.949 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:222905.799 executing housekeeper
 91631:20131231:222905.816 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010926 sec, idle 1 hour(s)]
 91596:20131231:222934.524 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20131231:224447.994 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20131231:230001.696 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20131231:231515.346 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20131231:232905.819 executing housekeeper
 91631:20131231:232905.837 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011650 sec, idle 1 hour(s)]
 91596:20131231:233029.094 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20131231:234542.734 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20140101:000056.106 sending configuration data to proxy "zabbix-p01", datalen 129581
 91638:20140101:000448.736 item [logger01:vm.memory.size[buffers]] became supported
 91598:20140101:001609.678 sending configuration data to proxy "zabbix-p01", datalen 129581
 91638:20140101:001821.339 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 91631:20140101:002905.839 executing housekeeper
 91631:20140101:002905.855 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010514 sec, idle 1 hour(s)]
 91595:20140101:003123.074 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20140101:004636.414 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20140101:010149.836 sending configuration data to proxy "zabbix-p01", datalen 129581
 91639:20140101:010452.246 item [logger01:vm.memory.size[buffers]] became supported
 91638:20140101:010849.426 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 91598:20140101:011703.308 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20140101:012905.859 executing housekeeper
 91631:20140101:012905.878 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012840 sec, idle 1 hour(s)]
 91596:20140101:013216.536 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20140101:014730.043 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20140101:020243.637 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20140101:021757.087 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20140101:022905.879 executing housekeeper
 91631:20140101:022905.898 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.013313 sec, idle 1 hour(s)]
 91597:20140101:023310.644 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20140101:024823.967 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20140101:030337.436 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20140101:031850.905 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20140101:032905.899 executing housekeeper
 91631:20140101:032905.914 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010410 sec, idle 1 hour(s)]
 91596:20140101:033404.208 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20140101:034917.768 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20140101:040431.348 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20140101:041945.147 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20140101:042905.919 executing housekeeper
 91631:20140101:042905.937 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011549 sec, idle 1 hour(s)]
 91598:20140101:043459.007 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20140101:045012.934 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20140101:050526.684 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20140101:052040.135 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20140101:052905.939 executing housekeeper
 91631:20140101:052905.958 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012286 sec, idle 1 hour(s)]
 91595:20140101:053553.796 sending configuration data to proxy "zabbix-p01", datalen 129581
 91599:20140101:055107.625 sending configuration data to proxy "zabbix-p01", datalen 129581
 91599:20140101:060621.080 sending configuration data to proxy "zabbix-p01", datalen 129581
 91599:20140101:062134.298 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20140101:062905.959 executing housekeeper
 91631:20140101:062905.974 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010339 sec, idle 1 hour(s)]
 91596:20140101:063647.787 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20140101:065201.354 sending configuration data to proxy "zabbix-p01", datalen 129581
 91554:20140101:070110.142 Zabbix agent item "perf_counter[\234(_Total)\210]" on host "SFG06" failed: first network error, wait for 15 seconds
 91594:20140101:070126.165 resuming Zabbix agent checks on host "SFG06": connection restored
 91598:20140101:070714.979 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20140101:072228.384 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20140101:072905.979 executing housekeeper
 91631:20140101:072905.999 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.013630 sec, idle 1 hour(s)]
 91597:20140101:073741.884 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20140101:075255.447 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20140101:080809.054 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20140101:082322.455 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20140101:082906.009 executing housekeeper
 91631:20140101:082906.026 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012188 sec, idle 1 hour(s)]
 91596:20140101:083835.979 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20140101:085349.405 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20140101:090902.785 sending configuration data to proxy "zabbix-p01", datalen 129581
 91599:20140101:092416.497 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20140101:092906.029 executing housekeeper
 91631:20140101:092906.044 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010369 sec, idle 1 hour(s)]
 91598:20140101:093929.979 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20140101:095443.334 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20140101:100956.738 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20140101:102510.297 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20140101:102906.049 executing housekeeper
 91631:20140101:102906.064 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010296 sec, idle 1 hour(s)]
 91596:20140101:104023.744 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20140101:105537.044 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20140101:111050.206 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20140101:112603.607 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20140101:112906.069 executing housekeeper
 91631:20140101:112906.088 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012845 sec, idle 1 hour(s)]
 91599:20140101:114116.654 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20140101:115629.714 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20140101:121143.188 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20140101:122656.850 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20140101:122906.089 executing housekeeper
 91631:20140101:122906.106 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010316 sec, idle 1 hour(s)]
 91598:20140101:124210.494 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20140101:125724.127 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20140101:131237.704 sending configuration data to proxy "zabbix-p01", datalen 129581
 91599:20140101:132751.144 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20140101:132906.109 executing housekeeper
 91631:20140101:132906.124 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010384 sec, idle 1 hour(s)]
 91595:20140101:134304.219 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20140101:135817.404 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20140101:141330.954 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20140101:142844.506 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20140101:142906.129 executing housekeeper
 91631:20140101:142906.148 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012108 sec, idle 1 hour(s)]
 91595:20140101:144358.057 sending configuration data to proxy "zabbix-p01", datalen 129581
 91599:20140101:145911.715 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20140101:151425.479 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20140101:152906.149 executing housekeeper
 91631:20140101:152906.164 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010349 sec, idle 1 hour(s)]
 91599:20140101:152939.354 sending configuration data to proxy "zabbix-p01", datalen 129581
 91596:20140101:154452.704 sending configuration data to proxy "zabbix-p01", datalen 129581
 91597:20140101:160005.907 sending configuration data to proxy "zabbix-p01", datalen 129581
 91595:20140101:161519.465 sending configuration data to proxy "zabbix-p01", datalen 129581
 91631:20140101:162906.169 executing housekeeper
 91631:20140101:162906.184 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010191 sec, idle 1 hour(s)]
 91598:20140101:163032.964 sending configuration data to proxy "zabbix-p01", datalen 129581
 91598:20140101:164546.517 sending configuration data to proxy "zabbix-p01", datalen 129581
 91637:20140101:165055.647 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x3039333630]. Crashing ...
 91637:20140101:165055.648 ====== Fatal information: ======
 91637:20140101:165055.648 program counter not available for this architecture
 91637:20140101:165055.648 === Registers: ===
 91637:20140101:165055.648 register dump not available for this architecture
 91637:20140101:165055.648 === Backtrace: ===
 91637:20140101:165055.655 === Memory map: ===
 91637:20140101:165055.655 memory map not available for this platform
 91637:20140101:165055.655 ================================
 91548:20140101:165055.676 One child process died (PID:91637,exitcode/signal:65280). Exiting ...
 91548:20140101:165057.683 syncing history data...
 91548:20140101:165057.707 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x3039333630]. Crashing ...
 91548:20140101:165057.707 ====== Fatal information: ======
 91548:20140101:165057.707 program counter not available for this architecture
 91548:20140101:165057.707 === Registers: ===
 91548:20140101:165057.707 register dump not available for this architecture
 91548:20140101:165057.707 === Backtrace: ===
 91548:20140101:165057.710 Got signal [signal:10(SIGBUS),reason:3,refaddr:0x8039b1ff4]. Crashing ...
 91548:20140101:165057.710 ====== Fatal information: ======
 91548:20140101:165057.710 program counter not available for this architecture
 91548:20140101:165057.710 === Registers: ===
 91548:20140101:165057.710 register dump not available for this architecture
 91548:20140101:165057.710 === Backtrace: ===
 91548:20140101:165057.710 === Memory map: ===
 91548:20140101:165057.710 memory map not available for this platform
 91548:20140101:165057.710 ================================
Comment by Oleksii Zagorskyi [ 2014 Jan 03 ]

There not possible to see backtrace but you could add it.

Try this command on your server:

# ldd /usr/local/sbin/zabbix_server | grep exec
	libexecinfo.so.1 => /usr/local/lib/libexecinfo.so.1 (0x28dff000)

If you don't have it, try to install http://www.freshports.org/devel/libexecinfo/ and recompile zabbix_server binary then.

Also, try it please on latest snapshot Pre-2.2.2rc1 (stable) http://www.zabbix.com/developers.php

Comment by Stefan Sabolowitsch [ 2014 Jan 03 ]

Hi Oleksiy,
here the result from command ldd:

 
ldd /usr/local/sbin/zabbix_server | grep exec
	libexecinfo.so.1 => /usr/local/lib/libexecinfo.so.1 (0x8039ab000)

actually i test 2.2.2rc1 (revision 41235)

Comment by Stefan Sabolowitsch [ 2014 Jan 07 ]

OK, same problem here with 2.2.2rc1 (revision 41235)

 
 51064:20140103:141107.153 Starting Zabbix Server. Zabbix 2.2.2rc1 (revision 41235).
 51064:20140103:141107.153 ****** Enabled features ******
 51064:20140103:141107.153 SNMP monitoring:           YES
 51064:20140103:141107.153 IPMI monitoring:           YES
 51064:20140103:141107.153 WEB monitoring:            YES
 51064:20140103:141107.153 VMware monitoring:          NO
 51064:20140103:141107.153 Jabber notifications:       NO
 51064:20140103:141107.154 Ez Texting notifications:  YES
 51064:20140103:141107.154 ODBC:                       NO
 51064:20140103:141107.154 SSH2 support:              YES
 51064:20140103:141107.154 IPv6 support:               NO
 51064:20140103:141107.154 ******************************
 51064:20140103:141107.154 using configuration file: /usr/local/etc/zabbix22/zabbix_server.conf
 51064:20140103:141107.164 current database version (mandatory/optional): 02020000/02020000
 51064:20140103:141107.165 required mandatory version: 02020000
 51067:20140103:141107.258 server #1 started [configuration syncer #1]
 51068:20140103:141107.259 server #2 started [db watchdog #1]
 51117:20140103:141107.282 server #50 started [icmp pinger #2]
 51118:20140103:141107.282 server #51 started [icmp pinger #3]
 51112:20140103:141107.283 server #45 started [trapper #2]
 51113:20140103:141107.284 server #46 started [trapper #3]
 51111:20140103:141107.284 server #44 started [trapper #1]
 51114:20140103:141107.285 server #47 started [trapper #4]
 51119:20140103:141107.289 server #52 started [icmp pinger #4]
 51116:20140103:141107.285 server #49 started [icmp pinger #1]
 51115:20140103:141107.291 server #48 started [trapper #5]
 51124:20140103:141107.292 server #57 started [icmp pinger #9]
 51125:20140103:141107.293 server #58 started [icmp pinger #10]
 51129:20140103:141107.293 server #61 started [icmp pinger #13]
 51126:20140103:141107.297 server #59 started [icmp pinger #11]
 51131:20140103:141107.331 server #62 started [icmp pinger #14]
 51143:20140103:141107.332 server #71 started [icmp pinger #23]
 51150:20140103:141107.332 server #78 started [icmp pinger #30]
 51136:20140103:141107.332 server #65 started [icmp pinger #17]
 51140:20140103:141107.332 server #68 started [icmp pinger #20]
 51163:20140103:141107.333 server #91 started [snmp trapper #1]
 51141:20140103:141107.332 server #69 started [icmp pinger #21]
 51164:20140103:141107.333 server #92 started [proxy poller #1]
 51135:20140103:141107.333 server #64 started [icmp pinger #16]
 51152:20140103:141107.334 server #80 started [housekeeper #1]
 51152:20140103:141107.334 executing housekeeper
 51160:20140103:141107.334 server #88 started [history syncer #3]
 51127:20140103:141107.335 server #60 started [icmp pinger #12]
 51064:20140103:141107.335 server #0 started [main process]
 51138:20140103:141107.335 server #66 started [icmp pinger #18]
 51121:20140103:141107.339 server #54 started [icmp pinger #6]
 51149:20140103:141107.339 server #77 started [icmp pinger #29]
 51161:20140103:141107.339 server #89 started [history syncer #4]
 51144:20140103:141107.340 server #72 started [icmp pinger #24]
 51148:20140103:141107.340 server #76 started [icmp pinger #28]
 51142:20140103:141107.339 server #70 started [icmp pinger #22]
 51146:20140103:141107.340 server #74 started [icmp pinger #26]
 51145:20140103:141107.340 server #73 started [icmp pinger #25]
 51151:20140103:141107.340 server #79 started [alerter #1]
 51154:20140103:141107.341 server #82 started [http poller #1]
 51139:20140103:141107.344 server #67 started [icmp pinger #19]
 51153:20140103:141107.344 server #81 started [timer #1]
 51122:20140103:141107.345 server #55 started [icmp pinger #7]
 51162:20140103:141107.347 server #90 started [escalator #1]
 51123:20140103:141107.352 server #56 started [icmp pinger #8]
 51147:20140103:141107.352 server #75 started [icmp pinger #27]
 51152:20140103:141107.355 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.015600 sec, idle 1 hour(s)]
 51134:20140103:141107.367 server #63 started [icmp pinger #15]
 51156:20140103:141107.392 server #84 started [http poller #3]
 51159:20140103:141107.427 server #87 started [history syncer #2]
 51165:20140103:141107.428 server #93 started [self-monitoring #1]
 51082:20140103:141107.482 server #15 started [poller #13]
 51094:20140103:141107.486 server #27 started [poller #25]
 51157:20140103:141107.488 server #85 started [discoverer #1]
 51075:20140103:141107.489 server #8 started [poller #6]
 51158:20140103:141107.339 server #86 started [history syncer #1]
 51120:20140103:141107.501 server #53 started [icmp pinger #5]
 51155:20140103:141107.502 server #83 started [http poller #2]
 51087:20140103:141107.510 server #20 started [poller #18]
 51069:20140103:141107.510 server #3 started [poller #1]
 51095:20140103:141107.528 server #28 started [poller #26]
 51074:20140103:141107.528 server #7 started [poller #5]
 51100:20140103:141107.530 server #33 started [poller #31]
 51085:20140103:141107.538 server #18 started [poller #16]
 51089:20140103:141107.538 server #22 started [poller #20]
 51110:20140103:141107.549 server #43 started [unreachable poller #1]
 51097:20140103:141107.555 server #30 started [poller #28]
 51109:20140103:141107.557 server #42 started [poller #40]
 51080:20140103:141107.560 server #13 started [poller #11]
 51078:20140103:141107.560 server #11 started [poller #9]
 51107:20140103:141107.573 server #40 started [poller #38]
 51091:20140103:141107.584 server #24 started [poller #22]
 51104:20140103:141107.586 server #37 started [poller #35]
 51086:20140103:141107.593 server #19 started [poller #17]
 51096:20140103:141107.600 server #29 started [poller #27]
 51077:20140103:141107.601 server #10 started [poller #8]
 51106:20140103:141107.607 server #39 started [poller #37]
 51083:20140103:141107.611 server #16 started [poller #14]
 51088:20140103:141107.612 server #21 started [poller #19]
 51101:20140103:141107.618 server #34 started [poller #32]
 51092:20140103:141107.622 server #25 started [poller #23]
 51099:20140103:141107.625 server #32 started [poller #30]
 51081:20140103:141107.643 server #14 started [poller #12]
 51108:20140103:141107.647 server #41 started [poller #39]
 51103:20140103:141107.649 server #36 started [poller #34]
 51084:20140103:141107.649 server #17 started [poller #15]
 51073:20140103:141107.657 server #6 started [poller #4]
 51079:20140103:141107.657 server #12 started [poller #10]
 51070:20140103:141107.665 server #4 started [poller #2]
 51098:20140103:141107.665 server #31 started [poller #29]
 51090:20140103:141107.666 server #23 started [poller #21]
 51071:20140103:141107.669 server #5 started [poller #3]
 51105:20140103:141107.675 server #38 started [poller #36]
 51076:20140103:141107.677 server #9 started [poller #7]
 51093:20140103:141107.679 server #26 started [poller #24]
 51102:20140103:141107.685 server #35 started [poller #33]
 51111:20140103:141419.009 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140103:142928.448 sending configuration data to proxy "zabbix-p01", datalen 129581
 51158:20140103:143451.126 item [logger01:vm.memory.size[buffers]] became supported
 51161:20140103:144019.364 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51112:20140103:144437.878 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140103:145947.319 sending configuration data to proxy "zabbix-p01", datalen 129581
 51107:20140103:150451.794 Zabbix agent item "net.if.out[lo0,bytes]" on host "helpdesk01" failed: first network error, wait for 15 seconds
 51110:20140103:150536.032 temporarily disabling Zabbix agent checks on host "helpdesk01": host unavailable
 51110:20140103:150551.115 enabling Zabbix agent checks on host "helpdesk01": host became available
 51152:20140103:151107.359 executing housekeeper
 51152:20140103:151107.375 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011523 sec, idle 1 hour(s)]
 51114:20140103:151459.839 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140103:153013.006 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140103:154526.588 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140103:160040.194 sending configuration data to proxy "zabbix-p01", datalen 129581
 51085:20140103:160141.042 Zabbix agent item "perf_counter[\234(_Total)\1400]" on host "SFG06" failed: first network error, wait for 15 seconds
 51110:20140103:160157.834 resuming Zabbix agent checks on host "SFG06": connection restored
 51152:20140103:161107.379 executing housekeeper
 51152:20140103:161107.396 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011935 sec, idle 1 hour(s)]
 51112:20140103:161553.558 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140103:163107.145 sending configuration data to proxy "zabbix-p01", datalen 129581
 51090:20140103:163909.170 Zabbix agent item "perf_counter[\234(_Total)\208]" on host "SFG06" failed: first network error, wait for 15 seconds
 51110:20140103:163925.324 resuming Zabbix agent checks on host "SFG06": connection restored
 51114:20140103:164620.524 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140103:170133.684 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140103:171107.399 executing housekeeper
 51152:20140103:171107.417 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012121 sec, idle 1 hour(s)]
 51113:20140103:171647.082 sending configuration data to proxy "zabbix-p01", datalen 129581
 51158:20140103:172450.856 item [logger01:vm.memory.size[buffers]] became supported
 51158:20140103:172521.109 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51113:20140103:173200.644 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140103:174714.154 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140103:180227.696 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140103:181107.419 executing housekeeper
 51152:20140103:181107.437 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012352 sec, idle 1 hour(s)]
 51111:20140103:181741.044 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140103:183254.246 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140103:184807.958 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140103:190321.514 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140103:191107.439 executing housekeeper
 51152:20140103:191107.455 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011674 sec, idle 1 hour(s)]
 51111:20140103:191835.280 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140103:193348.668 sending configuration data to proxy "zabbix-p01", datalen 129581
 51101:20140103:193603.922 Zabbix agent item "vfs.fs.size[/,pused]" on host "ftp1" failed: first network error, wait for 15 seconds
 51110:20140103:193618.515 resuming Zabbix agent checks on host "ftp1": connection restored
 51071:20140103:193626.210 Zabbix agent item "system.cpu.util[,system,avg1]" on host "helpdesk01" failed: first network error, wait for 15 seconds
 51110:20140103:193641.565 resuming Zabbix agent checks on host "helpdesk01": connection restored
 51114:20140103:194902.088 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140103:200415.514 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140103:201107.459 executing housekeeper
 51152:20140103:201107.475 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011668 sec, idle 1 hour(s)]
 51111:20140103:201929.167 sending configuration data to proxy "zabbix-p01", datalen 129581
 51107:20140103:202656.071 Zabbix agent item "net.if.in[lo0,bytes]" on host "helpdesk01" failed: first network error, wait for 15 seconds
 51110:20140103:202711.616 resuming Zabbix agent checks on host "helpdesk01": connection restored
 51114:20140103:203442.684 sending configuration data to proxy "zabbix-p01", datalen 129581
 51106:20140103:204346.038 Zabbix agent item "net.if.in[lo0,bytes]" on host "helpdesk01" failed: first network error, wait for 15 seconds
 51110:20140103:204401.635 resuming Zabbix agent checks on host "helpdesk01": connection restored
 51111:20140103:204956.144 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140103:210509.685 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140103:211107.479 executing housekeeper
 51152:20140103:211107.500 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.014550 sec, idle 1 hour(s)]
 51114:20140103:212023.209 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140103:213536.744 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140103:215050.350 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140103:220603.876 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140103:221107.509 executing housekeeper
 51152:20140103:221107.527 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012877 sec, idle 1 hour(s)]
 51115:20140103:222117.424 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140103:223630.898 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140103:225144.301 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140103:230658.034 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140103:231107.529 executing housekeeper
 51152:20140103:231107.545 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011703 sec, idle 1 hour(s)]
 51115:20140103:232211.439 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140103:233725.018 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140103:235238.794 sending configuration data to proxy "zabbix-p01", datalen 129581
 51161:20140104:000449.645 item [logger01:vm.memory.size[buffers]] became supported
 51115:20140104:000752.664 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:001107.549 executing housekeeper
 51152:20140104:001107.571 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.014435 sec, idle 1 hour(s)]
 51160:20140104:001252.827 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51114:20140104:002306.194 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140104:003820.145 sending configuration data to proxy "zabbix-p01", datalen 129581
 51159:20140104:004450.356 item [logger01:vm.memory.size[buffers]] became supported
 51161:20140104:005018.519 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51115:20140104:005334.087 sending configuration data to proxy "zabbix-p01", datalen 129581
 51159:20140104:010447.301 item [logger01:vm.memory.size[buffers]] became supported
 51158:20140104:010748.769 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51114:20140104:010847.884 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:011107.579 executing housekeeper
 51152:20140104:011107.599 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.014063 sec, idle 1 hour(s)]
 51111:20140104:012401.427 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140104:013914.555 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140104:015427.914 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140104:020941.208 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:021107.609 executing housekeeper
 51152:20140104:021107.625 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011704 sec, idle 1 hour(s)]
 51113:20140104:022454.737 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140104:024008.294 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140104:025521.605 sending configuration data to proxy "zabbix-p01", datalen 129581
 51158:20140104:030449.117 item [logger01:vm.memory.size[buffers]] became supported
 51115:20140104:031034.818 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:031107.629 executing housekeeper
 51152:20140104:031107.646 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012025 sec, idle 1 hour(s)]
 51159:20140104:031148.085 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51111:20140104:032548.030 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140104:034101.515 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140104:035614.807 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:041107.649 executing housekeeper
 51152:20140104:041107.668 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.013126 sec, idle 1 hour(s)]
 51114:20140104:041128.216 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140104:042641.519 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140104:044154.717 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140104:045708.227 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:051107.669 executing housekeeper
 51152:20140104:051107.685 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011724 sec, idle 1 hour(s)]
 51113:20140104:051221.537 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140104:052734.904 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140104:054248.105 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140104:055801.725 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:061107.689 executing housekeeper
 51152:20140104:061107.710 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.014412 sec, idle 1 hour(s)]
 51113:20140104:061314.846 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140104:062828.326 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140104:064341.799 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140104:065855.418 sending configuration data to proxy "zabbix-p01", datalen 129581
 51076:20140104:070111.548 Zabbix agent item "perf_counter[\234(_Total)\1400]" on host "SFG06" failed: first network error, wait for 15 seconds
 51110:20140104:070127.584 resuming Zabbix agent checks on host "SFG06": connection restored
 51152:20140104:071107.719 executing housekeeper
 51152:20140104:071107.744 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.018788 sec, idle 1 hour(s)]
 51114:20140104:071409.084 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140104:072922.307 sending configuration data to proxy "zabbix-p01", datalen 129581
 51159:20140104:073447.053 item [logger01:vm.memory.size[buffers]] became supported
 51160:20140104:074120.630 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51114:20140104:074435.817 sending configuration data to proxy "zabbix-p01", datalen 129581
 51082:20140104:075142.762 Zabbix agent item "perf_counter[\234(_Total)\200]" on host "SFG06" failed: first network error, wait for 15 seconds
 51110:20140104:075158.634 resuming Zabbix agent checks on host "SFG06": connection restored
 51113:20140104:075949.305 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:081107.749 executing housekeeper
 51152:20140104:081107.765 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011635 sec, idle 1 hour(s)]
 51111:20140104:081502.696 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140104:083016.183 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140104:084529.598 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140104:090043.176 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:091107.769 executing housekeeper
 51152:20140104:091107.786 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012553 sec, idle 1 hour(s)]
 51111:20140104:091556.835 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140104:093110.485 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140104:094623.863 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140104:100137.129 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:101107.789 executing housekeeper
 51152:20140104:101107.810 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.014836 sec, idle 1 hour(s)]
 51112:20140104:101650.399 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140104:103204.424 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140104:104718.258 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140104:110232.044 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:111107.819 executing housekeeper
 51152:20140104:111107.836 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012382 sec, idle 1 hour(s)]
 51113:20140104:111745.828 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140104:113259.094 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140104:114812.474 sending configuration data to proxy "zabbix-p01", datalen 129581
 51161:20140104:115448.176 item [logger01:vm.memory.size[buffers]] became supported
 51160:20140104:115548.736 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51115:20140104:120325.713 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:121107.839 executing housekeeper
 51152:20140104:121107.855 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011770 sec, idle 1 hour(s)]
 51114:20140104:121839.234 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140104:123352.634 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140104:124906.095 sending configuration data to proxy "zabbix-p01", datalen 129581
 51076:20140104:125100.151 Zabbix agent item "system.cpu.load[,avg1]" on host "ftp1" failed: first network error, wait for 15 seconds
 51110:20140104:125115.495 resuming Zabbix agent checks on host "ftp1": connection restored
 51115:20140104:130419.609 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:131107.859 executing housekeeper
 51152:20140104:131107.878 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012145 sec, idle 1 hour(s)]
 51112:20140104:131932.999 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140104:133446.484 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140104:134959.638 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140104:140513.177 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:141107.879 executing housekeeper
 51152:20140104:141107.896 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012169 sec, idle 1 hour(s)]
 51111:20140104:142026.700 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140104:143540.358 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140104:145053.905 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140104:150607.127 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:151107.899 executing housekeeper
 51152:20140104:151107.915 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011557 sec, idle 1 hour(s)]
 51111:20140104:152120.347 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140104:153633.825 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140104:155147.209 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140104:160700.454 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:161107.919 executing housekeeper
 51152:20140104:161107.940 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.014654 sec, idle 1 hour(s)]
 51112:20140104:162213.828 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140104:163727.519 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140104:165241.134 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140104:170754.628 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:171107.949 executing housekeeper
 51152:20140104:171107.965 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011735 sec, idle 1 hour(s)]
 51112:20140104:172308.354 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140104:173821.815 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140104:175335.306 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140104:180848.814 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:181107.969 executing housekeeper
 51152:20140104:181107.986 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012495 sec, idle 1 hour(s)]
 51111:20140104:182402.014 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140104:183915.155 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140104:185428.385 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140104:190941.719 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:191107.989 executing housekeeper
 51152:20140104:191108.009 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.013777 sec, idle 1 hour(s)]
 51114:20140104:192455.215 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140104:194009.081 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140104:195522.424 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140104:201035.607 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:201108.019 executing housekeeper
 51152:20140104:201108.039 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.013130 sec, idle 1 hour(s)]
 51114:20140104:202548.904 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140104:204102.226 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140104:205615.499 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:211108.049 executing housekeeper
 51152:20140104:211108.069 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.013352 sec, idle 1 hour(s)]
 51112:20140104:211129.037 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140104:212642.203 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140104:214155.506 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140104:215708.669 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:221108.079 executing housekeeper
 51152:20140104:221108.096 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010606 sec, idle 1 hour(s)]
 51114:20140104:221222.025 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140104:222735.538 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140104:224249.134 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140104:225802.376 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140104:231108.099 executing housekeeper
 51152:20140104:231108.114 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010456 sec, idle 1 hour(s)]
 51113:20140104:231315.944 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140104:232829.419 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140104:234342.894 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140104:235856.255 sending configuration data to proxy "zabbix-p01", datalen 129581
 51159:20140105:000447.241 item [logger01:vm.memory.size[buffers]] became supported
 51152:20140105:001108.119 executing housekeeper
 51152:20140105:001108.134 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010275 sec, idle 1 hour(s)]
 51113:20140105:001409.458 sending configuration data to proxy "zabbix-p01", datalen 129581
 51160:20140105:001517.676 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51114:20140105:002922.906 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140105:004436.394 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140105:005949.858 sending configuration data to proxy "zabbix-p01", datalen 129581
 51158:20140105:010449.877 item [logger01:vm.memory.size[buffers]] became supported
 51095:20140105:010724.076 Zabbix agent item "net.if.out[em0,bytes]" on host "ns2" failed: first network error, wait for 15 seconds
 51110:20140105:010739.697 resuming Zabbix agent checks on host "ns2": connection restored
 51161:20140105:010852.156 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51152:20140105:011108.139 executing housekeeper
 51152:20140105:011108.155 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011718 sec, idle 1 hour(s)]
 51111:20140105:011503.245 sending configuration data to proxy "zabbix-p01", datalen 129581
 51161:20140105:011706.356 item [helpdesk:vfs.file.cksum[/usr/bin/ssh]] became not supported: Not supported by Zabbix Agent
 51161:20140105:012706.967 item [helpdesk:vfs.file.cksum[/usr/bin/ssh]] became supported
 51112:20140105:013016.694 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140105:014529.934 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140105:020043.321 sending configuration data to proxy "zabbix-p01", datalen 129581
 51071:20140105:020853.500 Zabbix agent item "net.tcp.service[http]" on host "linuxsrv3" failed: first network error, wait for 15 seconds
 51110:20140105:020908.070 resuming Zabbix agent checks on host "linuxsrv3": connection restored
 51152:20140105:021108.159 executing housekeeper
 51152:20140105:021108.179 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.013520 sec, idle 1 hour(s)]
 51112:20140105:021556.568 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140105:023109.964 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140105:024623.456 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140105:030136.884 sending configuration data to proxy "zabbix-p01", datalen 129581
 51159:20140105:030448.165 item [logger01:vm.memory.size[buffers]] became supported
 51160:20140105:030820.285 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51152:20140105:031108.189 executing housekeeper
 51152:20140105:031108.205 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010553 sec, idle 1 hour(s)]
 51115:20140105:031650.708 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140105:033204.388 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140105:034718.235 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140105:040231.724 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:041108.209 executing housekeeper
 51152:20140105:041108.225 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011160 sec, idle 1 hour(s)]
 51111:20140105:041745.108 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140105:043258.849 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140105:044812.425 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140105:050326.108 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:051108.229 executing housekeeper
 51152:20140105:051108.248 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012212 sec, idle 1 hour(s)]
 51115:20140105:051839.464 sending configuration data to proxy "zabbix-p01", datalen 129581
 51077:20140105:052708.077 Zabbix agent item "net.if.in[em0,bytes]" on host "ftp1" failed: first network error, wait for 15 seconds
 51110:20140105:052723.826 resuming Zabbix agent checks on host "ftp1": connection restored
 51112:20140105:053352.855 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140105:054906.530 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140105:060419.837 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:061108.249 executing housekeeper
 51152:20140105:061108.264 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010360 sec, idle 1 hour(s)]
 51111:20140105:061933.473 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140105:063447.035 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140105:065000.225 sending configuration data to proxy "zabbix-p01", datalen 129581
 51078:20140105:070110.442 Zabbix agent item "perf_counter[\234(_Total)\210]" on host "SFG06" failed: first network error, wait for 15 seconds
 51110:20140105:070126.085 resuming Zabbix agent checks on host "SFG06": connection restored
 51115:20140105:070513.524 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:071108.269 executing housekeeper
 51152:20140105:071108.284 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010234 sec, idle 1 hour(s)]
 51111:20140105:072026.907 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140105:073540.137 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140105:075053.557 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140105:080607.085 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:081108.289 executing housekeeper
 51152:20140105:081108.306 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011151 sec, idle 1 hour(s)]
 51114:20140105:082120.558 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140105:083633.878 sending configuration data to proxy "zabbix-p01", datalen 129581
 51161:20140105:084451.658 item [logger01:vm.memory.size[buffers]] became supported
 51158:20140105:085019.596 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51112:20140105:085147.395 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140105:090700.830 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:091108.309 executing housekeeper
 51152:20140105:091108.327 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011913 sec, idle 1 hour(s)]
 51111:20140105:092214.096 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140105:093727.309 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140105:095240.653 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140105:100753.957 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:101108.329 executing housekeeper
 51152:20140105:101108.344 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010499 sec, idle 1 hour(s)]
 51115:20140105:102307.525 sending configuration data to proxy "zabbix-p01", datalen 129581
 51094:20140105:103021.182 Zabbix agent item "vfs.fs.size[c:,pfree]" on host "SFG141" failed: first network error, wait for 15 seconds
 51110:20140105:103036.143 resuming Zabbix agent checks on host "SFG141": connection restored
 51108:20140105:103751.132 Zabbix agent item "vfs.fs.size[c:,pfree]" on host "SFG141" failed: first network error, wait for 15 seconds
 51081:20140105:103810.373 Zabbix agent item "perf_counter[\234(_Total)\208]" on host "SFG141" failed: another network error, wait for 15 seconds
 51101:20140105:103811.451 Zabbix agent item "perf_counter[\234(_Total)\210]" on host "SFG141" failed: another network error, wait for 15 seconds
 51070:20140105:103812.132 Zabbix agent item "perf_counter[\234(_Total)\1400]" on host "SFG141" failed: another network error, wait for 15 seconds
 51099:20140105:103813.403 Zabbix agent item "perf_counter[\234(_Total)\200]" on host "SFG141" failed: another network error, wait for 15 seconds
 51095:20140105:103814.441 Zabbix agent item "net.if.total[{$NIC_NAME_1},bytes]" on host "SFG141" failed: another network error, wait for 15 seconds
 51100:20140105:103816.472 Zabbix agent item "net.if.in[{$NIC_NAME_1},bytes]" on host "SFG141" failed: another network error, wait for 15 seconds
 51075:20140105:103817.542 Zabbix agent item "perf_counter[\238(_Total)\696]" on host "SFG141" failed: another network error, wait for 15 seconds
 51111:20140105:103820.915 sending configuration data to proxy "zabbix-p01", datalen 129581
 51110:20140105:103836.051 temporarily disabling Zabbix agent checks on host "SFG141": host unavailable
 51110:20140105:103852.124 enabling Zabbix agent checks on host "SFG141": host became available
 51106:20140105:104443.427 Zabbix agent item "vfs.fs.size[c:,free]" on host "SFG141" failed: first network error, wait for 15 seconds
 51110:20140105:104458.862 resuming Zabbix agent checks on host "SFG141": connection restored
 51081:20140105:105043.041 Zabbix agent item "vfs.fs.size[c:,free]" on host "SFG141" failed: first network error, wait for 15 seconds
 51110:20140105:105128.592 temporarily disabling Zabbix agent checks on host "SFG141": host unavailable
 51115:20140105:105334.398 sending configuration data to proxy "zabbix-p01", datalen 129581
 51110:20140105:105340.694 enabling Zabbix agent checks on host "SFG141": host became available
 51091:20140105:110713.703 Zabbix agent item "vfs.fs.size[c:,free]" on host "SFG141" failed: first network error, wait for 15 seconds
 51110:20140105:110728.352 resuming Zabbix agent checks on host "SFG141": connection restored
 51114:20140105:110848.034 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:111108.349 executing housekeeper
 51152:20140105:111108.368 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012715 sec, idle 1 hour(s)]
 51115:20140105:112401.584 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140105:113915.424 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140105:115429.275 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140105:120942.684 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:121108.369 executing housekeeper
 51152:20140105:121108.384 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010391 sec, idle 1 hour(s)]
 51112:20140105:122455.926 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140105:124009.231 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140105:125522.643 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140105:131036.184 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:131108.389 executing housekeeper
 51152:20140105:131108.405 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010226 sec, idle 1 hour(s)]
 51112:20140105:132549.739 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140105:134102.944 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140105:135616.364 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:141108.409 executing housekeeper
 51152:20140105:141108.428 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012351 sec, idle 1 hour(s)]
 51111:20140105:141129.835 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140105:142643.394 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140105:144157.153 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140105:145710.649 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:151108.429 executing housekeeper
 51152:20140105:151108.448 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012927 sec, idle 1 hour(s)]
 51113:20140105:151224.008 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140105:152737.396 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140105:154250.606 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140105:155803.830 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:161108.449 executing housekeeper
 51152:20140105:161108.464 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010197 sec, idle 1 hour(s)]
 51115:20140105:161316.985 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140105:162830.354 sending configuration data to proxy "zabbix-p01", datalen 129581
 51158:20140105:163447.916 item [logger01:vm.memory.size[buffers]] became supported
 51159:20140105:163719.239 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51115:20140105:164343.617 sending configuration data to proxy "zabbix-p01", datalen 129581
 51158:20140105:165449.016 item [logger01:vm.memory.size[buffers]] became supported
 51160:20140105:165820.948 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51112:20140105:165856.939 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:171108.469 executing housekeeper
 51152:20140105:171108.487 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011241 sec, idle 1 hour(s)]
 51115:20140105:171410.110 sending configuration data to proxy "zabbix-p01", datalen 129581
 51160:20140105:172450.968 item [logger01:vm.memory.size[buffers]] became supported
 51114:20140105:172923.406 sending configuration data to proxy "zabbix-p01", datalen 129581
 51158:20140105:173219.917 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51115:20140105:174436.588 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140105:175949.757 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:181108.489 executing housekeeper
 51152:20140105:181108.504 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010531 sec, idle 1 hour(s)]
 51115:20140105:181502.964 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140105:183016.195 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140105:184529.194 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140105:190042.839 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:191108.509 executing housekeeper
 51152:20140105:191108.524 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010122 sec, idle 1 hour(s)]
 51114:20140105:191556.108 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140105:193109.314 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140105:194622.514 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140105:200135.778 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:201108.529 executing housekeeper
 51152:20140105:201108.544 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010465 sec, idle 1 hour(s)]
 51114:20140105:201649.414 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140105:203202.974 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140105:204716.704 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140105:210230.206 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:211108.549 executing housekeeper
 51152:20140105:211108.566 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010772 sec, idle 1 hour(s)]
 51114:20140105:211743.825 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140105:213257.557 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140105:214810.847 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140105:220324.283 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:221108.569 executing housekeeper
 51152:20140105:221108.584 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010178 sec, idle 1 hour(s)]
 51115:20140105:221837.958 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140105:223351.445 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140105:224904.925 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140105:230418.597 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140105:231108.589 executing housekeeper
 51152:20140105:231108.604 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010219 sec, idle 1 hour(s)]
 51115:20140105:231932.113 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140105:233445.436 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140105:234958.916 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140106:000512.398 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140106:001108.609 executing housekeeper
 51152:20140106:001108.629 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012138 sec, idle 1 hour(s)]
 51112:20140106:002025.824 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140106:003539.275 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140106:005052.472 sending configuration data to proxy "zabbix-p01", datalen 129581
 51158:20140106:010449.886 item [logger01:vm.memory.size[buffers]] became supported
 51112:20140106:010606.176 sending configuration data to proxy "zabbix-p01", datalen 129581
 51159:20140106:010847.531 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51152:20140106:011108.639 executing housekeeper
 51152:20140106:011108.654 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010564 sec, idle 1 hour(s)]
 51114:20140106:012119.768 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140106:013633.454 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140106:015146.734 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140106:020700.226 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140106:021108.659 executing housekeeper
 51152:20140106:021108.676 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011842 sec, idle 1 hour(s)]
 51113:20140106:022213.584 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140106:023727.006 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140106:025240.075 sending configuration data to proxy "zabbix-p01", datalen 129581
 51102:20140106:030030.372 Zabbix agent item "net.if.out[lo0,bytes]" on host "ns2" failed: first network error, wait for 15 seconds
 51110:20140106:030045.556 resuming Zabbix agent checks on host "ns2": connection restored
 51160:20140106:030447.930 item [logger01:vm.memory.size[buffers]] became supported
 51111:20140106:030753.195 sending configuration data to proxy "zabbix-p01", datalen 129581
 51159:20140106:030820.025 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51152:20140106:031108.679 executing housekeeper
 51152:20140106:031108.694 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010582 sec, idle 1 hour(s)]
 51112:20140106:032306.604 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140106:033819.394 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140106:035331.994 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140106:040844.654 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140106:041108.699 executing housekeeper
 51152:20140106:041108.717 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011775 sec, idle 1 hour(s)]
 51112:20140106:042357.110 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140106:043909.380 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140106:045421.814 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140106:050934.248 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140106:051108.719 executing housekeeper
 51152:20140106:051108.734 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010506 sec, idle 1 hour(s)]
 51114:20140106:052446.514 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140106:053958.989 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140106:055511.339 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140106:061023.998 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140106:061108.739 executing housekeeper
 51152:20140106:061108.754 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010255 sec, idle 1 hour(s)]
 51111:20140106:062536.588 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140106:064049.148 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140106:065601.641 sending configuration data to proxy "zabbix-p01", datalen 129581
 51079:20140106:070110.813 Zabbix agent item "perf_counter[\234(_Total)\210]" on host "SFG06" failed: first network error, wait for 15 seconds
 51110:20140106:070126.404 resuming Zabbix agent checks on host "SFG06": connection restored
 51152:20140106:071108.759 executing housekeeper
 51152:20140106:071108.776 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011087 sec, idle 1 hour(s)]
 51115:20140106:071113.978 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140106:072626.577 sending configuration data to proxy "zabbix-p01", datalen 129581
 51111:20140106:074139.371 sending configuration data to proxy "zabbix-p01", datalen 129581
 51159:20140106:075449.475 item [logger01:vm.memory.size[buffers]] became supported
 51113:20140106:075652.157 sending configuration data to proxy "zabbix-p01", datalen 129581
 51159:20140106:075851.879 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51152:20140106:081108.779 executing housekeeper
 51152:20140106:081108.795 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010731 sec, idle 1 hour(s)]
 51111:20140106:081204.995 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140106:082717.605 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140106:084230.294 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140106:085742.965 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140106:091108.799 executing housekeeper
 51152:20140106:091108.814 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010241 sec, idle 1 hour(s)]
 51114:20140106:091255.585 sending configuration data to proxy "zabbix-p01", datalen 129581
 51114:20140106:092808.050 sending configuration data to proxy "zabbix-p01", datalen 129581
 51112:20140106:094320.509 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140106:095832.948 sending configuration data to proxy "zabbix-p01", datalen 129581
 51158:20140106:100710.868 item [helpdesk:vfs.file.cksum[/usr/sbin/sshd]] became not supported: Not supported by Zabbix Agent
 51152:20140106:101108.819 executing housekeeper
 51152:20140106:101108.834 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010183 sec, idle 1 hour(s)]
 51115:20140106:101345.234 sending configuration data to proxy "zabbix-p01", datalen 129581
 51158:20140106:101450.478 item [logger01:vm.memory.size[buffers]] became supported
 51158:20140106:101711.848 item [helpdesk:vfs.file.cksum[/usr/sbin/sshd]] became supported
 51093:20140106:101922.371 Zabbix agent item "net.if.out[em0,bytes]" on host "ftp1" failed: first network error, wait for 15 seconds
 51110:20140106:101937.163 resuming Zabbix agent checks on host "ftp1": connection restored
 51160:20140106:102421.098 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51115:20140106:102857.676 sending configuration data to proxy "zabbix-p01", datalen 129581
 51115:20140106:104410.150 sending configuration data to proxy "zabbix-p01", datalen 129581
 51161:20140106:104448.195 item [logger01:vm.memory.size[buffers]] became supported
 51114:20140106:105922.553 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140106:111108.839 executing housekeeper
 51152:20140106:111108.854 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010242 sec, idle 1 hour(s)]
 51113:20140106:111435.128 sending configuration data to proxy "zabbix-p01", datalen 129581
 51098:20140106:112821.502 Zabbix agent item "system.cpu.util[,nice,avg1]" on host "ftp1" failed: first network error, wait for 15 seconds
 51110:20140106:112836.435 resuming Zabbix agent checks on host "ftp1": connection restored
 51115:20140106:112947.634 sending configuration data to proxy "zabbix-p01", datalen 129581
 51113:20140106:114459.996 sending configuration data to proxy "zabbix-p01", datalen 129581
 51094:20140106:114505.455 Zabbix agent item "vm.memory.size[shared]" on host "ftp1" failed: first network error, wait for 15 seconds
 51110:20140106:114520.445 resuming Zabbix agent checks on host "ftp1": connection restored
 51112:20140106:120012.380 sending configuration data to proxy "zabbix-p01", datalen 129581
 51152:20140106:121108.859 executing housekeeper
 51152:20140106:121108.874 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010252 sec, idle 1 hour(s)]
 51115:20140106:121524.688 sending configuration data to proxy "zabbix-p01", datalen 129581
 51160:20140106:121618.276 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51094:20140106:121901.241 Zabbix agent item "vm.memory.size[buffers]" on host "ftp1" failed: first network error, wait for 15 seconds
 51110:20140106:121916.522 resuming Zabbix agent checks on host "ftp1": connection restored
 51114:20140106:123037.209 sending configuration data to proxy "zabbix-p01", datalen 128801
 51113:20140106:124549.721 sending configuration data to proxy "zabbix-p01", datalen 128027
 51159:20140106:125450.218 item [logger01:vm.memory.size[buffers]] became supported
 51160:20140106:125520.518 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51112:20140106:130102.039 sending configuration data to proxy "zabbix-p01", datalen 128027
 51161:20140106:130451.228 item [logger01:vm.memory.size[buffers]] became supported
 51160:20140106:130521.615 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51152:20140106:131108.879 executing housekeeper
 51152:20140106:131108.897 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011698 sec, idle 1 hour(s)]
 51160:20140106:131447.299 item [logger01:vm.memory.size[buffers]] became supported
 51115:20140106:131614.527 sending configuration data to proxy "zabbix-p01", datalen 128027
 51158:20140106:132247.351 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51115:20140106:133126.735 sending configuration data to proxy "zabbix-p01", datalen 128027
 51111:20140106:134638.885 sending configuration data to proxy "zabbix-p01", datalen 128027
 51115:20140106:140151.205 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140106:141108.899 executing housekeeper
 51152:20140106:141108.914 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010172 sec, idle 1 hour(s)]
 51111:20140106:141703.595 sending configuration data to proxy "zabbix-p01", datalen 128027
 51113:20140106:143216.106 sending configuration data to proxy "zabbix-p01", datalen 128027
 51112:20140106:144728.505 sending configuration data to proxy "zabbix-p01", datalen 128027
 51114:20140106:150240.972 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140106:151108.919 executing housekeeper
 51152:20140106:151108.934 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010494 sec, idle 1 hour(s)]
 51112:20140106:151753.718 sending configuration data to proxy "zabbix-p01", datalen 128027
 51114:20140106:153306.185 sending configuration data to proxy "zabbix-p01", datalen 128027
 51113:20140106:154818.388 sending configuration data to proxy "zabbix-p01", datalen 128027
 51113:20140106:160330.836 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140106:161108.939 executing housekeeper
 51152:20140106:161108.956 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010791 sec, idle 1 hour(s)]
 51114:20140106:161843.119 sending configuration data to proxy "zabbix-p01", datalen 128027
 51115:20140106:163355.630 sending configuration data to proxy "zabbix-p01", datalen 128027
 51114:20140106:164908.071 sending configuration data to proxy "zabbix-p01", datalen 128027
 51113:20140106:170420.497 sending configuration data to proxy "zabbix-p01", datalen 128027
 51159:20140106:170533.257 item [SFG09:vfs.fs.size[d:,total]] became not supported: Not supported by Zabbix Agent
 51152:20140106:171108.959 executing housekeeper
 51152:20140106:171108.978 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012503 sec, idle 1 hour(s)]
 51113:20140106:171933.080 sending configuration data to proxy "zabbix-p01", datalen 128027
 51112:20140106:173445.299 sending configuration data to proxy "zabbix-p01", datalen 128027
 51112:20140106:174957.738 sending configuration data to proxy "zabbix-p01", datalen 128027
 51112:20140106:180510.159 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140106:181108.979 executing housekeeper
 51152:20140106:181108.997 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012185 sec, idle 1 hour(s)]
 51115:20140106:182022.678 sending configuration data to proxy "zabbix-p01", datalen 128027
 51111:20140106:183535.000 sending configuration data to proxy "zabbix-p01", datalen 128027
 51112:20140106:185047.390 sending configuration data to proxy "zabbix-p01", datalen 128027
 51112:20140106:190559.858 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140106:191108.999 executing housekeeper
 51152:20140106:191109.018 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012904 sec, idle 1 hour(s)]
 51111:20140106:192112.258 sending configuration data to proxy "zabbix-p01", datalen 128027
 51115:20140106:193624.782 sending configuration data to proxy "zabbix-p01", datalen 128027
 51113:20140106:195137.050 sending configuration data to proxy "zabbix-p01", datalen 128027
 51115:20140106:200649.285 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140106:201109.019 executing housekeeper
 51152:20140106:201109.039 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.013846 sec, idle 1 hour(s)]
 51111:20140106:202201.627 sending configuration data to proxy "zabbix-p01", datalen 128027
 51113:20140106:203713.815 sending configuration data to proxy "zabbix-p01", datalen 128027
 51112:20140106:205226.178 sending configuration data to proxy "zabbix-p01", datalen 128027
 51113:20140106:210738.425 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140106:211109.049 executing housekeeper
 51152:20140106:211109.067 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011125 sec, idle 1 hour(s)]
 51114:20140106:212250.819 sending configuration data to proxy "zabbix-p01", datalen 128027
 51114:20140106:213803.419 sending configuration data to proxy "zabbix-p01", datalen 128027
 51111:20140106:215315.898 sending configuration data to proxy "zabbix-p01", datalen 128027
 51115:20140106:220828.381 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140106:221109.070 executing housekeeper
 51152:20140106:221109.089 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011597 sec, idle 1 hour(s)]
 51113:20140106:222340.820 sending configuration data to proxy "zabbix-p01", datalen 128027
 51115:20140106:223853.359 sending configuration data to proxy "zabbix-p01", datalen 128027
 51113:20140106:225405.640 sending configuration data to proxy "zabbix-p01", datalen 128027
 51115:20140106:230918.047 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140106:231109.099 executing housekeeper
 51152:20140106:231109.118 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012280 sec, idle 1 hour(s)]
 51111:20140106:232430.401 sending configuration data to proxy "zabbix-p01", datalen 128027
 51113:20140106:233942.730 sending configuration data to proxy "zabbix-p01", datalen 128027
 51114:20140106:235455.056 sending configuration data to proxy "zabbix-p01", datalen 128027
 51158:20140107:000448.114 item [logger01:vm.memory.size[buffers]] became supported
 51113:20140107:001007.319 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140107:001109.119 executing housekeeper
 51152:20140107:001109.136 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012517 sec, idle 1 hour(s)]
 51159:20140107:001217.672 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51115:20140107:002519.770 sending configuration data to proxy "zabbix-p01", datalen 128027
 51112:20140107:004032.252 sending configuration data to proxy "zabbix-p01", datalen 128027
 51115:20140107:005544.809 sending configuration data to proxy "zabbix-p01", datalen 128027
 51159:20140107:010450.096 item [logger01:vm.memory.size[buffers]] became supported
 51161:20140107:010917.476 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51111:20140107:011057.237 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140107:011109.139 executing housekeeper
 51152:20140107:011109.156 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011196 sec, idle 1 hour(s)]
 51115:20140107:012609.578 sending configuration data to proxy "zabbix-p01", datalen 128027
 51114:20140107:014122.089 sending configuration data to proxy "zabbix-p01", datalen 128027
 51111:20140107:015634.475 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140107:021109.159 executing housekeeper
 51152:20140107:021109.175 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010909 sec, idle 1 hour(s)]
 51111:20140107:021146.889 sending configuration data to proxy "zabbix-p01", datalen 128027
 51112:20140107:022659.089 sending configuration data to proxy "zabbix-p01", datalen 128027
 51113:20140107:024211.479 sending configuration data to proxy "zabbix-p01", datalen 128027
 51113:20140107:025723.928 sending configuration data to proxy "zabbix-p01", datalen 128027
 51158:20140107:030450.615 item [logger01:vm.memory.size[buffers]] became supported
 51152:20140107:031109.179 executing housekeeper
 51152:20140107:031109.195 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010708 sec, idle 1 hour(s)]
 51112:20140107:031236.207 sending configuration data to proxy "zabbix-p01", datalen 128027
 51158:20140107:031320.396 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51111:20140107:032748.875 sending configuration data to proxy "zabbix-p01", datalen 128027
 51115:20140107:034302.016 sending configuration data to proxy "zabbix-p01", datalen 128027
 51111:20140107:035815.600 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140107:041109.199 executing housekeeper
 51152:20140107:041109.215 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011489 sec, idle 1 hour(s)]
 51112:20140107:041328.952 sending configuration data to proxy "zabbix-p01", datalen 128027
 51111:20140107:042842.275 sending configuration data to proxy "zabbix-p01", datalen 128027
 51112:20140107:044355.996 sending configuration data to proxy "zabbix-p01", datalen 128027
 51111:20140107:045909.449 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140107:051109.219 executing housekeeper
 51152:20140107:051109.239 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012819 sec, idle 1 hour(s)]
 51111:20140107:051422.889 sending configuration data to proxy "zabbix-p01", datalen 128027
 51115:20140107:052936.175 sending configuration data to proxy "zabbix-p01", datalen 128027
 51111:20140107:054449.534 sending configuration data to proxy "zabbix-p01", datalen 128027
 51112:20140107:060002.876 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140107:061109.249 executing housekeeper
 51152:20140107:061109.264 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010352 sec, idle 1 hour(s)]
 51113:20140107:061516.367 sending configuration data to proxy "zabbix-p01", datalen 128027
 51077:20140107:061747.801 Zabbix agent item "net.if.out[em0,bytes]" on host "helpdesk01" failed: first network error, wait for 15 seconds
 51110:20140107:061802.726 resuming Zabbix agent checks on host "helpdesk01": connection restored
 51112:20140107:063029.799 sending configuration data to proxy "zabbix-p01", datalen 128027
 51114:20140107:064543.286 sending configuration data to proxy "zabbix-p01", datalen 128027
 51115:20140107:070056.675 sending configuration data to proxy "zabbix-p01", datalen 128027
 51097:20140107:070109.740 Zabbix agent item "perf_counter[\234(_Total)\208]" on host "SFG06" failed: first network error, wait for 15 seconds
 51110:20140107:070125.926 resuming Zabbix agent checks on host "SFG06": connection restored
 51152:20140107:071109.269 executing housekeeper
 51152:20140107:071109.284 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010244 sec, idle 1 hour(s)]
 51112:20140107:071610.219 sending configuration data to proxy "zabbix-p01", datalen 128027
 51115:20140107:073123.585 sending configuration data to proxy "zabbix-p01", datalen 128027
 51113:20140107:074637.079 sending configuration data to proxy "zabbix-p01", datalen 128027
 51114:20140107:080150.397 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140107:081109.289 executing housekeeper
 51152:20140107:081109.304 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010320 sec, idle 1 hour(s)]
 51113:20140107:081703.537 sending configuration data to proxy "zabbix-p01", datalen 128027
 51115:20140107:083216.515 sending configuration data to proxy "zabbix-p01", datalen 128027
 51115:20140107:084729.924 sending configuration data to proxy "zabbix-p01", datalen 128027
 51160:20140107:085452.144 item [logger01:vm.memory.size[buffers]] became supported
 51161:20140107:085748.864 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51115:20140107:090243.425 sending configuration data to proxy "zabbix-p01", datalen 128027
 51158:20140107:090448.125 item [logger01:vm.memory.size[buffers]] became supported
 51152:20140107:091109.309 executing housekeeper
 51152:20140107:091109.328 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.012481 sec, idle 1 hour(s)]
 51113:20140107:091756.707 sending configuration data to proxy "zabbix-p01", datalen 128027
 51159:20140107:092948.016 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
 51111:20140107:093310.070 sending configuration data to proxy "zabbix-p01", datalen 128027
 51113:20140107:094823.555 sending configuration data to proxy "zabbix-p01", datalen 128027
 51113:20140107:100336.484 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140107:101109.329 executing housekeeper
 51152:20140107:101109.344 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.010516 sec, idle 1 hour(s)]
 51114:20140107:101849.625 sending configuration data to proxy "zabbix-p01", datalen 128027
 51112:20140107:103402.811 sending configuration data to proxy "zabbix-p01", datalen 128027
 51111:20140107:104916.106 sending configuration data to proxy "zabbix-p01", datalen 128027
 51115:20140107:110429.425 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140107:111109.349 executing housekeeper
 51152:20140107:111109.367 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011341 sec, idle 1 hour(s)]
 51111:20140107:111942.689 sending configuration data to proxy "zabbix-p01", datalen 128027
 51113:20140107:113455.898 sending configuration data to proxy "zabbix-p01", datalen 128027
 51113:20140107:115009.147 sending configuration data to proxy "zabbix-p01", datalen 128027
 51113:20140107:120522.395 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140107:121109.369 executing housekeeper
 51152:20140107:121109.386 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011196 sec, idle 1 hour(s)]
 51115:20140107:122035.980 sending configuration data to proxy "zabbix-p01", datalen 128027
 51112:20140107:123549.539 sending configuration data to proxy "zabbix-p01", datalen 128027
 51115:20140107:125103.085 sending configuration data to proxy "zabbix-p01", datalen 128027
 51115:20140107:130616.365 sending configuration data to proxy "zabbix-p01", datalen 128027
 51152:20140107:131109.389 executing housekeeper
 51152:20140107:131109.405 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.011640 sec, idle 1 hour(s)]
 51114:20140107:132129.740 sending configuration data to proxy "zabbix-p01", datalen 128027
 51112:20140107:133642.815 sending configuration data to proxy "zabbix-p01", datalen 128027
 51161:20140107:133851.551 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x0]. Crashing ...
 51161:20140107:133851.551 ====== Fatal information: ======
 51161:20140107:133851.551 program counter not available for this architecture
 51161:20140107:133851.551 === Registers: ===
 51161:20140107:133851.551 register dump not available for this architecture
 51161:20140107:133851.551 === Backtrace: ===
 51161:20140107:133851.559 === Memory map: ===
 51161:20140107:133851.559 memory map not available for this platform
 51161:20140107:133851.560 ================================
 51064:20140107:133851.582 One child process died (PID:51161,exitcode/signal:65280). Exiting ...
 51064:20140107:133853.594 syncing history data...
 51064:20140107:133853.689 syncing history data done
 51064:20140107:133853.689 syncing trends data...
 51064:20140107:133854.279 syncing trends data done
 51064:20140107:133854.292 Zabbix Server stopped. Zabbix 2.2.2rc1 (revision 41235).
 
Comment by Oleksii Zagorskyi [ 2014 Jan 07 ]

The crash report does not provide suggestion for user to create objdump.

Please do it by command "objdump -D -S zabbix_server", compress and attach.

Comment by Oleksii Zagorskyi [ 2014 Jan 09 ]

ZBX-7608 might be the same.

Comment by Stefan Sabolowitsch [ 2014 Feb 17 ]

Hi all, get a dump file > zabbix_server_2.2.2rc3_revision_42433_dumpfile.txt.zip

crashing information:

 
  1024:20140214:192039.859 Starting Zabbix Server. Zabbix 2.2.2rc3 (revision 42433).
  1024:20140214:192039.860 ****** Enabled features ******
  1024:20140214:192039.860 SNMP monitoring:           YES
  1024:20140214:192039.860 IPMI monitoring:           YES
  1024:20140214:192039.860 WEB monitoring:            YES
  1024:20140214:192039.860 VMware monitoring:          NO
  1024:20140214:192039.860 Jabber notifications:       NO
  1024:20140214:192039.860 Ez Texting notifications:  YES
  1024:20140214:192039.860 ODBC:                       NO
  1024:20140214:192039.860 SSH2 support:               NO
  1024:20140214:192039.861 IPv6 support:               NO
  1024:20140214:192039.861 ******************************
  1024:20140214:192039.861 using configuration file: /usr/local/etc/zabbix22/zabbix_server.conf
  1024:20140214:192040.257 current database version (mandatory/optional): 02020000/02020000
  1024:20140214:192040.257 required mandatory version: 02020000
  1041:20140214:192040.872 server #1 started [configuration syncer #1]
  1042:20140214:192040.873 server #2 started [db watchdog #1]
  1104:20140214:192041.101 server #63 started [trapper #1]
  1110:20140214:192041.115 server #69 started [trapper #7]
  1113:20140214:192041.201 server #72 started [trapper #10]
  1114:20140214:192041.203 server #73 started [icmp pinger #1]
  1118:20140214:192041.203 server #77 started [icmp pinger #5]
  1108:20140214:192041.204 server #67 started [trapper #5]
  1106:20140214:192041.206 server #65 started [trapper #3]
  1124:20140214:192041.207 server #83 started [icmp pinger #11]
  1136:20140214:192041.391 server #93 started [icmp pinger #21]
  1044:20140214:192041.392 server #4 started [poller #2]
  1107:20140214:192041.393 server #66 started [trapper #4]
  1115:20140214:192041.397 server #74 started [icmp pinger #2]
  1129:20140214:192041.397 server #86 started [icmp pinger #14]
  1151:20140214:192041.398 server #108 started [http poller #3]
  1131:20140214:192041.402 server #88 started [icmp pinger #16]
  1132:20140214:192041.403 server #89 started [icmp pinger #17]
  1133:20140214:192041.403 server #90 started [icmp pinger #18]
  1138:20140214:192041.404 server #95 started [icmp pinger #23]
  1117:20140214:192041.401 server #76 started [icmp pinger #4]
  1146:20140214:192041.619 server #103 started [alerter #1]
  1043:20140214:192041.622 server #3 started [poller #1]
  1052:20140214:192041.623 server #11 started [poller #9]
  1051:20140214:192041.623 server #10 started [poller #8]
  1055:20140214:192041.623 server #14 started [poller #12]
  1049:20140214:192041.627 server #8 started [poller #6]
  1057:20140214:192041.627 server #16 started [poller #14]
  1048:20140214:192041.627 server #7 started [poller #5]
  1054:20140214:192041.627 server #13 started [poller #11]
  1060:20140214:192041.627 server #19 started [poller #17]
  1061:20140214:192041.627 server #20 started [poller #18]
  1053:20140214:192041.627 server #12 started [poller #10]
  1050:20140214:192041.630 server #9 started [poller #7]
  1047:20140214:192041.632 server #6 started [poller #4]
  1056:20140214:192041.632 server #15 started [poller #13]
  1046:20140214:192041.632 server #5 started [poller #3]
  1122:20140214:192041.633 server #81 started [icmp pinger #9]
  1139:20140214:192041.635 server #96 started [icmp pinger #24]
  1135:20140214:192041.636 server #92 started [icmp pinger #20]
  1130:20140214:192041.637 server #87 started [icmp pinger #15]
  1162:20140214:192041.637 server #113 started [history syncer #2]
  1152:20140214:192041.638 server #109 started [http poller #4]
  1167:20140214:192041.639 server #118 started [proxy poller #1]
  1105:20140214:192041.642 server #64 started [trapper #2]
  1119:20140214:192041.658 server #78 started [icmp pinger #6]
  1148:20140214:192041.659 server #105 started [timer #1]
  1145:20140214:192041.661 server #102 started [icmp pinger #30]
  1149:20140214:192041.662 server #106 started [http poller #1]
  1111:20140214:192041.664 server #70 started [trapper #8]
  1112:20140214:192041.665 server #71 started [trapper #9]
  1134:20140214:192041.666 server #91 started [icmp pinger #19]
  1150:20140214:192041.674 server #107 started [http poller #2]
  1164:20140214:192041.690 server #115 started [history syncer #4]
  1024:20140214:192041.690 server #0 started [main process]
  1116:20140214:192041.692 server #75 started [icmp pinger #3]
  1140:20140214:192041.693 server #97 started [icmp pinger #25]
  1147:20140214:192041.694 server #104 started [housekeeper #1]
  1147:20140214:192041.694 executing housekeeper
  1126:20140214:192041.698 server #85 started [icmp pinger #13]
  1161:20140214:192041.704 server #112 started [history syncer #1]
  1143:20140214:192041.705 server #100 started [icmp pinger #28]
  1137:20140214:192041.706 server #94 started [icmp pinger #22]
  1121:20140214:192041.706 server #80 started [icmp pinger #8]
  1142:20140214:192041.707 server #99 started [icmp pinger #27]
  1058:20140214:192041.708 server #17 started [poller #15]
  1120:20140214:192041.710 server #79 started [icmp pinger #7]
  1123:20140214:192041.711 server #82 started [icmp pinger #10]
  1125:20140214:192041.714 server #84 started [icmp pinger #12]
  1165:20140214:192041.721 server #116 started [escalator #1]
  1168:20140214:192041.724 server #119 started [self-monitoring #1]
  1141:20140214:192041.724 server #98 started [icmp pinger #26]
  1144:20140214:192041.725 server #101 started [icmp pinger #29]
  1109:20140214:192041.727 server #68 started [trapper #6]
  1166:20140214:192041.739 server #117 started [snmp trapper #1]
  1159:20140214:192041.741 server #110 started [http poller #5]
  1163:20140214:192041.777 server #114 started [history syncer #3]
  1059:20140214:192042.025 server #18 started [poller #16]
  1065:20140214:192042.065 server #24 started [poller #22]
  1102:20140214:192042.140 server #61 started [unreachable poller #9]
  1096:20140214:192042.147 server #55 started [unreachable poller #3]
  1095:20140214:192042.173 server #54 started [unreachable poller #2]
  1082:20140214:192042.196 server #41 started [poller #39]
  1062:20140214:192042.226 server #21 started [poller #19]
  1073:20140214:192042.237 server #32 started [poller #30]
  1090:20140214:192042.240 server #49 started [poller #47]
  1092:20140214:192042.246 server #51 started [poller #49]
  1069:20140214:192042.253 server #28 started [poller #26]
  1100:20140214:192042.269 server #59 started [unreachable poller #7]
  1098:20140214:192042.283 server #57 started [unreachable poller #5]
  1080:20140214:192042.312 server #39 started [poller #37]
  1097:20140214:192042.316 server #56 started [unreachable poller #4]
  1063:20140214:192042.319 server #22 started [poller #20]
  1103:20140214:192042.327 server #62 started [unreachable poller #10]
  1066:20140214:192042.342 server #25 started [poller #23]
  1086:20140214:192042.344 server #45 started [poller #43]
  1160:20140214:192042.344 server #111 started [discoverer #1]
  1085:20140214:192042.347 server #44 started [poller #42]
  1064:20140214:192042.351 server #23 started [poller #21]
  1067:20140214:192042.355 server #26 started [poller #24]
  1101:20140214:192042.360 server #60 started [unreachable poller #8]
  1068:20140214:192042.378 server #27 started [poller #25]
  1079:20140214:192042.379 server #38 started [poller #36]
  1071:20140214:192042.380 server #30 started [poller #28]
  1091:20140214:192042.383 server #50 started [poller #48]
  1089:20140214:192042.387 server #48 started [poller #46]
  1081:20140214:192042.398 server #40 started [poller #38]
  1094:20140214:192042.402 server #53 started [unreachable poller #1]
  1083:20140214:192042.405 server #42 started [poller #40]
  1077:20140214:192042.406 server #36 started [poller #34]
  1072:20140214:192042.413 server #31 started [poller #29]
  1074:20140214:192042.414 server #33 started [poller #31]
  1093:20140214:192042.417 server #52 started [poller #50]
  1084:20140214:192042.419 server #43 started [poller #41]
  1078:20140214:192042.423 server #37 started [poller #35]
  1087:20140214:192042.424 server #46 started [poller #44]
  1070:20140214:192042.426 server #29 started [poller #27]
  1099:20140214:192042.429 server #58 started [unreachable poller #6]
  1088:20140214:192042.431 server #47 started [poller #45]
  1076:20140214:192042.432 server #35 started [poller #33]
  1075:20140214:192042.442 server #34 started [poller #32]
  1147:20140214:192042.723 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.143354 sec, idle 1 hour(s)]
  1109:20140214:192857.265 sending configuration data to proxy "zabbix-p01", datalen 197070
  1109:20140214:194410.712 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140214:195923.804 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140214:201436.914 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140214:202042.780 executing housekeeper
  1147:20140214:202042.807 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019147 sec, idle 1 hour(s)]
  1104:20140214:202950.550 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140214:204504.265 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140214:210018.152 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140214:211531.382 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140214:212042.811 executing housekeeper
  1147:20140214:212042.838 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019187 sec, idle 1 hour(s)]
  1110:20140214:213044.590 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140214:214557.897 sending configuration data to proxy "zabbix-p01", datalen 197070
  1113:20140214:220111.400 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140214:221624.861 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140214:222042.926 executing housekeeper
  1147:20140214:222042.953 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019194 sec, idle 1 hour(s)]
  1113:20140214:223138.069 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140214:224651.710 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140214:230205.338 sending configuration data to proxy "zabbix-p01", datalen 197070
  1113:20140214:231718.593 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140214:232042.965 executing housekeeper
  1147:20140214:232042.992 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019152 sec, idle 1 hour(s)]
  1110:20140214:233231.973 sending configuration data to proxy "zabbix-p01", datalen 197070
  1109:20140214:234745.302 sending configuration data to proxy "zabbix-p01", datalen 197070
  1113:20140215:000258.647 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140215:001812.211 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:002042.997 executing housekeeper
  1147:20140215:002043.025 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.020123 sec, idle 1 hour(s)]
  1109:20140215:003325.707 sending configuration data to proxy "zabbix-p01", datalen 197070
  1164:20140215:003449.685 item [logger01:vm.memory.size[buffers]] became supported
  1162:20140215:003520.102 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
  1113:20140215:004839.506 sending configuration data to proxy "zabbix-p01", datalen 197070
  1113:20140215:010353.090 sending configuration data to proxy "zabbix-p01", datalen 197070
  1162:20140215:010447.310 item [logger01:vm.memory.size[buffers]] became supported
  1164:20140215:011017.431 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
  1113:20140215:011906.408 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:012043.027 executing housekeeper
  1147:20140215:012043.063 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.027996 sec, idle 1 hour(s)]
  1109:20140215:013419.601 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140215:014933.159 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140215:020446.734 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140215:022000.435 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:022043.065 executing housekeeper
  1147:20140215:022043.097 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.024668 sec, idle 1 hour(s)]
  1113:20140215:023513.974 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140215:025027.533 sending configuration data to proxy "zabbix-p01", datalen 197070
  1162:20140215:030450.262 item [logger01:vm.memory.size[buffers]] became supported
  1113:20140215:030540.981 sending configuration data to proxy "zabbix-p01", datalen 197070
  1162:20140215:030950.605 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
  1147:20140215:032043.105 executing housekeeper
  1147:20140215:032043.152 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.035643 sec, idle 1 hour(s)]
  1109:20140215:032054.825 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140215:033608.499 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140215:035122.135 sending configuration data to proxy "zabbix-p01", datalen 197070
  1109:20140215:040635.827 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:042043.237 executing housekeeper
  1147:20140215:042043.264 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019207 sec, idle 1 hour(s)]
  1109:20140215:042149.203 sending configuration data to proxy "zabbix-p01", datalen 197070
  1161:20140215:042450.067 item [logger01:vm.memory.size[buffers]] became supported
  1162:20140215:042721.515 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
  1104:20140215:043702.780 sending configuration data to proxy "zabbix-p01", datalen 197070
  1109:20140215:045215.872 sending configuration data to proxy "zabbix-p01", datalen 197070
  1113:20140215:050729.385 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:052043.299 executing housekeeper
  1147:20140215:052043.327 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.020275 sec, idle 1 hour(s)]
  1113:20140215:052242.724 sending configuration data to proxy "zabbix-p01", datalen 197070
  1163:20140215:053449.123 item [logger01:vm.memory.size[buffers]] became supported
  1163:20140215:053721.579 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
  1104:20140215:053756.231 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140215:055309.833 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140215:060823.652 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:062043.357 executing housekeeper
  1147:20140215:062043.384 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.020019 sec, idle 1 hour(s)]
  1110:20140215:062337.015 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140215:063850.181 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140215:065403.432 sending configuration data to proxy "zabbix-p01", datalen 197070
  1073:20140215:070116.041 Zabbix agent item "perf_counter[\238(_Total)\696]" on host "SFG06" failed: first network error, wait for 15 seconds
  1099:20140215:070132.109 resuming Zabbix agent checks on host "SFG06": connection restored
  1164:20140215:070449.971 item [logger01:vm.memory.size[buffers]] became supported
  1164:20140215:070550.686 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
  1113:20140215:070917.212 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:072043.389 executing housekeeper
  1147:20140215:072043.416 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019009 sec, idle 1 hour(s)]
  1104:20140215:072431.298 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140215:073944.896 sending configuration data to proxy "zabbix-p01", datalen 197070
  1081:20140215:074050.190 Zabbix agent item "net.if.out[{$NIC_NAME_1},bytes]" on host "SFG06" failed: first network error, wait for 15 seconds
  1103:20140215:074105.111 resuming Zabbix agent checks on host "SFG06": connection restored
  1104:20140215:075458.471 sending configuration data to proxy "zabbix-p01", datalen 197070
  1113:20140215:081012.171 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:082043.419 executing housekeeper
  1147:20140215:082043.445 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.018530 sec, idle 1 hour(s)]
  1110:20140215:082525.731 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140215:084039.169 sending configuration data to proxy "zabbix-p01", datalen 197070
  1113:20140215:085552.486 sending configuration data to proxy "zabbix-p01", datalen 197070
  1109:20140215:091105.940 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:092043.458 executing housekeeper
  1147:20140215:092043.485 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019201 sec, idle 1 hour(s)]
  1109:20140215:092619.521 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140215:094133.051 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140215:095646.380 sending configuration data to proxy "zabbix-p01", datalen 197070
  1109:20140215:101159.750 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:102043.490 executing housekeeper
  1147:20140215:102043.518 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019791 sec, idle 1 hour(s)]
  1110:20140215:102713.180 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140215:104226.472 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140215:105740.092 sending configuration data to proxy "zabbix-p01", datalen 197070
  1113:20140215:111253.799 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:112043.519 executing housekeeper
  1147:20140215:112043.546 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019683 sec, idle 1 hour(s)]
  1104:20140215:112807.570 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140215:114321.026 sending configuration data to proxy "zabbix-p01", datalen 197070
  1113:20140215:115834.263 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140215:121348.058 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:122043.576 executing housekeeper
  1147:20140215:122043.603 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019232 sec, idle 1 hour(s)]
  1110:20140215:122901.814 sending configuration data to proxy "zabbix-p01", datalen 197070
  1113:20140215:124415.679 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140215:125929.285 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140215:131442.874 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:132043.618 executing housekeeper
  1147:20140215:132043.645 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019359 sec, idle 1 hour(s)]
  1109:20140215:132956.173 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140215:134509.704 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140215:140023.234 sending configuration data to proxy "zabbix-p01", datalen 197070
  1113:20140215:141537.022 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:142043.707 executing housekeeper
  1147:20140215:142043.733 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019192 sec, idle 1 hour(s)]
  1110:20140215:143050.700 sending configuration data to proxy "zabbix-p01", datalen 197070
  1113:20140215:144604.283 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140215:150117.961 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140215:151631.316 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:152043.744 executing housekeeper
  1147:20140215:152043.770 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019178 sec, idle 1 hour(s)]
  1110:20140215:153144.511 sending configuration data to proxy "zabbix-p01", datalen 197070
  1113:20140215:154657.715 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140215:160211.150 sending configuration data to proxy "zabbix-p01", datalen 197070
  1113:20140215:161724.720 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:162043.780 executing housekeeper
  1147:20140215:162043.807 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019132 sec, idle 1 hour(s)]
  1109:20140215:163238.125 sending configuration data to proxy "zabbix-p01", datalen 197070
  1113:20140215:164751.609 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140215:170304.788 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:172043.815 executing housekeeper
  1147:20140215:172043.842 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019114 sec, idle 1 hour(s)]
  1110:20140215:173301.960 sending configuration data to proxy "zabbix-p01", datalen 197070
  1164:20140215:173308.618 item [zabbix-p01:net.if.in[em0,bytes]] became not supported: Not supported by Zabbix Agent
  1164:20140215:173308.619 item [zabbix-p01:net.if.out[lo0,bytes]] became not supported: Not supported by Zabbix Agent
  1161:20140215:173313.698 item [zabbix-p01:ddd] became not supported: Cannot evaluate function [last()]: item [zabbix-p01:net.if.in[em0,bytes]] not found
  1162:20140215:173439.946 item [zabbix-p01:net.if.in[lo0,bytes]] became not supported: Not supported by Zabbix Agent
  1163:20140215:173500.288 item [zabbix-p01:net.if.out[em0,bytes]] became not supported: Not supported by Zabbix Agent
  1162:20140215:173505.317 item [zabbix-p01:ddd2] became not supported: Cannot evaluate function [last()]: item [zabbix-p01:net.if.out[em0,bytes]] not found
  1147:20140215:182043.863 executing housekeeper
  1147:20140215:182043.890 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019214 sec, idle 1 hour(s)]
  1113:20140215:182743.425 sending configuration data to proxy "zabbix-p01", datalen 197070
  1161:20140215:182757.303 item [zabbix-p01:net.if.in[lo0,bytes]] became supported
  1161:20140215:182757.303 item [zabbix-p01:net.if.in[em0,bytes]] became supported
  1161:20140215:182757.304 item [zabbix-p01:net.if.out[em0,bytes]] became supported
  1161:20140215:182757.305 item [zabbix-p01:net.if.out[lo0,bytes]] became supported
  1109:20140215:183114.108 sending configuration data to proxy "zabbix-p01", datalen 197070
  1164:20140215:183457.924 item [zabbix-p01:ddd2] became supported
  1162:20140215:183513.174 item [zabbix-p01:ddd] became supported
  1110:20140215:184644.314 sending configuration data to proxy "zabbix-p01", datalen 197070
  1109:20140215:190213.536 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140215:191745.298 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:192043.921 executing housekeeper
  1147:20140215:192043.948 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019358 sec, idle 1 hour(s)]
  1110:20140215:193317.914 sending configuration data to proxy "zabbix-p01", datalen 197070
  1109:20140215:194848.412 sending configuration data to proxy "zabbix-p01", datalen 197070
  1113:20140215:200418.874 sending configuration data to proxy "zabbix-p01", datalen 197070
  1109:20140215:201948.874 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:202043.950 executing housekeeper
  1147:20140215:202043.977 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019310 sec, idle 1 hour(s)]
  1109:20140215:203519.434 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140215:205051.486 sending configuration data to proxy "zabbix-p01", datalen 197070
  1164:20140215:210449.087 item [logger01:vm.memory.size[buffers]] became supported
  1113:20140215:210621.573 sending configuration data to proxy "zabbix-p01", datalen 197070
  1162:20140215:210751.351 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
  1147:20140215:212043.997 executing housekeeper
  1147:20140215:212044.025 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019940 sec, idle 1 hour(s)]
  1110:20140215:212152.245 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140215:213721.683 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140215:215253.842 sending configuration data to proxy "zabbix-p01", datalen 197070
  1113:20140215:220824.449 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:222044.027 executing housekeeper
  1147:20140215:222044.068 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.031600 sec, idle 1 hour(s)]
  1113:20140215:222350.002 sending configuration data to proxy "zabbix-p01", datalen 197070
  1104:20140215:223920.715 sending configuration data to proxy "zabbix-p01", datalen 197070
  1162:20140215:224112.411 item [VPN-Latency Wecker-Serrig:icmppingsec] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1161:20140215:224116.790 item [SFG26:icmpping] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1161:20140215:224116.791 item [SFG030:icmppingsec] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1164:20140215:224121.836 item [SFG05:icmppingsec] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1163:20140215:224126.947 item [webdesk:icmppingsec] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1163:20140215:224126.948 item [SFG09:icmppingsec] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1163:20140215:224126.949 item [SFG040:icmppingsec] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1163:20140215:224126.949 item [SFG030:icmpping] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1163:20140215:224126.950 item [Network-Latency Wecker-Serrig:icmpping] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1163:20140215:224126.951 item [Network-Latency Wecker-Serrig:icmppingsec] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1163:20140215:224126.952 item [fwgate-2:icmppingsec] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1164:20140215:224132.039 item [SFG05:icmpping] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1164:20140215:224132.040 item [ns6:icmppingsec] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1164:20140215:224132.041 item [fwgate-2:icmpping] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1164:20140215:224132.042 item [fwgate-2:icmppingloss[,4,,,2500]] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1161:20140215:224137.080 item [webdesk:icmpping] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1161:20140215:224137.081 item [SFG26:icmppingsec] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1161:20140215:224137.082 item [SFG09:icmpping] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1161:20140215:224137.083 item [SFG040:icmpping] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1163:20140215:224142.115 item [zabbix-p01:icmppingsec] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1163:20140215:224157.282 item [ns6:icmpping] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1164:20140215:224202.337 item [zabbix-p01:icmpping] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1164:20140215:224202.338 item [zabbix-p01:icmppingloss[,4,,,2500]] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1161:20140215:224212.531 item [VPN-Latency Wecker-Serrig:icmpping] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1161:20140215:224227.694 item [SFG030:icmppingloss[,4,,,2500]] became not supported: At least one of '/usr/local/sbin/fping', '/usr/sbin/fping6' must exist. Both are missing in the system.
  1161:20140215:224232.860 item [fwgate-2:icmpping] became supported
  1161:20140215:224232.861 item [fwgate-2:icmppingloss[,4,,,2500]] became supported
  1164:20140215:224429.445 item [SFG09:icmppingsec] became supported
  1164:20140215:224444.610 item [zabbix-p01:icmppingsec] became supported
  1104:20140215:224504.427 sending configuration data to proxy "zabbix-p01", datalen 197070
  1164:20140215:224504.967 item [zabbix-p01:icmpping] became supported
  1163:20140215:224509.989 item [SFG040:icmpping] became supported
  1162:20140215:224515.301 item [VPN-Latency Wecker-Serrig:icmpping] became supported
  1162:20140215:224515.302 item [VPN-Latency Wecker-Serrig:icmppingsec] became supported
  1162:20140215:224515.303 item [SFG030:icmppingsec] became supported
  1161:20140215:224525.118 item [SFG26:icmpping] became supported
  1164:20140215:224525.207 item [webdesk:icmppingsec] became supported
  1164:20140215:224525.209 item [SFG05:icmppingsec] became supported
  1164:20140215:224525.210 item [SFG030:icmpping] became supported
  1164:20140215:224525.211 item [fwgate-2:icmppingsec] became supported
  1161:20140215:224530.882 item [SFG040:icmppingsec] became supported
  1161:20140215:224530.883 item [SFG030:icmppingloss[,4,,,2500]] became supported
  1161:20140215:224530.884 item [Network-Latency Wecker-Serrig:icmpping] became supported
  1161:20140215:224530.884 item [Network-Latency Wecker-Serrig:icmppingsec] became supported
  1162:20140215:224540.450 item [webdesk:icmpping] became supported
  1162:20140215:224540.451 item [SFG26:icmppingsec] became supported
  1162:20140215:224540.452 item [SFG09:icmpping] became supported
  1162:20140215:224540.453 item [SFG05:icmpping] became supported
  1162:20140215:224540.454 item [ns6:icmppingsec] became supported
  1163:20140215:224555.732 item [ns6:icmpping] became supported
  1163:20140215:224807.826 item [zabbix-p01:icmppingloss[,4,,,2500]] became supported
  1110:20140215:225042.701 sending configuration data to proxy "zabbix-p01", datalen 197070
  1110:20140215:230613.833 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140215:232044.086 executing housekeeper
  1147:20140215:232044.113 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019503 sec, idle 1 hour(s)]
  1109:20140215:232144.041 sending configuration data to proxy "zabbix-p01", datalen 197070
  1162:20140215:232448.203 item [logger01:vm.memory.size[buffers]] became supported
  1113:20140215:233714.982 sending configuration data to proxy "zabbix-p01", datalen 197070
  1164:20140215:233951.569 item [logger01:vm.memory.size[buffers]] became not supported: Not supported by Zabbix Agent
  1092:20140215:234456.286 Zabbix agent item "vfs.fs.size[/var,pfree]" on host "ftp1" failed: first network error, wait for 15 seconds
  1099:20140215:234511.023 resuming Zabbix agent checks on host "ftp1": connection restored
  1109:20140215:235246.869 sending configuration data to proxy "zabbix-p01", datalen 197070
  1113:20140216:000818.402 sending configuration data to proxy "zabbix-p01", datalen 197070
  1147:20140216:002044.114 executing housekeeper
  1147:20140216:002044.141 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.019135 sec, idle 1 hour(s)]
  1110:20140216:002350.309 sending configuration data to proxy "zabbix-p01", datalen 197070
  1106:20140216:003922.915 sending configuration data to proxy "zabbix-p01", datalen 197070
  1162:20140216:005311.380 Got signal [signal:10(SIGBUS),reason:3,refaddr:0x803f70bdb]. Crashing ...
  1162:20140216:005311.381 ====== Fatal information: ======
  1162:20140216:005311.381 program counter not available for this architecture
  1162:20140216:005311.381 === Registers: ===
  1162:20140216:005311.381 register dump not available for this architecture
  1162:20140216:005311.381 === Backtrace: ===
  1162:20140216:005311.406 1: 0x455bab <print_fatal_info+0x7b> at /usr/local/sbin/zabbix_server
  1162:20140216:005311.406 0: 0x45600c <fatal_signal_handler+0x9c> at /usr/local/sbin/zabbix_server
  1162:20140216:005311.406 === Memory map: ===
  1162:20140216:005311.406 memory map not available for this platform
  1162:20140216:005311.407 ================================
  1024:20140216:005311.442 One child process died (PID:1162,exitcode/signal:65280). Exiting ...
  1024:20140216:005313.459 syncing history data...
  1024:20140216:005313.460 syncing history data done
  1024:20140216:005313.460 syncing trends data...
  1024:20140216:005315.065 syncing trends data done
  1024:20140216:005315.066 Zabbix Server stopped. Zabbix 2.2.2rc3 (revision 42433).
 
Comment by Stefan Sabolowitsch [ 2014 Feb 17 ]

And i've seen this error several times.
FreeBSD thinks zabbix-server makes a DOS.

DEBUG priority message

 
Feb 17 12:36:07 zabbix-m01 kernel: sonewconn: pcb 0xfffff801e3a197a8: Listen queue overflow: 193 already in queue awaiting acceptance
Feb 17 12:36:37 zabbix-m01 last message repeated 176 times
Feb 17 12:38:37 zabbix-m01 last message repeated 624 times
Feb 17 12:48:37 zabbix-m01 last message repeated 3108 times
Feb 17 12:58:37 zabbix-m01 last message repeated 3159 times
Feb 17 12:59:05 zabbix-m01 last message repeated 144 times
 
[root@zabbix-m01 /tmp]# netstat -Lan
Current listen queue sizes (qlen/incqlen/maxqlen)
Proto Listen         Local Address         
tcp4  193/0/128      *.10051                
tcp4  0/0/10         127.0.0.1.25           
tcp4  0/0/128        *.8080                 
tcp6  0/0/128        *.8080                 
tcp4  0/0/128        *.80                   
tcp6  0/0/128        *.80                   
tcp4  0/0/128        *.22                   
tcp6  0/0/128        *.22                   
tcp4  0/0/128        *.11000                
tcp4  0/0/128        *.10050                
tcp6  0/0/128        *.10050                
tcp4  0/0/128        *.5432                 
tcp6  0/0/128        *.5432                 
unix  0/0/128        /tmp/.s.PGSQL.5432
unix  0/0/4          /var/run/devd.pipe
Comment by richlv [ 2014 Apr 15 ]

ZBX-7765 seems to be similar

Comment by Stefan Sabolowitsch [ 2014 Apr 17 ]

Hi all,
again zabbix-server crashed.
I got a dumpfile, zabbix_server_2.2.2_dumpfile_17.04.14.txt.zip

 39642:20140417:061243.490 cannot send list of active checks to [192.168.1.10]: host [it] not found
 39660:20140417:061443.566 cannot send list of active checks to [192.168.1.10]: host [it] not found
 39659:20140417:061643.797 cannot send list of active checks to [192.168.1.10]: host [it] not found
 39640:20140417:061843.976 cannot send list of active checks to [192.168.1.10]: host [it] not found
 39660:20140417:062043.815 cannot send list of active checks to [192.168.1.10]: host [it] not found
 39642:20140417:062243.672 cannot send list of active checks to [192.168.1.10]: host [it] not found
 39660:20140417:062443.649 cannot send list of active checks to [192.168.1.10]: host [it] not found
 39642:20140417:062643.512 cannot send list of active checks to [192.168.1.10]: host [it] not found
 39658:20140417:062722.452 sending configuration data to proxy "zabbix-p01", datalen 208751
 39743:20140417:062744.893 executing housekeeper
 39743:20140417:062744.921 housekeeper [deleted 0 hist/trends, 0 items, 0 events, 0 sessions, 0 alarms, 0 audit items in 0.020389 sec, idle 1 hour(s)]
 39640:20140417:062843.593 cannot send list of active checks to [192.168.1.10]: host [it] not found
 39640:20140417:063043.737 cannot send list of active checks to [192.168.1.10]: host [it] not found
 39660:20140417:063243.799 cannot send list of active checks to [192.168.1.10]: host [it] not found
 39755:20140417:063418.367 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x0]. Crashing ...
 39755:20140417:063418.367 ====== Fatal information: ======
 39755:20140417:063418.367 program counter not available for this architecture
 39755:20140417:063418.367 === Registers: ===
 39755:20140417:063418.367 register dump not available for this architecture
 39755:20140417:063418.367 === Backtrace: ===
 39755:20140417:063418.403 1: 0x45f4fb <print_fatal_info+0x7b> at /usr/local/sbin/zabbix_server
 39755:20140417:063418.403 0: 0x45f95c <zbx_set_common_signal_handlers+0x2fc> at /usr/local/sbin/zabbix_server
 39755:20140417:063418.403 === Memory map: ===
 39755:20140417:063418.407 memory map not available for this platform
 39755:20140417:063418.407 ================================
 39564:20140417:063418.441 One child process died (PID:39755,exitcode/signal:65280). Exiting ...
 39564:20140417:063420.479 syncing history data...
 39564:20140417:063420.480 syncing history data done
 39564:20140417:063420.480 syncing trends data...
 39564:20140417:063421.566 syncing trends data done
 39564:20140417:063421.566 Zabbix Server stopped. Zabbix 2.2.2 (revision 42525).
Comment by Oleksii Zagorskyi [ 2014 Apr 17 ]

Stefan, 2.2.3 is released already.
Probably you have to upgrade and then retest it.

Comment by Ingus Vilnis [ 2017 Nov 29 ]

Closing old issue because 2.2.3 is out for a long time already. Please reopen or create a new issue if still required.





[ZBX-7461] zabbix does not compile if operating system cannot be determined Created: 2013 Nov 29  Updated: 2017 May 30  Resolved: 2013 Dec 02

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Installation (I)
Affects Version/s: 2.2.0
Fix Version/s: 2.2.1rc1, 2.3.0

Type: Incident report Priority: Minor
Reporter: Aleksandrs Saveljevs Assignee: Unassigned
Resolution: Fixed Votes: 0
Labels: compilation, freebsd
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified


 Description   

As the subject says, Zabbix fails to compile on an unknown platform ("unknown" in the sense of src/libs/zbxsysinfo/Makefile.am - "aix", "freebsd", ..., "solaris", "unknown").

One example of such a platform is kFreeBSD (https://wiki.debian.org/Debian_GNU/kFreeBSD) and was reported to us by Dmitry Smirnov, the maintainer of Zabbix package on Debian.



 Comments   
Comment by Aleksandrs Saveljevs [ 2013 Nov 29 ]

It seems to have broken after ZBX-5616 was implemented.

Comment by Aleksandrs Saveljevs [ 2013 Dec 02 ]

Fixed in development branch svn://svn.zabbix.com/branches/dev/ZBX-7461 .

Zabbix server, proxy, and agent - all compile and run well on kFreeBSD now.

Comment by Andris Zeila [ 2013 Dec 03 ]

Successfully tested

Comment by Aleksandrs Saveljevs [ 2013 Dec 03 ]

Fixed in pre-2.2.1rc1 r40705 and pre-2.3.0 (trunk) r40706.





[ZBX-7401] The Store value of Item prototypes in Template OS FreeBSD Created: 2013 Nov 19  Updated: 2017 May 30  Resolved: 2013 Dec 02

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Templates (T)
Affects Version/s: 2.2.0
Fix Version/s: None

Type: Incident report Priority: Blocker
Reporter: Yoshikazu GOTO Assignee: Unassigned
Resolution: Cannot Reproduce Votes: 0
Labels: freebsd, templates
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Zabbix Server/Frontend : Ubuntu 12.04
Zabbix Agent : FreeBSD 9.2



 Description   

Template OS FreeBSD -> Network interface discovery -> Item prototypes
The original "Store value" value is "As is", but it should be "Delta (speed per second)".



 Comments   
Comment by Alexei Vladishev [ 2013 Nov 26 ]

I do not see any item prototypes in the Template OS FreeBSD under 2.2.0. It seems to be broken.

Comment by Aleksandrs Saveljevs [ 2013 Nov 26 ]

Item prototypes for FreeBSD template are going to be fixed in ZBX-7339.

Comment by Aleksandrs Saveljevs [ 2013 Dec 02 ]

Similar to Alexei, I am not observing the described problem in the default installation of Zabbix 2.2.0.

Comment by Aleksandrs Saveljevs [ 2013 Dec 02 ]

Please reopen if the problem is still reproducible on a clean install.

Comment by Yoshikazu GOTO [ 2013 Dec 03 ]

Ok. Thanks.





[ZBX-7376] Installation failed with vmware monitoring Created: 2013 Nov 15  Updated: 2017 May 30  Resolved: 2013 Nov 15

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Installation (I)
Affects Version/s: 2.2.0
Fix Version/s: None

Type: Incident report Priority: Major
Reporter: Vladimir Marakshin Assignee: Unassigned
Resolution: Duplicate Votes: 0
Labels: freebsd, installation, libxml2, vmware
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD 8.3-RELEASE #0: Mon Apr 9 21:23:18 UTC 2012 (amd64)


Issue Links:
Duplicate
duplicates ZBX-7329 zabbix-2.2.0rc2 make error on FreeBSD... Closed

 Description   

If I install zabbix server from sources with option --with-libxml2 (for VMWare monitoring) on FreeBSD 8.3 (amd64), I`m get a error after command "make install".
Error text:
checks_simple_vmware.c: In function 'vmware_get_events':
checks_simple_vmware.c:235: error: invalid operands to binary -

      • Error code 1

Without --with-libxml2 installation success.

Version of libxml2: libxml2-2.8.0_2






[ZBX-7329] zabbix-2.2.0rc2 make error on FreeBSD 9.2 Created: 2013 Nov 11  Updated: 2017 May 30  Resolved: 2013 Nov 14

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Installation (I), Proxy (P), Server (S)
Affects Version/s: 2.2.0rc2
Fix Version/s: 2.2.1rc1, 2.3.0

Type: Incident report Priority: Minor
Reporter: Sergiu Assignee: Unassigned
Resolution: Fixed Votes: 0
Labels: freebsd, installation, libxml2
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD 9.2-RELEASE r255898: Thu Sep 26 22:50:31 UTC 2013 [email][email protected][/email]:/usr/obj/usr/src/sys/GENERIC amd64


Attachments: Text File zabbix2.2.-rc2.make.error.log     Text File zabbix2.2.0.rc2.configure.log    
Issue Links:
Duplicate
is duplicated by ZBX-7376 Installation failed with vmware monit... Closed
is duplicated by ZBX-7462 checks_simple_vmware.c: In function '... Closed

 Description   

Zabbix is configured with libxml2
./configure --enable-server --enable-agent --with-mysql --enable-ipv6 --with-net-snmp --with-libcurl --with-libxml2

  1. pkg_info | grep libxml2
    libxml2-2.8.0_2 XML parser library for GNOME

libxml2 port was builded with THREAD_ALLOC Per-thread memory (DEVELOPERS ONLY!) and without, same error.

Full log attached

/usr/include/sys/timeb.h:42:2: warning: #warning "this file includes <sys/timeb.h> which is deprecated"
mv -f .deps/libzbxpoller_a-checks_internal.Tpo .deps/libzbxpoller_a-checks_internal.Po
gcc -DHAVE_CONFIG_H -I. -I../../../include -I../../../src/libs/zbxsysinfo/simple -I../../../src/libs/zbxdbcache -g -O2 -I/usr/local/include/mysql -pipe -fno-strict-aliasing -g -DNDEBUG -I/usr/local/include/libxml2 -I/usr/local/include -I/usr/local/include -I/usr/local/lib/perl5/5.16/mach/CORE -I/usr/include -I. -I/usr/local/include -I/usr/local/include -MT libzbxpoller_a-checks_simple.o -MD -MP -MF .deps/libzbxpoller_a-checks_simple.Tpo -c -o libzbxpoller_a-checks_simple.o `test -f 'checks_simple.c' || echo './'`checks_simple.c
In file included from ../../../include/sysinc.h:378,
from ../../../include/common.h:23,
from checks_simple_vmware.h:23,
from checks_simple.c:20:
/usr/include/sys/timeb.h:42:2: warning: #warning "this file includes <sys/timeb.h> which is deprecated"
mv -f .deps/libzbxpoller_a-checks_simple.Tpo .deps/libzbxpoller_a-checks_simple.Po
gcc -DHAVE_CONFIG_H -I. -I../../../include -I../../../src/libs/zbxsysinfo/simple -I../../../src/libs/zbxdbcache -g -O2 -I/usr/local/include/mysql -pipe -fno-strict-aliasing -g -DNDEBUG -I/usr/local/include/libxml2 -I/usr/local/include -I/usr/local/include -I/usr/local/lib/perl5/5.16/mach/CORE -I/usr/include -I. -I/usr/local/include -I/usr/local/include -MT libzbxpoller_a-checks_simple_vmware.o -MD -MP -MF .deps/libzbxpoller_a-checks_simple_vmware.Tpo -c -o libzbxpoller_a-checks_simple_vmware.o `test -f 'checks_simple_vmware.c' || echo './'`checks_simple_vmware.c
In file included from ../../../include/sysinc.h:378,
from ../../../include/common.h:23,
from checks_simple_vmware.c:20:
/usr/include/sys/timeb.h:42:2: warning: #warning "this file includes <sys/timeb.h> which is deprecated"
checks_simple_vmware.c: In function 'vmware_get_events':
checks_simple_vmware.c:235: error: invalid operands to binary -

      • [libzbxpoller_a-checks_simple_vmware.o] Error code 1

Stop in /usr/home/sc/zabbix-2.2.0rc2/src/zabbix_server/poller.

      • [install-recursive] Error code 1

Stop in /usr/home/sc/zabbix-2.2.0rc2/src/zabbix_server.

      • [install-recursive] Error code 1

Stop in /usr/home/sc/zabbix-2.2.0rc2/src.

      • [install-recursive] Error code 1

Stop in /usr/home/sc/zabbix-2.2.0rc2.
Press any key to continue...



 Comments   
Comment by Andris Zeila [ 2013 Nov 12 ]

Fixed in development branch svn://svn.zabbix.com/branches/dev/ZBX-7329

Comment by Sergiu [ 2013 Nov 12 ]

Compilation is successful with revision 40218. Thanx

Comment by Alexander Vladishev [ 2013 Nov 14 ]

(1) Will be better to use HAVE_TM_TM_GMTOFF definition. It is already used in our code.

wiper RESOLVED in r40290

sasha CLOSED

Comment by Andris Zeila [ 2013 Nov 15 ]

Released in:
pre-2.2.1rc1 r40304
pre-2.3.0 r40305





[ZBX-6961] too many file descriptors from zabbix_agentd (Ver 1.8.13) on freebsd 9.1-release Created: 2013 Sep 06  Updated: 2017 Nov 29  Resolved: 2017 Nov 29

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Agent (G)
Affects Version/s: None
Fix Version/s: None

Type: Incident report Priority: Critical
Reporter: bousquet cyrille Assignee: Unassigned
Resolution: Unsupported version Votes: 0
Labels: freebsd
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

freebsd 9.1-release



 Description   

our servers went down because of "kern.maxfiles limit exceeded by uid 0, please see tuning(7)."
actually, zabbix_agentd keeps opened thousands of sockets

for now, we plan to cron restart of agent to reset socket usage, no idea if it'll work



 Comments   
Comment by Рада Кузнецова [ 2013 Sep 09 ]

в приложении про кота ошибка
IOErrorEvent (ioError): Error #2032

Comment by Glebs Ivanovskis (Inactive) [ 2017 Nov 29 ]

Closing as Unsupported Version. Please open a new ticket if you are still experiencing same problem in latest versions.





[ZBX-6733] wrong proc.mem in FreeBSD Created: 2013 Jun 20  Updated: 2017 May 30  Resolved: 2014 Oct 20

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Agent (G)
Affects Version/s: 2.0.5
Fix Version/s: None

Type: Incident report Priority: Major
Reporter: gescheit Assignee: Unassigned
Resolution: Duplicate Votes: 0
Labels: freebsd, memory, patch, trivial
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD 8.3


Attachments: File zabbix_agent_meminfo.diff    
Issue Links:
Duplicate
duplicates ZBXNEXT-1078 add fifth parameter to the key "proc.... Closed

 Description   

Seems proc.mem value not included dynamic allocated memory.
zabbix_agent_meminfo.diff change memory calculating algorithm, so proc.mem[] return vm size as in Linux.



 Comments   
Comment by Andris Mednis [ 2014 Oct 20 ]

On FreeBSD 4.x and older the attached patch uses "kp_eproc.e_vm.vm_size". Seems like it should be "kp_eproc.e_vm.vm_map.size".

Comment by Andris Mednis [ 2014 Oct 20 ]

This issue is being solved as part of ZBXNEXT-1078.
Virtual size of the FreeBSD process will be available using the proc.mem[] 5th parameter, for example:

$ zabbix_agentd -t proc.mem[syslogd,,,,vsize]




[ZBX-6230] zabbix server, all trapper messages seem to be truncated around 300 bytes. Created: 2013 Feb 07  Updated: 2019 Dec 10

Status: Open
Project: ZABBIX BUGS AND ISSUES
Component/s: Server (S)
Affects Version/s: 2.0.4
Fix Version/s: None

Type: Incident report Priority: Trivial
Reporter: Stefan Sabolowitsch Assignee: Unassigned
Resolution: Unresolved Votes: 0
Labels: freebsd, trapper
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD 9.2 x64 with all patches



 Description   

zbxlog send correct data to the zabbix server.
But all trapper messages seem to be truncated around 300 byte and therefore the data is not in the database are stored.

Please look on this thread in the zabbix forum, you will find all information here (debug files, configs etc.)
At beginning Post Nr. 158
https://httpwww.zabbix.com/forum/showthread.php?t=19180&page=16

thanks for bug fixing



 Comments   
Comment by richlv [ 2013 Feb 07 ]

please describe the issue shortly here - it is much more likely developers would take a look at it if they do not have to check lots and lots of forum posts. specifically, include information that shows proper information being sent over the network, but not received by the server

Comment by Stefan Sabolowitsch [ 2013 Feb 07 ]

OK, no problem sorry

zbxlog send this Data to zabbix.

bxlog::Sender::Send zbx_data={"request":"sender data",
"data":[
{
"host":"fwgate-1",
"key":"syslog[]",
"value":"fwgate-1: NetScreen device_id=fwgate-1  [Root]system-error-00601: DNS:QUERY:NULL-QUERY has been detected from 91.XXX.XXX.XXX/5976 t
o 217.XXX.XXX.XXX/53 through policy 114 1 times. (2013-02-06 16:56:19).",
"timestamp":"1360166180",
"source":"local0",
"severity":"14",
"eventid":"131",
}
]
}
Zbxlog::Sender::Send response=OK

and this see zabbix server (debug log):

91227:20130207:131808.083 Trapper got [{"request":"sender data",
"data":[
{
"host":"fwgate-1",
"key":"syslog[]",
"value":"fwgate-1: NetScreen device_id=fwgate-1  [Root]system-critical-00430: Dst IP session limit! From 91.xxx.xxx.xxx:60900 to 217.xxx.xxx
.xxx:53, proto UDP (zone Untrust int  ethernet0/0). Occurred 1 times. (2013-02-07 13:18:05)] len 301
 91226:20130207:131808.083 In process_mass_data()
 91226:20130207:131808.083 End of process_mass_data()
 91227:20130207:131808.084 Trapper got [{"request":"sender data",
"data":[
{
"host":"fwgate-1",
"key":"syslog[]",
"value":"fwgate-1: NetScreen device_id=fwgate-1  [Root]system-critical-00430: Dst IP session limit! From 91.xxx.xxx.xxx:1196 to 217.xxx.xxx.
xxx:53, proto UDP (zone Untrust int  ethernet0/0). Occurred 1 times. (2013-02-07 13:18:07)] len 300

you see, at the end complete missing timestamp, source, severity and event id

On an tcpdump you see zbxlog send the data correct (clear text):

ZBXD{"request":"sender data",
"data":[
{
"host":"fwgate-1",
"key":"syslog[]",
"value":"fwgate-1: NetScreen device_id=fwgate-1  [Root]system-critical-00430: Dst IP session limit! From 149.xxx.xxx.xxx:50955 to 217.xxx.xxx.xxx:53, proto UDP (zone Untrust int  ethernet0/0). Occurred 1 times. (2013-02-07 14:06:42)",
"timestamp":"1360242403",
"source":"local0",
"severity":"15",
"eventid":"130",
}
]
}

The interesting thing is that it with Ubuntu working properly, but with FreeBSD does not.

zabbix_server logfile on Ubuntu, you will here see timestamp, source, severity and eventid

 27781:20130206:134417.026 Trapper got [{"request":"sender data",
"data":[
{
"host":"Zabbix server",
"key":"syslog[]",
"value":"joseph: very long message very long messagevery long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long message very long messagevery long message very long messagevery long message very long message very long messagevery long message very long messagevery long message very long message very long messagevery long message very long messagevery long message very long message very long messagevery long message very long messagevery long message very long message very long messagevery long message very long messagevery long message very long message very long messagevery long message  very long messagevery long messagevery long message very long messagevery long message very long messagevery long message very long message very long messagevery long message  very long messagevery long message very long message very long message ry long message very long messagevery long message very long message very long message very long message very long message very long message very long message very long message very long message very long mes",
"timestamp":"1360154656",
"source":"user",
"severity":"12",
"eventid":"13",
}
]
}] len 1668

It looks that all trapper messages seem to be truncated around 300 byte on FreeBSD

Comment by richlv [ 2013 Feb 07 ]

if you try to send a longer message using commandline zabbix_sender, is it also truncated ?

Comment by Stefan Sabolowitsch [ 2013 Feb 07 ]

no this should work, see here

93469:20130207:174026.974 Trapper got [{
        "request":"sender data",
        "data":[
                {
                        "host":"fwagte-1",
                        "key":"syslog[]",
                        "value":"local0,11,1360071440,fwgate-1: NetScreen device_id=fwgate-1  [Root]system-information-00536: IKE 153.xxx.
xxx.xxx Phase 2 msg ID fe3c6610: Responded to the peer\\'s first END local0,11,1360071440,fwgate-1: NetScreen device_id=fwgate-1  [Root]sy
stem-information-00536: IKE 153.xxx.xxx.xxx Phase 2 msg ID fe3c6610: Responded to the peer\\'s first"}]}] len 440

Maybe a problem at the end with the Keywords timestamp, source, severity etc ?

Comment by Oleksii Zagorskyi [ 2013 Feb 08 ]

Stefan, there might be a question about correct packet size - a 64-bit number after ZBXD.... and it can be a question to correct calculation at zbxlog size.

Yeah, I know the zbxlog very well (I'm zalex_ua in that forum thread). There might be also question about FreeBSD x32 or x64 ? and is its Perl compiled with x64 support if FreeBSD is x32 ?

Could you check tcpdupm once again and consider precisely the packet size ?
See <DATALEN> here https://www.zabbix.com/documentation/2.0/manual/appendix/items/activepassive

Comment by Stefan Sabolowitsch [ 2013 Feb 08 ]

Hi (Привіт) Oleksiy, thanks for your fast answer.

about your question.

uname -a

FreeBSD zabbix-m01 9.1-RELEASE FreeBSD 9.1-RELEASE #0 r243825: Tue Dec  4 09:23:10 UTC 2012     [email protected]:/usr/obj/usr/src/sys/GENERIC  amd64

perl -v

This is perl 5, version 12, subversion 4 (v5.12.4) built for amd64-freebsd

But this behavior give it also on FreeBSD 32bit (i know, it's not to easy to find out this problem)
packet size / <DATALEN> is vary in length depending on the length of the message.

Comment by Stefan Sabolowitsch [ 2013 Feb 08 ]

JBo (zbxlog developer) wrote a patch to reorders the fields in trapper message so that syslog message is the last one.
This help little, but the value wont wrote in the database.
No values in hystory_log and items (lastvalue) database table

zbxlog logfile:

Zbxlog::Sender::Send item=$VAR1 = [
          'fwgate-1',
          '',
          'syslog[]',
          '134',
          'local0',
          11,
          1360324535,
          'fwgate-1: NetScreen device_id=fwgate-1  [Root]system-information-00536: IKE 153.xxx.xxx.xx Phase 1: Retransmission limit has been
reached. (2013-02-08 12:55:35).'
        ];

Zbxlog::Sender::Send zbx_data={"request":"sender data","data":[{"host":"fwgate-1","key":"syslog[]","timestamp":"1360324535","source":"local0
","severity":"11","eventid":"134","value":"fwgate-1: NetScreen device_id=fwgate-1  [Root]system-information-00536: IKE 153.xxx.xxx.xxx Phase 1
: Retransmission limit has been reached. (2013-02-08 12:55:35).",}]}Zbxlog::Sender::Send response=OK

and here zabbix server logfile:

65021:20130208:125426.256 Trapper got [{"request":"sender data","data":[{"host":"fwgate-1","key":"syslog[]","timestamp":"1360324466","sourc
e":"local0","severity":"11","eventid":"134","value":"fwgate-1: NetScreen device_id=fwgate-1  [Root]system-information-00536: IKE 153.xxx.xxx.
76 Phase 1: Retransmission limit has been reached. (2013-02-08 12:54:26)] len 312




[ZBX-6138] IPMI monitoring with zabbix requires admin privilege level with iLO otherwise connection to failed Created: 2013 Jan 16  Updated: 2017 May 30  Resolved: 2013 Jan 16

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Server (S)
Affects Version/s: 2.0.3
Fix Version/s: None

Type: Incident report Priority: Minor
Reporter: Alexey Pereklad Assignee: Unassigned
Resolution: Duplicate Votes: 0
Labels: freebsd, ipmi
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Zabbix server 2.0.4 works on FreeBSD 8.1-RELEASE-p1, HP Proliant DL380 G5, iLO v.2.12.



 Description   

Can't connect to iLO IPMI with privilege level other than Administrator, while ipmitool works fine with any privilage level. But there is no problem in zabbix to connect with user privilege level to DRAC IPMI interface. There a few posts on forum with the same problem and iLO and no solution (except setting admin level). Looks like this problem specific only for zabbix and iLO.

If I set user level for iLO IPMI connection, I've got red IPMI icon in frontend and error: ""cannot connect to IPMI host: [22] Invalid argument". Also there record in logs like this: "Expected privilege 2, got 4"



 Comments   
Comment by richlv [ 2013 Jan 16 ]

duplicate of ZBX-6077 (a combination of a bug in hp ilo and a bug in openipmi)





[ZBX-5662] keys "vfs.dev.read|write" with ops, bps paremeters cause crash of agent under FreeBSD Created: 2012 Oct 05  Updated: 2017 May 30  Resolved: 2012 Oct 11

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Agent (G)
Affects Version/s: 2.0.1
Fix Version/s: None

Type: Incident report Priority: Blocker
Reporter: Oleksii Zagorskyi Assignee: Unassigned
Resolution: Won't fix Votes: 0
Labels: crash, discs, freebsd
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: Text File freebsd_debug_new_config.txt    
Issue Links:
Duplicate
is duplicated by ZBX-11747 Zabbix proxy is crashing on unreachab... Closed

 Description   

I suppose an implementation of ZBXNEXT-801 caused agent crash under FreeBSD

  1. uname -a
    FreeBSD mon 8.1-RELEASE FreeBSD 8.1-RELEASE #0: Mon Jul 19 02:55:53 UTC 2010 [email protected]:/usr/obj/usr/src/sys/GENERIC i386

Some old compiled agent where the keys worked successfully:

  1. ./zabbix_agentd -V
    Zabbix Agent (daemon) v2.0.0rc3 (revision 26686) (22 March 2012)
    Compilation time: Apr 7 2012 17:43:40
  1. zabbix_get -s localhost -k vfs.dev.write[ad0,ops]
    11.969697

Then some old agent where the problem appeared:

  1. ./zabbix_agentd -V
    Zabbix Agent (daemon) v2.1.0 (revision 28358) (21 May 2012)
    Compilation time: Jun 19 2012 20:20:27

Its debuglog when getting the key:

51584:20121005:160220.675 Starting Zabbix Agent [fbsd]. Zabbix 2.1.0 (revision 28358).
51584:20121005:160220.675 In init_collector_data()
51584:20121005:160220.675 End of init_collector_data()
51585:20121005:160220.676 agent #0 started [collector]
51585:20121005:160220.676 In init_cpu_collector()
51585:20121005:160220.677 End of init_cpu_collector():SUCCEED
51587:20121005:160220.677 agent #2 started [listener]
51585:20121005:160220.677 In update_cpustats()
51585:20121005:160220.677 End of update_cpustats()
51586:20121005:160220.677 agent #1 started [listener]
51588:20121005:160220.677 agent #3 started [listener]
51585:20121005:160221.677 In update_cpustats()
51585:20121005:160221.677 End of update_cpustats()
51585:20121005:160222.678 In update_cpustats()
51585:20121005:160222.678 End of update_cpustats()
51586:20121005:160223.133 Processing request.
51586:20121005:160223.233 Requested [vfs.dev.write[ad0,ops]]
51586:20121005:160223.233 In collector_diskdevice_get() devname:'ad0'
51586:20121005:160223.233 zbx_shmget() removing existing shm_id:655367
zabbix_agentd_2012-08-16_11-52-49 [51586]: cannot remove existing shared memory: [13] Permission denied
51586:20121005:160223.234 cannot allocate shared memory for disk statistics collector
51584:20121005:160223.234 One child process died (PID:51586,exitcode/signal:256). Exiting ...
51584:20121005:160223.234 zbx_on_exit() called
51587:20121005:160223.234 Got signal [signal:15(SIGTERM),sender_pid:51584,sender_uid:122,reason:65537]. Exiting ...
51585:20121005:160223.235 Got signal [signal:15(SIGTERM),sender_pid:51584,sender_uid:122,reason:65537]. Exiting ...
51588:20121005:160223.235 Got signal [signal:15(SIGTERM),sender_pid:51584,sender_uid:122,reason:65537]. Exiting ...
51584:20121005:160225.237 Zabbix Agent stopped. Zabbix 2.1.0 (revision 28358).

Note that you cannot test this crash in current trunk/2.0.3 because another problem ZBX-5661



 Comments   
Comment by Andris Mednis [ 2012 Oct 10 ]

Hi, Oleksiy!
ZBX-5661 is fixed in development branch svn://svn.zabbix.com/branches/dev/ZBX-5661 (I hope so). Can you reproduce this ZBX-5662 with the ZBX-5661 development branch ?

zalex_ua the dev branch tested, the same crash:

 42162:20121011:023834.094 Processing request.
 42162:20121011:023834.194 Requested [vfs.dev.write[ad0,ops]]
 42162:20121011:023834.194 In collector_diskdevice_get() devname:'ad0'
 42162:20121011:023834.194 zbx_shmget() removing existing shm_id:655367
zabbix_agentd [42162]: cannot remove existing shared memory: [13] Permission denied
 42162:20121011:023834.194 cannot allocate shared memory for disk statistics collector
 42160:20121011:023834.195 One child process died (PID:42162,exitcode/signal:256). Exiting ...
 42160:20121011:023834.195 zbx_on_exit() called
 42161:20121011:023834.195 Got signal [signal:15(SIGTERM),sender_pid:42160,sender_uid:122,reason:65537]. Exiting ...
 42163:20121011:023834.195 Got signal [signal:15(SIGTERM),sender_pid:42160,sender_uid:122,reason:65537]. Exiting ...
 42164:20121011:023834.196 Got signal [signal:15(SIGTERM),sender_pid:42160,sender_uid:122,reason:65537]. Exiting ...
 42160:20121011:023836.197 Zabbix Agent stopped. Zabbix 2.0.4rc1 (revision {ZABBIX_REVISION}).
Comment by Oleksii Zagorskyi [ 2012 Oct 11 ]

New testing with changed path to agent's config file attached. The crash disappeared.
After reboot machine the crash disappeared at all.

In attached file you can see all details.

Comment by Andris Mednis [ 2012 Oct 11 ]

Thanks, Oleksiy, for the attached informative file!
This is not a crash, but termination of program when a shared memory segment cannot be created.
It is not specific to FreeBSD and not related to "vfs.dev.read|write" etc.
The symptom are messages in logfile like:
47515:20121011:113942.253 zbx_shmget() removing existing shm_id:655367
zabbix_agentd [47515]: cannot remove existing shared memory: [13] Permission denied

For users:
----------
This can happen in rare cases when Zabbix server or agent is started or some disk statistics is requested from the agent.
One workaround is to copy Zabbix server or agent configuration file to a different location or copy it with a slightly changed name.
For example, copy it from "/usr/local/etc/zabbix_agentd.conf" to "/usr/local/etc/zabbix_agentd.conf-A" (copy, not rename!)
Then start it with the changed config file name:
./zabbix_agentd -c /usr/local/etc/zabbix_agentd_test.conf-A

For developers:
---------------
The reason is using SysV functions for shared memory management and ftok() for generating shared memory segment keys. ftok() uses Zabbix server or agent configuration file path and name in the calculation of key. The produced key value is not guaranteed to be unique, it can be equal to keys already used by other users and applications.
Solution could be replacing SysV shared memory functions with POSIX shared memory (e.g. shm_open()) functions. Registered as ZBXNEXT-1463.





[ZBX-5609] change default disk check in freebsd from hda to da0 Created: 2012 Sep 24  Updated: 2017 May 30  Resolved: 2012 Oct 09

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Agent (G)
Affects Version/s: 2.1.0
Fix Version/s: 2.0.4rc1, 2.1.0

Type: Incident report Priority: Minor
Reporter: Sean Chittenden Assignee: Unassigned
Resolution: Fixed Votes: 0
Labels: agent, freebsd
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD


Attachments: Text File freebsd-agentd-crash.patch    

 Description   

`zabbix_agent -p` crashes on FreeBSD. The attached patch at least prevents the crash, though it doesn't prevent zabbix_agentd from returning prematurely. This patch also includes a small fix for vfs.dev.*. FreeBSD doesn't have hda, it uses da0 (most likely).



 Comments   
Comment by richlv [ 2012 Sep 25 ]

crash is probably a duplicate of ZBX-5473 (already fixed for 2.0.3)

let's leave this issue for changing default disk device

Comment by Alexander Vladishev [ 2012 Sep 26 ]

Yes, crash has been already fixed in ZBX-5473.

Comment by Alexander Vladishev [ 2012 Sep 26 ]

FreeBSD disk organization: http://www.freebsd.org/doc/handbook/disk-organization.html

Disk Device Codes
Code Meaning
ad ATAPI (IDE) disk
da SCSI direct access disk
acd ATAPI (IDE) CDROM
cd SCSI CDROM
fd Floppy disk
Sample Disk, Slice, and Partition Names
Name Meaning
ad0s1a The first partition (a) on the first slice (s1) on the first IDE disk (ad0).
da1s2e The fifth partition (e) on the second slice (s2) on the second SCSI disk (da1).

Use of "da0" will be more logical. It should be corrected.

Comment by Sean Chittenden [ 2012 Sep 26 ]

Correct. Given that almost all disks these days are SAS/SATA and show up as da(4) devices, use of da(4) is correct (vs ada(4)).

Comment by Alexander Vladishev [ 2012 Sep 26 ]

The same problem with OpenBSD.

Related link: http://www.openbsd.org/faq/faq14.html#intro

Code Meaning
wd IDE disks (and devices that look like IDE disks, for example, SATA, MFM or ESDI disks, or a flash device with an appropriate adapter) attached to a wdc(4) or pciide(4) interface.
sd Devices that utilize SCSI commands, such as SCSI disks attached to a SCSI adapter, USB disks, SATA disks attached to an ahci(4) interface, and disk arrays attached to a RAID controller.

"sd0" should be used as example.

Comment by Alexander Vladishev [ 2012 Sep 26 ]

Fixed in the development branch svn://svn.zabbix.com/branches/dev/ZBX-5609 r30371.

Comment by Andris Mednis [ 2012 Sep 28 ]

Successfully tested.

Comment by Alexander Vladishev [ 2012 Oct 03 ]

Fixed in pre-2.0.4 r30504 and pre-2.1.0 (trunk) r30505.

Comment by Sean Chittenden [ 2012 Oct 05 ]

Actually, this doens't crash any more, but the vfs.dev.read and vfs.dev.write are returning not supported, incorrectly.

zabbix_agentd -p | grep vfs.dev
vfs.dev.read [m|ZBX_NOTSUPPORTED]
vfs.dev.write [m|ZBX_NOTSUPPORTED]

But when I run manually:

zabbix_agentd -t 'vfs.dev.read[da0,operations]'
vfs.dev.read[da0,operations] [u|2105562]

It returns the right count. Omitting the second argument, things error out because ops isn't implemented correctly?

zabbix_agentd -t 'vfs.dev.read[da0]'
vfs.dev.read[da0] [m|ZBX_NOTSUPPORTED]

zabbix_agentd -t 'vfs.dev.read[da0,ops]'
vfs.dev.read[da0,ops] [m|ZBX_NOTSUPPORTED]
zabbix_agentd -t 'vfs.dev.read[da0,operations]'
vfs.dev.read[da0,operations] [u|2105641]
zabbix_agentd -t 'vfs.dev.read[da0,bytes]'
vfs.dev.read[da0,bytes] [u|110616835392]
zabbix_agentd -t 'vfs.dev.read[da0,bps]'
vfs.dev.read[da0,bps] [m|ZBX_NOTSUPPORTED]

Could we maybe change the default to be operations and not bps? operations per second is a much more useful metric than the bandwidth transferred, tbh. -sc

Index: src/libs/zbxsysinfo/freebsd/diskio.c
===================================================================
— src/libs/zbxsysinfo/freebsd/diskio.c (revision 30681)
+++ src/libs/zbxsysinfo/freebsd/diskio.c (working copy)
@@ -124,7 +124,7 @@
if (0 != get_param(param, 2, tmp, sizeof(tmp)))
*tmp = '\0';

  • if ('\0' == *tmp || 0 == strcmp(tmp, "bps")) /* default parameter */
    + if ('\0' == *tmp || 0 == strcmp(tmp, "operations")) /* default parameter */
    type = ZBX_DSTAT_TYPE_BPS;
    else if (0 == strcmp(tmp, "ops"))
    type = ZBX_DSTAT_TYPE_OPS;
Comment by Sean Chittenden [ 2012 Oct 05 ]

The second argument needs to be changed in order to be useful to people.

Comment by Alexander Vladishev [ 2012 Oct 08 ]

What version you used?

The crash was fixed under ZBX-5473 in version 2.0.3.
The default arguments for vfs.dev.read/write was fixed in version pre-2.0.4 (not released).

Comment by Sean Chittenden [ 2012 Oct 08 ]

2.0.3, and yes, in 2.0.3 the agent didn't crash, but its default values returned no information.

I haven't tried anything from svn/branches/2.0 yet, but it looks like r30710 of branches/2.0/src/libs/zbxsysinfo/freebsd/diskio.c is still showing "bps" and not operations. Wouldn't it make more sense to have the default operations always be counters and not rates? Requiring state in either the kernel or the agent to yield a rate seems like it should be optional and derived value, but shouldn't replace "truth" in the form of a raw counter.

Comment by Andris Mednis [ 2012 Oct 09 ]

For "zabbix_agentd -p" keys "vfs.dev.read" and "vfs.dev.write" the default parameter was changed to "operations" while fixing this ZBX-5609 (in files src/libs/zbxsysinfo/freebsd/freebsd.c, src/libs/zbxsysinfo/linux/linux.c, src/libs/zbxsysinfo/openbsd/openbsd.c, src/libs/zbxsysinfo/solaris/solaris.c).
For other cases we cannot change current default parameter (e.g. "bps") to "operations" amidst current version, but can discuss it for the next version.





[ZBX-5552] incorrect memory amount for "vm.memory.size[total]" under FreeBSD Created: 2012 Sep 07  Updated: 2017 May 30  Resolved: 2012 Sep 25

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Agent (G)
Affects Version/s: 2.0.0, 2.1.0
Fix Version/s: 2.0.4rc1, 2.1.0

Type: Incident report Priority: Major
Reporter: Oleksii Zagorskyi Assignee: Unassigned
Resolution: Fixed Votes: 0
Labels: freebsd, memory
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD



 Description   

Real memory is 2GB, but:

  1. zabbix_get -s 10.20.0.20 -k vm.memory.size
    2124775424
  2. zabbix_get -s 10.20.0.20 -k vm.memory.size[total]
    23599611904
  3. zabbix_get -s 10.20.0.20 -k system.uname
    FreeBSD mon 8.1-RELEASE FreeBSD 8.1-RELEASE #0: Mon Jul 19 02:55:53 UTC 2010 [email protected]:/usr/obj/usr/src/sys/GENERIC i386
  4. zabbix_get -s 10.20.0.20 -k agent.version
    2.1.0

So, the vm.memory.size[total] is doing something wrong.



 Comments   
Comment by Alexei Vladishev [ 2012 Sep 08 ]

If you have some time, please also test with 2.0.x.

Comment by Oleksii Zagorskyi [ 2012 Sep 11 ]

yes, please, it's the same freebsd box:

# ./zabbix_agentd -V
Zabbix Agent (daemon) v2.0.0 (revision 27675) (21 May 2012)
Compilation time: Aug 21 2012 14:12:03
# ./zabbix_agentd -t vm.memory.size
vm.memory.size                                [u|2124775424]
# ./zabbix_agentd -t vm.memory.size[total]
vm.memory.size[total]                         [u|23599611904]


# ./zabbix_agentd -V
Zabbix Agent (daemon) v2.0.1 (revision 28455) (27 June 2012)
Compilation time: Aug 21 2012 14:10:32
# ./zabbix_agentd -t vm.memory.size
vm.memory.size                                [u|2124775424]
# ./zabbix_agentd -t vm.memory.size[total]
vm.memory.size[total]                         [u|23599611904]


# ./zabbix_agentd -V
Zabbix Agent (daemon) v2.0.2 (revision 29214) (31 July 2012)
Compilation time: Sep 11 2012 00:24:56
# ./zabbix_agentd -t vm.memory.size
vm.memory.size                                [u|2124775424]
# ./zabbix_agentd -t vm.memory.size[total]
vm.memory.size[total]                         [u|23599611904]
Comment by Alexander Vladishev [ 2012 Sep 25 ]

Fixed in the development branch svn://svn.zabbix.com/branches/dev/ZBX-5552

zalex_ua dev branch tested - works fine now.

Andris Can somebody test the fix on 32-bit FreeBSD with more than 4 GB physical memory and a PAE kernel? Or just run "sysctl hw.physmem" command on such system and tell result ?

Comment by Andris Mednis [ 2012 Sep 26 ]

Successfully tested on 32-bit and 64-bit FreeBSD.
Documents
http://web.archiveorange.com/archive/v/2AdLpFn5TYbk0WTHRk3P
http://www.opennet.ru/openforum/vsluhforumID1/93151.html
suggest that even with this fix "vm.memory.size[total]" will be incorrect on 32-bit FreeBSD with PAE kernel and more than 4 GB memory.

Comment by Alexander Vladishev [ 2012 Oct 03 ]

Fixed in pre-2.0.4 r30500 and pre-2.1.0 (trunk) r30501.





[ZBX-5551] zabbix doesn't remove ipv6 socket Created: 2012 Sep 07  Updated: 2019 Aug 28  Resolved: 2019 Aug 28

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Agent (G)
Affects Version/s: 2.0.2
Fix Version/s: None

Type: Incident report Priority: Blocker
Reporter: gescheit Assignee: Unassigned
Resolution: Won't fix Votes: 1
Labels: freebsd, ipv6, patch
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD


Attachments: File fix_ipv6_ZBX5551.diff    

 Description   

If zabbix cant open connection to server i get this situation:
zabbix zabbix_agentd_noc 22920 6* internet6 stream tcp d4e51540
zabbix zabbix_agentd_noc 22920 7* internet6 stream tcp d6b49d20
zabbix zabbix_agentd_noc 22920 8* internet6 stream tcp d6b89d20
zabbix zabbix_agentd_noc 22920 9* internet6 stream tcp d6d67d20
zabbix zabbix_agentd_noc 22920 10* internet6 stream tcp d6cb0000
zabbix zabbix_agentd_noc 22920 11* internet6 stream tcp d6cb2540
zabbix zabbix_agentd_noc 22920 12* internet6 stream tcp d6cd4d20
zabbix zabbix_agentd_noc 22920 13* internet6 stream tcp d6d577e0
zabbix zabbix_agentd_noc 22920 14* internet6 stream tcp d6cb8540
zabbix zabbix_agentd_noc 22920 15* internet6 stream tcp d6c72d20
zabbix zabbix_agentd_noc 22920 16* internet6 stream tcp d6baf2a0
zabbix zabbix_agentd_noc 22920 17* internet6 stream tcp d6d65540
zabbix zabbix_agentd_noc 22920 18* internet6 stream tcp d6b8e7e0
zabbix zabbix_agentd_noc 22920 19* internet6 stream tcp d6d52d20
zabbix zabbix_agentd_noc 22920 20* internet6 stream tcp d6cb77e0
zabbix zabbix_agentd_noc 22920 21* internet6 stream tcp d6c77a80
zabbix zabbix_agentd_noc 22920 22* internet6 stream tcp d6cbcd20
zabbix zabbix_agentd_noc 22920 23* internet6 stream tcp d6c7a7e0
zabbix zabbix_agentd_noc 22920 24* internet6 stream tcp d6d60d20
zabbix zabbix_agentd_noc 22920 25* internet6 stream tcp d6cb97e0
zabbix zabbix_agentd_noc 22920 26* internet6 stream tcp d6bf4000
zabbix zabbix_agentd_noc 22920 27* internet6 stream tcp d6afc2a0
zabbix zabbix_agentd_noc 22920 28* internet6 stream tcp d6cc0a80
zabbix zabbix_agentd_noc 22920 29* internet6 stream tcp d6cbca80
zabbix zabbix_agentd_noc 22920 30* internet6 stream tcp d6d6e000
zabbix zabbix_agentd_noc 22920 31* internet6 stream tcp d6d6b2a0
zabbix zabbix_agentd_noc 22920 32* internet6 stream tcp d6d1e2a0
zabbix zabbix_agentd_noc 22920 33* internet6 stream tcp d6cbba80
zabbix zabbix_agentd_noc 22920 34* internet6 stream tcp d6cbfa80
zabbix zabbix_agentd_noc 22920 35* internet6 stream tcp d6a2a540
zabbix zabbix_agentd_noc 22920 36* internet6 stream tcp d6cba000
zabbix zabbix_agentd_noc 22920 37* internet6 stream tcp d6c787e0
zabbix zabbix_agentd_noc 22920 38* internet6 stream tcp d6c7a540
zabbix zabbix_agentd_noc 22920 39* internet6 stream tcp d6c81a80
zabbix zabbix_agentd_noc 22920 40* internet6 stream tcp d6c71000



 Comments   
Comment by gescheit [ 2012 Sep 07 ]

Also i found problem with SourceIP parameter in agent configuration. Zabbix agent try bind ipv6 socket with IPv4 address from SourceIP

Comment by Alexei Vladishev [ 2012 Sep 08 ]

What command did you use to generate this output? Netstat?

Comment by gescheit [ 2012 Sep 08 ]

This was output of fstat.

sockstat -l -6 -p 10052
USER COMMAND PID FD PROTO LOCAL ADDRESS FOREIGN ADDRESS
zabbix zabbix_age 29572 4 tcp6 :10052 *:
zabbix zabbix_age 29571 4 tcp6 :10052 *:
zabbix zabbix_age 29570 4 tcp6 :10052 *:
zabbix zabbix_age 29569 4 tcp6 :10052 *:
zabbix zabbix_age 29568 4 tcp6 :10052 *:
zabbix zabbix_age 29567 4 tcp6 :10052 *:
zabbix zabbix_age 29566 4 tcp6 :10052 *:
.

Comment by gescheit [ 2012 Sep 08 ]

In log file:
" 62704:20120908:131019.194 Get active checks error: bind() failed: [22] Invalid argument"
In configuration:
PidFile=/var/run/zabbix/zabbix_agentd.pid
LogFile=/var/log/zabbix/zabbix_agentd.log
LogFileSize=10
DebugLevel=4
EnableRemoteCommands=0
Server = server2:10053,server1:10053
ServerActive = server2:10053,server1:10053
RefreshActiveChecks=120
BufferSend=60
BufferSize=100
MaxLinesPerSecond=100
Timeout=30
Include=/usr/local/etc/zabbix_noc/conf.d/
ListenPort=10052
SourceIP=10.0.0.1
% nc -z -6 server1 10053
% nc -z -4 server1 10053
Connection to server1 10053 port [tcp/*] succeeded!

Comment by gescheit [ 2012 Sep 16 ]

Check patch in attachment. Description:
fix af_type in source address check(if HAVE_IPV6)
zbx_tcp_connect now try to connect to all IP(4 and 6) addresses from given hostname(if HAVE_IPV6)
close socket if unable to bind it(freebsd dont close it) (if HAVE_IPV6)
more debug messages

Comment by richlv [ 2013 Jul 19 ]

ipv6 related issues that might be dupes or at least should be considered/fixed together :

ZBX-2568
ZBX-3549
ZBX-3879
ZBX-4252
ZBX-5551
ZBX-6536
ZBX-6591
ZBX-6807

Comment by Vladislavs Boborikins (Inactive) [ 2019 Aug 28 ]

Hello,

Since this version of Zabbix is no longer supported, we've decided not to prioritize this bug for the near future and close the issue with "Won't fix" resolution.

Please let us know if this decision should be reconsidered.

Regards
Vladislavs





[ZBX-5473] Zabbix agent crash under FreeBSD when start it with "-p" Created: 2012 Aug 21  Updated: 2017 May 30  Resolved: 2012 Aug 30

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Agent (G)
Affects Version/s: 2.0.1
Fix Version/s: 2.0.3rc1, 2.1.0

Type: Incident report Priority: Major
Reporter: Oleksii Zagorskyi Assignee: Unassigned
Resolution: Fixed Votes: 0
Labels: crash, freebsd
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD 8.1, 9.0



 Description   

Reported in forum (in Russian) http://www.zabbix.com/forum/showthread.php?p=107384

Affected agent version: 2.0.1
Version 2.0.0 is OK

test# zabbix_agentd -p
agent.hostname [s|test.dom]
...
vfs.fs.discovery [s|{
"data":[
{
"

{#FSNAME}":"\/",
"{#FSTYPE}":"ufs"},
{
"{#FSNAME}

":"\/dev",
"

{#FSTYPE}":"devfs"},
{
"{#FSNAME}":"\/tmp",
"{#FSTYPE}

":"ufs"},
{
"

{#FSNAME}":"\/usr",
"{#FSTYPE}":"ufs"},
{
"{#FSNAME}

":"\/var",
"

{#FSTYPE}":"ufs"},
{
"{#FSNAME}":"\/files",
"{#FSTYPE}

":"ufs"},
{
"

{#FSNAME}

":"\/home",
"

{#FSTYPE}

":"ufs"},]}]
Segmentation fault (core dumped)



 Comments   
Comment by Alexei Vladishev [ 2012 Aug 28 ]

I confirm this problem under FreeBSD 8.2 386 and Ubuntu 12.04 32bit. Also:

FreeBSD:
zabbix_agentd -t vfs.dev.read
Segmentation fault (core dumped)

Ubuntu:
zabbix_agentd -t vfs.dev.read
Segmentation fault (core dumped)

Comment by Alexei Vladishev [ 2012 Aug 28 ]

It seems that the problem is in diskstat_shm_init(), which does

if (1 == (collector>diskstat_shmid = zbx_shmget(shm_key, shm_size)))

but the collector is not initialized, so the line causes code dump.

Function vfs_dev_rw() calls collector_diskdevice_get(), which tries to initialize data if collector is not started:

if (0 == DISKDEVICE_COLLECTOR_STARTED(collector))

{ diskstat_shm_init(); // Here is the problem. The function assumed that collector structure is initialized, see above. }

else

{ diskstat_shm_reattach(); }
Comment by richlv [ 2012 Aug 29 ]

segfaults in ZBX-5502 might be related

Comment by Alexander Vladishev [ 2012 Aug 30 ]

Fixed in the development branch svn://svn.zabbix.com/branches/dev/ZBX-5473

<zalex> successfully tested on fbsd 8.1

Comment by dimir [ 2012 Sep 05 ]

Successfully tested. Please review my small change in r30114.

<Sasha> Thanks, CLOSED

Comment by Alexander Vladishev [ 2012 Sep 05 ]

Fixed in pre-2.0.3 r30117 and pre-2.1.0 (trunk) r30118.

Comment by Oleksii Zagorskyi [ 2012 Oct 05 ]

This change caused another problem - ZBX-5661





[ZBX-4704] proc.num shows threads under FreeBSD Created: 2012 Feb 27  Updated: 2017 May 30  Resolved: 2012 Mar 29

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Agent (G)
Affects Version/s: 1.8.10
Fix Version/s: None

Type: Incident report Priority: Major
Reporter: Pavel Timofeev Assignee: Unassigned
Resolution: Duplicate Votes: 0
Labels: agent, freebsd, process, thread
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD


Issue Links:
Duplicate
duplicates ZBX-3897 proc.num show incorrect data under Fr... Closed

 Description   

proc.num item always returns number of threads instead of number of processes under FreeBSD.
Always. There is no way to get process number value.



 Comments   
Comment by Oleksii Zagorskyi [ 2012 Feb 28 ]

related issue ZBX-3897

Comment by Jim Riggs [ 2012 Mar 28 ]

I just attached a patch to ZBX-3897. This should probably be closed as a duplicate.

Comment by richlv [ 2012 Mar 29 ]

thanks, closing as a duplicate then





[ZBX-4469] Freebsd "net.if.in"and"net.if.out" bug Created: 2011 Dec 20  Updated: 2017 May 30  Resolved: 2017 May 09

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Agent (G)
Affects Version/s: 1.8.9
Fix Version/s: None

Type: Incident report Priority: Major
Reporter: Chen Zhu Assignee: Unassigned
Resolution: Cannot Reproduce Votes: 0
Labels: freebsd
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD 7.2/8.0/8.1 OS Distribution involved.


Attachments: File config.bmp     File netif.bmp     File outgoing.bmp     File switch.bmp    

 Description   

By using monitor key "net.if.out[igb0,bytes]" to get traffic information on 1000-Mbps NIC , the return max value is more than 1Gbps , Is there any reason why the value is more than 1Gbps ? please let me know if some reason cause it.



 Comments   
Comment by richlv [ 2011 Dec 20 ]

most likely that is what the interface returns. you can try getting values with zabbix_get and normal system tools - if you compare the counter values, do they match ?

Comment by Chen Zhu [ 2011 Dec 21 ]

Compared with Switch traffic flow and return data by issuing iftop command in FreeBSD , both of them are not overflow 1Gbps. Sectional graph seeing attach files

Comment by Aleksandrs Saveljevs [ 2016 Feb 02 ]

I have tried reproducing the issue on a 32-bit FreeBSD 7.3 with Zabbix 1.8.9 and Zabbix 3.0.0beta2. They both show the correct same result and exactly at the NIC limit.

Is this issue still relevant for you?

Comment by Alexander Vladishev [ 2017 May 09 ]

No information from reporter. I close this issue as "Cannot reproduce".





[ZBX-4461] init scripts need minor modification to be used 'as is' for FreeBSD 8.2 Created: 2011 Dec 16  Updated: 2017 May 30  Resolved: 2011 Dec 30

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Installation (I)
Affects Version/s: 1.8.10
Fix Version/s: 1.8.11

Type: Incident report Priority: Trivial
Reporter: Thomas Berton Assignee: Unassigned
Resolution: Fixed Votes: 0
Labels: freebsd, initscripts
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD 8.2



 Description   

By default on FreeBSD 8.2 zabbix_server and zabbix_agentd are installed in /usr/local/sbin . To use the init scripts provided in zabbix/misc/init.d/freebsd I had to change the command variable in those scripts to look for the binaries in the sbin directory instead of the bin directory.



 Comments   
Comment by richlv [ 2011 Dec 30 ]

fixed in r24456 for 1.8 and r24457 for trunk





[ZBX-4419] Missing memory items FreeBSD 8.2 Created: 2011 Dec 06  Updated: 2017 May 30  Resolved: 2011 Dec 07

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Agent (G)
Affects Version/s: 1.9.8 (beta)
Fix Version/s: None

Type: Incident report Priority: Major
Reporter: Marcin Gapiński Assignee: Unassigned
Resolution: Duplicate Votes: 0
Labels: agent, freebsd, item
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD 8.2


Issue Links:
Duplicate
duplicates ZBXNEXT-1024 Add/delete some modes for vm.memory.s... Closed

 Description   

Documentation states that the following item keys are supported in FreeBSD, but unfortunately not all are:

Parameter vm.memory.size[total]:
250236928
Parameter vm.memory.size[active]:
ZBX_NOTSUPPORTED
Parameter vm.memory.size[buffers]:
ZBX_NOTSUPPORTED
Parameter vm.memory.size[cached]:
3358720
Parameter vm.memory.size[free]:
9109504
Parameter vm.memory.size[inactive]:
ZBX_NOTSUPPORTED
Parameter vm.memory.size[shared]:
34516992
Parameter vm.memory.size[wired]:
ZBX_NOTSUPPORTED
Parameter vm.memory.size[used]:
241127424
Parameter vm.memory.size[pused]:
96.359648
Parameter vm.memory.size[available]:
ZBX_NOTSUPPORTED
Parameter vm.memory.size[pavailable]:
ZBX_NOTSUPPORTED



 Comments   
Comment by richlv [ 2011 Dec 07 ]

that's work in progress - please, see ZBXNEXT-1024
help with testing that development branch appreciated

Comment by Marcin Gapiński [ 2011 Dec 07 ]

In that case I apologize for creating unnecessary issue, it didn't occur to me to search in the feature requests because of the documentation

Comment by richlv [ 2011 Dec 07 ]

yeah, documentation has been updated as part of that development, but the actual code changes have not been finalised yet





[ZBX-4360] Server from trunk will not compile on FreeBSD 7.3 Created: 2011 Nov 17  Updated: 2017 May 30  Resolved: 2012 Jun 13

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Installation (I)
Affects Version/s: 1.9.8 (beta)
Fix Version/s: 1.8.10, 1.9.8 (beta)

Type: Incident report Priority: Trivial
Reporter: dimir Assignee: dimir
Resolution: Fixed Votes: 0
Labels: compilation, freebsd
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD 7.3-RELEASE FreeBSD 7.3-RELEASE #0: Sun Mar 21 06:15:01 UTC 2010 [email protected]:/usr/obj/usr/src/sys/GENERIC i386



 Description   

Server compilation fails with error while trying to compile trapper:

[...]
gcc -DHAVE_CONFIG_H -I. -I../../../include -g -O2 -I/usr/local/include/mysql -fno-strict-aliasing -pipe -I/usr/local/include -MT nodehistory.o -MD -MP -MF .deps/nodehistory.Tpo -c -o nodehistory.o nodehistory.c
In file included from nodehistory.h:24,
from nodehistory.c:23:
../../../include/comms.h:121: error: expected '=', ',', ';', 'asm' or '_attribute_' before 'zbx_tcp_recv_ext'

      • Error code 1
        [...]

The problem is that "ssize_t" type is not recognized in comms.h in line:

ssize_t zbx_tcp_recv_ext(zbx_sock_t *s, char **data, unsigned char flags, int timeout);

Including <unistd.h> fixed the problem.

Steps to reproduce:
1) checkout trunk
2) enter trunk directory
3) run: ./bootstrap.sh && ./configure --enable-server --with-mysql && make dbschema > /dev/null && make >/dev/null
4) observer compilation error message



 Comments   
Comment by dimir [ 2011 Nov 17 ]

Set Fix Version/s.

Comment by dimir [ 2011 Nov 17 ]

Fixed in pre-1.9.8 r23322 .

Comment by dimir [ 2011 Nov 17 ]

Fixed in development branch svn://svn.zabbix.com/branches/dev/ZBX-4360 .

Comment by dimir [ 2011 Nov 22 ]

Fixed in pre-1.8.10 r23415 .





[ZBX-3897] proc.num show incorrect data under FreeBSD Created: 2011 Jun 19  Updated: 2017 May 30  Resolved: 2012 May 09

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Agent (G)
Affects Version/s: 1.8.5
Fix Version/s: 1.8.14rc1, 2.0.1rc1, 2.1.0

Type: Incident report Priority: Major
Reporter: gescheit Assignee: Unassigned
Resolution: Fixed Votes: 4
Labels: freebsd
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD


Attachments: Text File proc.c+vsz.patch     Text File proc.c.patch    
Issue Links:
Duplicate
is duplicated by ZBX-4704 proc.num shows threads under FreeBSD Closed

 Description   

proc.num show incorrect data under FreeBSD. Example:

ps ax|wc -l
59

zabbix_agentd -t proc.num[]
proc.num[] [u|127]



 Comments   
Comment by Oleksii Zagorskyi [ 2011 Jun 19 ]

Several users can confirm the same: http://www.zabbix.com/forum/showthread.php?t=22322
I'm too.

Comment by Alexander Vladishev [ 2011 Jun 20 ]

Confirmed in version pre1.8.6, r20279.

Comment by Ya Bo [ 2012 Feb 11 ]

FreeBSD 9.0, zabbix-agent-1.8.10,2

zabbix-1.8.10/src/libs/zbxsysinfo/freebsd/proc.c
#if(__FreeBSD_version > 500000)
if (proc[i].ki_flag & P_KTHREAD) /* skip a system thread */
continue;
#endif

не работает, в результате имеем +системные треды

Comment by Oleksii Zagorskyi [ 2012 Feb 28 ]

related issue ZBX-4704

Comment by Jim Riggs [ 2012 Mar 28 ]

Please try the attached patch. It correctly calls sysctl() for proc.num and proc.mem with KERN_PROC_PROC instead of KERN_PROC_ALL for FreeBSD 5 and later. (Is this check really necessary anymore? Is < v5 supported?)

This has fixed the issue in my environment.

Comment by Ya Bo [ 2012 Mar 29 ]

FreeBSD 8.3-PRERELEASE
zabbix-agent-1.8.10_1,2

confirm, patch is good

Comment by Pavel Timofeev [ 2012 Mar 29 ]

thanks to Jim! proc.num work on FreeBSD 9.0-RELEASE amd64.

But I can't decide about proc.mem. Which unit does proc.mem return? Kbytes, bytes, etc.? Documentation didn't help=(

Comment by richlv [ 2012 Mar 30 ]

regarding documentation, could you please open another issue (documentation component) ?
thanks

Comment by Pavel Timofeev [ 2012 Apr 03 ]

2 richlv: https://support.zabbix.com/browse/ZBX-4831

Comment by Pavel Timofeev [ 2012 Apr 03 ]

Jim, does proc.mem work for you?

Comment by Pavel Timofeev [ 2012 Apr 03 ]

Jim's patch applied
[root@octans ]# ps -axo vsz,rss,command | grep syslogd
12184 1340 /usr/sbin/syslogd -s
[root@octans ]# zabbix_get -s octans -I 192.168.2.6 -k 'proc.mem[syslogd]'
2232320

2232320 Bytes = 2180 KBytes but != 12184 KBytes or 1340 KBytes returned by ps

Comment by Jim Riggs [ 2012 Apr 25 ]

The "memory usage" of a process is a controversial and subjective topic. There are many different views about what actually constitutes a proc's memory usage.

Currently, the zabbix code is using text size + data size + stack size for proc.mem (ki_tsize + ki_dsize + ki_ssize), whereas `top' and `ps' display resident size (ki_rssize) and VM size (ki_size). This is why the values from zabbix vs. top and ps are different. I would think that to eliminate confusion and to make the zabbix value more "verifiable," we should probably switch to using ki_rssize.

Thoughts? What are other OSes doing? I haven't dug into the linux code, for example.

Comment by richlv [ 2012 Apr 26 ]

i suppose we will want to match some value(s) from standard tools like ps if only to reduce the confusion - as noted, there is no definite "used memory" value, it's all quite relative.

Comment by Jim Riggs [ 2012 Apr 26 ]

Attached is proc.c+rss.patch which includes the original patch plus a switch to using the resident size for proc.mem as discussed. This works for me in FreeBSD 8 and 9 for single and multiple processes.

It would be nice to get these issues fixed sooner rather than later, if possible. The proc.num issue, specifically, has been causing problems for quite some time.

Comment by Jim Riggs [ 2012 Apr 26 ]

I guess the question still remains, is resident size what people expect from proc.mem or VM size? Resident is closer to what the value was before, but VM size might give a better picture of actual memory footprint.

Hrm. Looking at the Linux agent, it is pulling the VM size (vsz). We should probably match. New patch coming...

Comment by Jim Riggs [ 2012 Apr 26 ]

OK, proc.c+vsz.patch should be good to go. Original patch to fix proc.num + vsize patch to "fix" proc.mem on FreeBSD. Tested on FreeBSD 8 and 9.

Comment by Oleksii Zagorskyi [ 2012 Apr 26 ]

Jim, I'm sorry, it's not related to proc.mem, but do you know about changes for agent 2.0 ?
http://blog.zabbix.com/when-alexei-isnt-looking/#vm.memory.size implemented here: ZBXNEXT-1024
Would be good to follow latest ideology

I think would be better to not mix here discussion about proc.num and proc.mem

Also see ZBXNEXT-1078 and ZBX-4532

Comment by Pavel Timofeev [ 2012 Apr 26 ]

Oleksiy Zagorskyi, ZBXNEXT-1024 is not relative feature/fix. ZBXNEXT-1024 is on a different plane.

Comment by Pavel Timofeev [ 2012 Apr 26 ]

> Jim Riggs added a comment - 2012 Apr 26 07:07
> OK, proc.c+vsz.patch should be good to go. Original patch to fix proc.num + vsize patch to "fix" proc.mem on FreeBSD. Tested on FreeBSD 8 and 9.

Excellent, Jim! Patch works fine on FreeBSD 9-RELEASE amd64. I hope this patch will be included in the nearest release.

Comment by Alexander Vladishev [ 2012 May 09 ]

Fixed in the development branch svn://svn.zabbix.com/branches/dev/ZBX-3897

Fixed incorrect processing of proc.num[] item.
proc.mem[] item will be fixed later under ZBXNEXT-1078 or ZBX-4532.

Comment by dimir [ 2012 May 14 ]

I wonder why do I get less processes with zabbix get on FreeBSD 7.3. I tried 1.8.5, latest 1.8 with and without the fix:

$ uname -a
FreeBSD freebsd73.zabbix.com 7.3-RELEASE FreeBSD 7.3-RELEASE #0: Sun Mar 21 06:15:01 UTC 2010 [email protected]:/usr/obj/usr/src/sys/GENERIC i386

$ ps ax|wc -l
81

$ bin/zabbix_get -s 127.0.0.1 -k agent.version
1.8.5
$ bin/zabbix_get -s 127.0.0.1 -k proc.num[]
39

$ bin/zabbix_get -s 127.0.0.1 -k agent.version
1.8.13rc1

  1. without the fix
    $ bin/zabbix_get -s 127.0.0.1 -k proc.num[]
    39
  2. with the fix
    $ bin/zabbix_get -s 127.0.0.1 -k proc.num[]
    39
Comment by dimir [ 2012 May 14 ]

It appeared to be a problem on my side, please ignore the comment above.

Comment by dimir [ 2012 May 14 ]

Successfully tested, now the number of processes is reported properly.

Comment by Alexander Vladishev [ 2012 May 15 ]

Fixed in versions pre-1.8.14 r27534, pre-2.0.1 r27689, pre-2.1.0 (beta) r27694





[ZBX-3475] Compilation error --with-sqlite3 on FreeBSD Created: 2011 Jan 28  Updated: 2017 May 30  Resolved: 2012 Jan 30

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Server (S)
Affects Version/s: 1.9.2 (alpha)
Fix Version/s: 1.8.11, 1.9.9 (beta)

Type: Incident report Priority: Minor
Reporter: Oleksii Zagorskyi Assignee: Unassigned
Resolution: Fixed Votes: 0
Labels: freebsd
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD8.1
pkg_info | grep sqlite
php5-pdo_sqlite-5.3.5 The pdo_sqlite shared extension for php
php5-sqlite-5.3.5 The sqlite shared extension for php
py26-pysqlite-2.3.5 A DB-API v2 Python library for the SQLite 3 embedded SQL en
sqlite3-3.7.4 An SQL database engine in a C library


Attachments: File ax_lib_sqlite3.m4.diff    
Issue Links:
Duplicate
is duplicated by ZBX-4535 zabbix - FTBFS with ld --as-needed Closed

 Description   

If i configure --with-sqlite3 then:
checking for SQLite3 library >= 3.0.0... no
configure: error: SQLite3 library not found

If i configure --with-sqlite3=/usr/local then:
checking for SQLite3 library >= 3.0.0... yes
checking for function sqlite3_open_v2() in sqlite3.h... yes

It seems need to improve SQLite3 checking in the different OS.

p.s.zabbix_server (--with-sqlite3=/usr/local) starts and works normally with the sqlite3 db-backend.



 Comments   
Comment by Alexei Vladishev [ 2011 Jan 28 ]

Sorry, but I do not see any issues here. Why blocker?

Check for the SQLite3 library is done in exactly the same way as, for example, check for PostgreSQL library. We do not look at any OS specific directories.

I am closing it.

Comment by Oleksii Zagorskyi [ 2011 Jan 30 ]

he-he, the game is NOT over.
why blocker - because of compilation error .
Probably my knowledge is not great as your Alexei, but I'm single-minded and partially crazy .

I'm not agree that "/usr/local" is a specific directory. It's prefix-path, where installed all software under FreeBSD and maybe not only - i don't know.
And for example you're not right about <We do not look at any OS specific directories> - see to the "libssh2.m4". This macro try to check several paths and it authors are two Zabbix developers.

Okay enough talk, take my very simple patch "ax_lib_sqlite3.m4.diff"

A source info here:
http://git.savannah.gnu.org/gitweb/?p=autoconf-archive.git;a=commitdiff;h=cf19f0cc2e2b52c025063354c9cfd91ea0bf8fdf;hp=05f057531dfd0308c9892df4913c92101196ad18

Well, after figure out of the source code and manuals of auto**** stuff I see that static linking is not provided - and really I can't compile with --enable-static flag. Check it out and apparently it also should to be fixed.

Comment by Alexei Vladishev [ 2011 Jan 31 ]

All right, I agree that it shouldn't be closed. Let's keep it open, priority was changed to Minor.

Comment by Alexander Vladishev [ 2012 Jan 30 ]

Fixed in versions pre-1.8.11 r25085 and pre-1.9.9 r25087. See ZBX-4535 for more details.





[ZBX-2966] negative value vfs.fs.size amount of free space on partition Created: 2010 Aug 31  Updated: 2017 May 30  Resolved: 2015 Nov 13

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Agent (G)
Affects Version/s: 1.8.3
Fix Version/s: 3.0.0alpha4

Type: Incident report Priority: Major
Reporter: rootd Assignee: Unassigned
Resolution: Fixed Votes: 9
Labels: agent, freebsd
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD 8.1 RELEASE


Attachments: JPEG File 2010-08-31_170544.jpg     JPEG File 2010-08-31_170614.jpg     File zabbix-2.4.6-negative-vfs-fs-size.patch    
Issue Links:
Duplicate
is duplicated by ZBX-3388 Partition size lower than 0 show as 1... Closed
is duplicated by ZBX-9482 %Used overflow on RAID ~80TB Closed

 Description   

When there is no space left on a partition, FreeBSD has a negative space available,
As a result, the value vfs.fs.size out of range, and takes great importance. As a result, did not trigger. The problem is there. No alerts.

See screenshots....



 Comments   
Comment by Frank Wall [ 2011 Feb 22 ]

I have the same problem. It does NOT appear with FreeBSD 7.1, but after upgrading to FreeBSD 7.3 I ran into the same issue. The Zabbix Frontend shows 16 EB free disk space, while it actually is 0 Bytes (or in FreeBSD notation: -40 MB).

Comment by Ilyas [ 2011 Apr 19 ]

The problem affects also vfs.fs.size[/somepath,pfree] and vfs.fs.size[/somepath,pused].
Seems like bug which following monitoring to unusable state.

[[email protected]]# zabbix_get -s zbxagent.local -k 'vfs.fs.size["/mnt/disk",pused]'
-2090496434960.400879
[[email protected]]# zabbix_get -s zbxagent.local -k 'vfs.fs.size["/mnt/disk",pfree]'
2090496435060.400879

[[email protected] ~]# df -h | grep /mnt/disk
/dev/ufs/yaj13pgx 1.8T 1.7T -7.0G 100% /mnt/disk

In our cluster we have above 500 hard drives for first time and its count continuously growing.

There is more one trouble looks like (cut from zabbix_server.log):
92667:20110419:084334.369 Item [zbxagent.local:vfs.fs.size["/mnt/ybj0beyd",used]] error: Received value [1313742694400.000000] is not suitable for value type [Numeric (float)]
92662:20110419:084339.394 Item [zbxagent.local:vfs.fs.size["/mnt/yaj0gkjx",used]] error: Received value [1803575007232.000000] is not suitable for value type [Numeric (float)]
92664:20110419:084344.422 Item [zbxagent.local:vfs.fs.size["/mnt/yaj13pgx",used]] error: Received value [1814660216832.000000] is not suitable for value type [Numeric (float)]

Agent and server both:
Zabbix Agent v1.9.3 (revision 18740) (28 March 2011)
Zabbix Agent v1.9.3 (revision 18740) (28 March 2011)

(yes, we're ugins auto discovery for filesystems)

OS is FreeBSD 8.2-STABLE.

Comment by Ilyas [ 2011 Apr 19 ]

Oh, I forget write, we using 2TB hard drives.

Yes, if you could provide patches I run zabbix with its.

Comment by Alexander Vladishev [ 2013 Feb 17 ]

Related issues: ZBX-1274, ZBX-5804

Comment by Sap [ 2013 Mar 15 ]

Same problem

FreeBSD 8.2-RELEASE #0: Fri Feb 18 02:24:46 UTC 2011

# zabbix_agent -V
Zabbix Agent v1.8.3 (revision 13928) (16 August 2010)
Compilation time: Dec 13 2010 22:12:16

# df -h
Filesystem     Size    Used   Avail Capacity  Mounted on
/dev/ad0s1a    4.5G    4.1G    -27M   101%    /
devfs          1.0K    1.0K      0B   100%    /dev

# zabbix_agent -t 'vfs.fs.size[/,pfree]'
vfs.fs.size[]                                 [d|854069308670196.500000]

After remove some files to free space:

# df -h
Filesystem     Size    Used   Avail Capacity  Mounted on
/dev/ad0s1a    4.5G    3.7G    418M    90%    /
devfs          1.0K    1.0K      0B   100%    /dev

# zabbix_agent -t 'vfs.fs.size[/,pfree]'
vfs.fs.size[]                                 [d|9.916499]

-------
And most important: zabbix item got big number and switched to "Not avaliable state", so I never be informed about this issue.

Comment by Riaan Olivier [ 2013 Jun 03 ]

Got the same issue on FreeBSD 7.3 and 8.1

# zabbix_agent -V
Zabbix agent v2.0.5 (revision 33558) (12 February 2013)
Compilation time: Apr 12 2013 11:05:51
# df -h
Filesystem            Size    Used   Avail Capacity  Mounted on
/dev/mirror/gm0s1f    1.9G    1.9G   -158M   109%    /var
# zabbix_agentd -t "vfs.fs.size[/var,free]"
vfs.fs.size[/var,free][/var,free]             [u|18446744073544177664]

# zabbix_agentd -t "vfs.fs.size[/var,pfree]"
vfs.fs.size[/var,pfree][/var,pfree]           [d|1979319602661605.750000]

Can we request for this to be fixed as soon as possible, because it causes triggers to be missed and downtime on production environments.

Comment by Aleksandrs Saveljevs [ 2015 Mar 09 ]

Taking FreeBSD code in src/libs/zbxsysinfo/freebsd/diskspace.c as an example, below is the status of the current implementation, which seems to have remained unchanged since Zabbix 1.7. There are no comments regarding the implementation, but it seems that it was written with the intention to mimic df output.

Our code is as follows, supplemented with comments in each conditional describing the corresponding output in df, according to df source code at https://www.gitorious.org/freebsd/freebsd-head/source/214589d0d7e189b66514f6098f7c2a2c9b61dd87:bin/df/df.c#L239 :

#ifdef HAVE_SYS_STATVFS_H
#	define ZBX_STATFS	statvfs
#	define ZBX_BSIZE	f_frsize
#else
#	define ZBX_STATFS	statfs
#	define ZBX_BSIZE	f_bsize
#endif

struct ZBX_STATFS	s;

if (0 != ZBX_STATFS(fs, &s))
	return SYSINFO_RET_FAIL;

// uint64_t   f_blocks;	     /*	total data blocks in filesystem	*/
// uint64_t   f_bfree;	     /*	free blocks in filesystem */
// (u)int64_t f_bavail;	     /*	free blocks avail to non-superuser */

if (NULL != total)
{
	// Size:
	// f_blocks

	*total = (zbx_uint64_t)s.f_blocks * s.ZBX_BSIZE;
}

if (NULL != free)
{
	// Avail:
	// f_avail

	*free = (zbx_uint64_t)s.f_bavail * s.ZBX_BSIZE;
}

if (NULL != used)
{
	// Used:
	// f_blocks - f_bfree

	*used = (zbx_uint64_t)(s.f_blocks - s.f_bfree) * s.ZBX_BSIZE;
}

if (NULL != pfree)
{
	if (0 != s.f_blocks - s.f_bfree + s.f_bavail)
		*pfree = (double)(100.0 * s.f_bavail) / (s.f_blocks - s.f_bfree + s.f_bavail);
	else
		*pfree = 0;
}

if (NULL != pused)
{
	// Capacity:
	// (f_blocks - f_bfree) / (f_blocks - f_bfree + f_avail)

	if (0 != s.f_blocks - s.f_bfree + s.f_bavail)
		*pused = 100.0 - (double)(100.0 * s.f_bavail) / (s.f_blocks - s.f_bfree + s.f_bavail);
	else
		*pused = 0;
}

There are several things to note:

  • In our code, "pfree" is not the same as "free" / "total" and "pused" is not the same as "used" / "total".
  • "total", "free", "used" coincide with df output fields "Size", "Avail", "Used".
  • "pfree" does not have a corresponding field in df.
  • "pused" is different from "Capacity" field in df.
  • If statvfs() is used, "f_bavail" is unsigned. If statfs() is used, "f_bavail" is signed.
  • If statvfs() is used, even though "f_bavail" is unsigned, the value stored there may be a negative integer:
    # df -h
    Filesystem    Size    Used   Avail Capacity  Mounted on
    /dev/da0p2    3.7G    3.4G    -28M   101%    /
    devfs         1.0k    1.0k      0B   100%    /dev
    

    This output corresponds to "f_avail" of -7208, even though the field itself is unsigned.

Comment by Aleksandrs Saveljevs [ 2015 Mar 09 ]

Some of the complications with mimicking df are described above. Here is another one: if we wish "free" to return a negative value as in df, then we have to make it return a float if "f_bavail" is negative. However, we still have to return an unsigned integer in case "f_bavail" is non-negative, because our floats are only limited to 10^12 and this value is too low for modern drives.

This would be good enough for "zabbix_get", but it is of no use for Zabbix server: it is not possible for an item to accept both large unsigned integers and negative values. Therefore, an item will become unsupported in case "free" is negative.

One solution is to let it be and offer users to trigger based on "pfree" (which we shall also fix to return negative percentage) instead of "free": it is a floating-point item and should always work. Item "free" will then remain unreliable for triggering.

Another solution would be to abandon the idea of mimicking df behavior, but the changes in 1.7 were made specifically to look like df. Going back might not be an option.

Comment by Aleksandrs Saveljevs [ 2015 Jun 04 ]

Specification is necessary before proceeding with development.

Comment by dimir [ 2015 Oct 28 ]

Man tunefs

-m minfree
             Specify the percentage of space held back from normal users; the
             minimum free space threshold.  The default value used is 8%.
             Note that lowering the threshold can adversely affect performance:

             o   Settings of 5% and less force space optimization to always be
                 used which will greatly increase the overhead for file
                 writes.

             o   The file system's ability to avoid fragmentation will be
                 reduced when the total free space, including the reserve,
                 drops below 15%.  As free space approaches zero, throughput
                 can degrade by up to a factor of three over the performance
                 obtained at a 10% threshold.

             If the value is raised above the current usage level, users will
             be unable to allocate files until enough files have been deleted
             to get under the higher threshold

So, there is a reserved disk space that is available to root but not others. And when this reserved space is hit the value of available space becomes negative:

[build@freebsd73 ~]$ df -h /
Filesystem     Size    Used   Avail Capacity  Mounted on
/dev/da0s1a    1.7G    1.6G    -12K   100%    /

[build@freebsd73 ~]$ whoami
build

[build@freebsd73 ~]$ pwd
/home/build

[build@freebsd73 ~]$ echo foo > foo
/: write failed, filesystem is full
-bash: echo: write error: No space left on device

[build@freebsd73 ~]$ su  
Password:

[root@freebsd73 /home/build]# whoami
root

[root@freebsd73 /home/build]# pwd
/home/build

[root@freebsd73 /home/build]# echo foo > foo

[root@freebsd73 /home/build]# cat foo 
foo
[root@freebsd73 /home/build]# uname -a
FreeBSD freebsd73 7.3-RELEASE FreeBSD 7.3-RELEASE #0: Sun Mar 21 06:15:01 UTC 2010     [email protected]:/usr/obj/usr/src/sys/GENERIC  i386
Comment by dimir [ 2015 Oct 30 ]

For FreeBSD we have 2 options how to get filesystem data:

  • statfs
  • statvfs

The decision is made at compile time and statvfs() is preferable. Here's a snippet from statvfs man page

IMPLEMENTATION NOTES
     The statvfs() and fstatvfs() functions are implemented as wrappers around
     the statfs() and fstatfs()	functions, respectively.  Not all the informa-
     tion provided by those functions is made available	through	this inter-
     face.

There is a difference in statfs and statvfs structures which makes it impossible to detect negative value when using statvfs:

struct statfs {
     [...]
     int64_t  f_bavail;		     /*	free blocks avail to non-superuser */
     [...]
}
---------------------------------------------------------------------------------------------------------------
typedef __uint64_t __fsblkcnt_t;
typedef __fsblkcnt_t fsblkcnt_t;
struct statvfs {
     [...]
     fsblkcnt_t f_bavail;
     [...]
}

So, seems that when using statvfs we loose the signedness of filesystem sizes which makes it impossible for us to detect it. Using statfs we can get the negative value.

Comment by dimir [ 2015 Oct 30 ]

Too bad I missed same things already mentioned by asaveljevs.

Comment by dimir [ 2015 Oct 30 ]

We just had an internal discussion and it was decided that in this case we should detect negative size and change it to 0 (zero). We thought from a user perspective this would be the most convenient decision.

Comment by dimir [ 2015 Nov 04 ]

Fixed in development branch svn://svn.zabbix.com/branches/dev/ZBX-2966 .

Comment by Andris Zeila [ 2015 Nov 06 ]

Successfully tested, please review minor changes in r56581

Comment by dimir [ 2015 Nov 06 ]

(1) [G] Moved ZBX_IS_TOP_BIT_SET macro sysinfo.h -> zbxtypes.h , please check.

wiper CLOSED, please review another improvement in ZBX_IS_TOP_BIT_SET macro r56583

Comment by dimir [ 2015 Nov 06 ]

The fix will only be available for trunk (3.0).

Comment by dimir [ 2015 Nov 06 ]

Fixed in pre-3.0.0alpha4 (r56585).

The fix is only available for 3.0 because the change might affect the returned value which might cause a regression. E. g. AIX with 32-bit stat[v]fs interface with big disks might report 0 if available disk space is 16 TB (considering 4096 block size). This behavior wasn't noticed but is possible in theory.

The patch for 2.4.6 is attached.

Comment by dimir [ 2015 Nov 09 ]

(2) [D] Documented here.

wiper CLOSED

Comment by Alexander Vladishev [ 2015 Nov 12 ]

(3) The code of vfs.fs.inode must be also reviewed and fixed

<dimir> Actually I have checked and tested vfs.fs.inode and there is no issue. The issue is with stat[v]fs structure field f_bavail, which is not used in case of vfs.fs.inode.

RESOLVED

sasha Thanks! CLOSED





[ZBX-2204] ZABBIX with SSH2 support on FreeBSD8.0 Created: 2010 Mar 22  Updated: 2017 May 30  Resolved: 2012 Aug 27

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Server (S)
Affects Version/s: 1.8.1
Fix Version/s: None

Type: Incident report Priority: Minor
Reporter: Derick Smit Assignee: Unassigned
Resolution: Cannot Reproduce Votes: 0
Labels: freebsd
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

FreeBSD8.0, Zabbix 1.8.1 Server with SSH2 support compiled in


Attachments: JPEG File SSH monitors.jpg     Zip Archive ZBX-2204.zabbix_server.log.zip    

 Description   

When creating a new agentless SSH monitor, the first one works fine. Adding any more though results in non-working monitors with no apparent reason.



 Comments   
Comment by richlv [ 2010 Mar 22 ]

works just fine on linux. which libssh version was zabbix compiled against ?
please provide logfile at debuglevel 4 - preferably having single host w/o items, first ssh item added, then second added and wait for some time to be sure it does not collect any data.

make sure to increase max logfile size so that it contains some useful information

Comment by Derick Smit [ 2010 Mar 22 ]

Logfile set to debug mode. It shows the one SSH agentless monitor that works (ssh.run[rgel30cpu,10.83.114.201,22,utf8]), but it doesn't seem to even attempt running the other three (see to be attached screenshot).

As the three other monitors are clones of the working SSH monitor, I can't figure out why only the one would run fine, but not the other three.

Comment by Derick Smit [ 2010 Mar 22 ]

4 SSH monitors in total, yet only the first one seems to be run.

Comment by Derick Smit [ 2010 Mar 23 ]

Just regarding libssh, exact version I've got installed is:
libssh2-1.2.4, 2

Comment by Derick Smit [ 2012 Apr 19 ]

Guys, you may as well close this ticket, 2010 has been over for quite some time now. Besides, I doubt I'll run into this error again, and if I do, I'll just switch to a Linux distro that we know works.

Comment by Alexei Vladishev [ 2012 Aug 27 ]

Sorry we didn't help you much with the original issue. I am closing it for now, feel free to reopen.





Generated at Fri Mar 29 09:57:25 EET 2024 using Jira 9.12.4#9120004-sha1:625303b708afdb767e17cb2838290c41888e9ff0.