-
Incident report
-
Resolution: Won't fix
-
Major
-
None
-
2.0.3
-
None
-
uname -a
Linux monitor001.scl.five9.com 2.6.32-220.17.1.el6.x86_64 #1 SMP Wed May 16 00:01:37 BST 2012 x86_64 x86_64 x86_64 GNU/Linux
cat /etc/redhat-release
CentOS release 6.2 (Final)
We started to encounter a weird issue with one of the Zabbix internal processes. The zabbix history syncer process started to go above 50% and at times spikes all the way to 100%. We notice that when that happens, the zabbix queue backs up immensely. We also notice that the zabbix server and zabbix db server are barely breaking a sweat in terms of cpu load average and overall mem usage. They are on blade servers with 16 cpu cores 16/32 gigs of ram.
We tried bumping up the cache sizes, different poller starter counts. Issue continues to occur.
We are running Zabbix 2.0.3 and postgres 9.1.4.
Attached is the zabbix_server, postgres configuration files, snapshot of zabbix_queue, snapshot of zabbix history syncer graph.