-
Incident report
-
Resolution: Cannot Reproduce
-
Major
-
None
-
2.2.1
-
Linux zabbix-big 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
---------------------------------------------------------------------------------------------------------------------------
processor : 23
vendor_id : GenuineIntel
cpu family : 6
model : 44
model name : Intel(R) Xeon(R) CPU X5670 @ 2.93GHz
stepping : 2
cpu MHz : 2933.725
cache size : 12288 KB
physical id : 1
siblings : 12
core id : 9
cpu cores : 6
apicid : 51
initial apicid : 51
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm ida arat epb dts tpr_shadow vnmi flexpriority ept vpid
bogomips : 5866.51
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
------------------------------------------------------------------------------------------------------------------------------
load average: 4.83, 4.99, 5.07
Tasks: 615 total, 1 running, 613 sleeping, 0 stopped, 1 zombie
Cpu(s): 30.7%us, 1.9%sy, 0.0%ni, 67.3%id, 0.0%wa, 0.0%hi, 0.1%si, 0.0%st
Mem: 32865304k total, 27066508k used, 5798796k free, 156680k buffers
Swap: 16506872k total, 0k used, 16506872k free, 7555452k cached
------------------------------------------------------------------------------------------------------------------------------
mysql> show status like 'Threads%';
+-------------------+-------+
| Variable_name | Value |
+-------------------+-------+
| Threads_cached | 14 |
| Threads_connected | 123 |
| Threads_created | 137 |
| Threads_running | 5 |
+-------------------+-------+
4 rows in set (0.00 sec)
mysql> show global variables like 'innodb_thread%';
+---------------------------+-------+
| Variable_name | Value |
+---------------------------+-------+
| innodb_thread_concurrency | 16 |
| innodb_thread_sleep_delay | 0 |
+---------------------------+-------+
2 rows in set (0.00 sec)
mysql> show global variables like 'thread%';
+--------------------+---------------------------+
| Variable_name | Value |
+--------------------+---------------------------+
| thread_cache_size | 32 |
| thread_concurrency | 16 |
| thread_handling | one-thread-per-connection |
| thread_stack | 262144 |
+--------------------+---------------------------+
4 rows in set (0.00 sec)
------------------------------------------------------------------------------------------------------------
Number of hosts (monitored/not monitored/templates) 1094 972 / 45 / 77
Number of items (monitored/disabled/not supported) 61032 26935 / 33770 / 327
Number of triggers (enabled/disabled) [problem/ok] 20842 20076 / 766 [206 / 19870]
Number of users (online) 196 20
Required server performance, new values per second 280.39 -Linux zabbix-big 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux --------------------------------------------------------------------------------------------------------------------------- processor : 23 vendor_id : GenuineIntel cpu family : 6 model : 44 model name : Intel(R) Xeon(R) CPU X5670 @ 2.93GHz stepping : 2 cpu MHz : 2933.725 cache size : 12288 KB physical id : 1 siblings : 12 core id : 9 cpu cores : 6 apicid : 51 initial apicid : 51 fpu : yes fpu_exception : yes cpuid level : 11 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm ida arat epb dts tpr_shadow vnmi flexpriority ept vpid bogomips : 5866.51 clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual ------------------------------------------------------------------------------------------------------------------------------ load average: 4.83, 4.99, 5.07 Tasks: 615 total, 1 running, 613 sleeping, 0 stopped, 1 zombie Cpu(s): 30.7%us, 1.9%sy, 0.0%ni, 67.3%id, 0.0%wa, 0.0%hi, 0.1%si, 0.0%st Mem: 32865304k total, 27066508k used, 5798796k free, 156680k buffers Swap: 16506872k total, 0k used, 16506872k free, 7555452k cached ------------------------------------------------------------------------------------------------------------------------------ mysql> show status like 'Threads%'; +-------------------+-------+ | Variable_name | Value | +-------------------+-------+ | Threads_cached | 14 | | Threads_connected | 123 | | Threads_created | 137 | | Threads_running | 5 | +-------------------+-------+ 4 rows in set (0.00 sec) mysql> show global variables like 'innodb_thread%'; +---------------------------+-------+ | Variable_name | Value | +---------------------------+-------+ | innodb_thread_concurrency | 16 | | innodb_thread_sleep_delay | 0 | +---------------------------+-------+ 2 rows in set (0.00 sec) mysql> show global variables like 'thread%'; +--------------------+---------------------------+ | Variable_name | Value | +--------------------+---------------------------+ | thread_cache_size | 32 | | thread_concurrency | 16 | | thread_handling | one-thread-per-connection | | thread_stack | 262144 | +--------------------+---------------------------+ 4 rows in set (0.00 sec) ------------------------------------------------------------------------------------------------------------ Number of hosts (monitored/not monitored/templates) 1094 972 / 45 / 77 Number of items (monitored/disabled/not supported) 61032 26935 / 33770 / 327 Number of triggers (enabled/disabled) [problem/ok] 20842 20076 / 766 [206 / 19870] Number of users (online) 196 20 Required server performance, new values per second 280.39 -
Hi!
I'm using Zabbix 2.2.1 on mid size environment.
I see the big delay (about 5-6 sec) every time when zabbix is refreshing my top map containing all configured submaps and hosts.
The root cause looks like slow SQL query in function addRelatedObjects (CTriggerGeneral.php).
Attached in file.
// adding hosts
if ($options['selectHosts'] !== null && $options['selectHosts'] != API_OUTPUT_COUNT) {
$res = DBselect(
'SELECT f.triggerid,i.hostid'.
' FROM functions f,items i'.
' WHERE '.dbConditionInt('f.triggerid', $triggerids).
' AND f.itemid=i.itemid'
);
I would appreciate any solution which allows to reduce delay less than 1-2 sec.
Currently i'm using workaround when top map png is generated offline by curl script and users in NOC can see uninterrupted and quickly refreshing picture on the big screen.