[ZBX-5973] poller stick to 100% busy if there are a lot of dynamic index items Created: 2012 Dec 11  Updated: 2017 May 30  Resolved: 2013 Jan 30

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Proxy (P), Server (S)
Affects Version/s: 1.8.15
Fix Version/s: 1.8.17rc1, 2.0.5rc1, 2.1.0

Type: Incident report Priority: Critical
Reporter: Kodai Terashima Assignee: Unassigned
Resolution: Fixed Votes: 2
Labels: items, performance
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Zabbix 1.8.15, 10000 dynamic index items

Attachments: JPEG File poller_busy_state_for_dymanic_index.jpg    
Issue Links:
Duplicate

 Description   

Poller stick to 100% busy after restarting Zabbix server if there are a lot of dynamic index items. According to attached screenshot, there are 10000 dynemic index items, poller stick to 100% busy for 20-25 minutes.

Poller does not have shared cache for dynamic index at this moment, so there is no way to avoid this problem for large environment.

 Comments   
Comment by dimir [ 2012 Dec 13 ]

OK we decided to fix this for 1.8, 2.0 and trunk (2.2). Currently we plan to improve caching of dynamic indexes by implementing 2 things:

  • store all indexes of requested OID while doing snmpwalk
  • share the cache between all snmp pollers
Comment by Andris Mednis [ 2013 Jan 04 ]

Problem reproduced with 1-2 poller processes and 1000 dynamic indexes. Pollers are 100% busy for 15-20 minutes after server start.

Comment by Andris Mednis [ 2013 Jan 09 ]

Fixed in development branch svn://svn.zabbix.com/branches/dev/ZBX-5973

Searching for one SNMP dynamic index inserts all other indexes from the same OID table into the cache in the same pass. The cache builds up much faster, number of SNMP queries is reduced.
The assumption is that most of cache entries will be used and unnecessary elements in the cache is not a problem.

Comment by dimir [ 2013 Jan 11 ]

Successfully tested! The performance improved dramatically. See my small change in r32682.
andris Thanks, reviewed. Agree.

Comment by Andris Mednis [ 2013 Jan 21 ]

Fixed in versions pre-1.8.17 r32832, pre-2.0.5 r32863.

Comment by Andris Mednis [ 2013 Jan 21 ]

For trunk fixed in development branch svn://svn.zabbix.com/branches/dev/ZBX-5973-trunk

Comment by Andris Mednis [ 2013 Jan 25 ]

Fixed in version pre-1.8.17 r33135.

Comment by Andris Mednis [ 2013 Jan 28 ]

Fixed in version pre-2.0.5 r33192.

Comment by Andris Mednis [ 2013 Jan 29 ]

For trunk fixed in development branch svn://svn.zabbix.com/branches/dev/ZBX-5973-trunk, r33235.

sasha Successfully tested! Please review my changes in r33240:33245.
andris Reviewed. Agree.

Comment by Andris Mednis [ 2013 Jan 30 ]

Fixed in version pre-2.1.0 rev.33254.

Generated at Fri Apr 19 18:25:47 EEST 2024 using Jira 9.12.4#9120004-sha1:625303b708afdb767e17cb2838290c41888e9ff0.