[ZBXNEXT-4800] VMware event retrieval takes too long Created: 2018 Oct 09  Updated: 2023 Oct 20  Resolved: 2023 Oct 20

Status: Closed
Project: ZABBIX FEATURE REQUESTS
Component/s: Proxy (P), Server (S)
Affects Version/s: 3.0.22, 3.4.14, 4.0.0, 4.2.0alpha1
Fix Version/s: None

Type: Change Request Priority: Minor
Reporter: Andris Zeila Assignee: Zabbix Development Team
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Duplicate
duplicates ZBXNEXT-5037 Skip paramerter for vmware.eventlog key Closed
is duplicated by ZBXNEXT-5037 Skip paramerter for vmware.eventlog key Closed
is duplicated by ZBX-15670 Inefficient vmware eventlog downloading Closed

 Description   

When new VMware sevice is configured the collector tries to retrieve all events. This is done with batches by 10 events and can take long time. Debug log contains a lot of

 14153:20181009:195424.262 In vmware_service_read_previous_events()
 14153:20181009:195424.278 End of vmware_service_read_previous_events():SUCCEED
 14153:20181009:195424.279 In vmware_service_parse_event_data() last_key:0
 14153:20181009:195424.288 End of vmware_service_parse_event_data() parsed:10
 14153:20181009:195424.288 In vmware_service_read_previous_events()
 14153:20181009:195424.303 End of vmware_service_read_previous_events():SUCCEED
 14153:20181009:195424.303 In vmware_service_parse_event_data() last_key:0
 14153:20181009:195424.313 End of vmware_service_parse_event_data() parsed:10
 14153:20181009:195424.313 In vmware_service_read_previous_events()
 14153:20181009:195424.330 End of vmware_service_read_previous_events():SUCCEED
 14153:20181009:195424.330 In vmware_service_parse_event_data() last_key:0
 14153:20181009:195424.340 End of vmware_service_parse_event_data() parsed:10

which can be misleading - letting people think that collector entered in endless loop.

What could be done:

  • improve debug logging to show the progress of event retrieval
  • investigate if the batch limit of 10 events could be safely increased. Actually it makes sense to use smaller batches to update events (for existing hosts) and larger batches to download all events (for new hosts).
  • either add 'skip' option or make new VMware monitoring hosts skip the old events by default
  • add internal timeout so event downloading does not take too long. This way it would take serveral updates to catch up with events, but it would not block vmware collector. Cannot do this - while collector will download all events Zabbix would use only the first downloaded batch.

Generated at Fri Apr 19 13:05:02 EEST 2024 using Jira 9.12.4#9120004-sha1:625303b708afdb767e17cb2838290c41888e9ff0.