[ZBXNEXT-7049] Prometheus should support bulk processing Created: 2021 Nov 12 Updated: 2024 Oct 28 Resolved: 2022 Jan 25 |
|
Status: | Closed |
Project: | ZABBIX FEATURE REQUESTS |
Component/s: | Proxy (P), Server (S) |
Affects Version/s: | None |
Fix Version/s: | 6.0.0beta2, 6.0 (plan) |
Type: | New Feature Request | Priority: | Trivial |
Reporter: | Aleksandrs Larionovs (Inactive) | Assignee: | Andris Zeila |
Resolution: | Fixed | Votes: | 0 |
Labels: | None | ||
Σ Remaining Estimate: | Not Specified | Remaining Estimate: | Not Specified |
Σ Time Spent: | Not Specified | Time Spent: | Not Specified |
Σ Original Estimate: | Not Specified | Original Estimate: | Not Specified |
Attachments: |
![]() ![]() ![]() ![]() |
||||||||||||||||
Issue Links: |
|
||||||||||||||||
Sub-Tasks: |
|
||||||||||||||||
Team: | |||||||||||||||||
Sprint: | Sprint 82 (Nov 2021), Sprint 83 (Dec 2021), Sprint 84 (Jan 2022) | ||||||||||||||||
Story Points: | 5 |
Description |
Add bulk processing to prometheus metrics request to improve performance. Add Aggregate function (Avg, Sum, Count, Sum by). This will allow us to reduce the amount of usage of the JSONpath for template development. |
Comments |
Comment by Andris Zeila [ 2021 Dec 09 ] |
Released
|
Comment by Andris Zeila [ 2021 Dec 10 ] |
Released
|
Comment by Martins Valkovskis [ 2022 Jan 05 ] |
Updated documentation: Updated API documentation: |
Comment by Yi Troy Lu [ 2022 Jan 29 ] |
@Ivo Kurzemnieks I am a member of the Chinese document translation team. About prometheus bulk processing documents, I don't understand how one preprocessing step output can improve multi-dependency performance? Is there a blog to explain? In my guess, the improve just in one special case.
P.S. |
Comment by Andris Zeila [ 2022 Jan 31 ] |
When master item value is processed preprocessing manager spawned 'jobs' for each dependent item. Those 'jobs' were sent to different preprocessing workers and processed separately. So there was overhead in data sending (and with prometheus data this easily can reach megabytes per dependent item) and prometheus data parsing. There were two improvements made to improve this process: |
Comment by Yi Troy Lu [ 2022 Jan 31 ] |
Thank you for your explanation. |