-
Problem report
-
Resolution: Cannot Reproduce
-
Trivial
-
None
-
7.0.4
After upgrade from 6.4 to 7.0.4 there is a problem with pre-processing of data in Prometneus format.
I'm monitoring an Azure Kubernetes cluster and have an item that makes multiple API calls to get cAdvisor metrics from x nodes. The item's output contains metrics from x nodes in Prometheus format (see below):
# HELP cadvisor_version_info A metric with a constant '1' value labeled by kernel version, OS version, docker version, cadvisor version & cadvisor revision. # TYPE cadvisor_version_info gauge cadvisor_version_info{cadvisorRevision="",cadvisorVersion="",dockerVersion="",kernelVersion="5.15.0-1071-azure",osVersion="Ubuntu 22.04.4 LTS"} 1 # HELP container_blkio_device_usage_total Blkio Device bytes usage # TYPE container_blkio_device_usage_total counter container_blkio_device_usage_total{container="",device="",id="/",image="",major="11",minor="0",name="",namespace="",operation="Read",pod=""} 2.7058176e+07 1727772781281 container_blkio_device_usage_total{container="",device="",id="/",image="",major="11",minor="0",name="",namespace="",operation="Write",pod=""} 0 1727772781281 container_blkio_device_usage_total{container="",device="/dev/sda",id="/",image="",major="8",minor="0",name="",namespace="",operation="Read",pod=""} 1.713661952e+09 1727772781281
When I try to extract any metric using preprocessing (Prometheus pattern), I get an error:
Preprocessing failed for: # HELP cadvisor_version_info A metric with a constant '1' value labeled by kernel version, OS ver... 1. Failed: cannot apply Prometheus pattern: data parsing error at row 3213 "# HELP cadvisor_version_info A metric with a const...": multiple HELP comments found for metric "cadvisor_version_info"
After upgrade I didn’t change any configuration.