Uploaded image for project: 'ZABBIX BUGS AND ISSUES'
  1. ZABBIX BUGS AND ISSUES
  2. ZBX-25325

Prometheus: Preprocessing failed - multiple comments found

XMLWordPrintable

    • Icon: Problem report Problem report
    • Resolution: Cannot Reproduce
    • Icon: Trivial Trivial
    • None
    • 7.0.4
    • Server (S)

      After upgrade from 6.4 to 7.0.4 there is a problem with pre-processing of data in Prometneus format.

      I'm monitoring an Azure Kubernetes cluster and have an item that makes multiple API calls to get cAdvisor metrics from x nodes. The item's output contains metrics from x nodes in Prometheus format (see below):

       

      # HELP cadvisor_version_info A metric with a constant '1' value labeled by kernel version, OS version, docker version, cadvisor version & cadvisor revision.
      # TYPE cadvisor_version_info gauge
      cadvisor_version_info{cadvisorRevision="",cadvisorVersion="",dockerVersion="",kernelVersion="5.15.0-1071-azure",osVersion="Ubuntu 22.04.4 LTS"} 1
      # HELP container_blkio_device_usage_total Blkio Device bytes usage
      # TYPE container_blkio_device_usage_total counter
      container_blkio_device_usage_total{container="",device="",id="/",image="",major="11",minor="0",name="",namespace="",operation="Read",pod=""} 2.7058176e+07 1727772781281
      container_blkio_device_usage_total{container="",device="",id="/",image="",major="11",minor="0",name="",namespace="",operation="Write",pod=""} 0 1727772781281
      container_blkio_device_usage_total{container="",device="/dev/sda",id="/",image="",major="8",minor="0",name="",namespace="",operation="Read",pod=""} 1.713661952e+09 1727772781281

       

      When I try to extract any metric using preprocessing (Prometheus pattern), I get an error:

      Preprocessing failed for: # HELP cadvisor_version_info A metric with a constant '1' value labeled by kernel version, OS ver... 
      1. Failed: cannot apply Prometheus pattern: data parsing error at row 3213 "# HELP cadvisor_version_info A metric with a const...": multiple HELP comments found for metric "cadvisor_version_info"
      

      After upgrade I didn’t change any configuration.

            tgrzechulski Tomasz Grzechulski
            arina.lebedeva Arina Lebedeva
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: