Uploaded image for project: 'ZABBIX BUGS AND ISSUES'
  1. ZABBIX BUGS AND ISSUES
  2. ZBX-19030

Zabbix value cache full due to one trigger

    XMLWordPrintable

    Details

    • Type: Problem report
    • Status: Closed
    • Priority: Trivial
    • Resolution: Won't fix
    • Affects Version/s: 4.0.28
    • Fix Version/s: None
    • Component/s: Server (S)
    • Labels:
    • Environment:
      Centos 7
      zabbix-server-mysql.x86_64 4.0.28-1.el7 @zabbix

      Description

      Steps to reproduce:

      1. Create a trigger prototype based on 2 discovered values
      2. The trigger get triggered
      3. Leave the problem as is for a few months
      4. The value cache gets full because ALL the values since the trigger is triggered are kept in the value cache

      Trigger

      Name: Free disk space is less than 2GiB and 20% on volume {#FSNAME}
      Expression: {Template OS Linux:vfs.fs.size[{#FSNAME},free].last(0)}<2147483648 and {Template OS Linux:vfs.fs.size[{#FSNAME},pfree].last(0)}<20
      

      Expected:
      Value cache does not get full.

      Result:
      Server log:

      Unable to find source-code formatter for language: text. Available languages are: actionscript, ada, applescript, bash, c, c#, c++, cpp, css, erlang, go, groovy, haskell, html, java, javascript, js, json, lua, none, nyan, objc, perl, php, python, r, rainbow, ruby, scala, sh, sql, swift, visualbasic, xml, yaml  7266:20210216:184407.682 ================================
        7266:20210216:184407.682 value cache is fully used: please increase ValueCacheSize configuration parameter
        7266:20210216:184908.924 === most used items statistics for value cache ===
        7266:20210216:184908.924 itemid:25558 active range:1613497257 hits:11026 count:103304 perc:26.766161%
        7266:20210216:184908.924 itemid:25556 active range:1613497257 hits:11026 count:103304 perc:26.766161%
        7266:20210216:184908.924 itemid:24416 active range:1613497018 hits:1005 count:93224 perc:24.154424%
        7266:20210216:184908.924 itemid:24053 active range:2534532 hits:11206 count:42199 perc:10.933800%
        7266:20210216:184908.924 itemid:24050 active range:2534472 hits:11201 count:42198 perc:10.933541%
        7266:20210216:184908.924 itemid:23258 active range:1802 hits:168150 count:36 perc:0.009328%
        7266:20210216:184908.924 itemid:23662 active range:1804 hits:5516 count:34 perc:0.008809%
        7266:20210216:184908.924 itemid:24967 active range:671406 hits:199 count:32 perc:0.008291%
        7266:20210216:184908.924 itemid:24040 active range:671406 hits:199 count:32 perc:0.008291%
        7266:20210216:184908.924 itemid:25415 active range:671405 hits:199 count:32 perc:0.008291%
        7266:20210216:184908.924 itemid:24549 active range:671404 hits:199 count:32 perc:0.008291%
        7266:20210216:184908.924 itemid:25755 active range:649808 hits:199 count:31 perc:0.008032%
        7266:20210216:184908.924 itemid:24409 active range:649806 hits:199 count:31 perc:0.008032%
        7266:20210216:184908.924 itemid:25519 active range:649804 hits:199 count:31 perc:0.008032%
        7266:20210216:184908.924 itemid:25643 active range:628204 hits:199 count:30 perc:0.007773%
        7266:20210216:184908.924 itemid:25818 active range:606608 hits:195 count:29 perc:0.007514%
        7266:20210216:184908.924 itemid:23264 active range:602 hits:57848 count:13 perc:0.003368%
        7266:20210216:184908.924 itemid:23255 active range:602 hits:57895 count:13 perc:0.003368%
        7266:20210216:184908.924 itemid:23265 active range:602 hits:57840 count:13 perc:0.003368%
        7266:20210216:184908.924 itemid:23270 active range:602 hits:57836 count:13 perc:0.003368%
        7266:20210216:184908.925 itemid:23253 active range:602 hits:57878 count:13 perc:0.003368%
        7266:20210216:184908.925 itemid:23266 active range:602 hits:57841 count:13 perc:0.003368%
        7266:20210216:184908.925 itemid:23260 active range:602 hits:57852 count:13 perc:0.003368%
        7266:20210216:184908.925 itemid:23620 active range:602 hits:57852 count:13 perc:0.003368%
        7266:20210216:184908.925 itemid:23256 active range:602 hits:57890 count:13 perc:0.003368%
        7266:20210216:184908.925 ==================================================
        7266:20210216:184908.925 === memory statistics for value cache size ===
        7266:20210216:184908.925 free chunks of size     24 bytes:        1
        7266:20210216:184908.925 free chunks of size     32 bytes:       12
        7266:20210216:184908.925 free chunks of size     48 bytes:        6
        7266:20210216:184908.925 free chunks of size     64 bytes:        1
        7266:20210216:184908.925 free chunks of size     80 bytes:        1
        7266:20210216:184908.925 free chunks of size    112 bytes:        1
        7266:20210216:184908.925 free chunks of size    160 bytes:        1
        7266:20210216:184908.925 free chunks of size    176 bytes:        2
        7266:20210216:184908.925 free chunks of size >= 256 bytes:       67
        7266:20210216:184908.925 min chunk size:         24 bytes
        7266:20210216:184908.925 max chunk size:    1660880 bytes
        7266:20210216:184908.925 memory of total size 8388232 bytes fragmented into 1546 chunks
        7266:20210216:184908.925 of those,    1850152 bytes are in       92 free chunks
        7266:20210216:184908.925 of those,    6513360 bytes are in     1454 used chunks
        7266:20210216:184908.925 of those,      24720 bytes are used by allocation overhead
        7266:20210216:184908.925 ================================
        7266:20210216:184908.925 value cache is fully used: please increase ValueCacheSize configuration parameter
      

      Database:

      Unable to find source-code formatter for language: text. Available languages are: actionscript, ada, applescript, bash, c, c#, c++, cpp, css, erlang, go, groovy, haskell, html, java, javascript, js, json, lua, none, nyan, objc, perl, php, python, r, rainbow, ruby, scala, sh, sql, swift, visualbasic, xml, yamlMariaDB [zabbix]> select * from items where itemid in(25558,25556)\G
      *************************** 1. row ***************************
                     itemid: 25556
                       type: 7
             snmp_community: 
                   snmp_oid: 
                     hostid: 10129
                       name: Free disk space on $1
                       key_: vfs.fs.size[/,free]
                      delay: 1m
                    history: 1w
                     trends: 365d
                     status: 0
                 value_type: 3
              trapper_hosts: 
                      units: B
        snmpv3_securityname: 
       snmpv3_securitylevel: 0
      snmpv3_authpassphrase: 
      snmpv3_privpassphrase: 
                    formula: 
                      error: 
                lastlogsize: 0
                 logtimefmt: 
                 templateid: NULL
                 valuemapid: NULL
                     params: 
                ipmi_sensor: 
                   authtype: 0
                   username: 
                   password: 
                  publickey: 
                 privatekey: 
                      mtime: 0
                      flags: 4
                interfaceid: NULL
                       port: 
                description: 
             inventory_link: 0
                   lifetime: 30d
        snmpv3_authprotocol: 0
        snmpv3_privprotocol: 0
                      state: 0
         snmpv3_contextname: 
                   evaltype: 0
               jmx_endpoint: 
              master_itemid: NULL
                    timeout: 3s
                        url: 
               query_fields: 
                      posts: 
               status_codes: 200
           follow_redirects: 1
                  post_type: 0
                 http_proxy: 
                    headers: 
              retrieve_mode: 0
             request_method: 1
              output_format: 0
              ssl_cert_file: 
               ssl_key_file: 
           ssl_key_password: 
                verify_peer: 0
                verify_host: 0
                allow_traps: 0
      *************************** 2. row ***************************
                     itemid: 25558
                       type: 7
             snmp_community: 
                   snmp_oid: 
                     hostid: 10129
                       name: Free disk space on $1 (percentage)
                       key_: vfs.fs.size[/,pfree]
                      delay: 1m
                    history: 1w
                     trends: 365d
                     status: 0
                 value_type: 0
              trapper_hosts: 
                      units: %
        snmpv3_securityname: 
       snmpv3_securitylevel: 0
      snmpv3_authpassphrase: 
      snmpv3_privpassphrase: 
                    formula: 
                      error: 
                lastlogsize: 0
                 logtimefmt: 
                 templateid: NULL
                 valuemapid: NULL
                     params: 
                ipmi_sensor: 
                   authtype: 0
                   username: 
                   password: 
                  publickey: 
                 privatekey: 
                      mtime: 0
                      flags: 4
                interfaceid: NULL
                       port: 
                description: 
             inventory_link: 0
                   lifetime: 30d
        snmpv3_authprotocol: 0
        snmpv3_privprotocol: 0
                      state: 0
         snmpv3_contextname: 
                   evaltype: 0
               jmx_endpoint: 
              master_itemid: NULL
                    timeout: 3s
                        url: 
               query_fields: 
                      posts: 
               status_codes: 200
           follow_redirects: 1
                  post_type: 0
                 http_proxy: 
                    headers: 
              retrieve_mode: 0
             request_method: 1
              output_format: 0
              ssl_cert_file: 
               ssl_key_file: 
           ssl_key_password: 
                verify_peer: 0
                verify_host: 0
                allow_traps: 0
      2 rows in set (0.00 sec)MariaDB [zabbix]> select * from functions where itemid in (25556,25558)\G
      *************************** 1. row ***************************
      functionid: 14963
          itemid: 25556
       triggerid: 14737
            name: last
       parameter: 0
      *************************** 2. row ***************************
      functionid: 14967
          itemid: 25556
       triggerid: 14739
            name: last
       parameter: 0
      *************************** 3. row ***************************
      functionid: 14964
          itemid: 25558
       triggerid: 14737
            name: last
       parameter: 0
      *************************** 4. row ***************************
      functionid: 15090
          itemid: 25558
       triggerid: 14739
            name: last
       parameter: 0
      4 rows in set (0.00 sec)MariaDB [zabbix]> select * from problem where objectid in(14737,14739)\G
      *************************** 1. row ***************************
            eventid: 36360
             source: 0
             object: 0
           objectid: 14739
              clock: 1606442981
                 ns: 407373711
          r_eventid: NULL
            r_clock: 0
               r_ns: 0
      correlationid: NULL
             userid: NULL
               name: Free disk space is less than 2GiB and 20% on volume /
       acknowledged: 0
           severity: 1
      1 row in set (0.00 sec)MariaDB [zabbix]> select * from triggers where triggerid in(14739)\G
      *************************** 1. row ***************************
                triggerid: 14739
               expression: {14967}<2147483648 and {15090}<20
              description: Free disk space is less than 2GiB and 20% on volume /
                      url: 
                   status: 0
                    value: 1
                 priority: 1
               lastchange: 1606442981
                 comments: 
                    error: 
               templateid: NULL
                     type: 0
                    state: 0
                    flags: 4
            recovery_mode: 0
      recovery_expression: 
         correlation_mode: 0
          correlation_tag: 
             manual_close: 0
      1 row in set (0.00 sec)
      

        Attachments

          Activity

            People

            Assignee:
            atocko Andrey Tocko
            Reporter:
            janvenekamp Jan Venekamp
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: