Uploaded image for project: 'ZABBIX FEATURE REQUESTS'
  1. ZABBIX FEATURE REQUESTS
  2. ZBXNEXT-7122

Improve handling of hypertables with compressed chunks and disabled overrides in housekeeper

XMLWordPrintable

    • Sprint 83 (Dec 2021), Sprint 84 (Jan 2022), Sprint 85 (Feb 2022), Sprint 86 (Mar 2022), Sprint 87 (Apr 2022), Sprint 88 (May 2022), Sprint 89 (Jun 2022), Sprint 90 (Jul 2022), Sprint 91 (Aug 2022), Sprint 92 (Sep 2022), Sprint 93 (Oct 2022), Sprint 94 (Nov 2022)
    • 1

      Currently it is possible to set up Zabbix to use TimescaleDB and enable compression, but not select an override for trends or history.
      According to documentation:

      If using TimescaleDB, in order to take full advantage of TimescaleDB automatic partitioning of history and trends tables, Override item history period and Override item trend period options must be enabled as well as Enable internal housekeeping option for history and trends. Otherwise, the data kept in these tables will still be stored in partitions, however, the housekeeper will be cleaning the history and trends by deleting individual records rather than by dropping outdated partitions. When dropping of outdated partitions is enabled, Zabbix server and frontend will no longer keep track of deleted items and history for deleted items will be cleared when an outdated partition is deleted.

      https://www.zabbix.com/documentation/current/manual/web_interface/frontend_sections/administration/general

      This can lead to a situation where compression is enabled (and chunks read only) but housekeeper still tries to delete something from there:

      5658:20211115:125542.665 [Z3005] query failed: [0] PGRES_FATAL_ERROR:ERROR:  cannot update/delete rows from chunk "_hyper_3_2099_chunk" as it is compressed
       [delete from history_uint where itemid=XXXX
      

      We should only allow compression to be selected if overrides have been selected for trends and history. In addition not allow un-selecting them if compression is enabled.

        1. image-2021-12-23-14-08-40-524.png
          39 kB
          Janis Freibergs
        2. image-2021-12-23-14-11-01-427.png
          14 kB
          Janis Freibergs
        3. image-2021-12-23-14-11-20-361.png
          22 kB
          Janis Freibergs
        4. image-2021-12-23-14-14-34-239.png
          22 kB
          Janis Freibergs
        5. image-2022-09-05-17-01-29-342.png
          21 kB
          Janis Freibergs
        6. image-2022-09-05-17-01-38-218.png
          21 kB
          Janis Freibergs
        7. image-2022-09-05-17-02-28-088.png
          34 kB
          Janis Freibergs
        8. image-2022-09-05-17-11-29-965.png
          53 kB
          Janis Freibergs
        9. image-2022-10-18-17-43-38-296.png
          114 kB
          Larisa Grigorjeva
        10. image-2022-11-08-13-03-26-641.png
          11 kB
          Aleksey Volodin
        11. screenshot-1.png
          82 kB
          Larisa Grigorjeva

            dgoloscapov Dmitrijs Goloscapovs
            zux Edgars Melveris
            Team A
            Votes:
            6 Vote for this issue
            Watchers:
            18 Start watching this issue

              Created:
              Updated:
              Resolved: