Uploaded image for project: 'ZABBIX BUGS AND ISSUES'
  1. ZABBIX BUGS AND ISSUES
  2. ZBX-26537

Large number of redundant allocations in preprocessing manager per request

XMLWordPrintable

    • S25-W22/23, S25-W24/25
    • 0.125

      Send 1 million values one by one to preprocessing manager for item without preprocessing and observe cumulative memory allocations are 2150 MB

      Using local file ./sbin/zabbix_server.
      Using local file /tmp/pp_manager.0003.heap.
      Total: 2150.2 MB
        1953.1  90.8%  90.8%   1953.1  90.8% zbx_vector_pp_task_ptr_reserve 

      Remove vector reservation for each value and observe cumulative memory usage decrease to 197 MB

      Total: 197.0 MB
          80.1  40.7%  40.7%     80.1  40.7% zbx_preprocessor_unpack_value
          77.2  39.2%  79.9%     77.2  39.2% ipc_read_buffer 

       

      With preprocessing and error in JSONPath, before:

      Total: 5520.4 MB
        3064.9  55.5%  55.5%   3064.9  55.5% zbx_malloc2
        2252.3  40.8%  96.3%   2252.3  40.8% zbx_realloc2
         203.1   3.7% 100.0%    203.1   3.7% __GI___strdup
           0.0   0.0% 100.0%      0.0   0.0% event_new
           0.0   0.0% 100.0%      0.0   0.0% evsig_set_handler_
           0.0   0.0% 100.0%      0.0   0.0% event_add_nolock_ 

      After:

       google-pprof --alloc_space -text ./sbin/zabbix_server /tmp/pp_manager.0003.heap
      Using local file ./sbin/zabbix_server.
      Using local file /tmp/pp_manager.0003.heap.
      Total: 1299.8 MB
         264.6  20.4%  20.4%    264.6  20.4% jsonpath_reserve
         227.9  17.5%  37.9%    227.9  17.5% zbx_strncpy_alloc
         195.7  15.1%  53.0%    195.7  15.1% __GI___strdup
         195.7  15.1%  68.0%    195.7  15.1% zbx_snprintf_alloc
         117.6   9.0%  77.1%    117.6   9.0% pp_task_create
          77.2   5.9%  83.0%     77.2   5.9% ipc_read_buffer
          77.2   5.9%  88.9%     77.2   5.9% zbx_preprocessor_unpack_value
          36.8   2.8%  91.8%    957.5  73.7% pp_execute
          29.4   2.3%  94.0%     29.4   2.3% list_create_item 

      Expected:
      Should only allocate what is necessary

            vso Vladislavs Sokurenko
            vso Vladislavs Sokurenko
            Team A
            Votes:
            1 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - Not Specified
                Not Specified
                Logged:
                Time Spent - 6h
                6h