I'm investigating a memory consumption problem we have with a kafka_exporter master item. Our symptoms are very related to the ones described in
I seem to understand from the code that the value is copied from the master item to all dependant items. I suppose this is unavoidable ?
But it also seems that the preprocessor process progresses in its memory usage by steps, allocating memory (going up to 5GB here), freeing memory (back to a few hundred megs) ; once in a while, the freeing is much less, and the "base" memory usage goes up.
It makes me think of a memory leak under some circumstances. I've tried to investigate closely using Valgrind, but I couldn't as there wasn't enough RAM for Valgrind to run.
I've attached the template, which is really simple, having one master item and one discovery rule. The difficulty comes from the size of the /metrics endpoint, which returns a 19MB document.