Steps to reproduce:
- Create a (python) script that fetches records from auditlog.get and store them in a file
- Use Filebeat and Logstash to parse the produced JSON
- Also parse the "details" string using a second JSON parser step
Result:
Sometimes the "details" contain a key like: item.preprocessing[62432].
This naming causes ES to produce a unique fieldname like zabbix.auditlog.detail.item.preprocessing[62342] which causes the number of fields in an index to rise exponentially. This in turn can even cause ES to stop functioning.
Expected:
Would be better to set the unique number as a (sub)item, something like zabbix.auditlog.detail.item.preprocessing.item_id => 62432