[ZBXNEXT-4320] Elasticsearch : store history data in multiple date-based indices Created: 2018 Jan 08  Updated: 2024 Apr 10  Resolved: 2018 May 24

Status: Closed
Project: ZABBIX FEATURE REQUESTS
Component/s: Frontend (F), Server (S)
Affects Version/s: 3.4.5
Fix Version/s: 4.0.0alpha7, 4.0 (plan)

Type: Change Request Priority: Critical
Reporter: Julien Leboeuf Assignee: Vjaceslavs Bogdanovs
Resolution: Fixed Votes: 3
Labels: elasticsearch
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Duplicate
is duplicated by ZBX-13746 ElasticSearch: max documents per inde... Closed
Team: Team D
Team: Team D
Sprint: Sprint 33, Sprint 34
Story Points: 1

 Description   

In order to properly scale history data in elasticsearch, we should use multiple indices per type, and the common way to split them is by date.

With only one index, we can't dynamically add shards as index grows (a reindex is needed otherwise), we can't store fresh data in hot nodes and move old ones to cold nodes, etc..

IMO there are two ways to achieve date based indices setup :



 Comments   
Comment by Luzin Anatolij Alekseevich [ 2018 May 07 ]

Hello!
I really need this functionality.
Tell me, this task will be realized in what version?

Comment by Julien Leboeuf [ 2018 May 23 ]

Thank you so much for implementing this feature !

Now the way is open to long term storage of metric data and fast querying

Generated at Fri Apr 19 01:56:43 EEST 2024 using Jira 9.12.4#9120004-sha1:625303b708afdb767e17cb2838290c41888e9ff0.