[ZBX-15370] syncing history is too slow Created: 2018 Dec 27  Updated: 2020 Sep 03  Resolved: 2019 Jan 03

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Server (S)
Affects Version/s: 4.0.2
Fix Version/s: None

Type: Problem report Priority: Trivial
Reporter: Fabrice T Assignee: Arturs Lontons
Resolution: Won't fix Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Production


Attachments: PNG File Capture_busy.PNG     PNG File history.PNG     PNG File one.PNG     PNG File one.PNG     PNG File three.PNG     PNG File two.PNG     PNG File two.PNG    

 Description   

Hello

After a restart of Zabbix server  (due to a modification of configuration file)  ,

the syncing history data take a long time to finish

After 2h its only to 6%

 

35032:20181227:101742.008 syncing history data... 6.255328%
35032:20181227:101753.026 syncing history data... 6.266157%
35032:20181227:101804.055 syncing history data... 6.277176%
35032:20181227:101815.027 syncing history data... 6.288195%
35032:20181227:101826.045 syncing history data... 6.299784%
35032:20181227:101837.009 syncing history data... 6.310297%
35032:20181227:101848.014 syncing history data... 6.321759%
35032:20181227:101859.229 syncing history data... 6.332968%
35032:20181227:101910.048 syncing history data... 6.344557%
35032:20181227:101921.002 syncing history data... 6.356526%
35032:20181227:101932.006 syncing history data... 6.368559%
35032:20181227:101943.039 syncing history data... 6.380464%
35032:20181227:101954.049 syncing history data... 6.391104%
35032:20181227:102005.043 syncing history data... 6.403136%
35032:20181227:102016.045 syncing history data... 6.414915%
35032:20181227:102027.048 syncing history data... 6.427391%
35032:20181227:102038.021 syncing history data... 6.440120%
35032:20181227:102049.005 syncing history data... 6.451646%
35032:20181227:102100.028 syncing history data... 6.463108%
35032:20181227:102111.002 syncing history data... 6.473874%
35032:20181227:102122.054 syncing history data... 6.485526%
35032:20181227:102133.025 syncing history data... 6.496545%
35032:20181227:102144.014 syncing history data... 6.508071%
35032:20181227:102155.047 syncing history data... 6.520294%
35032:20181227:102206.102 syncing history data... 6.530743%
35032:20181227:102217.028 syncing history data... 6.542965%
35032:20181227:102228.036 syncing history data... 6.554744%

 

The problem is this zabbix is already used in production. We can not wait 20h...

 

 

I want to know if its possible to skip this process (syncing history data)  - to make zabbix available as son possible . 

 

Loose a data is not a problem , real time monitoring is the priority



 Comments   
Comment by Fabrice T [ 2018 Dec 27 ]

After 40 , just 1% progess

 

35032:20181227:103507.017 syncing history data... 7.364018%
35032:20181227:103518.024 syncing history data... 7.376240%
35032:20181227:103529.003 syncing history data... 7.386563%
35032:20181227:103540.034 syncing history data... 7.398342%
35032:20181227:103551.052 syncing history data... 7.409615%
35032:20181227:103602.104 syncing history data... 7.420507%
35032:20181227:103613.027 syncing history data... 7.431336%
35032:20181227:103624.034 syncing history data... 7.442419%
35032:20181227:103635.062 syncing history data... 7.453564%

Comment by Fabrice T [ 2018 Dec 27 ]

I have finally kill the process (kill -9 PID)

 

its not clean to dot it , but after 3 hours i have not the choice,

i dont know why this sync of data take a long time

 

Comment by Arturs Lontons [ 2018 Dec 27 ]

Hi!
Thank you for reporting the issue. Could you please provide the Zabbix server configuration file - specifically, I'd like to know your HistoryCacheSize value. Also, i'd like to take a look at the  Zabbix internal process busy % graph on the Zabbix server. I'd like to see how busy the history syncer process is before and after the restart.

Comment by Fabrice T [ 2018 Dec 27 ]

Hi

 

thank you for your feedback . this is my conf file :

 

StartPollers=5
StartTrappers=8
StartPingers=1
MaxHousekeeperDelete=5000
CacheSize=1G
CacheUpdateFrequency=90
StartDBSyncers=10
HistoryCacheSize=1G
HistoryIndexCacheSize=512M
TrendCacheSize=512M
ValueCacheSize=2G
Timeout=4
LogSlowQueries=10000
StartProxyPollers=6
ProxyConfigFrequency=300
ProxyDataFrequency=10

 

  

Comment by Fabrice T [ 2018 Dec 27 ]

Comment by Fabrice T [ 2018 Dec 27 ]

Comment by Arturs Lontons [ 2019 Jan 03 ]

This issue seems to be caused by bad database performance - you can see in the graphs that the history write cache was full until the restart (and may possibly become full again in the future) and that the housekeeper process is also periodically 100% busy.

Since this is not a Zabbix bug, but a configuration issue, you should direct this issue either at the Zabbix forums - https://www.zabbix.com/forum/ 
Or use Zabbix commercial support provided here  - https://www.zabbix.com/services

Comment by Timo Veith [ 2020 Sep 03 ]

Hi, 

it looks like we are having the same problem. Have you found a solution yet and if yes what was it? 

Thank you and have a nice day

timo

Generated at Wed Jan 07 13:41:49 EET 2026 using Jira 10.3.13#10030013-sha1:56dd970ae30ebfeda3a697d25be1f6388b68a422.