Uploaded image for project: 'ZABBIX BUGS AND ISSUES'
  1. ZABBIX BUGS AND ISSUES
  2. ZBX-5413

Table history_uint does not sync at the same speed as the other tables

XMLWordPrintable

    • Icon: Incident report Incident report
    • Resolution: Won't fix
    • Icon: Major Major
    • None
    • 2.0.1
    • Server (S)
    • CentOS 6.2 64-bit

      I'm encountering an issue with the history_uint tables not sync'ing to the master node at the same speed as the other tables, causing the integer values to lag/run behind, all other values are fine. This problem may only occur on very large installations, as the tables are actually sync'ing, just one table is sync'ing too slowly for us.

      I suspect that there is a limit in the code (didn't check this) somewhere, because all tables go over 400K bytes every now and then, especially when something big happens, except the history_uint table. I've never seen any sync of that table with a size hitting 400K, it's always something like 395K or so, while that table is running behind several days, and it's getting worse (it's a week at the moment and increasing, but the values ARE updating, just too slowly to keep up). Why isn't the sync sync'ing more data than 395K, when it's running behind that much? I should sync all missing data at once! If you look at the sync speeds, this is actually quite high, it takes about 2 minutes for a host to sync.

      Don't pay attention to nodes 5 and 6, they are not monitoring at the moment (temporarily suspended), that's why they are only sync'ing config, but no history tables.

      Very large distributed setup, 1 master node, 5 child nodes, all on CentOS 6.2 64-bit, MySQL 5.5:

      Number of hosts (monitored/not monitored/templates)	12043	11664 / 116 / 263
      Number of items (monitored/disabled/not supported)	688965	647656 / 2571 / 38738
      Number of triggers (enabled/disabled)[problem/unknown/ok]	194100	159297 / 34803  [709 / 0 / 158588]
      Number of users (online)	197	5
      Required server performance, new values per second	225.83	- 
      

      Node 2 is the MASTER.

        5539:20120803:083846.991 NODE 2: Received events from node 1 for node 1 datalen 2888
        5531:20120803:083904.408 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 17155
        5531:20120803:083954.943 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5542:20120803:084028.520 NODE 2: Received history from node 4 for node 4 datalen 259137
        5537:20120803:084036.140 NODE 2: Received history_uint from node 4 for node 4 datalen 391526
        5542:20120803:084058.916 NODE 2: Received history_str from node 4 for node 4 datalen 113558
        5521:20120803:084059.145 NODE 2: Received history_text from node 4 for node 4 datalen 3779
        5543:20120803:084210.848 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5543:20120803:084211.326 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5516:20120803:084213.958 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 17109
        5516:20120803:084310.529 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5531:20120803:084343.304 NODE 2: Received history from node 3 for node 3 datalen 443935
        5531:20120803:084357.151 NODE 2: Received history_uint from node 3 for node 3 datalen 396884
        5542:20120803:084415.787 NODE 2: Received history_str from node 3 for node 3 datalen 140176
        5542:20120803:084416.292 NODE 2: Received history_text from node 3 for node 3 datalen 14208
        5542:20120803:084416.588 NODE 2: Received events from node 3 for node 3 datalen 4058
        5515:20120803:084521.261 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:084524.404 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5519:20120803:084537.728 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12035
        5519:20120803:084559.698 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5536:20120803:084641.638 NODE 2: Received history from node 1 for node 1 datalen 114532
        5536:20120803:084645.467 NODE 2: Received history_uint from node 1 for node 1 datalen 205511
        5536:20120803:084700.537 NODE 2: Received history_str from node 1 for node 1 datalen 50000
        5536:20120803:084700.711 NODE 2: Received history_text from node 1 for node 1 datalen 2688
        5536:20120803:084700.763 NODE 2: Received events from node 1 for node 1 datalen 2785
        5539:20120803:084721.522 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 12742
        5539:20120803:084812.803 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5520:20120803:084846.685 NODE 2: Received history from node 4 for node 4 datalen 274713
        5521:20120803:084855.821 NODE 2: Received history_uint from node 4 for node 4 datalen 390840
        5520:20120803:084917.803 NODE 2: Received history_str from node 4 for node 4 datalen 116361
        5520:20120803:084918.050 NODE 2: Received history_text from node 4 for node 4 datalen 4333
        5543:20120803:085027.067 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5543:20120803:085027.550 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5542:20120803:085030.071 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 21301
        5542:20120803:085123.109 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5539:20120803:085155.529 NODE 2: Received history from node 3 for node 3 datalen 443648
        5514:20120803:085211.429 NODE 2: Received history_uint from node 3 for node 3 datalen 396617
        5514:20120803:085228.526 NODE 2: Received history_str from node 3 for node 3 datalen 141440
        5514:20120803:085229.029 NODE 2: Received history_text from node 3 for node 3 datalen 17663
        5514:20120803:085232.351 NODE 2: Received events from node 3 for node 3 datalen 4450
        5515:20120803:085332.632 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:085335.688 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5519:20120803:085349.620 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12138
        5519:20120803:085411.964 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5539:20120803:085450.828 NODE 2: Received history from node 1 for node 1 datalen 117230
        5539:20120803:085454.514 NODE 2: Received history_uint from node 1 for node 1 datalen 223913
        5539:20120803:085511.282 NODE 2: Received history_str from node 1 for node 1 datalen 47553
        5539:20120803:085511.408 NODE 2: Received history_text from node 1 for node 1 datalen 1282
        5539:20120803:085511.456 NODE 2: Received events from node 1 for node 1 datalen 2461
        5520:20120803:085530.446 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15452
        5520:20120803:085628.325 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5539:20120803:085701.973 NODE 2: Received history from node 4 for node 4 datalen 261040
        5539:20120803:085709.396 NODE 2: Received history_uint from node 4 for node 4 datalen 391747
        5539:20120803:085730.949 NODE 2: Received history_str from node 4 for node 4 datalen 115893
        5531:20120803:085731.283 NODE 2: Received history_text from node 4 for node 4 datalen 9272
        5543:20120803:085842.179 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5543:20120803:085842.665 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5542:20120803:085844.665 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 23236
        5542:20120803:085942.983 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5520:20120803:090017.926 NODE 2: Received history from node 3 for node 3 datalen 443976
        5520:20120803:090035.586 NODE 2: Received history_uint from node 3 for node 3 datalen 396236
        5520:20120803:090052.506 NODE 2: Received history_str from node 3 for node 3 datalen 133054
        5520:20120803:090052.906 NODE 2: Received history_text from node 3 for node 3 datalen 20790
        5525:20120803:090053.253 NODE 2: Received events from node 3 for node 3 datalen 3579
        5515:20120803:090152.299 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:090155.296 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5519:20120803:090208.979 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 11577
        5519:20120803:090227.942 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5525:20120803:090307.193 NODE 2: Received history from node 1 for node 1 datalen 106417
        5525:20120803:090309.806 NODE 2: Received history_uint from node 1 for node 1 datalen 210730
        5525:20120803:090325.920 NODE 2: Received history_str from node 1 for node 1 datalen 48728
        5525:20120803:090326.083 NODE 2: Received history_text from node 1 for node 1 datalen 2848
        5536:20120803:090326.145 NODE 2: Received events from node 1 for node 1 datalen 2716
        5531:20120803:090346.699 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15528
        5531:20120803:090437.971 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5539:20120803:090511.635 NODE 2: Received history from node 4 for node 4 datalen 258377
        5539:20120803:090519.415 NODE 2: Received history_uint from node 4 for node 4 datalen 391216
        5514:20120803:090541.453 NODE 2: Received history_str from node 4 for node 4 datalen 110822
        5514:20120803:090541.789 NODE 2: Received history_text from node 4 for node 4 datalen 3228
        5543:20120803:090651.603 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5543:20120803:090652.086 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5542:20120803:090654.097 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 19912
        5542:20120803:090741.156 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5518:20120803:090813.285 NODE 2: Received history from node 3 for node 3 datalen 443813
        5518:20120803:090830.279 NODE 2: Received history_uint from node 3 for node 3 datalen 396340
        5518:20120803:090846.838 NODE 2: Received history_str from node 3 for node 3 datalen 119344
        5518:20120803:090847.310 NODE 2: Received history_text from node 3 for node 3 datalen 17601
        5518:20120803:090847.698 NODE 2: Received events from node 3 for node 3 datalen 15621
        5515:20120803:090951.931 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:090954.919 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5519:20120803:091008.146 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 11577
        5519:20120803:091028.919 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5523:20120803:091110.282 NODE 2: Received history from node 1 for node 1 datalen 103584
        5517:20120803:091113.111 NODE 2: Received history_uint from node 1 for node 1 datalen 197053
        5523:20120803:091128.701 NODE 2: Received history_str from node 1 for node 1 datalen 41751
        5523:20120803:091128.798 NODE 2: Received history_text from node 1 for node 1 datalen 2070
        5523:20120803:091128.850 NODE 2: Received events from node 1 for node 1 datalen 2084
        5536:20120803:091149.624 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 17060
        5536:20120803:091246.667 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5523:20120803:091320.257 NODE 2: Received history from node 4 for node 4 datalen 265323
        5523:20120803:091329.442 NODE 2: Received history_uint from node 4 for node 4 datalen 391787
        5523:20120803:091351.825 NODE 2: Received history_str from node 4 for node 4 datalen 110295
        5523:20120803:091352.099 NODE 2: Received history_text from node 4 for node 4 datalen 16414
        5543:20120803:091502.251 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5543:20120803:091502.733 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5542:20120803:091505.321 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 38885
        5542:20120803:091555.716 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5536:20120803:091628.227 NODE 2: Received history from node 3 for node 3 datalen 443993
        5536:20120803:091644.839 NODE 2: Received history_uint from node 3 for node 3 datalen 395906
        5536:20120803:091701.877 NODE 2: Received history_str from node 3 for node 3 datalen 117452
        5536:20120803:091702.347 NODE 2: Received history_text from node 3 for node 3 datalen 17020
        5536:20120803:091702.649 NODE 2: Received events from node 3 for node 3 datalen 6621
        5515:20120803:091805.907 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:091808.902 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5519:20120803:091823.466 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 10212
        5519:20120803:091845.313 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5536:20120803:091922.425 NODE 2: Received history from node 1 for node 1 datalen 99317
        5525:20120803:091924.877 NODE 2: Received history_uint from node 1 for node 1 datalen 199702
        5531:20120803:091940.526 NODE 2: Received history_str from node 1 for node 1 datalen 48770
        5531:20120803:091940.652 NODE 2: Received history_text from node 1 for node 1 datalen 671
        5531:20120803:091940.696 NODE 2: Received events from node 1 for node 1 datalen 2514
        5523:20120803:092001.944 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 17374
        5523:20120803:092052.110 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5531:20120803:092125.705 NODE 2: Received history from node 4 for node 4 datalen 285745
        5525:20120803:092134.641 NODE 2: Received history_uint from node 4 for node 4 datalen 391057
        5536:20120803:092156.376 NODE 2: Received history_str from node 4 for node 4 datalen 121374
        5536:20120803:092156.752 NODE 2: Received history_text from node 4 for node 4 datalen 3665
        5543:20120803:092307.004 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5543:20120803:092307.485 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5542:20120803:092309.752 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 24952
        5542:20120803:092358.896 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5523:20120803:092431.064 NODE 2: Received history from node 3 for node 3 datalen 443634
        5523:20120803:092447.353 NODE 2: Received history_uint from node 3 for node 3 datalen 395621
        5523:20120803:092507.741 NODE 2: Received history_str from node 3 for node 3 datalen 122076
        5523:20120803:092508.129 NODE 2: Received history_text from node 3 for node 3 datalen 19071
        5521:20120803:092508.533 NODE 2: Received events from node 3 for node 3 datalen 3294
        5515:20120803:092608.039 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:092611.045 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 59
        5519:20120803:092625.583 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12027
        5519:20120803:092648.464 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 59
        5523:20120803:092729.717 NODE 2: Received history from node 1 for node 1 datalen 111150
        5528:20120803:092733.664 NODE 2: Received history_uint from node 1 for node 1 datalen 229148
        5528:20120803:092751.061 NODE 2: Received history_str from node 1 for node 1 datalen 56063
        5528:20120803:092751.182 NODE 2: Received history_text from node 1 for node 1 datalen 962
        5528:20120803:092751.247 NODE 2: Received events from node 1 for node 1 datalen 1969
        5528:20120803:092805.043 NODE 2: Sending command for Node 4 to Node 4
        5536:20120803:092809.467 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 17405
        5528:20120803:092846.847 NODE 2: Sending command for Node 4 to Node 4
        5536:20120803:092905.962 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 59
        5520:20120803:092939.522 NODE 2: Received history from node 4 for node 4 datalen 295707
        5523:20120803:092949.165 NODE 2: Received history_uint from node 4 for node 4 datalen 391105
        5523:20120803:093011.337 NODE 2: Received history_str from node 4 for node 4 datalen 119058
        5523:20120803:093011.647 NODE 2: Received history_text from node 4 for node 4 datalen 12137
        5543:20120803:093121.071 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5543:20120803:093121.552 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 59
        5542:20120803:093123.829 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 18238
        5542:20120803:093226.572 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 59
        5536:20120803:093259.318 NODE 2: Received history from node 3 for node 3 datalen 443269
        5536:20120803:093316.373 NODE 2: Received history_uint from node 3 for node 3 datalen 396006
        5536:20120803:093333.995 NODE 2: Received history_str from node 3 for node 3 datalen 138413
        5536:20120803:093334.577 NODE 2: Received history_text from node 3 for node 3 datalen 15345
        5531:20120803:093334.949 NODE 2: Received events from node 3 for node 3 datalen 3298
        5515:20120803:093437.975 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:093441.477 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5539:20120803:093454.922 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 10294
        5539:20120803:093520.066 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5537:20120803:093559.266 NODE 2: Received history from node 1 for node 1 datalen 114629
        5537:20120803:093602.483 NODE 2: Received history_uint from node 1 for node 1 datalen 263566
        5537:20120803:093621.295 NODE 2: Received history_str from node 1 for node 1 datalen 57619
        5523:20120803:093621.439 NODE 2: Received history_text from node 1 for node 1 datalen 1054
        5523:20120803:093621.498 NODE 2: Received events from node 1 for node 1 datalen 3525
        5519:20120803:093638.008 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 16037
        5519:20120803:093731.447 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5531:20120803:093805.754 NODE 2: Received history from node 4 for node 4 datalen 298997
        5525:20120803:093816.087 NODE 2: Received history_uint from node 4 for node 4 datalen 391865
        5542:20120803:093837.341 NODE 2: Received history_str from node 4 for node 4 datalen 116273
        5542:20120803:093837.609 NODE 2: Received history_text from node 4 for node 4 datalen 5204
        5543:20120803:093948.113 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5543:20120803:093948.596 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5514:20120803:093950.762 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 20438
        5514:20120803:094055.121 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5516:20120803:094127.143 NODE 2: Received history from node 3 for node 3 datalen 442960
        5516:20120803:094140.549 NODE 2: Received history_uint from node 3 for node 3 datalen 396319
        5516:20120803:094159.450 NODE 2: Received history_str from node 3 for node 3 datalen 137623
        5539:20120803:094159.877 NODE 2: Received history_text from node 3 for node 3 datalen 17324
        5523:20120803:094200.205 NODE 2: Received events from node 3 for node 3 datalen 4474
        5515:20120803:094304.659 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:094307.704 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5536:20120803:094321.329 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 13134
        5536:20120803:094340.853 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5519:20120803:094418.684 NODE 2: Received history from node 1 for node 1 datalen 111946
        5518:20120803:094421.899 NODE 2: Received history_uint from node 1 for node 1 datalen 233908
        5519:20120803:094438.846 NODE 2: Received history_str from node 1 for node 1 datalen 49094
        5519:20120803:094438.959 NODE 2: Received history_text from node 1 for node 1 datalen 570
        5519:20120803:094438.988 NODE 2: Received events from node 1 for node 1 datalen 3924
        5533:20120803:094458.317 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15619
        5533:20120803:094548.556 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5519:20120803:094623.200 NODE 2: Received history from node 4 for node 4 datalen 292637
        5519:20120803:094631.649 NODE 2: Received history_uint from node 4 for node 4 datalen 391291
        5543:20120803:094652.768 NODE 2: Received history_str from node 4 for node 4 datalen 119631
        5543:20120803:094653.141 NODE 2: Received history_text from node 4 for node 4 datalen 4940
        5513:20120803:094804.564 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5513:20120803:094805.061 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5514:20120803:094807.706 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 20915
        5514:20120803:094857.364 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5533:20120803:094929.263 NODE 2: Received history from node 3 for node 3 datalen 443594
        5533:20120803:094946.282 NODE 2: Received history_uint from node 3 for node 3 datalen 396571
        5533:20120803:095004.754 NODE 2: Received history_str from node 3 for node 3 datalen 128473
        5525:20120803:095005.271 NODE 2: Received history_text from node 3 for node 3 datalen 16343
        5518:20120803:095005.696 NODE 2: Received events from node 3 for node 3 datalen 3265
        5515:20120803:095106.623 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:095109.615 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5536:20120803:095122.079 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12880
        5536:20120803:095145.004 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5542:20120803:095149.225 NODE 2: Sending command for Node 3 to Node 3
        5542:20120803:095227.576 NODE 2: Received history from node 1 for node 1 datalen 116865
        5517:20120803:095231.893 NODE 2: Received history_uint from node 1 for node 1 datalen 215523
        5517:20120803:095247.548 NODE 2: Received history_str from node 1 for node 1 datalen 46852
        5517:20120803:095247.674 NODE 2: Received history_text from node 1 for node 1 datalen 2647
        5521:20120803:095247.738 NODE 2: Received events from node 1 for node 1 datalen 2648
        5543:20120803:095308.126 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 13708
        5555:20120803:095357.733 executing housekeeper
        5543:20120803:095409.153 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5528:20120803:095443.783 NODE 2: Received history from node 4 for node 4 datalen 296410
        5542:20120803:095454.802 NODE 2: Received history_uint from node 4 for node 4 datalen 390805
        5529:20120803:095517.198 NODE 2: Received history_str from node 4 for node 4 datalen 115587
        5516:20120803:095517.577 NODE 2: Received history_text from node 4 for node 4 datalen 4414
        5513:20120803:095627.913 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5513:20120803:095628.395 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5514:20120803:095630.137 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 20090
        5514:20120803:095739.760 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5521:20120803:095812.320 NODE 2: Received history from node 3 for node 3 datalen 443427
        5521:20120803:095840.956 NODE 2: Received history_uint from node 3 for node 3 datalen 395754
        5521:20120803:095901.150 NODE 2: Received history_str from node 3 for node 3 datalen 156569
        5521:20120803:095902.097 NODE 2: Received history_text from node 3 for node 3 datalen 21220
        5521:20120803:095902.876 NODE 2: Received events from node 3 for node 3 datalen 3951
        5539:20120803:095951.067 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5539:20120803:095956.410 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5515:20120803:100009.226 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 11845
        5515:20120803:100043.323 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5514:20120803:100119.409 NODE 2: Received history from node 1 for node 1 datalen 114396
        5533:20120803:100121.765 NODE 2: Received history_uint from node 1 for node 1 datalen 227949
        5514:20120803:100127.161 NODE 2: Received history_str from node 1 for node 1 datalen 43932
        5514:20120803:100127.285 NODE 2: Received history_text from node 1 for node 1 datalen 2532
        5518:20120803:100127.309 NODE 2: Received events from node 1 for node 1 datalen 2946
        5525:20120803:100159.162 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 14838
        5525:20120803:100313.505 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5519:20120803:100346.685 NODE 2: Received history from node 4 for node 4 datalen 330807
        5516:20120803:100413.605 NODE 2: Received history_uint from node 4 for node 4 datalen 391442
        5516:20120803:100436.707 NODE 2: Received history_str from node 4 for node 4 datalen 132652
        5516:20120803:100437.276 NODE 2: Received history_text from node 4 for node 4 datalen 5046
        5517:20120803:100530.556 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5517:20120803:100531.874 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5521:20120803:100533.556 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 23325
        5521:20120803:100708.670 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5518:20120803:100740.608 NODE 2: Received history from node 3 for node 3 datalen 443241
        5520:20120803:100750.258 NODE 2: Received history_uint from node 3 for node 3 datalen 396571
        5542:20120803:100759.875 NODE 2: Received history_str from node 3 for node 3 datalen 142017
        5514:20120803:100803.266 NODE 2: Received history_text from node 3 for node 3 datalen 21862
        5514:20120803:100803.524 NODE 2: Received events from node 3 for node 3 datalen 4241
        5529:20120803:100918.682 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5529:20120803:100923.649 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5515:20120803:100937.919 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12312
        5515:20120803:101006.644 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5523:20120803:101044.531 NODE 2: Received history from node 1 for node 1 datalen 124212
        5523:20120803:101052.459 NODE 2: Received history_uint from node 1 for node 1 datalen 249118
        5523:20120803:101116.091 NODE 2: Received history_str from node 1 for node 1 datalen 57792
        5523:20120803:101116.368 NODE 2: Received history_text from node 1 for node 1 datalen 1463
        5523:20120803:101116.438 NODE 2: Received events from node 1 for node 1 datalen 3107
        5517:20120803:101125.168 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5517:20120803:101125.724 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5536:20120803:101127.764 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 16759
        5536:20120803:101248.011 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5523:20120803:101321.217 NODE 2: Received history from node 4 for node 4 datalen 346894
        5523:20120803:101339.050 NODE 2: Received history_uint from node 4 for node 4 datalen 391552
        5523:20120803:101354.063 NODE 2: Received history_str from node 4 for node 4 datalen 121661
        5523:20120803:101354.407 NODE 2: Received history_text from node 4 for node 4 datalen 3925
        5514:20120803:101504.496 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 25712
        5514:20120803:101618.827 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5536:20120803:101655.122 NODE 2: Received history from node 3 for node 3 datalen 443071
        5536:20120803:101720.722 NODE 2: Received history_uint from node 3 for node 3 datalen 396185
        5536:20120803:101741.202 NODE 2: Received history_str from node 3 for node 3 datalen 146225
        5536:20120803:101741.901 NODE 2: Received history_text from node 3 for node 3 datalen 19984
        5536:20120803:101742.586 NODE 2: Received events from node 3 for node 3 datalen 4921
        5529:20120803:101831.098 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5529:20120803:101837.871 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5517:20120803:101851.383 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 121
        5517:20120803:101851.886 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5515:20120803:101853.806 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12436
        5515:20120803:101924.346 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5513:20120803:102002.636 NODE 2: Received history from node 1 for node 1 datalen 113207
        5513:20120803:102009.311 NODE 2: Received history_uint from node 1 for node 1 datalen 232244
        5513:20120803:102031.327 NODE 2: Received history_str from node 1 for node 1 datalen 45959
        5529:20120803:102031.616 NODE 2: Received history_text from node 1 for node 1 datalen 1452
        5529:20120803:102031.695 NODE 2: Received events from node 1 for node 1 datalen 3044
        5523:20120803:102042.852 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 17815
        5555:20120803:102147.132 housekeeper deleted: 435970 records from history and trends, 0 records of deleted items, 41621 events, 0 alerts, 0 sessions
        5523:20120803:102152.052 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5531:20120803:102226.440 NODE 2: Received history from node 4 for node 4 datalen 346241
        5533:20120803:102242.965 NODE 2: Received history_uint from node 4 for node 4 datalen 390489
        5531:20120803:102254.070 NODE 2: Received history_str from node 4 for node 4 datalen 124615
        5516:20120803:102254.419 NODE 2: Received history_text from node 4 for node 4 datalen 5491
        5536:20120803:102410.150 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5536:20120803:102410.630 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5539:20120803:102413.370 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 23068
        5539:20120803:102526.604 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5529:20120803:102601.822 NODE 2: Received history from node 3 for node 3 datalen 443351
        5529:20120803:102626.780 NODE 2: Received history_uint from node 3 for node 3 datalen 396217
        5521:20120803:102645.284 NODE 2: Received history_str from node 3 for node 3 datalen 155434
        5528:20120803:102648.836 NODE 2: Received history_text from node 3 for node 3 datalen 19003
        5528:20120803:102649.494 NODE 2: Received events from node 3 for node 3 datalen 5185
        5518:20120803:102735.403 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5518:20120803:102740.316 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5515:20120803:102754.953 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 10963
        5515:20120803:102821.638 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5531:20120803:102859.281 NODE 2: Received history from node 1 for node 1 datalen 120569
        5531:20120803:102906.221 NODE 2: Received history_uint from node 1 for node 1 datalen 260853
        5531:20120803:102926.599 NODE 2: Received history_str from node 1 for node 1 datalen 57533
        5519:20120803:102926.729 NODE 2: Received history_text from node 1 for node 1 datalen 961
        5519:20120803:102926.790 NODE 2: Received events from node 1 for node 1 datalen 2414
        5517:20120803:102938.936 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 16588
        5517:20120803:103031.412 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5519:20120803:103105.243 NODE 2: Received history from node 4 for node 4 datalen 341359
        5516:20120803:103117.792 NODE 2: Received history_uint from node 4 for node 4 datalen 391459
        5519:20120803:103139.198 NODE 2: Received history_str from node 4 for node 4 datalen 125443
        5543:20120803:103139.564 NODE 2: Received history_text from node 4 for node 4 datalen 5996
        5536:20120803:103247.015 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 174
        5536:20120803:103247.515 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5533:20120803:103249.588 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 25350
        5533:20120803:103343.639 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5518:20120803:103415.103 NODE 2: Received history from node 3 for node 3 datalen 443397
        5518:20120803:103431.922 NODE 2: Received history_uint from node 3 for node 3 datalen 396117
        5518:20120803:103449.316 NODE 2: Received history_str from node 3 for node 3 datalen 140360
        5517:20120803:103449.775 NODE 2: Received history_text from node 3 for node 3 datalen 16021
        5517:20120803:103450.133 NODE 2: Received events from node 3 for node 3 datalen 7595
        5525:20120803:103552.880 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5525:20120803:103555.912 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5515:20120803:103609.100 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 10904
        5515:20120803:103627.791 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5533:20120803:103705.382 NODE 2: Received history from node 1 for node 1 datalen 112827
        5517:20120803:103708.656 NODE 2: Received history_uint from node 1 for node 1 datalen 245289
        5517:20120803:103725.146 NODE 2: Received history_str from node 1 for node 1 datalen 45197
        5517:20120803:103725.269 NODE 2: Received history_text from node 1 for node 1 datalen 895
        5539:20120803:103725.314 NODE 2: Received events from node 1 for node 1 datalen 2589
        5543:20120803:103744.468 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15249
        5543:20120803:103837.092 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5514:20120803:103910.766 NODE 2: Received history from node 4 for node 4 datalen 308278
        5519:20120803:103919.717 NODE 2: Received history_uint from node 4 for node 4 datalen 390970
        5519:20120803:103941.951 NODE 2: Received history_str from node 4 for node 4 datalen 118848
        5542:20120803:103942.215 NODE 2: Received history_text from node 4 for node 4 datalen 5188
        5536:20120803:104051.488 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5536:20120803:104051.972 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5531:20120803:104054.288 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 29878
        5531:20120803:104144.882 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5543:20120803:104218.083 NODE 2: Received history from node 3 for node 3 datalen 442942
        5543:20120803:104234.036 NODE 2: Received history_uint from node 3 for node 3 datalen 396074
        5543:20120803:104254.823 NODE 2: Received history_str from node 3 for node 3 datalen 136020
        5543:20120803:104255.335 NODE 2: Received history_text from node 3 for node 3 datalen 16950
        5543:20120803:104255.703 NODE 2: Received events from node 3 for node 3 datalen 9502
        5516:20120803:104354.831 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5516:20120803:104358.122 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5537:20120803:104412.339 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 10460
        5537:20120803:104433.603 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5513:20120803:104515.578 NODE 2: Received history from node 1 for node 1 datalen 111333
        5513:20120803:104519.025 NODE 2: Received history_uint from node 1 for node 1 datalen 219686
        5518:20120803:104535.294 NODE 2: Received history_str from node 1 for node 1 datalen 38139
        5531:20120803:104535.371 NODE 2: Received history_text from node 1 for node 1 datalen 677
        5531:20120803:104535.414 NODE 2: Received events from node 1 for node 1 datalen 2376
        5542:20120803:104554.800 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 16427
        5542:20120803:104654.079 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5531:20120803:104728.515 NODE 2: Received history from node 4 for node 4 datalen 316834
        5531:20120803:104738.125 NODE 2: Received history_uint from node 4 for node 4 datalen 390747
        5513:20120803:104800.420 NODE 2: Received history_str from node 4 for node 4 datalen 138602
        5523:20120803:104800.769 NODE 2: Received history_text from node 4 for node 4 datalen 5598
        5536:20120803:104910.218 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5536:20120803:104910.705 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5543:20120803:104912.929 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 31780
        5543:20120803:105016.353 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5542:20120803:105049.650 NODE 2: Received history from node 3 for node 3 datalen 442970
        5542:20120803:105105.210 NODE 2: Received history_uint from node 3 for node 3 datalen 396751
        5542:20120803:105122.773 NODE 2: Received history_str from node 3 for node 3 datalen 137921
        5542:20120803:105123.290 NODE 2: Received history_text from node 3 for node 3 datalen 17027
        5542:20120803:105123.623 NODE 2: Received events from node 3 for node 3 datalen 6801
        5516:20120803:105227.626 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5516:20120803:105230.632 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 59
        5537:20120803:105243.347 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 10671
        5537:20120803:105301.907 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 59
        5518:20120803:105341.126 NODE 2: Received history from node 1 for node 1 datalen 119559
        5518:20120803:105344.698 NODE 2: Received history_uint from node 1 for node 1 datalen 224301
        5518:20120803:105401.393 NODE 2: Received history_str from node 1 for node 1 datalen 41452
        5518:20120803:105401.488 NODE 2: Received history_text from node 1 for node 1 datalen 1164
        5518:20120803:105401.545 NODE 2: Received events from node 1 for node 1 datalen 2887
        5523:20120803:105420.418 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 14196
        5523:20120803:105513.920 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 59
        5542:20120803:105548.179 NODE 2: Received history from node 4 for node 4 datalen 315019
        5542:20120803:105557.272 NODE 2: Received history_uint from node 4 for node 4 datalen 391725
        5542:20120803:105620.031 NODE 2: Received history_str from node 4 for node 4 datalen 133675
        5542:20120803:105620.379 NODE 2: Received history_text from node 4 for node 4 datalen 4836
        5536:20120803:105730.123 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5536:20120803:105730.616 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 59
        5543:20120803:105733.062 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 29807
        5543:20120803:105827.911 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 59
        5523:20120803:105858.981 NODE 2: Received history from node 3 for node 3 datalen 442999
        5523:20120803:105914.314 NODE 2: Received history_uint from node 3 for node 3 datalen 396232
        5523:20120803:105932.144 NODE 2: Received history_str from node 3 for node 3 datalen 139882
        5523:20120803:105932.704 NODE 2: Received history_text from node 3 for node 3 datalen 18290
        5523:20120803:105936.047 NODE 2: Received events from node 3 for node 3 datalen 4072
        5516:20120803:110035.491 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5516:20120803:110038.641 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5517:20120803:110050.978 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 13358
        5517:20120803:110110.806 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5531:20120803:110148.558 NODE 2: Received history from node 1 for node 1 datalen 106784
        5531:20120803:110151.367 NODE 2: Received history_uint from node 1 for node 1 datalen 210293
        5531:20120803:110206.786 NODE 2: Received history_str from node 1 for node 1 datalen 38116
        5531:20120803:110206.869 NODE 2: Received history_text from node 1 for node 1 datalen 785
        5531:20120803:110206.942 NODE 2: Received events from node 1 for node 1 datalen 3066
        5542:20120803:110227.465 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 12394
        5542:20120803:110319.428 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5531:20120803:110355.118 NODE 2: Received history from node 4 for node 4 datalen 310495
        5531:20120803:110404.466 NODE 2: Received history_uint from node 4 for node 4 datalen 392728
        5531:20120803:110427.075 NODE 2: Received history_str from node 4 for node 4 datalen 134091
        5531:20120803:110427.393 NODE 2: Received history_text from node 4 for node 4 datalen 3942
        5536:20120803:110535.579 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5536:20120803:110536.062 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5519:20120803:110538.185 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 28726
        5519:20120803:110643.648 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5539:20120803:110716.232 NODE 2: Received history from node 3 for node 3 datalen 442743
        5539:20120803:110732.139 NODE 2: Received history_uint from node 3 for node 3 datalen 395760
        5515:20120803:110749.108 NODE 2: Received history_str from node 3 for node 3 datalen 151747
        5529:20120803:110752.539 NODE 2: Received history_text from node 3 for node 3 datalen 26923
        5529:20120803:110752.912 NODE 2: Received events from node 3 for node 3 datalen 2972
        5516:20120803:110853.264 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5516:20120803:110856.269 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5517:20120803:110909.874 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12623
        5517:20120803:110927.989 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5543:20120803:111003.267 NODE 2: Received history from node 1 for node 1 datalen 105772
        5543:20120803:111005.906 NODE 2: Received history_uint from node 1 for node 1 datalen 211005
        5525:20120803:111021.556 NODE 2: Received history_str from node 1 for node 1 datalen 40987
        5519:20120803:111021.640 NODE 2: Received history_text from node 1 for node 1 datalen 890
        5519:20120803:111021.684 NODE 2: Received events from node 1 for node 1 datalen 2074
        5531:20120803:111042.725 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 115208
        5531:20120803:111135.767 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5518:20120803:111209.823 NODE 2: Received history from node 4 for node 4 datalen 310786
        5518:20120803:111218.862 NODE 2: Received history_uint from node 4 for node 4 datalen 392354
        5518:20120803:111241.266 NODE 2: Received history_str from node 4 for node 4 datalen 119444
        5518:20120803:111241.546 NODE 2: Received history_text from node 4 for node 4 datalen 5340
        5536:20120803:111350.686 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5536:20120803:111351.165 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5520:20120803:111353.609 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 29125
        5520:20120803:111449.205 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5531:20120803:111521.326 NODE 2: Received history from node 3 for node 3 datalen 443005
        5531:20120803:111536.455 NODE 2: Received history_uint from node 3 for node 3 datalen 396645
        5531:20120803:111555.261 NODE 2: Received history_str from node 3 for node 3 datalen 132367
        5531:20120803:111555.755 NODE 2: Received history_text from node 3 for node 3 datalen 19195
        5531:20120803:111556.048 NODE 2: Received events from node 3 for node 3 datalen 2194
        5521:20120803:111658.997 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5521:20120803:111702.549 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5517:20120803:111715.534 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 11350
        5517:20120803:111734.200 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5531:20120803:111813.913 NODE 2: Received history from node 1 for node 1 datalen 100370
        5531:20120803:111816.536 NODE 2: Received history_uint from node 1 for node 1 datalen 214517
        5531:20120803:111831.605 NODE 2: Received history_str from node 1 for node 1 datalen 48827
        5531:20120803:111831.774 NODE 2: Received history_text from node 1 for node 1 datalen 843
        5531:20120803:111831.820 NODE 2: Received events from node 1 for node 1 datalen 2518
        5518:20120803:111855.844 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 13684
        5518:20120803:111947.278 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5543:20120803:112023.346 NODE 2: Received history from node 4 for node 4 datalen 323253
        5542:20120803:112032.608 NODE 2: Received history_uint from node 4 for node 4 datalen 392062
        5529:20120803:112055.617 NODE 2: Received history_str from node 4 for node 4 datalen 130125
        5514:20120803:112055.930 NODE 2: Received history_text from node 4 for node 4 datalen 7032
        5536:20120803:112206.922 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5536:20120803:112207.403 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5520:20120803:112209.701 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 183258
        5520:20120803:112303.249 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5515:20120803:112335.860 NODE 2: Received history from node 3 for node 3 datalen 443058
        5542:20120803:112350.530 NODE 2: Received history_uint from node 3 for node 3 datalen 396611
        5517:20120803:112408.939 NODE 2: Received history_str from node 3 for node 3 datalen 130895
        5517:20120803:112409.265 NODE 2: Received history_text from node 3 for node 3 datalen 18562
        5529:20120803:112409.584 NODE 2: Received events from node 3 for node 3 datalen 2579
        5521:20120803:112511.723 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5521:20120803:112514.787 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5519:20120803:112528.235 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12582
        5519:20120803:112550.751 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5525:20120803:112629.988 NODE 2: Received history from node 1 for node 1 datalen 112019
        5537:20120803:112633.314 NODE 2: Received history_uint from node 1 for node 1 datalen 231831
        5537:20120803:112650.023 NODE 2: Received history_str from node 1 for node 1 datalen 70526
        5537:20120803:112650.216 NODE 2: Received history_text from node 1 for node 1 datalen 1183
        5537:20120803:112650.284 NODE 2: Received events from node 1 for node 1 datalen 2352
        5514:20120803:112709.772 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 13514
        5514:20120803:112804.221 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5525:20120803:112839.229 NODE 2: Received history from node 4 for node 4 datalen 326743
        5525:20120803:112848.894 NODE 2: Received history_uint from node 4 for node 4 datalen 391996
        5525:20120803:112911.255 NODE 2: Received history_str from node 4 for node 4 datalen 121776
        5528:20120803:112911.579 NODE 2: Received history_text from node 4 for node 4 datalen 5349
        5536:20120803:113019.849 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5536:20120803:113020.329 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5543:20120803:113022.114 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 25711
        5543:20120803:113118.650 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5513:20120803:113151.167 NODE 2: Received history from node 3 for node 3 datalen 443548
        5513:20120803:113208.302 NODE 2: Received history_uint from node 3 for node 3 datalen 395505
        5513:20120803:113225.817 NODE 2: Received history_str from node 3 for node 3 datalen 128866
        5513:20120803:113226.311 NODE 2: Received history_text from node 3 for node 3 datalen 26341
        5513:20120803:113226.678 NODE 2: Received events from node 3 for node 3 datalen 2802
        5521:20120803:113328.522 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5521:20120803:113331.553 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5519:20120803:113345.389 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 10252
        5519:20120803:113408.591 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5513:20120803:113449.012 NODE 2: Received history from node 1 for node 1 datalen 112909
        5513:20120803:113452.530 NODE 2: Received history_uint from node 1 for node 1 datalen 262472
        5513:20120803:113511.365 NODE 2: Received history_str from node 1 for node 1 datalen 68640
        5515:20120803:113511.615 NODE 2: Received history_text from node 1 for node 1 datalen 1001
        5539:20120803:113511.678 NODE 2: Received events from node 1 for node 1 datalen 3398
        5528:20120803:113528.370 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 14449
        5528:20120803:113622.746 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5525:20120803:113657.802 NODE 2: Received history from node 4 for node 4 datalen 323329
        5537:20120803:113707.471 NODE 2: Received history_uint from node 4 for node 4 datalen 391869
        5525:20120803:113730.552 NODE 2: Received history_str from node 4 for node 4 datalen 125779
        5520:20120803:113730.846 NODE 2: Received history_text from node 4 for node 4 datalen 5035
        5536:20120803:113838.352 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5536:20120803:113838.847 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5543:20120803:113841.612 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 26063
        5543:20120803:113940.059 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5515:20120803:114012.332 NODE 2: Received history from node 3 for node 3 datalen 443429
        5531:20120803:114028.629 NODE 2: Received history_uint from node 3 for node 3 datalen 397121
        5523:20120803:114046.755 NODE 2: Received history_str from node 3 for node 3 datalen 141948
        5523:20120803:114047.182 NODE 2: Received history_text from node 3 for node 3 datalen 48697
        5523:20120803:114047.547 NODE 2: Received events from node 3 for node 3 datalen 3900
        5521:20120803:114149.438 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5521:20120803:114152.485 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5519:20120803:114204.783 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 14756
        5519:20120803:114229.600 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5542:20120803:114308.694 NODE 2: Received history from node 1 for node 1 datalen 109585
        5542:20120803:114312.525 NODE 2: Received history_uint from node 1 for node 1 datalen 243135
        5542:20120803:114329.426 NODE 2: Received history_str from node 1 for node 1 datalen 47932
        5542:20120803:114329.652 NODE 2: Received history_text from node 1 for node 1 datalen 846
        5542:20120803:114329.695 NODE 2: Received events from node 1 for node 1 datalen 3296
        5539:20120803:114348.166 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15523
        5539:20120803:114440.661 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5542:20120803:114515.411 NODE 2: Received history from node 4 for node 4 datalen 312201
        5542:20120803:114525.828 NODE 2: Received history_uint from node 4 for node 4 datalen 392273
        5542:20120803:114547.734 NODE 2: Received history_str from node 4 for node 4 datalen 123651
        5542:20120803:114548.044 NODE 2: Received history_text from node 4 for node 4 datalen 4743
        5536:20120803:114658.078 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5536:20120803:114658.559 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5543:20120803:114700.239 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 29921
        5543:20120803:114759.609 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5531:20120803:114833.786 NODE 2: Received history from node 3 for node 3 datalen 443004
        5523:20120803:114849.640 NODE 2: Received history_uint from node 3 for node 3 datalen 396099
        5523:20120803:114907.383 NODE 2: Received history_str from node 3 for node 3 datalen 134588
        5518:20120803:114907.801 NODE 2: Received history_text from node 3 for node 3 datalen 56545
        5516:20120803:114908.204 NODE 2: Received events from node 3 for node 3 datalen 3715
        5520:20120803:115011.428 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5520:20120803:115015.084 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5519:20120803:115027.386 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12627
        5519:20120803:115049.961 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5515:20120803:115130.610 NODE 2: Received history from node 1 for node 1 datalen 121779
        5515:20120803:115134.618 NODE 2: Received history_uint from node 1 for node 1 datalen 224083
        5525:20120803:115152.669 NODE 2: Received history_str from node 1 for node 1 datalen 47794
        5539:20120803:115152.798 NODE 2: Received history_text from node 1 for node 1 datalen 1004
        5539:20120803:115152.843 NODE 2: Received events from node 1 for node 1 datalen 2792
        5521:20120803:115209.677 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 14310
        5521:20120803:115301.825 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5539:20120803:115334.683 NODE 2: Received history from node 4 for node 4 datalen 320118
        5525:20120803:115344.476 NODE 2: Received history_uint from node 4 for node 4 datalen 391732
        5513:20120803:115406.588 NODE 2: Received history_str from node 4 for node 4 datalen 132676
        5515:20120803:115406.896 NODE 2: Received history_text from node 4 for node 4 datalen 5026
        5536:20120803:115515.958 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5536:20120803:115516.441 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5543:20120803:115519.261 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 53369
        5543:20120803:115613.294 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5523:20120803:115648.665 NODE 2: Received history from node 3 for node 3 datalen 442680
        5523:20120803:115706.704 NODE 2: Received history_uint from node 3 for node 3 datalen 397391
        5514:20120803:115731.302 NODE 2: Received history_str from node 3 for node 3 datalen 163601
        5528:20120803:115731.835 NODE 2: Received history_text from node 3 for node 3 datalen 43015
        5525:20120803:115732.169 NODE 2: Received events from node 3 for node 3 datalen 6488
        5520:20120803:115828.939 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5520:20120803:115832.013 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5519:20120803:115846.696 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 11397
        5519:20120803:115908.260 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5542:20120803:115946.914 NODE 2: Received history from node 1 for node 1 datalen 104991
        5529:20120803:115949.804 NODE 2: Received history_uint from node 1 for node 1 datalen 222859
        5529:20120803:120005.399 NODE 2: Received history_str from node 1 for node 1 datalen 39662
        5529:20120803:120005.503 NODE 2: Received history_text from node 1 for node 1 datalen 1506
        5529:20120803:120005.561 NODE 2: Received events from node 1 for node 1 datalen 2618
        5515:20120803:120025.920 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 14525
        5515:20120803:120135.351 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5536:20120803:120212.637 NODE 2: Received history from node 4 for node 4 datalen 330907
        5543:20120803:120222.291 NODE 2: Received history_uint from node 4 for node 4 datalen 391685
        5543:20120803:120244.512 NODE 2: Received history_str from node 4 for node 4 datalen 145511
        5513:20120803:120244.877 NODE 2: Received history_text from node 4 for node 4 datalen 14526
        5539:20120803:120353.335 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5539:20120803:120353.823 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5520:20120803:120355.960 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 39383
        5520:20120803:120450.879 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5515:20120803:120526.796 NODE 2: Received history from node 3 for node 3 datalen 442859
        5515:20120803:120543.733 NODE 2: Received history_uint from node 3 for node 3 datalen 396221
        5515:20120803:120600.855 NODE 2: Received history_str from node 3 for node 3 datalen 158744
        5515:20120803:120601.330 NODE 2: Received history_text from node 3 for node 3 datalen 45534
        5515:20120803:120601.694 NODE 2: Received events from node 3 for node 3 datalen 2964
        5521:20120803:120700.830 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5521:20120803:120703.845 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5519:20120803:120716.982 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 11532
        5519:20120803:120735.828 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5543:20120803:120814.520 NODE 2: Received history from node 1 for node 1 datalen 108863
        5543:20120803:120817.361 NODE 2: Received history_uint from node 1 for node 1 datalen 225009
        5543:20120803:120834.586 NODE 2: Received history_str from node 1 for node 1 datalen 51035
        5543:20120803:120834.701 NODE 2: Received history_text from node 1 for node 1 datalen 2500
        5543:20120803:120834.775 NODE 2: Received events from node 1 for node 1 datalen 3466
        5513:20120803:120853.872 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15127
        5513:20120803:120945.765 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5520:20120803:121021.364 NODE 2: Received history from node 4 for node 4 datalen 308145
        5533:20120803:121030.371 NODE 2: Received history_uint from node 4 for node 4 datalen 391715
        5533:20120803:121052.367 NODE 2: Received history_str from node 4 for node 4 datalen 143454
        5529:20120803:121052.739 NODE 2: Received history_text from node 4 for node 4 datalen 17819
        5539:20120803:121203.734 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5539:20120803:121204.218 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5521:20120803:121206.334 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 284636
        5521:20120803:121311.227 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5520:20120803:121345.794 NODE 2: Received history from node 3 for node 3 datalen 443110
        5520:20120803:121402.412 NODE 2: Received history_uint from node 3 for node 3 datalen 396096
        5520:20120803:121419.478 NODE 2: Received history_str from node 3 for node 3 datalen 144233
        5520:20120803:121419.979 NODE 2: Received history_text from node 3 for node 3 datalen 49993
        5520:20120803:121420.378 NODE 2: Received events from node 3 for node 3 datalen 3452
        5515:20120803:121523.697 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:121526.703 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5519:20120803:121539.898 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 13715
        5519:20120803:121558.949 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5514:20120803:121643.481 NODE 2: Received history from node 1 for node 1 datalen 105929
        5514:20120803:121646.124 NODE 2: Received history_uint from node 1 for node 1 datalen 231451
        5514:20120803:121702.902 NODE 2: Received history_str from node 1 for node 1 datalen 50292
        5514:20120803:121703.014 NODE 2: Received history_text from node 1 for node 1 datalen 2016
        5514:20120803:121703.074 NODE 2: Received events from node 1 for node 1 datalen 2741
        5529:20120803:121722.926 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 12259
        5529:20120803:121818.856 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5514:20120803:121855.227 NODE 2: Received history from node 4 for node 4 datalen 332895
        5514:20120803:121905.265 NODE 2: Received history_uint from node 4 for node 4 datalen 391387
        5523:20120803:121927.572 NODE 2: Received history_str from node 4 for node 4 datalen 149823
        5523:20120803:121928.600 NODE 2: Received history_text from node 4 for node 4 datalen 11034
        5539:20120803:122036.692 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5539:20120803:122037.173 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5521:20120803:122039.520 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 29947
        5521:20120803:122131.397 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5514:20120803:122204.369 NODE 2: Received history from node 3 for node 3 datalen 443178
        5514:20120803:122220.576 NODE 2: Received history_uint from node 3 for node 3 datalen 395831
        5514:20120803:122238.234 NODE 2: Received history_str from node 3 for node 3 datalen 134196
        5514:20120803:122238.706 NODE 2: Received history_text from node 3 for node 3 datalen 49058
        5514:20120803:122239.118 NODE 2: Received events from node 3 for node 3 datalen 3192
        5514:20120803:122239.153 NODE 2: Received acknowledges from node 3 for node 3 datalen 124
        5515:20120803:122341.701 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:122344.727 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5519:20120803:122357.509 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12989
        5519:20120803:122418.858 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5514:20120803:122456.832 NODE 2: Received history from node 1 for node 1 datalen 112497
        5514:20120803:122500.100 NODE 2: Received history_uint from node 1 for node 1 datalen 237948
        5514:20120803:122517.399 NODE 2: Received history_str from node 1 for node 1 datalen 57979
        5514:20120803:122517.575 NODE 2: Received history_text from node 1 for node 1 datalen 1671
        5514:20120803:122517.631 NODE 2: Received events from node 1 for node 1 datalen 2952
        5523:20120803:122536.214 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15025
        5523:20120803:122631.633 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5529:20120803:122705.775 NODE 2: Received history from node 4 for node 4 datalen 316808
        5529:20120803:122715.688 NODE 2: Received history_uint from node 4 for node 4 datalen 392075
        5529:20120803:122738.970 NODE 2: Received history_str from node 4 for node 4 datalen 143217
        5529:20120803:122739.290 NODE 2: Received history_text from node 4 for node 4 datalen 19563
        5539:20120803:122846.841 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5539:20120803:122847.322 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5521:20120803:122849.474 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 27114
        5521:20120803:122948.157 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5539:20120803:123019.900 NODE 2: Received history from node 3 for node 3 datalen 443132
        5539:20120803:123035.123 NODE 2: Received history_uint from node 3 for node 3 datalen 395533
        5539:20120803:123054.304 NODE 2: Received history_str from node 3 for node 3 datalen 150855
        5539:20120803:123054.744 NODE 2: Received history_text from node 3 for node 3 datalen 48957
        5539:20120803:123055.166 NODE 2: Received events from node 3 for node 3 datalen 3544
        5515:20120803:123156.956 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:123159.972 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5519:20120803:123212.888 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12619
        5519:20120803:123231.778 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5539:20120803:123313.576 NODE 2: Received history from node 1 for node 1 datalen 106490
        5539:20120803:123316.712 NODE 2: Received history_uint from node 1 for node 1 datalen 242031
        5539:20120803:123333.989 NODE 2: Received history_str from node 1 for node 1 datalen 56525
        5539:20120803:123334.191 NODE 2: Received history_text from node 1 for node 1 datalen 2053
        5539:20120803:123334.243 NODE 2: Received events from node 1 for node 1 datalen 2461
        5529:20120803:123352.927 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15372
        5529:20120803:123443.082 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5539:20120803:123518.408 NODE 2: Received history from node 4 for node 4 datalen 325252
        5531:20120803:123530.089 NODE 2: Received history_uint from node 4 for node 4 datalen 392019
        5539:20120803:123552.392 NODE 2: Received history_str from node 4 for node 4 datalen 149438
        5539:20120803:123552.813 NODE 2: Received history_text from node 4 for node 4 datalen 4111
        5523:20120803:123659.389 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5523:20120803:123659.870 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5521:20120803:123701.725 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 30557
        5521:20120803:123802.975 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5539:20120803:123835.138 NODE 2: Received history from node 3 for node 3 datalen 443071
        5537:20120803:123851.859 NODE 2: Received history_uint from node 3 for node 3 datalen 396377
        5537:20120803:123908.993 NODE 2: Received history_str from node 3 for node 3 datalen 151620
        5537:20120803:123909.518 NODE 2: Received history_text from node 3 for node 3 datalen 72626
        5537:20120803:123909.878 NODE 2: Received events from node 3 for node 3 datalen 3187
        5515:20120803:124011.658 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:124014.672 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5519:20120803:124028.830 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 9432
        5519:20120803:124047.102 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5537:20120803:124128.143 NODE 2: Received history from node 1 for node 1 datalen 119410
        5528:20120803:124132.915 NODE 2: Received history_uint from node 1 for node 1 datalen 278229
        5528:20120803:124151.528 NODE 2: Received history_str from node 1 for node 1 datalen 57823
        5514:20120803:124151.763 NODE 2: Received history_text from node 1 for node 1 datalen 1633
        5514:20120803:124151.817 NODE 2: Received events from node 1 for node 1 datalen 2614
        5529:20120803:124207.983 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 14696
        5529:20120803:124257.894 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5539:20120803:124331.787 NODE 2: Received history from node 4 for node 4 datalen 309336
        5539:20120803:124341.113 NODE 2: Received history_uint from node 4 for node 4 datalen 392183
        5525:20120803:124404.480 NODE 2: Received history_str from node 4 for node 4 datalen 141133
        5525:20120803:124404.804 NODE 2: Received history_text from node 4 for node 4 datalen 18420
        5523:20120803:124513.247 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5523:20120803:124513.733 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5513:20120803:124515.798 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 21855
        5513:20120803:124620.941 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5521:20120803:124652.937 NODE 2: Received history from node 3 for node 3 datalen 443105
        5521:20120803:124709.937 NODE 2: Received history_uint from node 3 for node 3 datalen 396404
        5521:20120803:124726.887 NODE 2: Received history_str from node 3 for node 3 datalen 149411
        5521:20120803:124727.325 NODE 2: Received history_text from node 3 for node 3 datalen 65594
        5521:20120803:124727.669 NODE 2: Received events from node 3 for node 3 datalen 3542
        5515:20120803:124830.452 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:124833.560 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5514:20120803:124847.107 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12272
        5514:20120803:124906.130 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5525:20120803:124946.451 NODE 2: Received history from node 1 for node 1 datalen 122938
        5525:20120803:124950.116 NODE 2: Received history_uint from node 1 for node 1 datalen 246729
        5517:20120803:125007.424 NODE 2: Received history_str from node 1 for node 1 datalen 62666
        5517:20120803:125008.051 NODE 2: Received history_text from node 1 for node 1 datalen 2738
        5517:20120803:125008.195 NODE 2: Received events from node 1 for node 1 datalen 2100
        5531:20120803:125025.614 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 13283
        5531:20120803:125123.257 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5517:20120803:125156.420 NODE 2: Received history from node 4 for node 4 datalen 327200
        5517:20120803:125207.434 NODE 2: Received history_uint from node 4 for node 4 datalen 392154
        5525:20120803:125230.151 NODE 2: Received history_str from node 4 for node 4 datalen 142021
        5525:20120803:125230.498 NODE 2: Received history_text from node 4 for node 4 datalen 4915
        5523:20120803:125337.349 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5523:20120803:125337.843 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5513:20120803:125339.851 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 29935
        5513:20120803:125437.929 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5531:20120803:125510.027 NODE 2: Received history from node 3 for node 3 datalen 443199
        5531:20120803:125526.269 NODE 2: Received history_uint from node 3 for node 3 datalen 396729
        5533:20120803:125543.972 NODE 2: Received history_str from node 3 for node 3 datalen 144821
        5533:20120803:125544.498 NODE 2: Received history_text from node 3 for node 3 datalen 61374
        5533:20120803:125544.853 NODE 2: Received events from node 3 for node 3 datalen 1959
        5515:20120803:125647.357 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:125650.399 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5514:20120803:125704.235 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 9425
        5514:20120803:125723.595 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5531:20120803:125804.967 NODE 2: Received history from node 1 for node 1 datalen 107392
        5531:20120803:125808.070 NODE 2: Received history_uint from node 1 for node 1 datalen 247474
        5531:20120803:125824.563 NODE 2: Received history_str from node 1 for node 1 datalen 59823
        5517:20120803:125824.797 NODE 2: Received history_text from node 1 for node 1 datalen 2299
        5517:20120803:125824.838 NODE 2: Received events from node 1 for node 1 datalen 2353
        5525:20120803:125844.321 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15431
        5525:20120803:125937.254 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5517:20120803:130010.980 NODE 2: Received history from node 4 for node 4 datalen 314266
        5517:20120803:130019.909 NODE 2: Received history_uint from node 4 for node 4 datalen 391544
        5517:20120803:130042.969 NODE 2: Received history_str from node 4 for node 4 datalen 126653
        5531:20120803:130043.254 NODE 2: Received history_text from node 4 for node 4 datalen 5054
        5523:20120803:130151.169 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5523:20120803:130151.676 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5513:20120803:130153.761 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 28538
        5513:20120803:130248.010 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5516:20120803:130321.007 NODE 2: Received history from node 3 for node 3 datalen 442493
        5516:20120803:130336.302 NODE 2: Received history_uint from node 3 for node 3 datalen 395485
        5516:20120803:130353.891 NODE 2: Received history_str from node 3 for node 3 datalen 147806
        5521:20120803:130354.374 NODE 2: Received history_text from node 3 for node 3 datalen 49102
        5518:20120803:130354.738 NODE 2: Received events from node 3 for node 3 datalen 6092
        5515:20120803:130459.021 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:130502.073 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5514:20120803:130515.275 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 11699
        5514:20120803:130537.155 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5521:20120803:130619.077 NODE 2: Received history from node 1 for node 1 datalen 110691
        5539:20120803:130622.289 NODE 2: Received history_uint from node 1 for node 1 datalen 231512
        5539:20120803:130638.681 NODE 2: Received history_str from node 1 for node 1 datalen 65096
        5539:20120803:130638.846 NODE 2: Received history_text from node 1 for node 1 datalen 3441
        5539:20120803:130638.922 NODE 2: Received events from node 1 for node 1 datalen 2242
        5531:20120803:130658.734 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 13983
        5531:20120803:130751.400 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5539:20120803:130825.079 NODE 2: Received history from node 4 for node 4 datalen 315142
        5539:20120803:130834.689 NODE 2: Received history_uint from node 4 for node 4 datalen 391855
        5539:20120803:130858.460 NODE 2: Received history_str from node 4 for node 4 datalen 125297
        5539:20120803:130858.739 NODE 2: Received history_text from node 4 for node 4 datalen 3241
        5523:20120803:131007.313 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5523:20120803:131007.801 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5513:20120803:131009.643 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 29746
        5513:20120803:131107.595 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5531:20120803:131139.089 NODE 2: Received history from node 3 for node 3 datalen 443466
        5531:20120803:131154.696 NODE 2: Received history_uint from node 3 for node 3 datalen 395841
        5521:20120803:131212.754 NODE 2: Received history_str from node 3 for node 3 datalen 144832
        5531:20120803:131213.268 NODE 2: Received history_text from node 3 for node 3 datalen 58197
        5531:20120803:131213.720 NODE 2: Received events from node 3 for node 3 datalen 1651
        5515:20120803:131316.379 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:131319.397 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5514:20120803:131331.284 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 11649
        5514:20120803:131351.276 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5543:20120803:131426.041 NODE 2: Received history from node 1 for node 1 datalen 102440
        5543:20120803:131428.609 NODE 2: Received history_uint from node 1 for node 1 datalen 243410
        5543:20120803:131445.621 NODE 2: Received history_str from node 1 for node 1 datalen 58448
        5543:20120803:131445.812 NODE 2: Received history_text from node 1 for node 1 datalen 1959
        5543:20120803:131445.874 NODE 2: Received events from node 1 for node 1 datalen 2288
        5539:20120803:131505.768 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15382
        5539:20120803:131558.001 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5543:20120803:131631.640 NODE 2: Received history from node 4 for node 4 datalen 302567
        5543:20120803:131641.075 NODE 2: Received history_uint from node 4 for node 4 datalen 392343
        5543:20120803:131704.255 NODE 2: Received history_str from node 4 for node 4 datalen 127963
        5543:20120803:131704.670 NODE 2: Received history_text from node 4 for node 4 datalen 3410
        5523:20120803:131812.188 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5523:20120803:131812.691 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5519:20120803:131814.414 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 21974
        5519:20120803:131906.044 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5539:20120803:131937.540 NODE 2: Received history from node 3 for node 3 datalen 443029
        5539:20120803:131954.540 NODE 2: Received history_uint from node 3 for node 3 datalen 396291
        5539:20120803:132011.985 NODE 2: Received history_str from node 3 for node 3 datalen 130469
        5539:20120803:132012.511 NODE 2: Received history_text from node 3 for node 3 datalen 54410
        5518:20120803:132012.896 NODE 2: Received events from node 3 for node 3 datalen 1644
        5515:20120803:132115.295 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:132118.310 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5514:20120803:132129.779 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 10376
        5514:20120803:132151.404 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5555:20120803:132158.281 executing housekeeper
        5518:20120803:132227.471 NODE 2: Received history from node 1 for node 1 datalen 106883
        5518:20120803:132231.182 NODE 2: Received history_uint from node 1 for node 1 datalen 242394
        5518:20120803:132246.804 NODE 2: Received history_str from node 1 for node 1 datalen 54571
        5518:20120803:132246.916 NODE 2: Received history_text from node 1 for node 1 datalen 1228
        5518:20120803:132246.960 NODE 2: Received events from node 1 for node 1 datalen 2440
        5543:20120803:132307.682 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 13805
        5543:20120803:132412.605 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5518:20120803:132446.920 NODE 2: Received history from node 4 for node 4 datalen 327367
        5518:20120803:132500.985 NODE 2: Received history_uint from node 4 for node 4 datalen 392103
        5518:20120803:132526.288 NODE 2: Received history_str from node 4 for node 4 datalen 140107
        5528:20120803:132526.788 NODE 2: Received history_text from node 4 for node 4 datalen 4567
        5523:20120803:132628.905 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5523:20120803:132629.452 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5519:20120803:132631.857 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 25279
        5519:20120803:132754.681 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5517:20120803:132826.354 NODE 2: Received history from node 3 for node 3 datalen 443234
        5536:20120803:132850.429 NODE 2: Received history_uint from node 3 for node 3 datalen 395852
        5536:20120803:132907.489 NODE 2: Received history_str from node 3 for node 3 datalen 165644
        5513:20120803:132908.193 NODE 2: Received history_text from node 3 for node 3 datalen 61028
        5513:20120803:132908.871 NODE 2: Received events from node 3 for node 3 datalen 2462
        5515:20120803:133005.274 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5515:20120803:133011.850 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5514:20120803:133025.656 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 11048
        5514:20120803:133056.786 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5515:20120803:133137.062 NODE 2: Received history from node 1 for node 1 datalen 122593
        5515:20120803:133141.743 NODE 2: Received history_uint from node 1 for node 1 datalen 291383
        5515:20120803:133154.651 NODE 2: Received history_str from node 1 for node 1 datalen 61388
        5515:20120803:133154.824 NODE 2: Received history_text from node 1 for node 1 datalen 1458
        5515:20120803:133154.882 NODE 2: Received events from node 1 for node 1 datalen 2625
        5528:20120803:133217.185 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 14896
        5528:20120803:133346.158 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5543:20120803:133420.005 NODE 2: Received history from node 4 for node 4 datalen 389765
        5543:20120803:133452.653 NODE 2: Received history_uint from node 4 for node 4 datalen 391927
        5543:20120803:133519.873 NODE 2: Received history_str from node 4 for node 4 datalen 179584
        5543:20120803:133520.756 NODE 2: Received history_text from node 4 for node 4 datalen 12291
        5523:20120803:133603.898 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5523:20120803:133605.149 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5513:20120803:133607.539 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 22251
        5513:20120803:133736.666 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5515:20120803:133808.484 NODE 2: Received history from node 3 for node 3 datalen 442978
        5516:20120803:133820.708 NODE 2: Received history_uint from node 3 for node 3 datalen 396286
        5536:20120803:133830.423 NODE 2: Received history_str from node 3 for node 3 datalen 167079
        5536:20120803:133830.922 NODE 2: Received history_text from node 3 for node 3 datalen 70425
        5536:20120803:133831.266 NODE 2: Received events from node 3 for node 3 datalen 1929
        5521:20120803:133946.938 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5521:20120803:133952.324 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5514:20120803:134005.620 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 13639
        5514:20120803:134036.519 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5543:20120803:134117.460 NODE 2: Received history from node 1 for node 1 datalen 130576
        5516:20120803:134126.185 NODE 2: Received history_uint from node 1 for node 1 datalen 310193
        5543:20120803:134153.254 NODE 2: Received history_str from node 1 for node 1 datalen 69149
        5515:20120803:134153.509 NODE 2: Received history_text from node 1 for node 1 datalen 1445
        5518:20120803:134153.660 NODE 2: Received events from node 1 for node 1 datalen 2982
        5533:20120803:134157.353 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5533:20120803:134200.982 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5539:20120803:134204.182 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 16738
        5539:20120803:134338.229 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5518:20120803:134412.225 NODE 2: Received history from node 4 for node 4 datalen 377923
        5531:20120803:134426.483 NODE 2: Received history_uint from node 4 for node 4 datalen 391603
        5525:20120803:134440.421 NODE 2: Received history_str from node 4 for node 4 datalen 163888
        5516:20120803:134440.852 NODE 2: Received history_text from node 4 for node 4 datalen 7275
        5517:20120803:134555.775 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 28750
        5517:20120803:134709.140 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5529:20120803:134741.046 NODE 2: Received history from node 3 for node 3 datalen 443517
        5539:20120803:134810.405 NODE 2: Received history_uint from node 3 for node 3 datalen 395738
        5539:20120803:134832.441 NODE 2: Received history_str from node 3 for node 3 datalen 169223
        5525:20120803:134836.096 NODE 2: Received history_text from node 3 for node 3 datalen 55557
        5516:20120803:134837.025 NODE 2: Received events from node 3 for node 3 datalen 2493
        5521:20120803:134920.547 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5521:20120803:134926.068 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5515:20120803:134940.116 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5515:20120803:134940.654 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5533:20120803:134943.135 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 13913
        5533:20120803:135013.070 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
        5555:20120803:135016.554 housekeeper deleted: 452022 records from history and trends, 0 records of deleted items, 56949 events, 0 alerts, 0 sessions
        5542:20120803:135055.229 NODE 2: Received history from node 1 for node 1 datalen 140841
        5542:20120803:135102.525 NODE 2: Received history_uint from node 1 for node 1 datalen 290446
        5521:20120803:135127.308 NODE 2: Received history_str from node 1 for node 1 datalen 64688
        5536:20120803:135127.603 NODE 2: Received history_text from node 1 for node 1 datalen 2507
        5516:20120803:135127.679 NODE 2: Received events from node 1 for node 1 datalen 3446
        5523:20120803:135134.407 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 13641
        5523:20120803:135244.103 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
        5514:20120803:135317.721 NODE 2: Received history from node 4 for node 4 datalen 362708
        5521:20120803:135340.958 NODE 2: Received history_uint from node 4 for node 4 datalen 391842
        5539:20120803:135402.040 NODE 2: Received history_str from node 4 for node 4 datalen 169887
        5536:20120803:135403.428 NODE 2: Received history_text from node 4 for node 4 datalen 7458
        5529:20120803:135502.684 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 26464
        5529:20120803:135556.627 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
        5542:20120803:135628.245 NODE 2: Received history from node 3 for node 3 datalen 442993
        5521:20120803:135647.142 NODE 2: Received history_uint from node 3 for node 3 datalen 397425
        5539:20120803:135706.526 NODE 2: Received history_str from node 3 for node 3 datalen 144661
        5525:20120803:135710.098 NODE 2: Received history_text from node 3 for node 3 datalen 46116
        5525:20120803:135710.472 NODE 2: Received events from node 3 for node 3 datalen 2346
        5519:20120803:135806.716 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
        5519:20120803:135807.204 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
        5537:20120803:135809.539 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
        5537:20120803:135812.797 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
        5533:20120803:135827.218 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 15880
        5533:20120803:135851.607 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
      

      There are no errors in the logs.

        1. netmon 2 - master.png
          73 kB
          Roderick Groeneveld
        2. netmon 3 - slave.png
          73 kB
          Roderick Groeneveld
        3. status.png
          16 kB
          Roderick Groeneveld

            Unassigned Unassigned
            groe0286 Roderick Groeneveld
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

              Created:
              Updated:
              Resolved: