Uploaded image for project: 'ZABBIX BUGS AND ISSUES'
  1. ZABBIX BUGS AND ISSUES
  2. ZBX-5413

Table history_uint does not sync at the same speed as the other tables

XMLWordPrintable

    • Icon: Incident report Incident report
    • Resolution: Won't fix
    • Icon: Major Major
    • None
    • 2.0.1
    • Server (S)
    • CentOS 6.2 64-bit

      I'm encountering an issue with the history_uint tables not sync'ing to the master node at the same speed as the other tables, causing the integer values to lag/run behind, all other values are fine. This problem may only occur on very large installations, as the tables are actually sync'ing, just one table is sync'ing too slowly for us.

      I suspect that there is a limit in the code (didn't check this) somewhere, because all tables go over 400K bytes every now and then, especially when something big happens, except the history_uint table. I've never seen any sync of that table with a size hitting 400K, it's always something like 395K or so, while that table is running behind several days, and it's getting worse (it's a week at the moment and increasing, but the values ARE updating, just too slowly to keep up). Why isn't the sync sync'ing more data than 395K, when it's running behind that much? I should sync all missing data at once! If you look at the sync speeds, this is actually quite high, it takes about 2 minutes for a host to sync.

      Don't pay attention to nodes 5 and 6, they are not monitoring at the moment (temporarily suspended), that's why they are only sync'ing config, but no history tables.

      Very large distributed setup, 1 master node, 5 child nodes, all on CentOS 6.2 64-bit, MySQL 5.5:

      Number of hosts (monitored/not monitored/templates)	12043	11664 / 116 / 263
Number of items (monitored/disabled/not supported)	688965	647656 / 2571 / 38738
Number of triggers (enabled/disabled)[problem/unknown/ok]	194100	159297 / 34803  [709 / 0 / 158588]
Number of users (online)	197	5
Required server performance, new values per second	225.83	-

      Node 2 is the MASTER.

        5539:20120803:083846.991 NODE 2: Received events from node 1 for node 1 datalen 2888
  5531:20120803:083904.408 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 17155
  5531:20120803:083954.943 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5542:20120803:084028.520 NODE 2: Received history from node 4 for node 4 datalen 259137
  5537:20120803:084036.140 NODE 2: Received history_uint from node 4 for node 4 datalen 391526
  5542:20120803:084058.916 NODE 2: Received history_str from node 4 for node 4 datalen 113558
  5521:20120803:084059.145 NODE 2: Received history_text from node 4 for node 4 datalen 3779
  5543:20120803:084210.848 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5543:20120803:084211.326 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5516:20120803:084213.958 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 17109
  5516:20120803:084310.529 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5531:20120803:084343.304 NODE 2: Received history from node 3 for node 3 datalen 443935
  5531:20120803:084357.151 NODE 2: Received history_uint from node 3 for node 3 datalen 396884
  5542:20120803:084415.787 NODE 2: Received history_str from node 3 for node 3 datalen 140176
  5542:20120803:084416.292 NODE 2: Received history_text from node 3 for node 3 datalen 14208
  5542:20120803:084416.588 NODE 2: Received events from node 3 for node 3 datalen 4058
  5515:20120803:084521.261 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:084524.404 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5519:20120803:084537.728 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12035
  5519:20120803:084559.698 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5536:20120803:084641.638 NODE 2: Received history from node 1 for node 1 datalen 114532
  5536:20120803:084645.467 NODE 2: Received history_uint from node 1 for node 1 datalen 205511
  5536:20120803:084700.537 NODE 2: Received history_str from node 1 for node 1 datalen 50000
  5536:20120803:084700.711 NODE 2: Received history_text from node 1 for node 1 datalen 2688
  5536:20120803:084700.763 NODE 2: Received events from node 1 for node 1 datalen 2785
  5539:20120803:084721.522 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 12742
  5539:20120803:084812.803 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5520:20120803:084846.685 NODE 2: Received history from node 4 for node 4 datalen 274713
  5521:20120803:084855.821 NODE 2: Received history_uint from node 4 for node 4 datalen 390840
  5520:20120803:084917.803 NODE 2: Received history_str from node 4 for node 4 datalen 116361
  5520:20120803:084918.050 NODE 2: Received history_text from node 4 for node 4 datalen 4333
  5543:20120803:085027.067 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5543:20120803:085027.550 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5542:20120803:085030.071 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 21301
  5542:20120803:085123.109 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5539:20120803:085155.529 NODE 2: Received history from node 3 for node 3 datalen 443648
  5514:20120803:085211.429 NODE 2: Received history_uint from node 3 for node 3 datalen 396617
  5514:20120803:085228.526 NODE 2: Received history_str from node 3 for node 3 datalen 141440
  5514:20120803:085229.029 NODE 2: Received history_text from node 3 for node 3 datalen 17663
  5514:20120803:085232.351 NODE 2: Received events from node 3 for node 3 datalen 4450
  5515:20120803:085332.632 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:085335.688 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5519:20120803:085349.620 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12138
  5519:20120803:085411.964 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5539:20120803:085450.828 NODE 2: Received history from node 1 for node 1 datalen 117230
  5539:20120803:085454.514 NODE 2: Received history_uint from node 1 for node 1 datalen 223913
  5539:20120803:085511.282 NODE 2: Received history_str from node 1 for node 1 datalen 47553
  5539:20120803:085511.408 NODE 2: Received history_text from node 1 for node 1 datalen 1282
  5539:20120803:085511.456 NODE 2: Received events from node 1 for node 1 datalen 2461
  5520:20120803:085530.446 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15452
  5520:20120803:085628.325 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5539:20120803:085701.973 NODE 2: Received history from node 4 for node 4 datalen 261040
  5539:20120803:085709.396 NODE 2: Received history_uint from node 4 for node 4 datalen 391747
  5539:20120803:085730.949 NODE 2: Received history_str from node 4 for node 4 datalen 115893
  5531:20120803:085731.283 NODE 2: Received history_text from node 4 for node 4 datalen 9272
  5543:20120803:085842.179 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5543:20120803:085842.665 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5542:20120803:085844.665 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 23236
  5542:20120803:085942.983 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5520:20120803:090017.926 NODE 2: Received history from node 3 for node 3 datalen 443976
  5520:20120803:090035.586 NODE 2: Received history_uint from node 3 for node 3 datalen 396236
  5520:20120803:090052.506 NODE 2: Received history_str from node 3 for node 3 datalen 133054
  5520:20120803:090052.906 NODE 2: Received history_text from node 3 for node 3 datalen 20790
  5525:20120803:090053.253 NODE 2: Received events from node 3 for node 3 datalen 3579
  5515:20120803:090152.299 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:090155.296 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5519:20120803:090208.979 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 11577
  5519:20120803:090227.942 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5525:20120803:090307.193 NODE 2: Received history from node 1 for node 1 datalen 106417
  5525:20120803:090309.806 NODE 2: Received history_uint from node 1 for node 1 datalen 210730
  5525:20120803:090325.920 NODE 2: Received history_str from node 1 for node 1 datalen 48728
  5525:20120803:090326.083 NODE 2: Received history_text from node 1 for node 1 datalen 2848
  5536:20120803:090326.145 NODE 2: Received events from node 1 for node 1 datalen 2716
  5531:20120803:090346.699 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15528
  5531:20120803:090437.971 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5539:20120803:090511.635 NODE 2: Received history from node 4 for node 4 datalen 258377
  5539:20120803:090519.415 NODE 2: Received history_uint from node 4 for node 4 datalen 391216
  5514:20120803:090541.453 NODE 2: Received history_str from node 4 for node 4 datalen 110822
  5514:20120803:090541.789 NODE 2: Received history_text from node 4 for node 4 datalen 3228
  5543:20120803:090651.603 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5543:20120803:090652.086 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5542:20120803:090654.097 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 19912
  5542:20120803:090741.156 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5518:20120803:090813.285 NODE 2: Received history from node 3 for node 3 datalen 443813
  5518:20120803:090830.279 NODE 2: Received history_uint from node 3 for node 3 datalen 396340
  5518:20120803:090846.838 NODE 2: Received history_str from node 3 for node 3 datalen 119344
  5518:20120803:090847.310 NODE 2: Received history_text from node 3 for node 3 datalen 17601
  5518:20120803:090847.698 NODE 2: Received events from node 3 for node 3 datalen 15621
  5515:20120803:090951.931 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:090954.919 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5519:20120803:091008.146 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 11577
  5519:20120803:091028.919 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5523:20120803:091110.282 NODE 2: Received history from node 1 for node 1 datalen 103584
  5517:20120803:091113.111 NODE 2: Received history_uint from node 1 for node 1 datalen 197053
  5523:20120803:091128.701 NODE 2: Received history_str from node 1 for node 1 datalen 41751
  5523:20120803:091128.798 NODE 2: Received history_text from node 1 for node 1 datalen 2070
  5523:20120803:091128.850 NODE 2: Received events from node 1 for node 1 datalen 2084
  5536:20120803:091149.624 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 17060
  5536:20120803:091246.667 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5523:20120803:091320.257 NODE 2: Received history from node 4 for node 4 datalen 265323
  5523:20120803:091329.442 NODE 2: Received history_uint from node 4 for node 4 datalen 391787
  5523:20120803:091351.825 NODE 2: Received history_str from node 4 for node 4 datalen 110295
  5523:20120803:091352.099 NODE 2: Received history_text from node 4 for node 4 datalen 16414
  5543:20120803:091502.251 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5543:20120803:091502.733 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5542:20120803:091505.321 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 38885
  5542:20120803:091555.716 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5536:20120803:091628.227 NODE 2: Received history from node 3 for node 3 datalen 443993
  5536:20120803:091644.839 NODE 2: Received history_uint from node 3 for node 3 datalen 395906
  5536:20120803:091701.877 NODE 2: Received history_str from node 3 for node 3 datalen 117452
  5536:20120803:091702.347 NODE 2: Received history_text from node 3 for node 3 datalen 17020
  5536:20120803:091702.649 NODE 2: Received events from node 3 for node 3 datalen 6621
  5515:20120803:091805.907 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:091808.902 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5519:20120803:091823.466 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 10212
  5519:20120803:091845.313 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5536:20120803:091922.425 NODE 2: Received history from node 1 for node 1 datalen 99317
  5525:20120803:091924.877 NODE 2: Received history_uint from node 1 for node 1 datalen 199702
  5531:20120803:091940.526 NODE 2: Received history_str from node 1 for node 1 datalen 48770
  5531:20120803:091940.652 NODE 2: Received history_text from node 1 for node 1 datalen 671
  5531:20120803:091940.696 NODE 2: Received events from node 1 for node 1 datalen 2514
  5523:20120803:092001.944 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 17374
  5523:20120803:092052.110 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5531:20120803:092125.705 NODE 2: Received history from node 4 for node 4 datalen 285745
  5525:20120803:092134.641 NODE 2: Received history_uint from node 4 for node 4 datalen 391057
  5536:20120803:092156.376 NODE 2: Received history_str from node 4 for node 4 datalen 121374
  5536:20120803:092156.752 NODE 2: Received history_text from node 4 for node 4 datalen 3665
  5543:20120803:092307.004 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5543:20120803:092307.485 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5542:20120803:092309.752 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 24952
  5542:20120803:092358.896 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5523:20120803:092431.064 NODE 2: Received history from node 3 for node 3 datalen 443634
  5523:20120803:092447.353 NODE 2: Received history_uint from node 3 for node 3 datalen 395621
  5523:20120803:092507.741 NODE 2: Received history_str from node 3 for node 3 datalen 122076
  5523:20120803:092508.129 NODE 2: Received history_text from node 3 for node 3 datalen 19071
  5521:20120803:092508.533 NODE 2: Received events from node 3 for node 3 datalen 3294
  5515:20120803:092608.039 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:092611.045 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 59
  5519:20120803:092625.583 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12027
  5519:20120803:092648.464 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 59
  5523:20120803:092729.717 NODE 2: Received history from node 1 for node 1 datalen 111150
  5528:20120803:092733.664 NODE 2: Received history_uint from node 1 for node 1 datalen 229148
  5528:20120803:092751.061 NODE 2: Received history_str from node 1 for node 1 datalen 56063
  5528:20120803:092751.182 NODE 2: Received history_text from node 1 for node 1 datalen 962
  5528:20120803:092751.247 NODE 2: Received events from node 1 for node 1 datalen 1969
  5528:20120803:092805.043 NODE 2: Sending command for Node 4 to Node 4
  5536:20120803:092809.467 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 17405
  5528:20120803:092846.847 NODE 2: Sending command for Node 4 to Node 4
  5536:20120803:092905.962 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 59
  5520:20120803:092939.522 NODE 2: Received history from node 4 for node 4 datalen 295707
  5523:20120803:092949.165 NODE 2: Received history_uint from node 4 for node 4 datalen 391105
  5523:20120803:093011.337 NODE 2: Received history_str from node 4 for node 4 datalen 119058
  5523:20120803:093011.647 NODE 2: Received history_text from node 4 for node 4 datalen 12137
  5543:20120803:093121.071 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5543:20120803:093121.552 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 59
  5542:20120803:093123.829 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 18238
  5542:20120803:093226.572 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 59
  5536:20120803:093259.318 NODE 2: Received history from node 3 for node 3 datalen 443269
  5536:20120803:093316.373 NODE 2: Received history_uint from node 3 for node 3 datalen 396006
  5536:20120803:093333.995 NODE 2: Received history_str from node 3 for node 3 datalen 138413
  5536:20120803:093334.577 NODE 2: Received history_text from node 3 for node 3 datalen 15345
  5531:20120803:093334.949 NODE 2: Received events from node 3 for node 3 datalen 3298
  5515:20120803:093437.975 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:093441.477 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5539:20120803:093454.922 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 10294
  5539:20120803:093520.066 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5537:20120803:093559.266 NODE 2: Received history from node 1 for node 1 datalen 114629
  5537:20120803:093602.483 NODE 2: Received history_uint from node 1 for node 1 datalen 263566
  5537:20120803:093621.295 NODE 2: Received history_str from node 1 for node 1 datalen 57619
  5523:20120803:093621.439 NODE 2: Received history_text from node 1 for node 1 datalen 1054
  5523:20120803:093621.498 NODE 2: Received events from node 1 for node 1 datalen 3525
  5519:20120803:093638.008 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 16037
  5519:20120803:093731.447 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5531:20120803:093805.754 NODE 2: Received history from node 4 for node 4 datalen 298997
  5525:20120803:093816.087 NODE 2: Received history_uint from node 4 for node 4 datalen 391865
  5542:20120803:093837.341 NODE 2: Received history_str from node 4 for node 4 datalen 116273
  5542:20120803:093837.609 NODE 2: Received history_text from node 4 for node 4 datalen 5204
  5543:20120803:093948.113 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5543:20120803:093948.596 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5514:20120803:093950.762 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 20438
  5514:20120803:094055.121 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5516:20120803:094127.143 NODE 2: Received history from node 3 for node 3 datalen 442960
  5516:20120803:094140.549 NODE 2: Received history_uint from node 3 for node 3 datalen 396319
  5516:20120803:094159.450 NODE 2: Received history_str from node 3 for node 3 datalen 137623
  5539:20120803:094159.877 NODE 2: Received history_text from node 3 for node 3 datalen 17324
  5523:20120803:094200.205 NODE 2: Received events from node 3 for node 3 datalen 4474
  5515:20120803:094304.659 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:094307.704 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5536:20120803:094321.329 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 13134
  5536:20120803:094340.853 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5519:20120803:094418.684 NODE 2: Received history from node 1 for node 1 datalen 111946
  5518:20120803:094421.899 NODE 2: Received history_uint from node 1 for node 1 datalen 233908
  5519:20120803:094438.846 NODE 2: Received history_str from node 1 for node 1 datalen 49094
  5519:20120803:094438.959 NODE 2: Received history_text from node 1 for node 1 datalen 570
  5519:20120803:094438.988 NODE 2: Received events from node 1 for node 1 datalen 3924
  5533:20120803:094458.317 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15619
  5533:20120803:094548.556 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5519:20120803:094623.200 NODE 2: Received history from node 4 for node 4 datalen 292637
  5519:20120803:094631.649 NODE 2: Received history_uint from node 4 for node 4 datalen 391291
  5543:20120803:094652.768 NODE 2: Received history_str from node 4 for node 4 datalen 119631
  5543:20120803:094653.141 NODE 2: Received history_text from node 4 for node 4 datalen 4940
  5513:20120803:094804.564 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5513:20120803:094805.061 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5514:20120803:094807.706 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 20915
  5514:20120803:094857.364 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5533:20120803:094929.263 NODE 2: Received history from node 3 for node 3 datalen 443594
  5533:20120803:094946.282 NODE 2: Received history_uint from node 3 for node 3 datalen 396571
  5533:20120803:095004.754 NODE 2: Received history_str from node 3 for node 3 datalen 128473
  5525:20120803:095005.271 NODE 2: Received history_text from node 3 for node 3 datalen 16343
  5518:20120803:095005.696 NODE 2: Received events from node 3 for node 3 datalen 3265
  5515:20120803:095106.623 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:095109.615 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5536:20120803:095122.079 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12880
  5536:20120803:095145.004 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5542:20120803:095149.225 NODE 2: Sending command for Node 3 to Node 3
  5542:20120803:095227.576 NODE 2: Received history from node 1 for node 1 datalen 116865
  5517:20120803:095231.893 NODE 2: Received history_uint from node 1 for node 1 datalen 215523
  5517:20120803:095247.548 NODE 2: Received history_str from node 1 for node 1 datalen 46852
  5517:20120803:095247.674 NODE 2: Received history_text from node 1 for node 1 datalen 2647
  5521:20120803:095247.738 NODE 2: Received events from node 1 for node 1 datalen 2648
  5543:20120803:095308.126 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 13708
  5555:20120803:095357.733 executing housekeeper
  5543:20120803:095409.153 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5528:20120803:095443.783 NODE 2: Received history from node 4 for node 4 datalen 296410
  5542:20120803:095454.802 NODE 2: Received history_uint from node 4 for node 4 datalen 390805
  5529:20120803:095517.198 NODE 2: Received history_str from node 4 for node 4 datalen 115587
  5516:20120803:095517.577 NODE 2: Received history_text from node 4 for node 4 datalen 4414
  5513:20120803:095627.913 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5513:20120803:095628.395 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5514:20120803:095630.137 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 20090
  5514:20120803:095739.760 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5521:20120803:095812.320 NODE 2: Received history from node 3 for node 3 datalen 443427
  5521:20120803:095840.956 NODE 2: Received history_uint from node 3 for node 3 datalen 395754
  5521:20120803:095901.150 NODE 2: Received history_str from node 3 for node 3 datalen 156569
  5521:20120803:095902.097 NODE 2: Received history_text from node 3 for node 3 datalen 21220
  5521:20120803:095902.876 NODE 2: Received events from node 3 for node 3 datalen 3951
  5539:20120803:095951.067 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5539:20120803:095956.410 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5515:20120803:100009.226 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 11845
  5515:20120803:100043.323 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5514:20120803:100119.409 NODE 2: Received history from node 1 for node 1 datalen 114396
  5533:20120803:100121.765 NODE 2: Received history_uint from node 1 for node 1 datalen 227949
  5514:20120803:100127.161 NODE 2: Received history_str from node 1 for node 1 datalen 43932
  5514:20120803:100127.285 NODE 2: Received history_text from node 1 for node 1 datalen 2532
  5518:20120803:100127.309 NODE 2: Received events from node 1 for node 1 datalen 2946
  5525:20120803:100159.162 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 14838
  5525:20120803:100313.505 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5519:20120803:100346.685 NODE 2: Received history from node 4 for node 4 datalen 330807
  5516:20120803:100413.605 NODE 2: Received history_uint from node 4 for node 4 datalen 391442
  5516:20120803:100436.707 NODE 2: Received history_str from node 4 for node 4 datalen 132652
  5516:20120803:100437.276 NODE 2: Received history_text from node 4 for node 4 datalen 5046
  5517:20120803:100530.556 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5517:20120803:100531.874 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5521:20120803:100533.556 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 23325
  5521:20120803:100708.670 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5518:20120803:100740.608 NODE 2: Received history from node 3 for node 3 datalen 443241
  5520:20120803:100750.258 NODE 2: Received history_uint from node 3 for node 3 datalen 396571
  5542:20120803:100759.875 NODE 2: Received history_str from node 3 for node 3 datalen 142017
  5514:20120803:100803.266 NODE 2: Received history_text from node 3 for node 3 datalen 21862
  5514:20120803:100803.524 NODE 2: Received events from node 3 for node 3 datalen 4241
  5529:20120803:100918.682 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5529:20120803:100923.649 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5515:20120803:100937.919 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12312
  5515:20120803:101006.644 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5523:20120803:101044.531 NODE 2: Received history from node 1 for node 1 datalen 124212
  5523:20120803:101052.459 NODE 2: Received history_uint from node 1 for node 1 datalen 249118
  5523:20120803:101116.091 NODE 2: Received history_str from node 1 for node 1 datalen 57792
  5523:20120803:101116.368 NODE 2: Received history_text from node 1 for node 1 datalen 1463
  5523:20120803:101116.438 NODE 2: Received events from node 1 for node 1 datalen 3107
  5517:20120803:101125.168 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5517:20120803:101125.724 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5536:20120803:101127.764 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 16759
  5536:20120803:101248.011 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5523:20120803:101321.217 NODE 2: Received history from node 4 for node 4 datalen 346894
  5523:20120803:101339.050 NODE 2: Received history_uint from node 4 for node 4 datalen 391552
  5523:20120803:101354.063 NODE 2: Received history_str from node 4 for node 4 datalen 121661
  5523:20120803:101354.407 NODE 2: Received history_text from node 4 for node 4 datalen 3925
  5514:20120803:101504.496 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 25712
  5514:20120803:101618.827 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5536:20120803:101655.122 NODE 2: Received history from node 3 for node 3 datalen 443071
  5536:20120803:101720.722 NODE 2: Received history_uint from node 3 for node 3 datalen 396185
  5536:20120803:101741.202 NODE 2: Received history_str from node 3 for node 3 datalen 146225
  5536:20120803:101741.901 NODE 2: Received history_text from node 3 for node 3 datalen 19984
  5536:20120803:101742.586 NODE 2: Received events from node 3 for node 3 datalen 4921
  5529:20120803:101831.098 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5529:20120803:101837.871 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5517:20120803:101851.383 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 121
  5517:20120803:101851.886 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5515:20120803:101853.806 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12436
  5515:20120803:101924.346 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5513:20120803:102002.636 NODE 2: Received history from node 1 for node 1 datalen 113207
  5513:20120803:102009.311 NODE 2: Received history_uint from node 1 for node 1 datalen 232244
  5513:20120803:102031.327 NODE 2: Received history_str from node 1 for node 1 datalen 45959
  5529:20120803:102031.616 NODE 2: Received history_text from node 1 for node 1 datalen 1452
  5529:20120803:102031.695 NODE 2: Received events from node 1 for node 1 datalen 3044
  5523:20120803:102042.852 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 17815
  5555:20120803:102147.132 housekeeper deleted: 435970 records from history and trends, 0 records of deleted items, 41621 events, 0 alerts, 0 sessions
  5523:20120803:102152.052 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5531:20120803:102226.440 NODE 2: Received history from node 4 for node 4 datalen 346241
  5533:20120803:102242.965 NODE 2: Received history_uint from node 4 for node 4 datalen 390489
  5531:20120803:102254.070 NODE 2: Received history_str from node 4 for node 4 datalen 124615
  5516:20120803:102254.419 NODE 2: Received history_text from node 4 for node 4 datalen 5491
  5536:20120803:102410.150 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5536:20120803:102410.630 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5539:20120803:102413.370 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 23068
  5539:20120803:102526.604 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5529:20120803:102601.822 NODE 2: Received history from node 3 for node 3 datalen 443351
  5529:20120803:102626.780 NODE 2: Received history_uint from node 3 for node 3 datalen 396217
  5521:20120803:102645.284 NODE 2: Received history_str from node 3 for node 3 datalen 155434
  5528:20120803:102648.836 NODE 2: Received history_text from node 3 for node 3 datalen 19003
  5528:20120803:102649.494 NODE 2: Received events from node 3 for node 3 datalen 5185
  5518:20120803:102735.403 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5518:20120803:102740.316 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5515:20120803:102754.953 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 10963
  5515:20120803:102821.638 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5531:20120803:102859.281 NODE 2: Received history from node 1 for node 1 datalen 120569
  5531:20120803:102906.221 NODE 2: Received history_uint from node 1 for node 1 datalen 260853
  5531:20120803:102926.599 NODE 2: Received history_str from node 1 for node 1 datalen 57533
  5519:20120803:102926.729 NODE 2: Received history_text from node 1 for node 1 datalen 961
  5519:20120803:102926.790 NODE 2: Received events from node 1 for node 1 datalen 2414
  5517:20120803:102938.936 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 16588
  5517:20120803:103031.412 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5519:20120803:103105.243 NODE 2: Received history from node 4 for node 4 datalen 341359
  5516:20120803:103117.792 NODE 2: Received history_uint from node 4 for node 4 datalen 391459
  5519:20120803:103139.198 NODE 2: Received history_str from node 4 for node 4 datalen 125443
  5543:20120803:103139.564 NODE 2: Received history_text from node 4 for node 4 datalen 5996
  5536:20120803:103247.015 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 174
  5536:20120803:103247.515 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5533:20120803:103249.588 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 25350
  5533:20120803:103343.639 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5518:20120803:103415.103 NODE 2: Received history from node 3 for node 3 datalen 443397
  5518:20120803:103431.922 NODE 2: Received history_uint from node 3 for node 3 datalen 396117
  5518:20120803:103449.316 NODE 2: Received history_str from node 3 for node 3 datalen 140360
  5517:20120803:103449.775 NODE 2: Received history_text from node 3 for node 3 datalen 16021
  5517:20120803:103450.133 NODE 2: Received events from node 3 for node 3 datalen 7595
  5525:20120803:103552.880 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5525:20120803:103555.912 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5515:20120803:103609.100 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 10904
  5515:20120803:103627.791 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5533:20120803:103705.382 NODE 2: Received history from node 1 for node 1 datalen 112827
  5517:20120803:103708.656 NODE 2: Received history_uint from node 1 for node 1 datalen 245289
  5517:20120803:103725.146 NODE 2: Received history_str from node 1 for node 1 datalen 45197
  5517:20120803:103725.269 NODE 2: Received history_text from node 1 for node 1 datalen 895
  5539:20120803:103725.314 NODE 2: Received events from node 1 for node 1 datalen 2589
  5543:20120803:103744.468 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15249
  5543:20120803:103837.092 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5514:20120803:103910.766 NODE 2: Received history from node 4 for node 4 datalen 308278
  5519:20120803:103919.717 NODE 2: Received history_uint from node 4 for node 4 datalen 390970
  5519:20120803:103941.951 NODE 2: Received history_str from node 4 for node 4 datalen 118848
  5542:20120803:103942.215 NODE 2: Received history_text from node 4 for node 4 datalen 5188
  5536:20120803:104051.488 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5536:20120803:104051.972 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5531:20120803:104054.288 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 29878
  5531:20120803:104144.882 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5543:20120803:104218.083 NODE 2: Received history from node 3 for node 3 datalen 442942
  5543:20120803:104234.036 NODE 2: Received history_uint from node 3 for node 3 datalen 396074
  5543:20120803:104254.823 NODE 2: Received history_str from node 3 for node 3 datalen 136020
  5543:20120803:104255.335 NODE 2: Received history_text from node 3 for node 3 datalen 16950
  5543:20120803:104255.703 NODE 2: Received events from node 3 for node 3 datalen 9502
  5516:20120803:104354.831 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5516:20120803:104358.122 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5537:20120803:104412.339 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 10460
  5537:20120803:104433.603 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5513:20120803:104515.578 NODE 2: Received history from node 1 for node 1 datalen 111333
  5513:20120803:104519.025 NODE 2: Received history_uint from node 1 for node 1 datalen 219686
  5518:20120803:104535.294 NODE 2: Received history_str from node 1 for node 1 datalen 38139
  5531:20120803:104535.371 NODE 2: Received history_text from node 1 for node 1 datalen 677
  5531:20120803:104535.414 NODE 2: Received events from node 1 for node 1 datalen 2376
  5542:20120803:104554.800 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 16427
  5542:20120803:104654.079 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5531:20120803:104728.515 NODE 2: Received history from node 4 for node 4 datalen 316834
  5531:20120803:104738.125 NODE 2: Received history_uint from node 4 for node 4 datalen 390747
  5513:20120803:104800.420 NODE 2: Received history_str from node 4 for node 4 datalen 138602
  5523:20120803:104800.769 NODE 2: Received history_text from node 4 for node 4 datalen 5598
  5536:20120803:104910.218 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5536:20120803:104910.705 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5543:20120803:104912.929 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 31780
  5543:20120803:105016.353 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5542:20120803:105049.650 NODE 2: Received history from node 3 for node 3 datalen 442970
  5542:20120803:105105.210 NODE 2: Received history_uint from node 3 for node 3 datalen 396751
  5542:20120803:105122.773 NODE 2: Received history_str from node 3 for node 3 datalen 137921
  5542:20120803:105123.290 NODE 2: Received history_text from node 3 for node 3 datalen 17027
  5542:20120803:105123.623 NODE 2: Received events from node 3 for node 3 datalen 6801
  5516:20120803:105227.626 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5516:20120803:105230.632 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 59
  5537:20120803:105243.347 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 10671
  5537:20120803:105301.907 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 59
  5518:20120803:105341.126 NODE 2: Received history from node 1 for node 1 datalen 119559
  5518:20120803:105344.698 NODE 2: Received history_uint from node 1 for node 1 datalen 224301
  5518:20120803:105401.393 NODE 2: Received history_str from node 1 for node 1 datalen 41452
  5518:20120803:105401.488 NODE 2: Received history_text from node 1 for node 1 datalen 1164
  5518:20120803:105401.545 NODE 2: Received events from node 1 for node 1 datalen 2887
  5523:20120803:105420.418 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 14196
  5523:20120803:105513.920 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 59
  5542:20120803:105548.179 NODE 2: Received history from node 4 for node 4 datalen 315019
  5542:20120803:105557.272 NODE 2: Received history_uint from node 4 for node 4 datalen 391725
  5542:20120803:105620.031 NODE 2: Received history_str from node 4 for node 4 datalen 133675
  5542:20120803:105620.379 NODE 2: Received history_text from node 4 for node 4 datalen 4836
  5536:20120803:105730.123 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5536:20120803:105730.616 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 59
  5543:20120803:105733.062 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 29807
  5543:20120803:105827.911 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 59
  5523:20120803:105858.981 NODE 2: Received history from node 3 for node 3 datalen 442999
  5523:20120803:105914.314 NODE 2: Received history_uint from node 3 for node 3 datalen 396232
  5523:20120803:105932.144 NODE 2: Received history_str from node 3 for node 3 datalen 139882
  5523:20120803:105932.704 NODE 2: Received history_text from node 3 for node 3 datalen 18290
  5523:20120803:105936.047 NODE 2: Received events from node 3 for node 3 datalen 4072
  5516:20120803:110035.491 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5516:20120803:110038.641 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5517:20120803:110050.978 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 13358
  5517:20120803:110110.806 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5531:20120803:110148.558 NODE 2: Received history from node 1 for node 1 datalen 106784
  5531:20120803:110151.367 NODE 2: Received history_uint from node 1 for node 1 datalen 210293
  5531:20120803:110206.786 NODE 2: Received history_str from node 1 for node 1 datalen 38116
  5531:20120803:110206.869 NODE 2: Received history_text from node 1 for node 1 datalen 785
  5531:20120803:110206.942 NODE 2: Received events from node 1 for node 1 datalen 3066
  5542:20120803:110227.465 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 12394
  5542:20120803:110319.428 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5531:20120803:110355.118 NODE 2: Received history from node 4 for node 4 datalen 310495
  5531:20120803:110404.466 NODE 2: Received history_uint from node 4 for node 4 datalen 392728
  5531:20120803:110427.075 NODE 2: Received history_str from node 4 for node 4 datalen 134091
  5531:20120803:110427.393 NODE 2: Received history_text from node 4 for node 4 datalen 3942
  5536:20120803:110535.579 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5536:20120803:110536.062 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5519:20120803:110538.185 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 28726
  5519:20120803:110643.648 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5539:20120803:110716.232 NODE 2: Received history from node 3 for node 3 datalen 442743
  5539:20120803:110732.139 NODE 2: Received history_uint from node 3 for node 3 datalen 395760
  5515:20120803:110749.108 NODE 2: Received history_str from node 3 for node 3 datalen 151747
  5529:20120803:110752.539 NODE 2: Received history_text from node 3 for node 3 datalen 26923
  5529:20120803:110752.912 NODE 2: Received events from node 3 for node 3 datalen 2972
  5516:20120803:110853.264 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5516:20120803:110856.269 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5517:20120803:110909.874 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12623
  5517:20120803:110927.989 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5543:20120803:111003.267 NODE 2: Received history from node 1 for node 1 datalen 105772
  5543:20120803:111005.906 NODE 2: Received history_uint from node 1 for node 1 datalen 211005
  5525:20120803:111021.556 NODE 2: Received history_str from node 1 for node 1 datalen 40987
  5519:20120803:111021.640 NODE 2: Received history_text from node 1 for node 1 datalen 890
  5519:20120803:111021.684 NODE 2: Received events from node 1 for node 1 datalen 2074
  5531:20120803:111042.725 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 115208
  5531:20120803:111135.767 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5518:20120803:111209.823 NODE 2: Received history from node 4 for node 4 datalen 310786
  5518:20120803:111218.862 NODE 2: Received history_uint from node 4 for node 4 datalen 392354
  5518:20120803:111241.266 NODE 2: Received history_str from node 4 for node 4 datalen 119444
  5518:20120803:111241.546 NODE 2: Received history_text from node 4 for node 4 datalen 5340
  5536:20120803:111350.686 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5536:20120803:111351.165 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5520:20120803:111353.609 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 29125
  5520:20120803:111449.205 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5531:20120803:111521.326 NODE 2: Received history from node 3 for node 3 datalen 443005
  5531:20120803:111536.455 NODE 2: Received history_uint from node 3 for node 3 datalen 396645
  5531:20120803:111555.261 NODE 2: Received history_str from node 3 for node 3 datalen 132367
  5531:20120803:111555.755 NODE 2: Received history_text from node 3 for node 3 datalen 19195
  5531:20120803:111556.048 NODE 2: Received events from node 3 for node 3 datalen 2194
  5521:20120803:111658.997 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5521:20120803:111702.549 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5517:20120803:111715.534 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 11350
  5517:20120803:111734.200 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5531:20120803:111813.913 NODE 2: Received history from node 1 for node 1 datalen 100370
  5531:20120803:111816.536 NODE 2: Received history_uint from node 1 for node 1 datalen 214517
  5531:20120803:111831.605 NODE 2: Received history_str from node 1 for node 1 datalen 48827
  5531:20120803:111831.774 NODE 2: Received history_text from node 1 for node 1 datalen 843
  5531:20120803:111831.820 NODE 2: Received events from node 1 for node 1 datalen 2518
  5518:20120803:111855.844 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 13684
  5518:20120803:111947.278 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5543:20120803:112023.346 NODE 2: Received history from node 4 for node 4 datalen 323253
  5542:20120803:112032.608 NODE 2: Received history_uint from node 4 for node 4 datalen 392062
  5529:20120803:112055.617 NODE 2: Received history_str from node 4 for node 4 datalen 130125
  5514:20120803:112055.930 NODE 2: Received history_text from node 4 for node 4 datalen 7032
  5536:20120803:112206.922 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5536:20120803:112207.403 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5520:20120803:112209.701 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 183258
  5520:20120803:112303.249 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5515:20120803:112335.860 NODE 2: Received history from node 3 for node 3 datalen 443058
  5542:20120803:112350.530 NODE 2: Received history_uint from node 3 for node 3 datalen 396611
  5517:20120803:112408.939 NODE 2: Received history_str from node 3 for node 3 datalen 130895
  5517:20120803:112409.265 NODE 2: Received history_text from node 3 for node 3 datalen 18562
  5529:20120803:112409.584 NODE 2: Received events from node 3 for node 3 datalen 2579
  5521:20120803:112511.723 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5521:20120803:112514.787 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5519:20120803:112528.235 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12582
  5519:20120803:112550.751 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5525:20120803:112629.988 NODE 2: Received history from node 1 for node 1 datalen 112019
  5537:20120803:112633.314 NODE 2: Received history_uint from node 1 for node 1 datalen 231831
  5537:20120803:112650.023 NODE 2: Received history_str from node 1 for node 1 datalen 70526
  5537:20120803:112650.216 NODE 2: Received history_text from node 1 for node 1 datalen 1183
  5537:20120803:112650.284 NODE 2: Received events from node 1 for node 1 datalen 2352
  5514:20120803:112709.772 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 13514
  5514:20120803:112804.221 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5525:20120803:112839.229 NODE 2: Received history from node 4 for node 4 datalen 326743
  5525:20120803:112848.894 NODE 2: Received history_uint from node 4 for node 4 datalen 391996
  5525:20120803:112911.255 NODE 2: Received history_str from node 4 for node 4 datalen 121776
  5528:20120803:112911.579 NODE 2: Received history_text from node 4 for node 4 datalen 5349
  5536:20120803:113019.849 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5536:20120803:113020.329 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5543:20120803:113022.114 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 25711
  5543:20120803:113118.650 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5513:20120803:113151.167 NODE 2: Received history from node 3 for node 3 datalen 443548
  5513:20120803:113208.302 NODE 2: Received history_uint from node 3 for node 3 datalen 395505
  5513:20120803:113225.817 NODE 2: Received history_str from node 3 for node 3 datalen 128866
  5513:20120803:113226.311 NODE 2: Received history_text from node 3 for node 3 datalen 26341
  5513:20120803:113226.678 NODE 2: Received events from node 3 for node 3 datalen 2802
  5521:20120803:113328.522 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5521:20120803:113331.553 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5519:20120803:113345.389 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 10252
  5519:20120803:113408.591 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5513:20120803:113449.012 NODE 2: Received history from node 1 for node 1 datalen 112909
  5513:20120803:113452.530 NODE 2: Received history_uint from node 1 for node 1 datalen 262472
  5513:20120803:113511.365 NODE 2: Received history_str from node 1 for node 1 datalen 68640
  5515:20120803:113511.615 NODE 2: Received history_text from node 1 for node 1 datalen 1001
  5539:20120803:113511.678 NODE 2: Received events from node 1 for node 1 datalen 3398
  5528:20120803:113528.370 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 14449
  5528:20120803:113622.746 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5525:20120803:113657.802 NODE 2: Received history from node 4 for node 4 datalen 323329
  5537:20120803:113707.471 NODE 2: Received history_uint from node 4 for node 4 datalen 391869
  5525:20120803:113730.552 NODE 2: Received history_str from node 4 for node 4 datalen 125779
  5520:20120803:113730.846 NODE 2: Received history_text from node 4 for node 4 datalen 5035
  5536:20120803:113838.352 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5536:20120803:113838.847 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5543:20120803:113841.612 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 26063
  5543:20120803:113940.059 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5515:20120803:114012.332 NODE 2: Received history from node 3 for node 3 datalen 443429
  5531:20120803:114028.629 NODE 2: Received history_uint from node 3 for node 3 datalen 397121
  5523:20120803:114046.755 NODE 2: Received history_str from node 3 for node 3 datalen 141948
  5523:20120803:114047.182 NODE 2: Received history_text from node 3 for node 3 datalen 48697
  5523:20120803:114047.547 NODE 2: Received events from node 3 for node 3 datalen 3900
  5521:20120803:114149.438 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5521:20120803:114152.485 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5519:20120803:114204.783 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 14756
  5519:20120803:114229.600 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5542:20120803:114308.694 NODE 2: Received history from node 1 for node 1 datalen 109585
  5542:20120803:114312.525 NODE 2: Received history_uint from node 1 for node 1 datalen 243135
  5542:20120803:114329.426 NODE 2: Received history_str from node 1 for node 1 datalen 47932
  5542:20120803:114329.652 NODE 2: Received history_text from node 1 for node 1 datalen 846
  5542:20120803:114329.695 NODE 2: Received events from node 1 for node 1 datalen 3296
  5539:20120803:114348.166 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15523
  5539:20120803:114440.661 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5542:20120803:114515.411 NODE 2: Received history from node 4 for node 4 datalen 312201
  5542:20120803:114525.828 NODE 2: Received history_uint from node 4 for node 4 datalen 392273
  5542:20120803:114547.734 NODE 2: Received history_str from node 4 for node 4 datalen 123651
  5542:20120803:114548.044 NODE 2: Received history_text from node 4 for node 4 datalen 4743
  5536:20120803:114658.078 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5536:20120803:114658.559 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5543:20120803:114700.239 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 29921
  5543:20120803:114759.609 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5531:20120803:114833.786 NODE 2: Received history from node 3 for node 3 datalen 443004
  5523:20120803:114849.640 NODE 2: Received history_uint from node 3 for node 3 datalen 396099
  5523:20120803:114907.383 NODE 2: Received history_str from node 3 for node 3 datalen 134588
  5518:20120803:114907.801 NODE 2: Received history_text from node 3 for node 3 datalen 56545
  5516:20120803:114908.204 NODE 2: Received events from node 3 for node 3 datalen 3715
  5520:20120803:115011.428 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5520:20120803:115015.084 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5519:20120803:115027.386 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12627
  5519:20120803:115049.961 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5515:20120803:115130.610 NODE 2: Received history from node 1 for node 1 datalen 121779
  5515:20120803:115134.618 NODE 2: Received history_uint from node 1 for node 1 datalen 224083
  5525:20120803:115152.669 NODE 2: Received history_str from node 1 for node 1 datalen 47794
  5539:20120803:115152.798 NODE 2: Received history_text from node 1 for node 1 datalen 1004
  5539:20120803:115152.843 NODE 2: Received events from node 1 for node 1 datalen 2792
  5521:20120803:115209.677 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 14310
  5521:20120803:115301.825 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5539:20120803:115334.683 NODE 2: Received history from node 4 for node 4 datalen 320118
  5525:20120803:115344.476 NODE 2: Received history_uint from node 4 for node 4 datalen 391732
  5513:20120803:115406.588 NODE 2: Received history_str from node 4 for node 4 datalen 132676
  5515:20120803:115406.896 NODE 2: Received history_text from node 4 for node 4 datalen 5026
  5536:20120803:115515.958 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5536:20120803:115516.441 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5543:20120803:115519.261 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 53369
  5543:20120803:115613.294 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5523:20120803:115648.665 NODE 2: Received history from node 3 for node 3 datalen 442680
  5523:20120803:115706.704 NODE 2: Received history_uint from node 3 for node 3 datalen 397391
  5514:20120803:115731.302 NODE 2: Received history_str from node 3 for node 3 datalen 163601
  5528:20120803:115731.835 NODE 2: Received history_text from node 3 for node 3 datalen 43015
  5525:20120803:115732.169 NODE 2: Received events from node 3 for node 3 datalen 6488
  5520:20120803:115828.939 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5520:20120803:115832.013 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5519:20120803:115846.696 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 11397
  5519:20120803:115908.260 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5542:20120803:115946.914 NODE 2: Received history from node 1 for node 1 datalen 104991
  5529:20120803:115949.804 NODE 2: Received history_uint from node 1 for node 1 datalen 222859
  5529:20120803:120005.399 NODE 2: Received history_str from node 1 for node 1 datalen 39662
  5529:20120803:120005.503 NODE 2: Received history_text from node 1 for node 1 datalen 1506
  5529:20120803:120005.561 NODE 2: Received events from node 1 for node 1 datalen 2618
  5515:20120803:120025.920 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 14525
  5515:20120803:120135.351 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5536:20120803:120212.637 NODE 2: Received history from node 4 for node 4 datalen 330907
  5543:20120803:120222.291 NODE 2: Received history_uint from node 4 for node 4 datalen 391685
  5543:20120803:120244.512 NODE 2: Received history_str from node 4 for node 4 datalen 145511
  5513:20120803:120244.877 NODE 2: Received history_text from node 4 for node 4 datalen 14526
  5539:20120803:120353.335 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5539:20120803:120353.823 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5520:20120803:120355.960 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 39383
  5520:20120803:120450.879 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5515:20120803:120526.796 NODE 2: Received history from node 3 for node 3 datalen 442859
  5515:20120803:120543.733 NODE 2: Received history_uint from node 3 for node 3 datalen 396221
  5515:20120803:120600.855 NODE 2: Received history_str from node 3 for node 3 datalen 158744
  5515:20120803:120601.330 NODE 2: Received history_text from node 3 for node 3 datalen 45534
  5515:20120803:120601.694 NODE 2: Received events from node 3 for node 3 datalen 2964
  5521:20120803:120700.830 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5521:20120803:120703.845 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5519:20120803:120716.982 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 11532
  5519:20120803:120735.828 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5543:20120803:120814.520 NODE 2: Received history from node 1 for node 1 datalen 108863
  5543:20120803:120817.361 NODE 2: Received history_uint from node 1 for node 1 datalen 225009
  5543:20120803:120834.586 NODE 2: Received history_str from node 1 for node 1 datalen 51035
  5543:20120803:120834.701 NODE 2: Received history_text from node 1 for node 1 datalen 2500
  5543:20120803:120834.775 NODE 2: Received events from node 1 for node 1 datalen 3466
  5513:20120803:120853.872 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15127
  5513:20120803:120945.765 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5520:20120803:121021.364 NODE 2: Received history from node 4 for node 4 datalen 308145
  5533:20120803:121030.371 NODE 2: Received history_uint from node 4 for node 4 datalen 391715
  5533:20120803:121052.367 NODE 2: Received history_str from node 4 for node 4 datalen 143454
  5529:20120803:121052.739 NODE 2: Received history_text from node 4 for node 4 datalen 17819
  5539:20120803:121203.734 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5539:20120803:121204.218 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5521:20120803:121206.334 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 284636
  5521:20120803:121311.227 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5520:20120803:121345.794 NODE 2: Received history from node 3 for node 3 datalen 443110
  5520:20120803:121402.412 NODE 2: Received history_uint from node 3 for node 3 datalen 396096
  5520:20120803:121419.478 NODE 2: Received history_str from node 3 for node 3 datalen 144233
  5520:20120803:121419.979 NODE 2: Received history_text from node 3 for node 3 datalen 49993
  5520:20120803:121420.378 NODE 2: Received events from node 3 for node 3 datalen 3452
  5515:20120803:121523.697 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:121526.703 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5519:20120803:121539.898 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 13715
  5519:20120803:121558.949 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5514:20120803:121643.481 NODE 2: Received history from node 1 for node 1 datalen 105929
  5514:20120803:121646.124 NODE 2: Received history_uint from node 1 for node 1 datalen 231451
  5514:20120803:121702.902 NODE 2: Received history_str from node 1 for node 1 datalen 50292
  5514:20120803:121703.014 NODE 2: Received history_text from node 1 for node 1 datalen 2016
  5514:20120803:121703.074 NODE 2: Received events from node 1 for node 1 datalen 2741
  5529:20120803:121722.926 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 12259
  5529:20120803:121818.856 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5514:20120803:121855.227 NODE 2: Received history from node 4 for node 4 datalen 332895
  5514:20120803:121905.265 NODE 2: Received history_uint from node 4 for node 4 datalen 391387
  5523:20120803:121927.572 NODE 2: Received history_str from node 4 for node 4 datalen 149823
  5523:20120803:121928.600 NODE 2: Received history_text from node 4 for node 4 datalen 11034
  5539:20120803:122036.692 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5539:20120803:122037.173 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5521:20120803:122039.520 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 29947
  5521:20120803:122131.397 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5514:20120803:122204.369 NODE 2: Received history from node 3 for node 3 datalen 443178
  5514:20120803:122220.576 NODE 2: Received history_uint from node 3 for node 3 datalen 395831
  5514:20120803:122238.234 NODE 2: Received history_str from node 3 for node 3 datalen 134196
  5514:20120803:122238.706 NODE 2: Received history_text from node 3 for node 3 datalen 49058
  5514:20120803:122239.118 NODE 2: Received events from node 3 for node 3 datalen 3192
  5514:20120803:122239.153 NODE 2: Received acknowledges from node 3 for node 3 datalen 124
  5515:20120803:122341.701 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:122344.727 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5519:20120803:122357.509 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12989
  5519:20120803:122418.858 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5514:20120803:122456.832 NODE 2: Received history from node 1 for node 1 datalen 112497
  5514:20120803:122500.100 NODE 2: Received history_uint from node 1 for node 1 datalen 237948
  5514:20120803:122517.399 NODE 2: Received history_str from node 1 for node 1 datalen 57979
  5514:20120803:122517.575 NODE 2: Received history_text from node 1 for node 1 datalen 1671
  5514:20120803:122517.631 NODE 2: Received events from node 1 for node 1 datalen 2952
  5523:20120803:122536.214 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15025
  5523:20120803:122631.633 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5529:20120803:122705.775 NODE 2: Received history from node 4 for node 4 datalen 316808
  5529:20120803:122715.688 NODE 2: Received history_uint from node 4 for node 4 datalen 392075
  5529:20120803:122738.970 NODE 2: Received history_str from node 4 for node 4 datalen 143217
  5529:20120803:122739.290 NODE 2: Received history_text from node 4 for node 4 datalen 19563
  5539:20120803:122846.841 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5539:20120803:122847.322 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5521:20120803:122849.474 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 27114
  5521:20120803:122948.157 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5539:20120803:123019.900 NODE 2: Received history from node 3 for node 3 datalen 443132
  5539:20120803:123035.123 NODE 2: Received history_uint from node 3 for node 3 datalen 395533
  5539:20120803:123054.304 NODE 2: Received history_str from node 3 for node 3 datalen 150855
  5539:20120803:123054.744 NODE 2: Received history_text from node 3 for node 3 datalen 48957
  5539:20120803:123055.166 NODE 2: Received events from node 3 for node 3 datalen 3544
  5515:20120803:123156.956 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:123159.972 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5519:20120803:123212.888 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12619
  5519:20120803:123231.778 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5539:20120803:123313.576 NODE 2: Received history from node 1 for node 1 datalen 106490
  5539:20120803:123316.712 NODE 2: Received history_uint from node 1 for node 1 datalen 242031
  5539:20120803:123333.989 NODE 2: Received history_str from node 1 for node 1 datalen 56525
  5539:20120803:123334.191 NODE 2: Received history_text from node 1 for node 1 datalen 2053
  5539:20120803:123334.243 NODE 2: Received events from node 1 for node 1 datalen 2461
  5529:20120803:123352.927 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15372
  5529:20120803:123443.082 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5539:20120803:123518.408 NODE 2: Received history from node 4 for node 4 datalen 325252
  5531:20120803:123530.089 NODE 2: Received history_uint from node 4 for node 4 datalen 392019
  5539:20120803:123552.392 NODE 2: Received history_str from node 4 for node 4 datalen 149438
  5539:20120803:123552.813 NODE 2: Received history_text from node 4 for node 4 datalen 4111
  5523:20120803:123659.389 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5523:20120803:123659.870 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5521:20120803:123701.725 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 30557
  5521:20120803:123802.975 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5539:20120803:123835.138 NODE 2: Received history from node 3 for node 3 datalen 443071
  5537:20120803:123851.859 NODE 2: Received history_uint from node 3 for node 3 datalen 396377
  5537:20120803:123908.993 NODE 2: Received history_str from node 3 for node 3 datalen 151620
  5537:20120803:123909.518 NODE 2: Received history_text from node 3 for node 3 datalen 72626
  5537:20120803:123909.878 NODE 2: Received events from node 3 for node 3 datalen 3187
  5515:20120803:124011.658 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:124014.672 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5519:20120803:124028.830 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 9432
  5519:20120803:124047.102 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5537:20120803:124128.143 NODE 2: Received history from node 1 for node 1 datalen 119410
  5528:20120803:124132.915 NODE 2: Received history_uint from node 1 for node 1 datalen 278229
  5528:20120803:124151.528 NODE 2: Received history_str from node 1 for node 1 datalen 57823
  5514:20120803:124151.763 NODE 2: Received history_text from node 1 for node 1 datalen 1633
  5514:20120803:124151.817 NODE 2: Received events from node 1 for node 1 datalen 2614
  5529:20120803:124207.983 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 14696
  5529:20120803:124257.894 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5539:20120803:124331.787 NODE 2: Received history from node 4 for node 4 datalen 309336
  5539:20120803:124341.113 NODE 2: Received history_uint from node 4 for node 4 datalen 392183
  5525:20120803:124404.480 NODE 2: Received history_str from node 4 for node 4 datalen 141133
  5525:20120803:124404.804 NODE 2: Received history_text from node 4 for node 4 datalen 18420
  5523:20120803:124513.247 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5523:20120803:124513.733 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5513:20120803:124515.798 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 21855
  5513:20120803:124620.941 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5521:20120803:124652.937 NODE 2: Received history from node 3 for node 3 datalen 443105
  5521:20120803:124709.937 NODE 2: Received history_uint from node 3 for node 3 datalen 396404
  5521:20120803:124726.887 NODE 2: Received history_str from node 3 for node 3 datalen 149411
  5521:20120803:124727.325 NODE 2: Received history_text from node 3 for node 3 datalen 65594
  5521:20120803:124727.669 NODE 2: Received events from node 3 for node 3 datalen 3542
  5515:20120803:124830.452 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:124833.560 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5514:20120803:124847.107 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 12272
  5514:20120803:124906.130 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5525:20120803:124946.451 NODE 2: Received history from node 1 for node 1 datalen 122938
  5525:20120803:124950.116 NODE 2: Received history_uint from node 1 for node 1 datalen 246729
  5517:20120803:125007.424 NODE 2: Received history_str from node 1 for node 1 datalen 62666
  5517:20120803:125008.051 NODE 2: Received history_text from node 1 for node 1 datalen 2738
  5517:20120803:125008.195 NODE 2: Received events from node 1 for node 1 datalen 2100
  5531:20120803:125025.614 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 13283
  5531:20120803:125123.257 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5517:20120803:125156.420 NODE 2: Received history from node 4 for node 4 datalen 327200
  5517:20120803:125207.434 NODE 2: Received history_uint from node 4 for node 4 datalen 392154
  5525:20120803:125230.151 NODE 2: Received history_str from node 4 for node 4 datalen 142021
  5525:20120803:125230.498 NODE 2: Received history_text from node 4 for node 4 datalen 4915
  5523:20120803:125337.349 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5523:20120803:125337.843 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5513:20120803:125339.851 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 29935
  5513:20120803:125437.929 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5531:20120803:125510.027 NODE 2: Received history from node 3 for node 3 datalen 443199
  5531:20120803:125526.269 NODE 2: Received history_uint from node 3 for node 3 datalen 396729
  5533:20120803:125543.972 NODE 2: Received history_str from node 3 for node 3 datalen 144821
  5533:20120803:125544.498 NODE 2: Received history_text from node 3 for node 3 datalen 61374
  5533:20120803:125544.853 NODE 2: Received events from node 3 for node 3 datalen 1959
  5515:20120803:125647.357 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:125650.399 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5514:20120803:125704.235 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 9425
  5514:20120803:125723.595 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5531:20120803:125804.967 NODE 2: Received history from node 1 for node 1 datalen 107392
  5531:20120803:125808.070 NODE 2: Received history_uint from node 1 for node 1 datalen 247474
  5531:20120803:125824.563 NODE 2: Received history_str from node 1 for node 1 datalen 59823
  5517:20120803:125824.797 NODE 2: Received history_text from node 1 for node 1 datalen 2299
  5517:20120803:125824.838 NODE 2: Received events from node 1 for node 1 datalen 2353
  5525:20120803:125844.321 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15431
  5525:20120803:125937.254 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5517:20120803:130010.980 NODE 2: Received history from node 4 for node 4 datalen 314266
  5517:20120803:130019.909 NODE 2: Received history_uint from node 4 for node 4 datalen 391544
  5517:20120803:130042.969 NODE 2: Received history_str from node 4 for node 4 datalen 126653
  5531:20120803:130043.254 NODE 2: Received history_text from node 4 for node 4 datalen 5054
  5523:20120803:130151.169 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5523:20120803:130151.676 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5513:20120803:130153.761 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 28538
  5513:20120803:130248.010 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5516:20120803:130321.007 NODE 2: Received history from node 3 for node 3 datalen 442493
  5516:20120803:130336.302 NODE 2: Received history_uint from node 3 for node 3 datalen 395485
  5516:20120803:130353.891 NODE 2: Received history_str from node 3 for node 3 datalen 147806
  5521:20120803:130354.374 NODE 2: Received history_text from node 3 for node 3 datalen 49102
  5518:20120803:130354.738 NODE 2: Received events from node 3 for node 3 datalen 6092
  5515:20120803:130459.021 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:130502.073 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5514:20120803:130515.275 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 11699
  5514:20120803:130537.155 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5521:20120803:130619.077 NODE 2: Received history from node 1 for node 1 datalen 110691
  5539:20120803:130622.289 NODE 2: Received history_uint from node 1 for node 1 datalen 231512
  5539:20120803:130638.681 NODE 2: Received history_str from node 1 for node 1 datalen 65096
  5539:20120803:130638.846 NODE 2: Received history_text from node 1 for node 1 datalen 3441
  5539:20120803:130638.922 NODE 2: Received events from node 1 for node 1 datalen 2242
  5531:20120803:130658.734 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 13983
  5531:20120803:130751.400 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5539:20120803:130825.079 NODE 2: Received history from node 4 for node 4 datalen 315142
  5539:20120803:130834.689 NODE 2: Received history_uint from node 4 for node 4 datalen 391855
  5539:20120803:130858.460 NODE 2: Received history_str from node 4 for node 4 datalen 125297
  5539:20120803:130858.739 NODE 2: Received history_text from node 4 for node 4 datalen 3241
  5523:20120803:131007.313 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5523:20120803:131007.801 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5513:20120803:131009.643 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 29746
  5513:20120803:131107.595 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5531:20120803:131139.089 NODE 2: Received history from node 3 for node 3 datalen 443466
  5531:20120803:131154.696 NODE 2: Received history_uint from node 3 for node 3 datalen 395841
  5521:20120803:131212.754 NODE 2: Received history_str from node 3 for node 3 datalen 144832
  5531:20120803:131213.268 NODE 2: Received history_text from node 3 for node 3 datalen 58197
  5531:20120803:131213.720 NODE 2: Received events from node 3 for node 3 datalen 1651
  5515:20120803:131316.379 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:131319.397 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5514:20120803:131331.284 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 11649
  5514:20120803:131351.276 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5543:20120803:131426.041 NODE 2: Received history from node 1 for node 1 datalen 102440
  5543:20120803:131428.609 NODE 2: Received history_uint from node 1 for node 1 datalen 243410
  5543:20120803:131445.621 NODE 2: Received history_str from node 1 for node 1 datalen 58448
  5543:20120803:131445.812 NODE 2: Received history_text from node 1 for node 1 datalen 1959
  5543:20120803:131445.874 NODE 2: Received events from node 1 for node 1 datalen 2288
  5539:20120803:131505.768 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 15382
  5539:20120803:131558.001 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5543:20120803:131631.640 NODE 2: Received history from node 4 for node 4 datalen 302567
  5543:20120803:131641.075 NODE 2: Received history_uint from node 4 for node 4 datalen 392343
  5543:20120803:131704.255 NODE 2: Received history_str from node 4 for node 4 datalen 127963
  5543:20120803:131704.670 NODE 2: Received history_text from node 4 for node 4 datalen 3410
  5523:20120803:131812.188 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5523:20120803:131812.691 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5519:20120803:131814.414 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 21974
  5519:20120803:131906.044 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5539:20120803:131937.540 NODE 2: Received history from node 3 for node 3 datalen 443029
  5539:20120803:131954.540 NODE 2: Received history_uint from node 3 for node 3 datalen 396291
  5539:20120803:132011.985 NODE 2: Received history_str from node 3 for node 3 datalen 130469
  5539:20120803:132012.511 NODE 2: Received history_text from node 3 for node 3 datalen 54410
  5518:20120803:132012.896 NODE 2: Received events from node 3 for node 3 datalen 1644
  5515:20120803:132115.295 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:132118.310 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5514:20120803:132129.779 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 10376
  5514:20120803:132151.404 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5555:20120803:132158.281 executing housekeeper
  5518:20120803:132227.471 NODE 2: Received history from node 1 for node 1 datalen 106883
  5518:20120803:132231.182 NODE 2: Received history_uint from node 1 for node 1 datalen 242394
  5518:20120803:132246.804 NODE 2: Received history_str from node 1 for node 1 datalen 54571
  5518:20120803:132246.916 NODE 2: Received history_text from node 1 for node 1 datalen 1228
  5518:20120803:132246.960 NODE 2: Received events from node 1 for node 1 datalen 2440
  5543:20120803:132307.682 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 13805
  5543:20120803:132412.605 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5518:20120803:132446.920 NODE 2: Received history from node 4 for node 4 datalen 327367
  5518:20120803:132500.985 NODE 2: Received history_uint from node 4 for node 4 datalen 392103
  5518:20120803:132526.288 NODE 2: Received history_str from node 4 for node 4 datalen 140107
  5528:20120803:132526.788 NODE 2: Received history_text from node 4 for node 4 datalen 4567
  5523:20120803:132628.905 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5523:20120803:132629.452 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5519:20120803:132631.857 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 25279
  5519:20120803:132754.681 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5517:20120803:132826.354 NODE 2: Received history from node 3 for node 3 datalen 443234
  5536:20120803:132850.429 NODE 2: Received history_uint from node 3 for node 3 datalen 395852
  5536:20120803:132907.489 NODE 2: Received history_str from node 3 for node 3 datalen 165644
  5513:20120803:132908.193 NODE 2: Received history_text from node 3 for node 3 datalen 61028
  5513:20120803:132908.871 NODE 2: Received events from node 3 for node 3 datalen 2462
  5515:20120803:133005.274 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5515:20120803:133011.850 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5514:20120803:133025.656 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 11048
  5514:20120803:133056.786 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5515:20120803:133137.062 NODE 2: Received history from node 1 for node 1 datalen 122593
  5515:20120803:133141.743 NODE 2: Received history_uint from node 1 for node 1 datalen 291383
  5515:20120803:133154.651 NODE 2: Received history_str from node 1 for node 1 datalen 61388
  5515:20120803:133154.824 NODE 2: Received history_text from node 1 for node 1 datalen 1458
  5515:20120803:133154.882 NODE 2: Received events from node 1 for node 1 datalen 2625
  5528:20120803:133217.185 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 14896
  5528:20120803:133346.158 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5543:20120803:133420.005 NODE 2: Received history from node 4 for node 4 datalen 389765
  5543:20120803:133452.653 NODE 2: Received history_uint from node 4 for node 4 datalen 391927
  5543:20120803:133519.873 NODE 2: Received history_str from node 4 for node 4 datalen 179584
  5543:20120803:133520.756 NODE 2: Received history_text from node 4 for node 4 datalen 12291
  5523:20120803:133603.898 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5523:20120803:133605.149 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5513:20120803:133607.539 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 22251
  5513:20120803:133736.666 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5515:20120803:133808.484 NODE 2: Received history from node 3 for node 3 datalen 442978
  5516:20120803:133820.708 NODE 2: Received history_uint from node 3 for node 3 datalen 396286
  5536:20120803:133830.423 NODE 2: Received history_str from node 3 for node 3 datalen 167079
  5536:20120803:133830.922 NODE 2: Received history_text from node 3 for node 3 datalen 70425
  5536:20120803:133831.266 NODE 2: Received events from node 3 for node 3 datalen 1929
  5521:20120803:133946.938 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5521:20120803:133952.324 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5514:20120803:134005.620 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 13639
  5514:20120803:134036.519 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5543:20120803:134117.460 NODE 2: Received history from node 1 for node 1 datalen 130576
  5516:20120803:134126.185 NODE 2: Received history_uint from node 1 for node 1 datalen 310193
  5543:20120803:134153.254 NODE 2: Received history_str from node 1 for node 1 datalen 69149
  5515:20120803:134153.509 NODE 2: Received history_text from node 1 for node 1 datalen 1445
  5518:20120803:134153.660 NODE 2: Received events from node 1 for node 1 datalen 2982
  5533:20120803:134157.353 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5533:20120803:134200.982 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5539:20120803:134204.182 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 16738
  5539:20120803:134338.229 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5518:20120803:134412.225 NODE 2: Received history from node 4 for node 4 datalen 377923
  5531:20120803:134426.483 NODE 2: Received history_uint from node 4 for node 4 datalen 391603
  5525:20120803:134440.421 NODE 2: Received history_str from node 4 for node 4 datalen 163888
  5516:20120803:134440.852 NODE 2: Received history_text from node 4 for node 4 datalen 7275
  5517:20120803:134555.775 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 28750
  5517:20120803:134709.140 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5529:20120803:134741.046 NODE 2: Received history from node 3 for node 3 datalen 443517
  5539:20120803:134810.405 NODE 2: Received history_uint from node 3 for node 3 datalen 395738
  5539:20120803:134832.441 NODE 2: Received history_str from node 3 for node 3 datalen 169223
  5525:20120803:134836.096 NODE 2: Received history_text from node 3 for node 3 datalen 55557
  5516:20120803:134837.025 NODE 2: Received events from node 3 for node 3 datalen 2493
  5521:20120803:134920.547 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5521:20120803:134926.068 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5515:20120803:134940.116 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5515:20120803:134940.654 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5533:20120803:134943.135 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 13913
  5533:20120803:135013.070 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8
  5555:20120803:135016.554 housekeeper deleted: 452022 records from history and trends, 0 records of deleted items, 56949 events, 0 alerts, 0 sessions
  5542:20120803:135055.229 NODE 2: Received history from node 1 for node 1 datalen 140841
  5542:20120803:135102.525 NODE 2: Received history_uint from node 1 for node 1 datalen 290446
  5521:20120803:135127.308 NODE 2: Received history_str from node 1 for node 1 datalen 64688
  5536:20120803:135127.603 NODE 2: Received history_text from node 1 for node 1 datalen 2507
  5516:20120803:135127.679 NODE 2: Received events from node 1 for node 1 datalen 3446
  5523:20120803:135134.407 NODE 2: Received configuration changes from slave node 4 for node 4 datalen 13641
  5523:20120803:135244.103 NODE 2: Sending configuration changes to slave node 4 for node 4 datalen 8
  5514:20120803:135317.721 NODE 2: Received history from node 4 for node 4 datalen 362708
  5521:20120803:135340.958 NODE 2: Received history_uint from node 4 for node 4 datalen 391842
  5539:20120803:135402.040 NODE 2: Received history_str from node 4 for node 4 datalen 169887
  5536:20120803:135403.428 NODE 2: Received history_text from node 4 for node 4 datalen 7458
  5529:20120803:135502.684 NODE 2: Received configuration changes from slave node 3 for node 3 datalen 26464
  5529:20120803:135556.627 NODE 2: Sending configuration changes to slave node 3 for node 3 datalen 8
  5542:20120803:135628.245 NODE 2: Received history from node 3 for node 3 datalen 442993
  5521:20120803:135647.142 NODE 2: Received history_uint from node 3 for node 3 datalen 397425
  5539:20120803:135706.526 NODE 2: Received history_str from node 3 for node 3 datalen 144661
  5525:20120803:135710.098 NODE 2: Received history_text from node 3 for node 3 datalen 46116
  5525:20120803:135710.472 NODE 2: Received events from node 3 for node 3 datalen 2346
  5519:20120803:135806.716 NODE 2: Received configuration changes from slave node 5 for node 5 datalen 8
  5519:20120803:135807.204 NODE 2: Sending configuration changes to slave node 5 for node 5 datalen 8
  5537:20120803:135809.539 NODE 2: Received configuration changes from slave node 6 for node 6 datalen 8
  5537:20120803:135812.797 NODE 2: Sending configuration changes to slave node 6 for node 6 datalen 8
  5533:20120803:135827.218 NODE 2: Received configuration changes from slave node 1 for node 1 datalen 15880
  5533:20120803:135851.607 NODE 2: Sending configuration changes to slave node 1 for node 1 datalen 8

      There are no errors in the logs.

        1. netmon 2 - master.png
          73 kB
          Roderick Groeneveld
        2. netmon 3 - slave.png
          73 kB
          Roderick Groeneveld
        3. status.png
          16 kB
          Roderick Groeneveld

            Unassigned Unassigned
            groe0286 Roderick Groeneveld
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

              Created:
              Updated:
              Resolved: