Would be good to know at least what process type was for PID 7225.
You can find it in start of server log.
There was one crash fixed for 2.2.2 in ZBX-7521
Would be good to retest on latest snapshot Pre-2.2.2rc1 (stable) http://www.zabbix.com/developers.php
And is another crash in ZBX-7579 (also on FeeBSD)
It's reproducible?
Please attach log with debug level 4. Otherwise we won't be able to help you.
Problem is not repeated after zabbix restart. We can't now change debug level because server in production. We will change it after holidays or after next server fail. Please keep case opened.
In any case you could find and post here what process type was for crashed PID 7225.
Today crash repeated. We can't find info about PID 7225 because default log size was 1M. Now we changed size to 1GB and wait for next crash.
Crash again. Last log
3885:20140109:152706.279 query [txnlev:1] [insert into trends_uint (itemid,clock,num,value_min,value_avg,value_max) values (52970,1389261600,1,3086,3086,3086),(53295,1389261600,1,1,1,1),(53176,1389261600,1,1,1,1),(52002,1389261600,1,1,1,1),(53824,1389261600,1,1,1,1),(53733,1389261600,1,1,1,1),(52999,1389261600,1,2575,2575,2575),(52431,1389261600,1,81,81,81),(53316,1389261600,1,1,1,1),(52694,1389261600,1,28,28,28),(53072,1389261600,1,214,214,214),(52823,1389261600,1,1,1,1),(53240,1389261600,1,3063,3063,3063),(52722,1389261600,1,28,28,28),(51413,1389261600,1,3043,3043,3043),(52086,1389261600,1,1,1,1),(53429,1389261600,1,1,1,1),(53076,1389261600,1,1,1,1),(52278,1389261600,1,1,1,1),(51709,1389261600,1,1,1,1),(53073,1389261600,1,1,1,1),(51793,1389261600,1,1,1,1),(52228,1389261600,1,1,1,1),(52761,1389261600,1,3013,3013,3013),(53527,1389261600,1,1,1,1),(52570,1389261600,1,1,1,1),(51744,1389261600,1,3117,3117,3117),(53489,1389261600,1,1,1,1),(51461,1389261600,1,3004,3004,3004),(52307,1389261600,1,1,1,1),(53815,1389261600,1,1,1,1),(52887,1389261600,1,3162,3162,3162),(53953,1389261600,1,1,1,1),(53782,1389261600,1,1,1,1),(53163,1389261600,1,3053,3053,3053),(53547,1389261600,1,1,1,1),(53419,1389261600,1,1,1,1),(51730,1389261600,1,1,1,1),(52356,1389261600,1,1,1,1),(51728,1389261600,1,1,1,1),(53445,1389261600,1,1,1,1),(53615,1389261600,1,1,1,1),(53876,1389261600,1,1,1,1),(52567,1389261600,1,1,1,1),(51746,1389261600,1,1,1,1),(51505,1389261600,1,60,60,60),(51578,1389261600,1,1,1,1),(52227,1389261600,1,1,1,1),(53386,1389261600,1,3115,3115,3115),(53353,1389261600,1,1,1,1),(51508,1389261600,1,1,1,1),(52924,1389261600,1,2589,2589,2589),(52290,1389261600,1,1,1,1),(52878,1389261600,1,3142,3142,3142),(52001,1389261600,1,1,1,1),(52792,1389261600,1,1,1,1),(53790,1389261600,1,1,1,1),(53880,1389261600,1,1,1,1),(53635,1389261600,1,1,1,1),(52400,1389261600,1,1,1,1),(52829,1389261600,1,2574,2574,2574),(51632,1389261600,1,1,1,1),(51879,1389261600,1,1,1,1),(53389,1389261600,1,1,1,1),(53472,1389261600,1,1,1,1),(52347,1389261600,1,1,1,1),(51748,1389261600,1,1,1,1),(51951,1389261600,1,83,83,83),(51523,1389261600,1,1,1,1),(51400,1389261600,1,3025,3025,3025),(51698,1389261600,1,1,1,1),(52183,1389261600,1,1,1,1),(51949,1389261600,1,62,62,62),(52325,1389261600,1,1,1,1),(51988,1389261600,1,1,1,1),(53467,1389261600,1,3047,3047,3047),(52880,1389261600,1,3046,3046,3046),(51833,1389261600,1,1,1,1),(52502,1389261600,1,1,1,1),(53870,1389261600,1,1,1,1),(52383,1389261600,1,1,1,1),(52125,1389261600,1,1,1,1),(53642,1389261600,1,1,1,1),(53823,1389261600,1,1,1,1),(53215,1389261600,1,3036,3036,3036),(52428,1389261600,1,87,87,87),(52446,1389261600,1,60,60,60),(52785,1389261600,1,3019,3019,3019),(52610,1389261600,1,1,1,1),(53105,1389261600,1,3138,3138,3138),(53428,1389261600,1,3005,3005,3005),(53996,1389261600,1,1,1,1),(51652,1389261600,1,1,1,1),(52053,1389261600,1,3056,3056,3056),(53907,1389261600,1,1,1,1),(52119,1389261600,1,3020,3020,3020),(53620,1389261600,1,1,1,1),(53440,1389261600,1,1,1,1),(51614,1389261600,1,1,1,1),(52767,1389261600,1,3015,3015,3015),(52109,1389261600,1,1,1,1),(53027,1389261600,1,259,259,259),(51990,1389261600,1,1,1,1),(52574,1389261600,1,1,1,1),(51625,1389261600,1,83,83,83),(52317,1389261600,1,60,60,60),(53473,1389261600,1,1,1,1),(51453,1389261600,1,1,1,1),(53814,1389261600,1,3072,3072,3072),(52348,1389261600,1,1,1,1),(53923,1389261600,1,1,1,1),(52008,1389261600,1,1412,1412,1412),(52435,1389261600,1,62,62,62),(53903,1389261600,1,1,1,1),(53426,1389261600,1,3053,3053,3053),(53536,1389261600,1,1,1,1),(51937,1389261600,1,60,60,60),(51973,1389261600,1,1,1,1),(53321,1389261600,1,3060,3060,3060),(52297,1389261600,1,1,1,1),(52854,1389261600,1,3040,3040,3040),(52975,1389261600,1,3015,3015,3015),(52545,1389261600,1,1,1,1),(53723,1389261600,1,1,1,1),(52004,1389261600,1,1,1,1),(52443,1389261600,1,60,60,60),(53866,1389261600,1,1,1,1),(53326,1389261600,1,1,1,1),(53075,1389261600,1,3133,3133,3133),(52170,1389261600,1,3176,3176,3176),(52612,1389261600,1,1,1,1),(52903,1389261600,1,3015,3015,3015),(53689,1389261600,1,1,1,1),(53183,1389261600,1,1,1,1),(52419,1389261600,1,83,83,83),(51573,1389261600,1,1,1,1),(53137,1389261600,1,3011,3011,3011),(51552,1389261600,1,3086,3086,3086),(53080,1389261600,1,3067,3067,3067),(53998,1389261600,1,1,1,1),(52894,1389261600,1,3050,3050,3050),(52179,1389261600,1,1,1,1),(53786,1389261600,1,1,1,1),(51483,1389261600,1,1,1,1),(52794,1389261600,1,3022,3022,3022),(53361,1389261600,1,3006,3006,3006),(53351,1389261600,1,1,1,1),(51835,1389261600,1,1,1,1),(52920,1389261600,1,2583,2583,2583),(52864,1389261600,1,3032,3032,3032),(52839,1389261600,1,3074,3074,3074),(51504,1389261600,1,83,83,83),(53112,1389261600,1,3002,3002,3002),(52346,1389261600,1,1,1,1),(53431,1389261600,1,1,1,1),(53340,1389261600,1,1,1,1),(52462,1389261600,1,80,80,80),(52413,1389261600,1,1,1,1),(53468,1389261600,1,1,1,1),(53833,1389261600,1,1,1,1),(27514,1389261600,1,31193542656,31193542656,31193542656),(53368,1389261600,1,3018,3018,3018),(27500,1389261600,1,31193542656,31193542656,31193542656),(53257,1389261600,1,3046,3046,3046),(53171,1389261600,1,3008,3008,3008),(53465,1389261600,1,1,1,1),(52917,1389261600,1,3025,3025,3025),(51524,1389261600,1,1,1,1),(53066,1389261600,1,2813,2813,2813),(51724,1389261600,1,1,1,1),(52650,1389261600,1,25,25,25),(53634,1389261600,1,1,1,1),(51761,1389261600,1,1,1,1),(53416,1389261600,1,1,1,1),(51470,1389261600,1,1,1,1),(52198,1389261600,1,3054,3054,3054),(52646,1389261600,1,25,25,25),(53470,1389261600,1,1,1,1),(52919,1389261600,1,1,1,1),(52529,1389261600,1,1,1,1),(53269,1389261600,1,3069,3069,3069),(51875,1389261600,1,1,1,1),(52045,1389261600,1,3136,3136,3136),(52448,1389261600,1,83,83,83),(52958,1389261600,1,401,401,401),(53087,1389261600,1,3107,3107,3107),(53250,1389261600,1,1,1,1),(53346,1389261600,1,1,1,1),(53774,1389261600,1,1,1,1),(53362,1389261600,1,1,1,1),(51694,1389261600,1,3021,3021,3021),(53083,1389261600,1,3098,3098,3098),(52077,1389261600,1,3035,3035,3035),(53494,1389261600,1,3042,3042,3042),(52967,1389261600,1,1,1,1),(52338,1389261600,1,3068,3068,3068),(53607,1389261600,1,1,1,1),(51477,1389261600,1,1,1,1),(51826,1389261600,1,1,1,1),(52047,1389261600,1,3048,3048,3048),(51600,1389261600,1,3094,3094,3094),(51834,1389261600,1,1,1,1),(53716,1389261600,1,1,1,1),(51521,1389261600,1,1,1,1),(51738,1389261600,1,1,1,1),(53497,1389261600,1,1,1,1),(52921,1389261600,1,3017,3017,3017),(53701,1389261600,1,1,1,1),(52161,1389261600,1,1,1,1),(53271,1389261600,1,1,1,1),(53698,1389261600,1,1,1,1),(52855,1389261600,1,3062,3062,3062),(51691,1389261600,1,1,1,1),(53233,1389261600,1,3037,3037,3037),(52966,1389261600,1,3047,3047,3047),(52834,1389261600,1,3055,3055,3055),(53666,1389261600,1,1,1,1),(53718,1389261600,1,1,1,1),(52424,1389261600,1,83,83,83),(51634,1389261600,1,1,1,1),(53488,1389261600,1,1,1,1),(27493,1389261600,1,3956734,3956734,3956734),(53325,1389261600,1,1,1,1),(53449,1389261600,1,1,1,1),(52445,1389261600,1,1,1,1),(52094,1389261600,1,2815,2815,2815),(51920,1389261600,1,50,50,50),(51992,1389261600,1,1,1,1),(51564,1389261600,1,3089,3089,3089),(52756,1389261600,1,1,1,1),(52207,1389261600,1,1,1,1),(53335,1389261600,1,1,1,1),(53569,1389261600,1,1,1,1),(52219,1389261600,1,1,1,1),(53918,1389261600,1,1,1,1),(53293,1389261600,1,3007,3007,3007),(52973,1389261600,1,1,1,1),(51506,1389261600,1,89,89,89),(53868,1389261600,1,1,1,1),(52752,1389261600,1,3010,3010,3010),(52331,1389261600,1,1,1,1),(52266,1389261600,1,1,1,1),(53892,1389261600,1,1,1,1),(51893,1389261600,1,1,1,1),(53751,1389261600,1,1,1,1),(51664,1389261600,1,1,1,1),(52660,1389261600,1,80,80,80),(53725,1389261600,1,1,1,1),(52261,1389261600,1,1,1,1),(53799,1389261600,1,1,1,1),(53909,1389261600,1,1,1,1),(52370,1389261600,1,1,1,1),(53576,1389261600,1,1,1,1),(53764,1389261600,1,1,1,1),(53699,1389261600,1,1,1,1),(51821,1389261600,1,1,1,1),(53392,1389261600,1,1,1,1),(51414,1389261600,1,3063,3063,3063),(51403,1389261600,1,2808,2808,2808),(52513,1389261600,1,1,1,1),(52541,1389261600,1,1,1,1),(52899,1389261600,1,3100,3100,3100),(51919,1389261600,1,1,1,1),(51443,1389261600,1,3045,3045,3045),(52138,1389261600,1,1,1,1),(52535,1389261600,1,1,1,1),(52507,1389261600,1,1,1,1),(53820,1389261600,1,1,1,1),(53749,1389261600,1,1,1,1),(53550,1389261600,1,1,1,1),(52514,1389261600,1,1,1,1),(53485,1389261600,1,1,1,1),(53297,1389261600,1,1,1,1),(51409,1389261600,1,3004,3004,3004),(51971,1389261600,1,1,1,1),(53366,1389261600,1,1,1,1),(51853,1389261600,1,1,1,1),(52031,1389261600,1,1,1,1),(53311,1389261600,1,1,1,1),(52390,1389261600,1,1,1,1),(53618,1389261600,1,1,1,1),(51503,1389261600,1,81,81,81),(52218,1389261600,1,1,1,1),(52930,1389261600,1,1,1,1),(53259,1389261600,1,1,1,1),(53721,1389261600,1,1,1,1),(53119,1389261600,1,1,1,1),(53885,1389261600,1,1,1,1),(51438,1389261600,1,1,1,1),(53768,1389261600,1,1,1,1),(52396,1389261600,1,1,1,1),(52058,1389261600,1,3038,3038,3038),(53791,1389261600,1,1,1,1),(53004,1389261600,1,2578,2578,2578),(52415,1389261600,1,83,83,83),(53954,1389261600,1,1,1,1),(52401,1389261600,1,60,60,60),(53691,1389261600,1,1,1,1),(53886,1389261600,1,1,1,1),(53695,1389261600,1,3059,3059,3059),(51621,1389261600,1,1,1,1),(53897,1389261600,1,1,1,1),(53936,1389261600,1,1,1,1),(51736,1389261600,1,1,1,1),(51636,1389261600,1,1,1,1),(51589,1389261600,1,1,1,1),(53014,1389261600,1,1,1,1),(52530,1389261600,1,1,1,1),(52029,1389261600,1,3137,3137,3137),(51979,1389261600,1,1,1,1),(52896,1389261600,1,3002,3002,3002),(52571,1389261600,1,1,1,1),(51936,1389261600,1,86,86,86),(53566,1389261600,1,1,1,1),(53359,1389261600,1,1,1,1),(53741,1389261600,1,1,1,1),(53432,1389261600,1,3005,3005,3005),(52644,1389261600,1,401,401,401),(52061,1389261600,1,3062,3062,3062),(53765,1389261600,1,1,1,1),(52209,1389261600,1,1,1,1),(53726,1389261600,1,1,1,1),(51963,1389261600,1,1,1,1),(52800,1389261600,1,60,60,60),(51727,1389261600,1,1,1,1),(52100,1389261600,1,3086,3086,3086),(53141,1389261600,1,3096,3096,3096),(51870,1389261600,1,1,1,1),(53846,1389261600,1,1,1,1),(53286,1389261600,1,1,1,1),(53690,1389261600,1,1,1,1),(51787,1389261600,1,1,1,1),(51944,1389261600,1,81,81,81),(52952,1389261600,1,3008,3008,3008),(53994,1389261600,1,1,1,1),(52056,1389261600,1,3064,3064,3064),(53219,1389261600,1,1,1,1),(52960,1389261600,1,3000,3000,3000),(53659,1389261600,1,1,1,1),(51827,1389261600,1,1,1,1),(51442,1389261600,1,1,1,1),(52479,1389261600,1,1,1,1),(53803,1389261600,1,1,1,1),(52518,1389261600,1,1,1,1),(51677,1389261600,1,3000,3000,3000),(51465,1389261600,1,1,1,1),(27519,1389261600,1,31193542656,31193542656,31193542656),(53122,1389261600,1,3051,3051,3051),(52662,1389261600,1,21,21,21),(52122,1389261600,1,1,1,1),(53772,1389261600,1,1,1,1),(53188,1389261600,1,1,1,1),(52113,1389261600,1,3000,3000,3000),(52744,1389261600,1,1,1,1),(53964,1389261600,1,3177,3177,3177),(51481,1389261600,1,1,1,1),(52402,1389261600,1,1,1,1),(51407,1389261600,1,3083,3083,3083),(51500,1389261600,1,1,1,1),(51644,1389261600,1,60,60,60),(51852,1389261600,1,1,1,1),(51537,1389261600,1,1,1,1),(53276,1389261600,1,2573,2573,2573),(52362,1389261600,1,1,1,1),(51448,1389261600,1,1,1,1),(51513,1389261600,1,1,1,1),(52531,1389261600,1,1,1,1),(51476,1389261600,1,60,60,60),(51478,1389261600,1,1,1,1),(53310,1389261600,1,3020,3020,3020),(53199,1389261600,1,1,1,1),(51593,1389261600,1,1,1,1),(53549,1389261600,1,1,1,1),(53737,1389261600,1,1,1,1),(52285,1389261600,1,1,1,1),(53200,1389261600,1,3004,3004,3004),(53230,1389261600,1,1,1,1),(52352,1389261600,1,1,1,1),(53962,1389261600,1,1,1,1),(51487,1389261600,1,1,1,1),(53769,1389261600,1,1,1,1),(53800,1389261600,1,1,1,1),(53969,1389261600,1,1,1,1),(51446,1389261600,1,3003,3003,3003),(53773,1389261600,1,1,1,1),(51570,1389261600,1,1,1,1),(52124,1389261600,1,1,1,1),(52776,1389261600,1,3017,3017,3017),(53654,1389261600,1,3175,3175,3175),(53744,1389261600,1,1,1,1),(52804,1389261600,1,1,1,1),(53692,1389261600,1,1,1,1),(52264,1389261600,1,1,1,1),(51795,1389261600,1,1,1,1),(53977,1389261600,1,1,1,1),(53070,1389261600,1,3095,3095,3095),(53395,1389261600,1,1,1,1),(53667,1389261600,1,1,1,1),(51922,1389261600,1,1,1,1),(52508,1389261600,1,1,1,1),(52160,1389261600,1,1,1,1),(52521,1389261600,1,1,1,1),(51462,1389261600,1,1,1,1),(51900,1389261600,1,1,1,1),(51687,1389261600,1,3001,3001,3001),(53623,1389261600,1,1,1,1),(52648,1389261600,1,80,80,80),(53631,1389261600,1,1,1,1),(51772,1389261600,1,1,1,1),(51752,1389261600,1,1,1,1),(51880,1389261600,1,1,1,1),(53730,1389261600,1,1,1,1),(52277,1389261600,1,1,1,1),(51474,1389261600,1,1,1,1),(52032,1389261600,1,3040,3040,3040),(52075,1389261600,1,3102,3102,3102),(52204,1389261600,1,1,1,1),(52238,1389261600,1,1,1,1),(52840,1389261600,1,3025,3025,3025),(53951,1389261600,1,1,1,1),(52134,1389261600,1,1,1,1),(53059,1389261600,1,3005,3005,3005),(51699,1389261600,1,3013,3013,3013),(52885,1389261600,1,3124,3124,3124),(51399,1389261600,1,3068,3068,3068),(53573,1389261600,1,1,1,1),(53327,1389261600,1,3004,3004,3004),(53719,1389261600,1,1,1,1),(52120,1389261600,1,1,1,1),(51813,1389261600,1,1,1,1),(52630,1389261600,1,1,1,1),(53405,1389261600,1,1,1,1),(53847,1389261600,1,1,1,1),(52565,1389261600,1,1,1,1),(51542,1389261600,1,3003,3003,3003),(51954,1389261600,1,83,83,83),(53711,1389261600,1,1,1,1),(51784,1389261600,1,1,1,1),(53084,1389261600,1,3030,3030,3030),(53597,1389261600,1,1,1,1),(52254,1389261600,1,1,1,1),(53266,1389261600,1,3034,3034,3034),(53496,1389261600,1,1,1,1),(52395,1389261600,1,60,60,60),(52816,1389261600,1,1,1,1),(53557,1389261600,1,1,1,1),(53323,1389261600,1,1,1,1),(53225,1389261600,1,1,1,1),(52762,1389261600,1,1,1,1),(52771,1389261600,1,1,1,1),(53211,1389261600,1,3007,3007,3007),(52251,1389261600,1,1,1,1),(52734,1389261600,1,3005,3005,3005),(52044,1389261600,1,3026,3026,3026),(51771,1389261600,1,3070,3070,3070),(52459,1389261600,1,1,1,1),(51511,1389261600,1,1,1,1),(51714,1389261600,1,1,1,1),(52144,1389261600,1,1,1,1),(53614,1389261600,1,1,1,1),(53959,1389261600,1,1,1,1),(53483,1389261600,1,1,1,1),(53303,1389261600,1,1,1,1),(52271,1389261600,1,3102,3102,3102),(52283,1389261600,1,1,1,1),(52048,1389261600,1,3152,3152,3152),(52335,1389261600,1,1,1,1),(52836,1389261600,1,3067,3067,3067),(52837,1389261600,1,3008,3008,3008),(53872,1389261600,1,1,1,1),(53378,1389261600,1,401,401,401),(52888,1389261600,1,1,1,1),(51606,1389261600,1,1,1,1),(53117,1389261600,1,3050,3050,3050),(52366,1389261600,1,60,60,60),(51923,1389261600,1,1,1,1),(51783,1389261600,1,1,1,1),(51710,1389261600,1,1,1,1),(53588,1389261600,1,1,1,1),(53609,1389261600,1,1,1,1),(52902,1389261600,1,2575,2575,2575),(53890,1389261600,1,3073,3073,3073),(52485,1389261600,1,1,1,1),(52304,1389261600,1,3065,3065,3065),(51924,1389261600,1,1,1,1),(53331,1389261600,1,1,1,1),(51733,1389261600,1,1,1,1),(52955,1389261600,1,3049,3049,3049),(52059,1389261600,1,3066,3066,3066),(52996,1389261600,1,2521,2521,2521),(51801,1389261600,1,1,1,1),(51696,1389261600,1,3001,3001,3001),(51904,1389261600,1,1,1,1),(52997,1389261600,1,2582,2582,2582),(52547,1389261600,1,1,1,1),(52477,1389261600,1,1,1,1),(51910,1389261600,1,1,1,1),(53908,1389261600,1,1,1,1),(53198,1389261600,1,1,1,1),(53193,1389261600,1,3059,3059,3059),(51715,1389261600,1,1,1,1),(53036,1389261600,1,3001,3001,3001),(52950,1389261600,1,3141,3141,3141),(53747,1389261600,1,1,1,1),(53097,1389261600,1,1,1,1),(53981,1389261600,1,1,1,1),(53946,1389261600,1,1,1,1),(52073,1389261600,1,1433,1433,1433),(52714,1389261600,1,23,23,23),(53110,1389261600,1,1,1,1),(53517,1389261600,1,1,1,1),(52509,1389261600,1,1,1,1),(53646,1389261600,1,1,1,1),(51762,1389261600,1,1,1,1),(53901,1389261600,1,1,1,1),(52148,1389261600,1,3083,3083,3083),(53238,1389261600,1,3079,3079,3079),(51997,1389261600,1,1,1,1),(52883,1389261600,1,3013,3013,3013),(53694,1389261600,1,1,1,1),(53459,1389261600,1,1,1,1),(53320,1389261600,1,1,1,1),(52922,1389261600,1,206,206,206),(52017,1389261600,1,3042,3042,3042),(51528,1389261600,1,1,1,1),(51867,1389261600,1,1,1,1),(53142,1389261600,1,1,1,1),(52258,1389261600,1,1,1,1),(52475,1389261600,1,1,1,1),(53982,1389261600,1,1,1,1),(52551,1389261600,1,1,1,1),(53688,1389261600,1,1,1,1),(53462,1389261600,1,1,1,1),(53491,1389261600,1,1,1,1),(53347,1389261600,1,1,1,1),(52355,1389261600,1,83,83,83),(52634,1389261600,1,25,25,25),(53784,1389261600,1,1,1,1),(52062,1389261600,1,3018,3018,3018),(51485,1389261600,1,1,1,1),(51925,1389261600,1,1,1,1),(53146,1389261600,1,1,1,1),(53371,1389261600,1,1,1,1),(51782,1389261600,1,1,1,1),(52901,1389261600,1,3020,3020,3020),(53143,1389261600,1,1,1,1),(53857,1389261600,1,1,1,1),(52436,1389261600,1,1,1,1),(52289,1389261600,1,1,1,1),(53871,1389261600,1,1,1,1),(51974,1389261600,1,1,1,1),(52368,1389261600,1,1,1,1),(52503,1389261600,1,1,1,1),(52006,1389261600,1,1,1,1),(52853,1389261600,1,1,1,1),(52563,1389261600,1,1,1,1),(53732,1389261600,1,1,1,1),(52586,1389261600,1,3104,3104,3104),(53818,1389261600,1,1,1,1),(53334,1389261600,1,507,507,507),(52215,1389261600,1,1,1,1),(53862,1389261600,1,1,1,1),(53302,1389261600,1,401,401,401),(53879,1389261600,1,1,1,1),(51876,1389261600,1,1,1,1),(53187,1389261600,1,1,1,1),(51742,1389261600,1,3090,3090,3090),(51914,1389261600,1,1,1,1),(51497,1389261600,1,1,1,1),(52472,1389261600,1,1,1,1),(53414,1389261600,1,1,1,1),(52442,1389261600,1,81,81,81),(53755,1389261600,1,1,1,1),(53438,1389261600,1,1,1,1),(53663,1389261600,1,1,1,1),(52636,1389261600,1,80,80,80),(52412,1389261600,1,60,60,60),(53556,1389261600,1,1,1,1),(51613,1389261600,1,3030,3030,3030),(51745,1389261600,1,3158,3158,3158),(52882,1389261600,1,3023,3023,3023),(53633,1389261600,1,1,1,1),(53942,1389261600,1,1,1,1),(53454,1389261600,1,401,401,401),(51554,1389261600,1,3001,3001,3001),(53439,1389261600,1,258,258,258),(53128,1389261600,1,3001,3001,3001),(53252,1389261600,1,1,1,1),(53787,1389261600,1,1,1,1),(53047,1389261600,1,3000,3000,3000),(53967,1389261600,1,1,1,1),(52361,1389261600,1,60,60,60),(52197,1389261600,1,1,1,1),(52146,1389261600,1,3170,3170,3170),(53878,1389261600,1,1,1,1),(53212,1389261600,1,1,1,1),(52553,1389261600,1,1,1,1),(53180,1389261600,1,3010,3010,3010),(51464,1389261600,1,1,1,1),(53486,1389261600,1,1,1,1),(52881,1389261600,1,3020,3020,3020),(53630,1389261600,1,1,1,1),(52155,1389261600,1,1,1,1),(53544,1389261600,1,1,1,1),(53948,1389261600,1,1,1,1),(52747,1389261600,1,1,1,1),(52248,1389261600,1,1,1,1),(52850,1389261600,1,3091,3091,3091),(53363,1389261600,1,3008,3008,3008),(52293,1389261600,1,1,1,1),(51896,1389261600,1,1,1,1),(53669,1389261600,1,1,1,1),(53565,1389261600,1,3026,3026,3026),(51440,1389261600,1,1,1,1),(51790,1389261600,1,1,1,1),(51576,1389261600,1,3091,3091,3091),(52287,1389261600,1,1,1,1),(53874,1389261600,1,1,1,1),(53632,1389261600,1,1,1,1),(53679,1389261600,1,1,1,1),(53678,1389261600,1,1,1,1),(53479,1389261600,1,1,1,1),(52700,1389261600,1,1,1,1),(51629,1389261600,1,1,1,1),(52890,1389261600,1,3163,3163,3163),(53532,1389261600,1,1,1,1),(52116,1389261600,1,1,1,1),(52569,1389261600,1,1,1,1),(52054,1389261600,1,1,1,1),(51804,1389261600,1,1,1,1),(53350,1389261600,1,3052,3052,3052),(51848,1389261600,1,1,1,1),(51814,1389261600,1,1,1,1),(52841,1389261600,1,3024,3024,3024),(51907,1389261600,1,50,50,50),(52906,1389261600,1,1,1,1),(52328,1389261600,1,1,1,1),(53135,1389261600,1,3006,3006,3006),(52079,1389261600,1,1,1,1),(53807,1389261600,1,1,1,1),(52151,1389261600,1,1,1,1),(53896,1389261600,1,1,1,1),(52830,1389261600,1,2574,2574,2574),(53079,1389261600,1,3030,3030,3030),(53840,1389261600,1,1,1,1),(52954,1389261600,1,1,1,1),(53304,1389261600,1,1,1,1),(53134,1389261600,1,1,1,1),(51473,1389261600,1,3047,3047,3047),(51412,1389261600,1,2576,2576,2576),(51667,1389261600,1,2516,2516,2516),(51662,1389261600,1,3014,3014,3014),(52195,1389261600,1,1,1,1),(51863,1389261600,1,1,1,1),(53095,1389261600,1,3089,3089,3089),(53960,1389261600,1,1,1,1),(53100,1389261600,1,401,401,401),(52425,1389261600,1,1,1,1),(53608,1389261600,1,1,1,1),(51602,1389261600,1,1,1,1),(52482,1389261600,1,1,1,1),(53702,1389261600,1,1,1,1),(52205,1389261600,1,3084,3084,3084),(51444,1389261600,1,1,1,1),(53526,1389261600,1,1,1,1),(52959,1389261600,1,3020,3020,3020),(51753,1389261600,1,1,1,1),(52354,1389261600,1,1,1,1),(52174,1389261600,1,557,557,557),(51455,1389261600,1,1,1,1),(51475,1389261600,1,1,1,1),(53792,1389261600,1,1,1,1),(51934,1389261600,1,60,60,60),(53972,1389261600,1,1,1,1),(53046,1389261600,1,3104,3104,3104),(53602,1389261600,1,1,1,1),(53377,1389261600,1,1,1,1),(52875,1389261600,1,3138,3138,3138),(53148,1389261600,1,3016,3016,3016),(53226,1389261600,1,3010,3010,3010),(51957,1389261600,1,1,1,1),(52490,1389261600,1,1,1,1),(53164,1389261600,1,3151,3151,3151),(52191,1389261600,1,1,1,1),(52460,1389261600,1,83,83,83),(51775,1389261600,1,1,1,1),(53767,1389261600,1,1,1,1),(53313,1389261600,1,1,1,1),(53270,1389261600,1,1,1,1),(52267,1389261600,1,1,1,1),(53139,1389261600,1,3035,3035,3035),(52892,1389261600,1,2572,2572,2572),(53453,1389261600,1,1,1,1),(51882,1389261600,1,1,1,1),(52206,1389261600,1,1,1,1),(53808,1389261600,1,1,1,1),(52991,1389261600,1,3081,3081,3081),(52895,1389261600,1,2577,2577,2577),(53622,1389261600,1,1,1,1),(51707,1389261600,1,60,60,60),(53401,1389261600,1,1,1,1),(52150,1389261600,1,1,1,1),(53940,1389261600,1,1,1,1),(51605,1389261600,1,1,1,1),(52560,1389261600,1,1,1,1),(51679,1389261600,1,3032,3032,3032),(51673,1389261600,1,3011,3011,3011),(52345,1389261600,1,1,1,1),(52343,1389261600,1,1,1,1),(53855,1389261600,1,1,1,1),(53752,1389261600,1,1,1,1),(53884,1389261600,1,1,1,1),(51756,1389261600,1,1,1,1),(52104,1389261600,1,1,1,1),(51802,1389261600,1,1,1,1),(53660,1389261600,1,1,1,1),(53413,1389261600,1,3168,3168,3168),(53776,1389261600,1,1,1,1),(52033,1389261600,1,3097,3097,3097),(51800,1389261600,1,1,1,1),(52060,1389261600,1,203,203,203),(51436,1389261600,1,1,1,1),(51445,1389261600,1,1,1,1),(51425,1389261600,1,1,1,1),(53900,1389261600,1,1,1,1),(51939,1389261600,1,1,1,1),(52268,1389261600,1,1,1,1),(51978,1389261600,1,1,1,1),(53051,1389261600,1,3048,3048,3048),(52915,1389261600,1,2579,2579,2579),(53436,1389261600,1,1,1,1),(52990,1389261600,1,3010,3010,3010),(53748,1389261600,1,1,1,1),(52525,1389261600,1,1,1,1),(53098,1389261600,1,3008,3008,3008),(53853,1389261600,1,1,1,1),(53570,1389261600,1,1,1,1),(52101,1389261600,1,1,1,1),(51720,1389261600,1,1,1,1),(53039,1389261600,1,2571,2571,2571),(52440,1389261600,1,83,83,83),(53444,1389261600,1,1,1,1),(51805,1389261600,1,1,1,1),(51661,1389261600,1,3000,3000,3000),(53587,1389261600,1,1,1,1),(52420,1389261600,1,81,81,81),(52163,1389261600,1,1,1,1),(53837,1389261600,1,1,1,1),(52937,1389261600,1,3111,3111,3111),(52280,1389261600,1,1,1,1),(53513,1389261600,1,1,1,1),(52042,1389261600,1,3019,3019,3019),(53736,1389261600,1,1,1,1),(51562,1389261600,1,1,1,1),(51998,1389261600,1,1,1,1),(51541,1389261600,1,2515,2515,2515),(53151,1389261600,1,1,1,1),(52081,1389261600,1,1,1,1),(51498,1389261600,1,1,1,1),(52827,1389261600,1,3019,3019,3019),(53592,1389261600,1,1,1,1),(51818,1389261600,1,1,1,1),(51883,1389261600,1,1,1,1),(53352,1389261600,1,1,1,1),(52164,1389261600,1,3061,3061,3061),(53448,1389261600,1,3026,3026,3026),(53673,1389261600,1,1,1,1),(52550,1389261600,1,1,1,1),(52012,1389261600,1,3074,3074,3074),(51823,1389261600,1,1,1,1),(53604,1389261600,1,1,1,1),(53037,1389261600,1,3022,3022,3022),(53272,1389261600,1,1,1,1),(51626,1389261600,1,81,81,81),(53952,1389261600,1,1,1,1),(53849,1389261600,1,1,1,1),(52552,1389261600,1,1,1,1),(52791,1389261600,1,3021,3021,3021),(52074,1389261600,1,3120,3120,3120),(52272,1389261600,1,1,1,1),(52214,1389261600,1,3088,3088,3088),(52384,1389261600,1,60,60,60),(53735,1389261600,1,1,1,1),(53804,1389261600,1,1,1,1),(53650,1389261600,1,1,1,1),(53203,1389261600,1,1,1,1),(52818,1389261600,1,2577,2577,2577),(52030,1389261600,1,3077,3077,3077),(52642,1389261600,1,25,25,25),(52941,1389261600,1,3040,3040,3040),(53031,1389261600,1,1,1,1),(53867,1389261600,1,1,1,1),(52315,1389261600,1,1,1,1),(53126,1389261600,1,3005,3005,3005),(51975,1389261600,1,1,1,1),(53424,1389261600,1,1,1,1),(53383,1389261600,1,3177,3177,3177),(53380,1389261600,1,1,1,1),(53251,1389261600,1,3007,3007,3007),(53746,1389261600,1,1,1,1),(53504,1389261600,1,3006,3006,3006),(51806,1389261600,1,1,1,1),(53484,1389261600,1,3014,3014,3014),(53738,1389261600,1,3071,3071,3071),(52057,1389261600,1,1,1,1),(52336,1389261600,1,1,1,1),(53686,1389261600,1,1,1,1),(53034,1389261600,1,1,1,1),(51418,1389261600,1,2578,2578,2578),(52730,1389261600,1,1,1,1),(53053,1389261600,1,3013,3013,3013),(52538,1389261600,1,1,1,1),(52498,1389261600,1,1,1,1),(52326,1389261600,1,1,1,1),(51458,1389261600,1,3046,3046,3046),(53899,1389261600,1,1,1,1),(53978,1389261600,1,1,1,1),(51556,1389261600,1,3087,3087,3087),(53061,1389261600,1,3009,3009,3009),(52270,1389261600,1,1,1,1),(52684,1389261600,1,62,62,62),(52418,1389261600,1,83,83,83),(52034,1389261600,1,3123,3123,3123),(52884,1389261600,1,2570,2570,2570),(53190,1389261600,1,3033,3033,3033),(51887,1389261600,1,1,1,1),(53130,1389261600,1,3029,3029,3029),(53643,1389261600,1,1,1,1),(52447,1389261600,1,1,1,1),(53985,1389261600,1,1,1,1),(53442,1389261600,1,1,1,1),(51966,1389261600,1,1,1,1),(52851,1389261600,1,3027,3027,3027),(53262,1389261600,1,1,1,1),(51844,1389261600,1,1,1,1),(53873,1389261600,1,1,1,1),(52478,1389261600,1,1,1,1),(52961,1389261600,1,3023,3023,3023),(52159,1389261600,1,1,1,1),(53085,1389261600,1,2579,2579,2579),(52849,1389261600,1,2574,2574,2574),(51913,1389261600,1,1,1,1),(53916,1389261600,1,1,1,1),(52758,1389261600,1,2574,2574,2574),(52726,1389261600,1,1,1,1),(53945,1389261600,1,3135,3135,3135),(51654,1389261600,1,730,730,730),(52451,1389261600,1,81,81,81),(52136,1389261600,1,1,1,1),(53753,1389261600,1,1,1,1),(53213,1389261600,1,3010,3010,3010),(52398,1389261600,1,60,60,60),(53289,1389261600,1,3012,3012,3012),(53210,1389261600,1,1,1,1),(53545,1389261600,1,1,1,1),(51463,1389261600,1,1,1,1),(51561,1389261600,1,535,535,535),(53980,1389261600,1,1,1,1),(53812,1389261600,1,3139,3139,3139),(53433,1389261600,1,3016,3016,3016),(52169,1389261600,1,1,1,1),(52750,1389261600,1,1,1,1),(53548,1389261600,1,1,1,1),(53756,1389261600,1,1,1,1),(53558,1389261600,1,1,1,1),(52367,1389261600,1,62,62,62),(51672,1389261600,1,1,1,1),(52417,1389261600,1,82,82,82),(51965,1389261600,1,1,1,1),(53396,1389261600,1,1,1,1),(53906,1389261600,1,1,1,1),(53507,1389261600,1,1,1,1),(53054,1389261600,1,3030,3030,3030),(51608,1389261600,1,62,62,62),(52324,1389261600,1,60,60,60),(53372,1389261600,1,3041,3041,3041),(53394,1389261600,1,1,1,1),(52869,1389261600,1,3011,3011,3011),(52927,1389261600,1,3028,3028,3028),(51766,1389261600,1,1,1,1),(51856,1389261600,1,1,1,1),(52995,1389261600,1,3002,3002,3002),(53279,1389261600,1,1,1,1),(53078,1389261600,1,3033,3033,3033),(52929,1389261600,1,3034,3034,3034),(52118,1389261600,1,1,1,1),(52867,1389261600,1,3122,3122,3122),(52455,1389261600,1,81,81,81),(53935,1389261600,1,1,1,1),(53580,1389261600,1,3049,3049,3049),(53049,1389261600,1,1,1,1),(51819,1389261600,1,1,1,1),(52162,1389261600,1,1,1,1),(52156,1389261600,1,1,1,1),(53370,1389261600,1,1,1,1),(51397,1389261600,1,1,1,1),(52232,1389261600,1,1,1,1),(53208,1389261600,1,1,1,1),(53508,1389261600,1,3006,3006,3006),(52308,1389261600,1,1,1,1),(51457,1389261600,1,1,1,1),(53307,1389261600,1,3070,3070,3070),(51976,1389261600,1,1,1,1),(53533,1389261600,1,1,1,1),(53067,1389261600,1,1,1,1),(53375,1389261600,1,3022,3022,3022),(53831,1389261600,1,1,1,1),(53381,1389261600,1,1,1,1),(52449,1389261600,1,60,60,60),(52046,1389261600,1,3050,3050,3050),(53477,1389261600,1,1,1,1),(52282,1389261600,1,1,1,1),(52378,1389261600,1,1,1,1),(52825,1389261600,1,241,241,241),(53827,1389261600,1,1,1,1),(52871,1389261600,1,3002,3002,3002),(52737,1389261600,1,3006,3006,3006),(52249,1389261600,1,3128,3128,3128),(53794,1389261600,1,1,1,1),(53877,1389261600,1,1,1,1),(51830,1389261600,1,1,1,1),(53863,1389261600,1,1,1,1),(53231,1389261600,1,27,27,27),(52945,1389261600,1,3012,3012,3012),(53520,1389261600,1,1,1,1),(52870,1389261600,1,3000,3000,3000),(52532,1389261600,1,1,1,1),(52519,1389261600,1,1,1,1),(52224,1389261600,1,3064,3064,3064),(51658,1389261600,1,3031,3031,3031),(52145,1389261600,1,1,1,1),(52389,1389261600,1,83,83,83),(51842,1389261600,1,1,1,1),(52309,1389261600,1,1,1,1),(52302,1389261600,1,60,60,60),(52786,1389261600,1,1,1,1),(52188,1389261600,1,1,1,1),(53789,1389261600,1,1,1,1),(52082,1389261600,1,1,1,1),(53490,1389261600,1,1,1,1),(52898,1389261600,1,3016,3016,3016),(52084,1389261600,1,1,1,1),(53675,1389261600,1,1,1,1),(53843,1389261600,1,1,1,1),(52087,1389261600,1,532,532,532),(51540,1389261600,1,3083,3083,3083),(53579,1389261600,1,1,1,1),(53357,1389261600,1,3181,3181,3181),(53290,1389261600,1,1,1,1),(52911,1389261600,1,3034,3034,3034),(51650,1389261600,1,2576,2576,2576),(52815,1389261600,1,1,1,1),(53770,1389261600,1,1,1,1),(52688,1389261600,1,23,23,23),(52510,1389261600,1,1,1,1),(52003,1389261600,1,1,1,1),(53637,1389261600,1,1,1,1),(52770,1389261600,1,3140,3140,3140),(53025,1389261600,1,1,1,1),(53542,1389261600,1,1,1,1),(53706,1389261600,1,1,1,1),(53417,1389261600,1,1,1,1),(51705,1389261600,1,3027,3027,3027),(52562,1389261600,1,1,1,1),(53107,1389261600,1,1,1,1),(52779,1389261600,1,3018,3018,3018),(53925,1389261600,1,1,1,1),(52376,1389261600,1,60,60,60),(52925,1389261600,1,1,1,1),(52350,1389261600,1,1,1,1),(52091,1389261600,1,3082,3082,3082),(53125,1389261600,1,1,1,1),(53717,1389261600,1,3031,3031,3031),(52986,1389261600,1,2582,2582,2582),(27504,1389261600,1,31193542656,31193542656,31193542656),(52115,1389261600,1,2819,2819,2819),(51788,1389261600,1,1,1,1),(52923,1389261600,1,2576,2576,2576),(51751,1389261600,1,1,1,1),(52196,1389261600,1,1,1,1),(51836,1389261600,1,1,1,1),(52536,1389261600,1,1,1,1),(53595,1389261600,1,1,1,1),(53287,1389261600,1,3056,3056,3056),(52303,1389261600,1,3008,3008,3008),(53332,1389261600,1,3012,3012,3012),(51630,1389261600,1,1,1,1),(53543,1389261600,1,3057,3057,3057),(52379,1389261600,1,1,1,1),(52137,1389261600,1,3043,3043,3043),(53069,1389261600,1,1,1,1),(53116,1389261600,1,1,1,1),(53177,1389261600,1,1,1,1),(53810,1389261600,1,1,1,1),(53759,1389261600,1,1,1,1),(51927,1389261600,1,1,1,1),(51678,1389261600,1,1,1,1),(51582,1389261600,1,1,1,1),(52246,1389261600,1,3160,3160,3160),(53796,1389261600,1,1,1,1),(53777,1389261600,1,1,1,1),(51885,1389261600,1,1,1,1),(52886,1389261600,1,241,241,241),(53341,1389261600,1,3178,3178,3178),(52963,1389261600,1,2583,2583,2583); 3885:20140109:152706.291 End of DCflush_trends() 3885:20140109:152706.291 In DCflush_trends() trends_num:263 3885:20140109:152706.291 query [txnlev:1] [select distinct itemid from trends_uint where clock>=1389261600 and itemid in (51402,51405,51406,51408,51420,51428,51432,51452,51459,51489,51491,51492,51499,51510,51519,51527,51530,51544,51553,51568,51577,51592,51597,51616,51618,51624,51633,51646,51648,51651,51665,51674,51675,51676,51681,51685,51701,51703,51704,51712,51716,51729,51741,51778,51796,51808,51809,51816,51837,51846,51854,51868,51886,51888,51897,51901,51911,51915,51918,51930,51931,51940,51947,51950,51956,51960,51977,51983,51987,51989,52014,52021,52027,52040,52041,52063,52085,52095,52097,52107,52108,52114,52126,52140,52152,52165,52166,52167,52171,52172,52176,52192,52193,52202,52212,52221,52236,52252,52262,52269,52273,52281,52291,52313,52330,52340,52363,52374,52381,52385,52392,52393,52430,52437,52457,52470,52474,52480,52484,52488,52492,52493,52497,52499,52500,52501,52505,52523,52557,52596,52598,52656,52666,52670,52704,52706,52708,52741,52743,52753,52797,52801,52833,52835,52842,52874,52876,52905,52939,52949,52953,52957,52962,52968,52972,52974,52977,52981,52982,52985,52989,53001,53005,53006,53007,53035,53038,53040,53074,53077,53081,53090,53106,53109,53113,53152,53158,53160,53179,53185,53191,53195,53196,53209,53217,53234,53235,53241,53264,53268,53282,53292,53300,53301,53308,53312,53314,53318,53328,53330,53344,53354,53355,53374,53379,53387,53391,53407,53409,53420,53446,53450,53455,53463,53464,53487,53503,53510,53511,53512,53516,53518,53522,53535,53540,53562,53581,53582,53596,53599,53611,53656,53658,53664,53671,53672,53685,53693,53700,53709,53715,53720,53775,53779,53798,53811,53832,53858,53859,53864,53891,53914,53922,53930,53931,53941,53943,53949,53958,53988,53995)] 3885:20140109:152706.295 query [txnlev:1] [insert into trends_uint (itemid,clock,num,value_min,value_avg,value_max) values (51499,1389261600,1,1,1,1),(53387,1389261600,1,1,1,1),(51809,1389261600,1,1,1,1),(52236,1389261600,1,1,1,1),(51459,1389261600,1,1,1,1),(52212,1389261600,1,1,1,1),(51778,1389261600,1,1,1,1),(52753,1389261600,1,1,1,1),(51646,1389261600,1,2578,2578,2578),(53217,1389261600,1,3009,3009,3009),(53596,1389261600,1,1,1,1),(51553,1389261600,1,3027,3027,3027),(53209,1389261600,1,3005,3005,3005),(52014,1389261600,1,3118,3118,3118),(52269,1389261600,1,1,1,1),(52165,1389261600,1,1,1,1),(53001,1389261600,1,3001,3001,3001),(53312,1389261600,1,1,1,1),(52192,1389261600,1,3051,3051,3051),(52974,1389261600,1,1,1,1),(51703,1389261600,1,1,1,1),(53234,1389261600,1,3048,3048,3048),(52167,1389261600,1,3063,3063,3063),(53409,1389261600,1,1,1,1),(52874,1389261600,1,2585,2585,2585),(52488,1389261600,1,1,1,1),(52126,1389261600,1,1,1,1),(51701,1389261600,1,1,1,1),(53599,1389261600,1,1,1,1),(52281,1389261600,1,3066,3066,3066),(53464,1389261600,1,1,1,1),(51712,1389261600,1,3038,3038,3038),(51616,1389261600,1,3095,3095,3095),(52480,1389261600,1,1,1,1),(51420,1389261600,1,3038,3038,3038),(51530,1389261600,1,1,1,1),(53264,1389261600,1,1,1,1),(51940,1389261600,1,60,60,60),(52393,1389261600,1,1,1,1),(51911,1389261600,1,1,1,1),(52097,1389261600,1,2586,2586,2586),(52457,1389261600,1,81,81,81),(52273,1389261600,1,1,1,1),(51408,1389261600,1,3064,3064,3064),(51452,1389261600,1,1,1,1),(52706,1389261600,1,81,81,81),(51405,1389261600,1,3039,3039,3039),(53487,1389261600,1,1,1,1),(51960,1389261600,1,1,1,1),(53318,1389261600,1,1,1,1),(52021,1389261600,1,3048,3048,3048),(53268,1389261600,1,1,1,1),(53540,1389261600,1,1,1,1),(53658,1389261600,1,3036,3036,3036),(52972,1389261600,1,3002,3002,3002),(51432,1389261600,1,2572,2572,2572),(53455,1389261600,1,1,1,1),(51886,1389261600,1,1,1,1),(51956,1389261600,1,1,1,1),(53081,1389261600,1,1,1,1),(52876,1389261600,1,3007,3007,3007),(53922,1389261600,1,1,1,1),(53995,1389261600,1,1,1,1),(52493,1389261600,1,1,1,1),(51527,1389261600,1,1,1,1),(52114,1389261600,1,1,1,1),(51704,1389261600,1,1,1,1),(53811,1389261600,1,1,1,1),(52095,1389261600,1,1,1,1),(53693,1389261600,1,1,1,1),(51648,1389261600,1,3006,3006,3006),(53040,1389261600,1,1,1,1),(52842,1389261600,1,3093,3093,3093),(51592,1389261600,1,3093,3093,3093),(51846,1389261600,1,1,1,1),(53282,1389261600,1,3065,3065,3065),(53158,1389261600,1,3019,3019,3019),(51837,1389261600,1,1,1,1),(53109,1389261600,1,3022,3022,3022),(53931,1389261600,1,1,1,1),(53798,1389261600,1,1,1,1),(52392,1389261600,1,1,1,1),(52977,1389261600,1,3017,3017,3017),(53463,1389261600,1,1,1,1),(52262,1389261600,1,3176,3176,3176),(53562,1389261600,1,1,1,1),(51633,1389261600,1,1,1,1),(52363,1389261600,1,60,60,60),(52385,1389261600,1,60,60,60),(51989,1389261600,1,1,1,1),(52962,1389261600,1,3020,3020,3020),(51977,1389261600,1,1,1,1),(52040,1389261600,1,3112,3112,3112),(52982,1389261600,1,1,1,1),(52085,1389261600,1,1,1,1),(52598,1389261600,1,1,1,1),(51808,1389261600,1,1,1,1),(53007,1389261600,1,3051,3051,3051),(53300,1389261600,1,3109,3109,3109),(52957,1389261600,1,2576,2576,2576),(51665,1389261600,1,1,1,1),(52557,1389261600,1,1,1,1),(53891,1389261600,1,1,1,1),(52437,1389261600,1,83,83,83),(53407,1389261600,1,1,1,1),(53035,1389261600,1,1,1,1),(53374,1389261600,1,1,1,1),(52291,1389261600,1,1,1,1),(53308,1389261600,1,1,1,1),(52905,1389261600,1,1,1,1),(52797,1389261600,1,3023,3023,3023),(52193,1389261600,1,1,1,1),(51729,1389261600,1,3130,3130,3130),(51931,1389261600,1,60,60,60),(53518,1389261600,1,1,1,1),(52470,1389261600,1,1,1,1),(52656,1389261600,1,25,25,25),(52501,1389261600,1,1,1,1),(53512,1389261600,1,1,1,1),(51947,1389261600,1,83,83,83),(53510,1389261600,1,3067,3067,3067),(53775,1389261600,1,1,1,1),(52989,1389261600,1,287,287,287),(53709,1389261600,1,1,1,1),(53160,1389261600,1,3059,3059,3059),(53152,1389261600,1,1,1,1),(51597,1389261600,1,1,1,1),(52949,1389261600,1,1,1,1),(52041,1389261600,1,3161,3161,3161),(53685,1389261600,1,1,1,1),(53949,1389261600,1,1,1,1),(53330,1389261600,1,1,1,1),(52340,1389261600,1,1,1,1),(53191,1389261600,1,1,1,1),(52172,1389261600,1,1,1,1),(51674,1389261600,1,1,1,1),(52741,1389261600,1,3140,3140,3140),(51519,1389261600,1,1,1,1),(53185,1389261600,1,3023,3023,3023),(51651,1389261600,1,3013,3013,3013),(52027,1389261600,1,3128,3128,3128),(51618,1389261600,1,1,1,1),(53864,1389261600,1,1,1,1),(51428,1389261600,1,3044,3044,3044),(53522,1389261600,1,1,1,1),(52981,1389261600,1,3004,3004,3004),(53943,1389261600,1,1,1,1),(51544,1389261600,1,3084,3084,3084),(51897,1389261600,1,1,1,1),(53196,1389261600,1,1,1,1),(53113,1389261600,1,3081,3081,3081),(53988,1389261600,1,1,1,1),(53344,1389261600,1,1,1,1),(53354,1389261600,1,3007,3007,3007),(53195,1389261600,1,1,1,1),(52835,1389261600,1,3033,3033,3033),(53328,1389261600,1,1,1,1),(53611,1389261600,1,1,1,1),(52497,1389261600,1,1,1,1),(51716,1389261600,1,3002,3002,3002),(52833,1389261600,1,2520,2520,2520),(52743,1389261600,1,3044,3044,3044),(53077,1389261600,1,3002,3002,3002),(53671,1389261600,1,1,1,1),(51983,1389261600,1,1,1,1),(52330,1389261600,1,1,1,1),(51816,1389261600,1,1,1,1),(53450,1389261600,1,1,1,1),(53446,1389261600,1,1,1,1),(53858,1389261600,1,1,1,1),(52985,1389261600,1,2560,2560,2560),(51681,1389261600,1,2513,2513,2513),(52666,1389261600,1,81,81,81),(52484,1389261600,1,1,1,1),(53292,1389261600,1,3017,3017,3017),(52474,1389261600,1,1,1,1),(52523,1389261600,1,1,1,1),(51741,1389261600,1,1,1,1),(53503,1389261600,1,1,1,1),(53090,1389261600,1,1,1,1),(51675,1389261600,1,1,1,1),(52430,1389261600,1,81,81,81),(52176,1389261600,1,1,1,1),(53006,1389261600,1,3017,3017,3017),(52596,1389261600,1,1,1,1),(53715,1389261600,1,1,1,1),(51915,1389261600,1,1,1,1),(52313,1389261600,1,1,1,1),(53859,1389261600,1,1,1,1),(51492,1389261600,1,1,1,1),(52968,1389261600,1,3044,3044,3044),(53832,1389261600,1,1,1,1),(52063,1389261600,1,3026,3026,3026),(52107,1389261600,1,3060,3060,3060),(51868,1389261600,1,1,1,1),(53914,1389261600,1,1,1,1),(27484,1389261600,1,3956734,3956734,3956734),(53930,1389261600,1,1,1,1),(53314,1389261600,1,3080,3080,3080),(53005,1389261600,1,3035,3035,3035),(51950,1389261600,1,87,87,87),(53241,1389261600,1,3173,3173,3173),(52166,1389261600,1,1,1,1),(53700,1389261600,1,1,1,1),(52221,1389261600,1,3103,3103,3103),(53516,1389261600,1,1,1,1),(51489,1389261600,1,1,1,1),(53720,1389261600,1,1,1,1),(53779,1389261600,1,1,1,1),(52492,1389261600,1,1,1,1),(51930,1389261600,1,1,1,1),(52670,1389261600,1,81,81,81),(53535,1389261600,1,1,1,1),(53420,1389261600,1,1,1,1),(51987,1389261600,1,1,1,1),(53106,1389261600,1,3160,3160,3160),(51918,1389261600,1,1,1,1),(52202,1389261600,1,1,1,1),(51510,1389261600,1,81,81,81),(51676,1389261600,1,1,1,1),(53664,1389261600,1,1,1,1),(51685,1389261600,1,1,1,1),(52381,1389261600,1,60,60,60),(53179,1389261600,1,1,1,1),(53958,1389261600,1,1,1,1),(53391,1389261600,1,3056,3056,3056),(53235,1389261600,1,1,1,1),(53581,1389261600,1,1,1,1),(52140,1389261600,1,1,1,1),(51624,1389261600,1,83,83,83),(52499,1389261600,1,1,1,1),(53038,1389261600,1,3017,3017,3017),(52171,1389261600,1,1,1,1),(52704,1389261600,1,1,1,1),(52252,1389261600,1,1,1,1),(53074,1389261600,1,2812,2812,2812),(52374,1389261600,1,60,60,60),(52801,1389261600,1,1,1,1),(51491,1389261600,1,60,60,60),(51568,1389261600,1,1,1,1),(52505,1389261600,1,1,1,1),(51888,1389261600,1,1,1,1),(52939,1389261600,1,1,1,1),(51901,1389261600,1,1,1,1),(51796,1389261600,1,1,1,1),(53941,1389261600,1,1,1,1),(53582,1389261600,1,3009,3009,3009),(53379,1389261600,1,1,1,1),(52708,1389261600,1,1,1,1),(52500,1389261600,1,1,1,1),(51406,1389261600,1,3003,3003,3003),(53301,1389261600,1,1,1,1),(51577,1389261600,1,1,1,1),(51854,1389261600,1,1,1,1),(53656,1389261600,1,1,1,1),(51402,1389261600,1,3036,3036,3036),(27496,1389261600,1,3956734,3956734,3956734),(52108,1389261600,1,1,1,1),(53672,1389261600,1,1,1,1),(53355,1389261600,1,1,1,1),(53511,1389261600,1,1,1,1),(52953,1389261600,1,2811,2811,2811),(52152,1389261600,1,1,1,1); 3885:20140109:152706.298 End of DCflush_trends() 3885:20140109:152706.298 query [txnlev:1] [commit;] 3885:20140109:152706.313 syncing trends data done 3885:20140109:152706.313 End of DCsync_trends() 3885:20140109:152706.313 End of DCsync_all() 3885:20140109:152706.313 In zbx_mem_destroy() descr:'history cache' 3885:20140109:152706.313 End of zbx_mem_destroy() 3885:20140109:152706.313 In zbx_mem_destroy() descr:'history text cache' 3885:20140109:152706.313 End of zbx_mem_destroy() 3885:20140109:152706.314 In zbx_mem_destroy() descr:'trend cache' 3885:20140109:152706.314 End of zbx_mem_destroy() 3885:20140109:152706.314 End of free_database_cache() 3885:20140109:152706.314 In free_configuration_cache() 3885:20140109:152706.314 In zbx_mem_destroy() descr:'configuration cache' 3885:20140109:152706.314 End of zbx_mem_destroy() 3885:20140109:152706.314 In zbx_strpool_destroy() 3885:20140109:152706.314 In zbx_mem_destroy() descr:'string pool' 3885:20140109:152706.314 End of zbx_mem_destroy() 3885:20140109:152706.314 End of zbx_strpool_destroy() 3885:20140109:152706.314 End of free_configuration_cache() 3885:20140109:152706.314 In zbx_vc_destroy() 3885:20140109:152706.314 In zbx_mem_destroy() descr:'value cache size' 3885:20140109:152706.314 End of zbx_mem_destroy() 3885:20140109:152706.314 End of zbx_vc_destroy() 3885:20140109:152706.314 In free_ipmi_handler() 3885:20140109:152706.314 End of free_ipmi_handler() 3885:20140109:152706.314 In free_selfmon_collector() collector:0x80065b000 3885:20140109:152706.314 End of free_selfmon_collector() 3885:20140109:152706.314 In unload_modules() 3885:20140109:152706.314 Zabbix Server stopped. Zabbix 2.2.1 (revision 40808).
37468:20140109:163304.558 One child process died (PID:37511,exitcode/signal:65280). Exiting ... 37474:20140109:163304.558 In get_values() 37479:20140109:163304.558 get_value_snmp() standard processing 37501:20140109:163304.558 In substitute_simple_macros() data:'161' 37472:20140109:163304.558 In activate_host() hostid:10291 itemid:39514 type:4 37500:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.1' 37493:20140109:163304.558 In substitute_simple_macros() data:'public' 37473:20140109:163304.558 End of activate_host() 37476:20140109:163304.558 In activate_host() hostid:10327 itemid:41134 type:4 37490:20140109:163304.558 In substitute_simple_macros() data:'161' 37481:20140109:163304.558 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10121' 37475:20140109:163304.558 End of get_value():SUCCEED 37475:20140109:163304.558 In activate_host() hostid:10248 itemid:36964 type:4 37477:20140109:163304.558 In get_values() 37468:20140109:163304.558 zbx_on_exit() called 37488:20140109:163304.558 zbx_snmp_get_value() snmp_synch_response():0 37485:20140109:163304.558 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10003' 37489:20140109:163304.558 End of zbx_snmp_get_value():SUCCEED 37481:20140109:163304.558 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.10121' 37501:20140109:163304.558 In substitute_simple_macros() data:'public' 37497:20140109:163304.558 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.2' 37474:20140109:163304.558 In DCconfig_get_poller_items() poller_type:0 37488:20140109:163304.558 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37507:20140109:163304.559 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37479:20140109:163304.559 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37499:20140109:163304.558 In DCconfig_get_poller_items() poller_type:0 37504:20140109:163304.558 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37503:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37538:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37544:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37495:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37493:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37494:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37485:20140109:163304.563 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37497:20140109:163304.563 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37472:20140109:163304.566 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37482:20140109:163304.563 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37476:20140109:163304.567 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37480:20140109:163304.568 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37484:20140109:163304.568 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37483:20140109:163304.568 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37475:20140109:163304.568 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37470:20140109:163304.569 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37474:20140109:163304.570 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37498:20140109:163304.570 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37489:20140109:163304.571 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37501:20140109:163304.572 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37550:20140109:163304.572 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37506:20140109:163304.573 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37499:20140109:163304.574 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37542:20140109:163304.574 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37500:20140109:163304.575 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37527:20140109:163304.575 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37516:20140109:163304.577 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37523:20140109:163304.578 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37551:20140109:163304.579 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37490:20140109:163304.579 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37502:20140109:163304.580 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37533:20140109:163304.582 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37509:20140109:163304.582 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37534:20140109:163304.582 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37508:20140109:163304.582 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37528:20140109:163304.583 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37546:20140109:163304.584 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37514:20140109:163304.584 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37532:20140109:163304.585 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37529:20140109:163304.586 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37471:20140109:163304.586 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37536:20140109:163304.586 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37526:20140109:163304.587 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37521:20140109:163304.587 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37522:20140109:163304.588 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37481:20140109:163304.589 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37478:20140109:163304.589 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37541:20140109:163304.590 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37496:20140109:163304.591 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37517:20140109:163304.591 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37548:20140109:163304.591 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37518:20140109:163304.592 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37520:20140109:163304.593 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37492:20140109:163304.593 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37512:20140109:163304.593 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37540:20140109:163304.594 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37525:20140109:163304.594 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37515:20140109:163304.595 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37513:20140109:163304.595 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37531:20140109:163304.596 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37487:20140109:163304.596 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37519:20140109:163304.596 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37473:20140109:163304.597 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37530:20140109:163304.597 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37543:20140109:163304.598 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37539:20140109:163304.598 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37547:20140109:163304.599 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37545:20140109:163304.599 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37477:20140109:163304.602 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37491:20140109:163304.603 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37552:20140109:163304.604 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37486:20140109:163304.604 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37535:20140109:163304.605 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37505:20140109:163304.605 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37524:20140109:163304.606 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37537:20140109:163304.607 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37549:20140109:163304.607 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37510:20140109:163304.783 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
37481:20140109:163304.554 End of get_value():SUCCEED 37486:20140109:163304.554 End of zbx_snmp_close_session() 37501:20140109:163304.554 End of get_value_snmp():SUCCEED 37495:20140109:163304.554 SNMP [public@10.16.1.2:161] 37491:20140109:163304.554 End of get_value():SUCCEED 37477:20140109:163304.554 zbx_snmp_get_value() snmp_synch_response():0 37511:20140109:163304.554 ====== Fatal information: ====== 37485:20140109:163304.554 In activate_host() hostid:10121 itemid:48934 type:4 37478:20140109:163304.554 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.7' 37494:20140109:163304.554 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10015' 37511:20140109:163304.554 program counter not available for this architecture 37497:20140109:163304.554 End of activate_host() 37474:20140109:163304.554 zbx_snmp_get_value() snmp_synch_response():0 37499:20140109:163304.554 End of zbx_snmp_set_result():SUCCEED 37480:20140109:163304.554 In activate_host() hostid:10339 itemid:41944 type:4 37493:20140109:163304.554 End of get_value():SUCCEED 37491:20140109:163304.554 In activate_host() hostid:10131 itemid:49454 type:4 37500:20140109:163304.554 In activate_host() hostid:10103 itemid:24904 type:4 37497:20140109:163304.554 End of get_values():1 37482:20140109:163304.554 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.6' 37485:20140109:163304.554 End of activate_host() 37480:20140109:163304.554 End of activate_host() 37494:20140109:163304.554 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.10015' 37477:20140109:163304.554 In zbx_snmp_set_result() 37481:20140109:163304.554 In activate_host() hostid:10403 itemid:45814 type:4 37486:20140109:163304.554 End of get_value_snmp():SUCCEED 37492:20140109:163304.554 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.20' 37478:20140109:163304.554 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.7' 37496:20140109:163304.554 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.10001' 37479:20140109:163304.554 End of DCconfig_get_poller_items():1 37480:20140109:163304.554 End of get_values():1 37495:20140109:163304.554 End of zbx_snmp_open_session() 37491:20140109:163304.554 End of activate_host() 37493:20140109:163304.554 In activate_host() hostid:10326 itemid:41224 type:4 37485:20140109:163304.554 End of get_values():1 37474:20140109:163304.554 In zbx_snmp_set_result() 37511:20140109:163304.554 === Registers: === 37481:20140109:163304.554 End of activate_host() 37490:20140109:163304.554 End of get_value():SUCCEED 37501:20140109:163304.554 End of get_value():SUCCEED 37496:20140109:163304.554 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.10.10001' oid:'.1.3.6.1.2.1.2.2.1.10.10001' 37478:20140109:163304.554 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.7' 37497:20140109:163304.554 In DCconfig_get_poller_nextcheck() poller_type:0 37478:20140109:163304.554 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.10.7' oid:'.1.3.6.1.2.1.2.2.1.10.7' 37499:20140109:163304.554 End of zbx_snmp_get_value():SUCCEED 37492:20140109:163304.554 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.20' 37511:20140109:163304.554 register dump not available for this architecture 37494:20140109:163304.554 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.10.10015' oid:'.1.3.6.1.2.1.2.2.1.10.10015' 37482:20140109:163304.554 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.6' 37493:20140109:163304.554 End of activate_host() 37479:20140109:163304.554 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.10044' 37481:20140109:163304.554 End of get_values():1 37477:20140109:163304.554 End of zbx_snmp_set_result():SUCCEED 37500:20140109:163304.554 End of activate_host() 37497:20140109:163304.554 End of DCconfig_get_poller_nextcheck():1389270784 37496:20140109:163304.554 In zbx_snmp_open_session() 37485:20140109:163304.554 In DCconfig_get_poller_nextcheck() poller_type:0 37480:20140109:163304.554 In DCconfig_get_poller_nextcheck() poller_type:0 37479:20140109:163304.554 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.10044' 37495:20140109:163304.554 get_value_snmp() standard processing 37481:20140109:163304.554 In DCconfig_get_poller_nextcheck() poller_type:0 37490:20140109:163304.554 In activate_host() hostid:10480 itemid:50044 type:4 37477:20140109:163304.554 End of zbx_snmp_get_value():SUCCEED 37496:20140109:163304.554 SNMP [public@10.16.18.2:161] 37493:20140109:163304.554 End of get_values():1 37499:20140109:163304.554 In zbx_snmp_close_session() 37501:20140109:163304.554 In activate_host() hostid:10097 itemid:40694 type:4 37474:20140109:163304.554 End of zbx_snmp_set_result():SUCCEED 37478:20140109:163304.554 In zbx_snmp_open_session() 37474:20140109:163304.554 End of zbx_snmp_get_value():SUCCEED 37511:20140109:163304.554 === Backtrace: === 37495:20140109:163304.554 In zbx_snmp_translate() oid:'.1.3.6.1.2.1.2.2.1.16.10002' 37472:20140109:163304.554 zbx_snmp_get_value() snmp_synch_response():0 37499:20140109:163304.554 End of zbx_snmp_close_session()
last output does not seem to be very useful because you have cut off the backtrace part
for the record, the weird exit code 65280 might be related to ZBX-2196
37511:20140109:163304.554 === Backtrace: === 37486:20140109:163304.555 End of get_value():SUCCEED 37495:20140109:163304.554 In zbx_snmp_translate() oid:'.1.3.6.1.2.1.2.2.1.16.10002' 37490:20140109:163304.555 End of activate_host() 37472:20140109:163304.554 zbx_snmp_get_value() snmp_synch_response():0 37499:20140109:163304.554 End of zbx_snmp_close_session() 37482:20140109:163304.555 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.6' 37491:20140109:163304.555 End of get_values():1 37482:20140109:163304.555 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.10.6' oid:'.1.3.6.1.2.1.2.2.1.10.6' 37479:20140109:163304.555 In substitute_simple_macros() data:'161' 37475:20140109:163304.555 zbx_snmp_get_value() snmp_synch_response():0 37474:20140109:163304.555 In zbx_snmp_close_session() 37491:20140109:163304.555 In DCconfig_get_poller_nextcheck() poller_type:0 37501:20140109:163304.555 End of activate_host() 37480:20140109:163304.555 End of DCconfig_get_poller_nextcheck():1389270784 37497:20140109:163304.555 In get_values() 37485:20140109:163304.555 End of DCconfig_get_poller_nextcheck():1389270784 37499:20140109:163304.555 End of get_value_snmp():SUCCEED 37499:20140109:163304.555 End of get_value():SUCCEED 37492:20140109:163304.555 In substitute_simple_macros() data:'161' 37482:20140109:163304.555 In zbx_snmp_open_session() 37500:20140109:163304.555 End of get_values():1 37493:20140109:163304.555 In DCconfig_get_poller_nextcheck() poller_type:0 37499:20140109:163304.555 In activate_host() hostid:10092 itemid:24724 type:4 37486:20140109:163304.555 In activate_host() hostid:10473 itemid:49684 type:4 37478:20140109:163304.555 SNMP [public@10.16.3.12:161] 37472:20140109:163304.555 In zbx_snmp_set_result() 37501:20140109:163304.555 End of get_values():1 37485:20140109:163304.555 In get_values() 37497:20140109:163304.555 In DCconfig_get_poller_items() poller_type:0 37473:20140109:163304.555 zbx_snmp_get_value() snmp_synch_response():0 37496:20140109:163304.555 End of zbx_snmp_open_session() 37474:20140109:163304.555 End of zbx_snmp_close_session() 37494:20140109:163304.555 In zbx_snmp_open_session() 37511:20140109:163304.555 backtrace not available for this platform 37481:20140109:163304.555 End of DCconfig_get_poller_nextcheck():1389270784 37500:20140109:163304.555 In DCconfig_get_poller_nextcheck() poller_type:0 37475:20140109:163304.555 In zbx_snmp_set_result() 37480:20140109:163304.555 In get_values() 37482:20140109:163304.555 SNMP [public@10.16.1.40:161] 37485:20140109:163304.555 In DCconfig_get_poller_items() poller_type:0 37479:20140109:163304.555 In substitute_simple_macros() data:'public' 37492:20140109:163304.555 In substitute_simple_macros() data:'public' 37474:20140109:163304.555 End of get_value_snmp():SUCCEED 37490:20140109:163304.555 End of get_values():1 37477:20140109:163304.555 In zbx_snmp_close_session() 37472:20140109:163304.555 End of zbx_snmp_set_result():SUCCEED 37473:20140109:163304.555 In zbx_snmp_set_result() 37501:20140109:163304.555 In DCconfig_get_poller_nextcheck() poller_type:0 37499:20140109:163304.555 End of activate_host() 37511:20140109:163304.555 === Memory map: === 37486:20140109:163304.555 End of activate_host() 37493:20140109:163304.555 End of DCconfig_get_poller_nextcheck():1389270784 37492:20140109:163304.555 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.20' 37478:20140109:163304.555 End of zbx_snmp_open_session() 37495:20140109:163304.555 End of zbx_snmp_translate() oid_translated:'.1.3.6.1.2.1.2.2.1.16.10002' 37490:20140109:163304.555 In DCconfig_get_poller_nextcheck() poller_type:0 37485:20140109:163304.555 End of DCconfig_get_poller_items():1 37494:20140109:163304.555 SNMP [public@10.16.10.2:161] 37481:20140109:163304.555 In get_values() 37479:20140109:163304.555 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.10044' 37476:20140109:163304.555 zbx_snmp_get_value() snmp_synch_response():0 37480:20140109:163304.555 In DCconfig_get_poller_items() poller_type:0 37493:20140109:163304.555 In get_values() 37495:20140109:163304.555 In zbx_snmp_get_value() oid:'.1.3.6.1.2.1.2.2.1.16.10002' 37477:20140109:163304.555 End of zbx_snmp_close_session() 37472:20140109:163304.555 End of zbx_snmp_get_value():SUCCEED 37497:20140109:163304.555 End of DCconfig_get_poller_items():1 37482:20140109:163304.555 End of zbx_snmp_open_session() 37473:20140109:163304.555 End of zbx_snmp_set_result():SUCCEED 37494:20140109:163304.555 End of zbx_snmp_open_session() 37496:20140109:163304.555 get_value_snmp() standard processing 37482:20140109:163304.555 get_value_snmp() standard processing 37486:20140109:163304.556 End of get_values():1 37511:20140109:163304.556 memory map not available for this platform 37501:20140109:163304.556 End of DCconfig_get_poller_nextcheck():1389270784 37477:20140109:163304.556 End of get_value_snmp():SUCCEED 37492:20140109:163304.556 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.20' 37499:20140109:163304.556 End of get_values():1 37472:20140109:163304.556 In zbx_snmp_close_session() 37479:20140109:163304.556 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.10044' 37476:20140109:163304.556 In zbx_snmp_set_result() 37485:20140109:163304.556 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.10003' 37493:20140109:163304.556 In DCconfig_get_poller_items() poller_type:0 37481:20140109:163304.556 In DCconfig_get_poller_items() poller_type:0 37478:20140109:163304.556 get_value_snmp() standard processing 37475:20140109:163304.556 End of zbx_snmp_set_result():SUCCEED 37474:20140109:163304.556 End of get_value():SUCCEED 37491:20140109:163304.556 End of DCconfig_get_poller_nextcheck():1389270784 37473:20140109:163304.556 End of zbx_snmp_get_value():SUCCEED 37490:20140109:163304.556 End of DCconfig_get_poller_nextcheck():1389270784 37480:20140109:163304.556 End of DCconfig_get_poller_items():1 37481:20140109:163304.556 End of DCconfig_get_poller_items():1 37476:20140109:163304.556 End of zbx_snmp_set_result():SUCCEED 37479:20140109:163304.556 In get_value() key:'.1.3.6.1.2.1.2.2.1.16.10044' 37477:20140109:163304.556 End of get_value():SUCCEED 37500:20140109:163304.556 End of DCconfig_get_poller_nextcheck():1389270784 37492:20140109:163304.556 In get_value() key:'.1.3.6.1.2.1.2.2.1.16.20' 37496:20140109:163304.556 In zbx_snmp_translate() oid:'.1.3.6.1.2.1.2.2.1.10.10001' 37474:20140109:163304.556 In activate_host() hostid:10469 itemid:49504 type:4 37475:20140109:163304.556 End of zbx_snmp_get_value():SUCCEED 37489:20140109:163304.556 zbx_snmp_get_value() snmp_synch_response():0 37485:20140109:163304.556 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10003' 37480:20140109:163304.556 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.10111' 37499:20140109:163304.556 In DCconfig_get_poller_nextcheck() poller_type:0 37482:20140109:163304.556 In zbx_snmp_translate() oid:'.1.3.6.1.2.1.2.2.1.10.6' 37477:20140109:163304.556 In activate_host() hostid:10228 itemid:36304 type:4 37474:20140109:163304.556 End of activate_host() 37481:20140109:163304.556 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.10121' 37473:20140109:163304.556 In zbx_snmp_close_session() 37479:20140109:163304.556 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.16.10044' oid:'.1.3.6.1.2.1.2.2.1.16.10044' 37494:20140109:163304.556 get_value_snmp() standard processing 37501:20140109:163304.556 In get_values() 37511:20140109:163304.556 ================================ 37493:20140109:163304.556 End of DCconfig_get_poller_items():1 37486:20140109:163304.556 In DCconfig_get_poller_nextcheck() poller_type:0 37500:20140109:163304.556 In get_values() 37476:20140109:163304.556 End of zbx_snmp_get_value():SUCCEED 37478:20140109:163304.556 In zbx_snmp_translate() oid:'.1.3.6.1.2.1.2.2.1.10.7' 37497:20140109:163304.556 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.2' 37490:20140109:163304.556 In get_values() 37472:20140109:163304.556 End of zbx_snmp_close_session() 37491:20140109:163304.556 In get_values() 37477:20140109:163304.556 End of activate_host() 37492:20140109:163304.556 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.16.20' oid:'.1.3.6.1.2.1.2.2.1.16.20' 37490:20140109:163304.556 In DCconfig_get_poller_items() poller_type:0 37497:20140109:163304.556 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.2' 37490:20140109:163304.556 End of DCconfig_get_poller_items():1 37497:20140109:163304.556 In substitute_simple_macros() data:'161' 37493:20140109:163304.556 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.10007' 37477:20140109:163304.556 End of get_values():1 37500:20140109:163304.556 In DCconfig_get_poller_items() poller_type:0 37486:20140109:163304.556 End of DCconfig_get_poller_nextcheck():1389270784 37485:20140109:163304.556 In substitute_simple_macros() data:'161' 37489:20140109:163304.556 In zbx_snmp_set_result() 37499:20140109:163304.556 End of DCconfig_get_poller_nextcheck():1389270784 37496:20140109:163304.556 End of zbx_snmp_translate() oid_translated:'.1.3.6.1.2.1.2.2.1.10.10001' 37478:20140109:163304.556 End of zbx_snmp_translate() oid_translated:'.1.3.6.1.2.1.2.2.1.10.7' 37479:20140109:163304.556 In zbx_snmp_open_session() 37491:20140109:163304.556 In DCconfig_get_poller_items() poller_type:0 37476:20140109:163304.557 In zbx_snmp_close_session() 37474:20140109:163304.557 End of get_values():1 37501:20140109:163304.557 In DCconfig_get_poller_items() poller_type:0 37480:20140109:163304.557 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.10111' 37486:20140109:163304.557 In get_values() 37473:20140109:163304.557 End of zbx_snmp_close_session() 37492:20140109:163304.557 In zbx_snmp_open_session() 37475:20140109:163304.557 In zbx_snmp_close_session() 37481:20140109:163304.557 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10121' 37490:20140109:163304.557 In substitute_key_macros() data:'1.3.6.1.2.1.31.1.1.1.6.10103' 37493:20140109:163304.557 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.10007' 37497:20140109:163304.557 In substitute_simple_macros() data:'public' 37491:20140109:163304.557 End of DCconfig_get_poller_items():1 37494:20140109:163304.557 In zbx_snmp_translate() oid:'.1.3.6.1.2.1.2.2.1.10.10015' 37486:20140109:163304.557 In DCconfig_get_poller_items() poller_type:0 37476:20140109:163304.557 End of zbx_snmp_close_session() 37480:20140109:163304.557 In substitute_simple_macros() data:'161' 37482:20140109:163304.557 End of zbx_snmp_translate() oid_translated:'.1.3.6.1.2.1.2.2.1.10.6' 37476:20140109:163304.557 End of get_value_snmp():SUCCEED 37497:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.2' 37475:20140109:163304.557 End of zbx_snmp_close_session() 37478:20140109:163304.557 In zbx_snmp_get_value() oid:'.1.3.6.1.2.1.2.2.1.10.7' 37485:20140109:163304.557 In substitute_simple_macros() data:'public' 37496:20140109:163304.557 In zbx_snmp_get_value() oid:'.1.3.6.1.2.1.2.2.1.10.10001' 37491:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.10101' 37494:20140109:163304.558 End of zbx_snmp_translate() oid_translated:'.1.3.6.1.2.1.2.2.1.10.10015' 37501:20140109:163304.557 End of DCconfig_get_poller_items():1 37489:20140109:163304.557 End of zbx_snmp_set_result():SUCCEED 37479:20140109:163304.558 SNMP [public@10.16.0.131:161] 37500:20140109:163304.558 End of DCconfig_get_poller_items():1 37481:20140109:163304.558 In substitute_simple_macros() data:'161' 37477:20140109:163304.558 In DCconfig_get_poller_nextcheck() poller_type:0 37474:20140109:163304.558 In DCconfig_get_poller_nextcheck() poller_type:0 37473:20140109:163304.558 End of get_value_snmp():SUCCEED 37485:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.10003' 37472:20140109:163304.558 End of get_value_snmp():SUCCEED 37492:20140109:163304.558 SNMP [public@10.16.17.13:161] 37499:20140109:163304.558 In get_values() 37475:20140109:163304.558 End of get_value_snmp():SUCCEED 37494:20140109:163304.558 In zbx_snmp_get_value() oid:'.1.3.6.1.2.1.2.2.1.10.10015' 37486:20140109:163304.558 End of DCconfig_get_poller_items():1 37473:20140109:163304.558 End of get_value():SUCCEED 37493:20140109:163304.558 In substitute_simple_macros() data:'161' 37482:20140109:163304.558 In zbx_snmp_get_value() oid:'.1.3.6.1.2.1.2.2.1.10.6' 37474:20140109:163304.558 End of DCconfig_get_poller_nextcheck():1389270784 37501:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.10015' 37480:20140109:163304.558 In substitute_simple_macros() data:'public' 37476:20140109:163304.558 End of get_value():SUCCEED 37479:20140109:163304.558 End of zbx_snmp_open_session() 37481:20140109:163304.558 In substitute_simple_macros() data:'public' 37490:20140109:163304.558 End of substitute_key_macros():SUCCEED data:'1.3.6.1.2.1.31.1.1.1.6.10103' 37481:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.10121' 37477:20140109:163304.558 End of DCconfig_get_poller_nextcheck():1389270784 37486:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.10012' 37501:20140109:163304.558 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.10015' 37497:20140109:163304.558 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.2' 37472:20140109:163304.558 End of get_value():SUCCEED 37491:20140109:163304.558 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.10101' 37492:20140109:163304.558 End of zbx_snmp_open_session() 37473:20140109:163304.558 In activate_host() hostid:10122 itemid:34504 type:4 37480:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.10111' 37468:20140109:163304.558 One child process died (PID:37511,exitcode/signal:65280). Exiting ... 37474:20140109:163304.558 In get_values() 37479:20140109:163304.558 get_value_snmp() standard processing 37501:20140109:163304.558 In substitute_simple_macros() data:'161' 37472:20140109:163304.558 In activate_host() hostid:10291 itemid:39514 type:4 37500:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.1' 37493:20140109:163304.558 In substitute_simple_macros() data:'public' 37473:20140109:163304.558 End of activate_host() 37476:20140109:163304.558 In activate_host() hostid:10327 itemid:41134 type:4 37490:20140109:163304.558 In substitute_simple_macros() data:'161' 37481:20140109:163304.558 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10121' 37475:20140109:163304.558 End of get_value():SUCCEED 37475:20140109:163304.558 In activate_host() hostid:10248 itemid:36964 type:4 37477:20140109:163304.558 In get_values() 37468:20140109:163304.558 zbx_on_exit() called 37488:20140109:163304.558 zbx_snmp_get_value() snmp_synch_response():0 37485:20140109:163304.558 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10003' 37489:20140109:163304.558 End of zbx_snmp_get_value():SUCCEED 37481:20140109:163304.558 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.10121' 37501:20140109:163304.558 In substitute_simple_macros() data:'public' 37497:20140109:163304.558 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.2' 37474:20140109:163304.558 In DCconfig_get_poller_items() poller_type:0 37488:20140109:163304.558 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37507:20140109:163304.559 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37479:20140109:163304.559 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37499:20140109:163304.558 In DCconfig_get_poller_items() poller_type:0 37504:20140109:163304.558 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37503:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37538:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37544:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37495:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37493:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37494:20140109:163304.561 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37485:20140109:163304.563 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37497:20140109:163304.563 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37472:20140109:163304.566 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37482:20140109:163304.563 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37476:20140109:163304.567 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37480:20140109:163304.568 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37484:20140109:163304.568 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37483:20140109:163304.568 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37475:20140109:163304.568 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37470:20140109:163304.569 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37474:20140109:163304.570 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37498:20140109:163304.570 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37489:20140109:163304.571 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37501:20140109:163304.572 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37550:20140109:163304.572 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37506:20140109:163304.573 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37499:20140109:163304.574 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37542:20140109:163304.574 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37500:20140109:163304.575 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37527:20140109:163304.575 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37516:20140109:163304.577 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37523:20140109:163304.578 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37551:20140109:163304.579 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37490:20140109:163304.579 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37502:20140109:163304.580 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37533:20140109:163304.582 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37509:20140109:163304.582 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37534:20140109:163304.582 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37508:20140109:163304.582 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37528:20140109:163304.583 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37546:20140109:163304.584 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37514:20140109:163304.584 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37532:20140109:163304.585 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37529:20140109:163304.586 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37471:20140109:163304.586 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37536:20140109:163304.586 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37526:20140109:163304.587 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37521:20140109:163304.587 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37522:20140109:163304.588 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37481:20140109:163304.589 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37478:20140109:163304.589 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37541:20140109:163304.590 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37496:20140109:163304.591 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37517:20140109:163304.591 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37548:20140109:163304.591 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37518:20140109:163304.592 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37520:20140109:163304.593 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37492:20140109:163304.593 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37512:20140109:163304.593 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37540:20140109:163304.594 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37525:20140109:163304.594 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37515:20140109:163304.595 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37513:20140109:163304.595 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37531:20140109:163304.596 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37487:20140109:163304.596 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37519:20140109:163304.596 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37473:20140109:163304.597 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37530:20140109:163304.597 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37543:20140109:163304.598 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37539:20140109:163304.598 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37547:20140109:163304.599 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37545:20140109:163304.599 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37477:20140109:163304.602 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37491:20140109:163304.603 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37552:20140109:163304.604 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37486:20140109:163304.604 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ... 37535:20140109:163304.605 Got signal [signal:15(SIGTERM),sender_pid:37468,sender_uid:122,reason:65537]. Exiting ...
Vekli, please use formating tags to show long listing, for example {code} tag.
Ok.
Crash related lines are mixed with other process activity and there is still:
37511:20140109:163304.555 backtrace not available for this platform
Comments above have duplicated log parts.
There no crashed process (PID 37511) activity visible.
The same exit code 65280 we can see in already mentioned ZBX-7579 (which is also on freebsd where crash is in "history syncer").
Vekli, if you see line like:
37468:20140109:163304.558 One child process died (PID:37511,exitcode/signal:65280). Exiting ...
then take crashed PID there and try
# grep -A10 "37511" zabbix_server.log
and show its end where we can see the process activity.
grep -A10 "37511" zabbix_server.log 37539:20140109:162800.733 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:162800.733 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:162800.733 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:162800.733 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:162800.733 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:162800.733 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:162800.733 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:162800.733 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:162800.733 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:162800.733 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:162800.733 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' 37539:20140109:162800.733 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' -- 37539:20140109:162800.775 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0' 37542:20140109:162800.775 End of __get_function_parameter_uint31():SUCCEED 37539:20140109:162800.775 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0' 37542:20140109:162800.775 In zbx_vc_get_value_range() itemid:46370 value_type:0 seconds:0 count:1 timestamp:1389270480 37539:20140109:162800.775 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0' 37542:20140109:162800.775 End of zbx_vc_get_value_range():SUCCEED count:1 cached:1 37539:20140109:162800.775 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0' 37542:20140109:162800.775 End of evaluate_NODATA():SUCCEED 37542:20140109:162800.775 End of evaluate_function():SUCCEED value:'0' 37539:20140109:162800.775 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0' 37542:20140109:162800.775 In evaluate_function() function:'1.8a.i.ups.1.local:.1.3.6.1.4.1.318.1.1.1.2.1.2.0.last(0)' -- 37511:20140109:162802.956 trapper #5 [processing data] 37511:20140109:162802.959 Trapper got [{"request":"command","nodeid":0,"scriptid":"4","hostid":"10352"}] len 64 37511:20140109:162802.959 In node_process_command() 37511:20140109:162802.959 In execute_script() scriptid:4 hostid:10352 37511:20140109:162802.959 In zbx_execute_script() 37511:20140109:162802.959 In DBget_script_by_scriptid() 37511:20140109:162802.959 query [txnlev:0] [select type,execute_on,command,groupid from scripts where scriptid=4] 37511:20140109:162802.959 End of DBget_script_by_scriptid():SUCCEED 37511:20140109:162802.959 In check_script_permissions() groupid:0 hostid:10352 37511:20140109:162802.959 End of check_script_permissions():SUCCEED 37511:20140109:162802.959 In substitute_simple_macros() data:'/data/scripts/zabbix/show_ports.pl {HOST.CONN} | /usr/bin/column -t' 37511:20140109:162802.959 query [txnlev:0] [select type,useip,ip,dns from interface where hostid=10352 and type in (1,2,3,4) and main=1] 37511:20140109:162802.959 End substitute_simple_macros() data:'/data/scripts/zabbix/show_ports.pl 10.16.6.26 | /usr/bin/column -t' 37511:20140109:162802.959 In zbx_execute_script() 37511:20140109:162802.959 In zbx_popen() command:'/data/scripts/zabbix/show_ports.pl 10.16.6.26 | /usr/bin/column -t' 37511:20140109:162802.960 End of zbx_popen():7 50338:20140109:162802.960 zbx_popen(): executing script 37533:20140109:162802.961 icmp pinger #17 [getting values] 37533:20140109:162802.963 In get_pinger_hosts() 37533:20140109:162802.963 In DCconfig_get_poller_items() poller_type:3 37528:20140109:162802.974 icmp pinger #12 [getting values] 37533:20140109:162802.974 End of DCconfig_get_poller_items():0 37528:20140109:162802.975 In get_pinger_hosts() 37533:20140109:162802.975 End of get_pinger_hosts():0 37528:20140109:162802.975 In DCconfig_get_poller_items() poller_type:3 37533:20140109:162802.975 In process_pinger_hosts() -- 37539:20140109:162830.959 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:162830.959 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:162830.959 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:162830.959 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:162830.959 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:162830.959 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:162830.959 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:162830.959 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:162830.959 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:162830.959 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:162830.959 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' 37539:20140109:162830.959 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' -- 37539:20140109:162830.998 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0' 37542:20140109:162830.998 In evaluate_LAST() 37542:20140109:162830.998 In __get_function_parameter_uint31() parameters:'#2' Nparam:1 37539:20140109:162830.998 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0' 37542:20140109:162830.998 In substitute_simple_macros() data:'#2' 37539:20140109:162830.998 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0' 37542:20140109:162830.998 __get_function_parameter_uint31() flag:1 value:2 37539:20140109:162830.998 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0' 37542:20140109:162830.998 End of __get_function_parameter_uint31():SUCCEED 37539:20140109:162830.998 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0' 37542:20140109:162830.998 In zbx_vc_get_value_range() itemid:41417 value_type:0 seconds:0 count:2 timestamp:1389270510 -- 37539:20140109:162900.176 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:162900.176 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:162900.176 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:162900.176 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:162900.176 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:162900.176 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:162900.176 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:162900.176 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:162900.176 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:162900.176 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:162900.176 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' 37539:20140109:162900.176 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' -- 37539:20140109:162900.211 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0' 37542:20140109:162900.211 In evaluate_LAST() 37542:20140109:162900.211 In __get_function_parameter_uint31() parameters:'#2' Nparam:1 37505:20140109:162900.211 In get_values() 37539:20140109:162900.211 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0' 37505:20140109:162900.211 In DCconfig_get_poller_items() poller_type:1 37542:20140109:162900.211 In substitute_simple_macros() data:'#2' 37539:20140109:162900.211 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0' 37539:20140109:162900.211 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0' 37542:20140109:162900.211 __get_function_parameter_uint31() flag:1 value:2 37505:20140109:162900.211 End of DCconfig_get_poller_items():0 -- 37539:20140109:162930.375 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:162930.375 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:162930.375 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:162930.375 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:162930.375 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:162930.375 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:162930.375 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:162930.375 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:162930.375 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:162930.375 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:162930.375 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' 37539:20140109:162930.375 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' -- 37539:20140109:162930.410 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0' 37542:20140109:162930.410 In substitute_simple_macros() data:'{43681}=1&{43682}=0' 37539:20140109:162930.410 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0' 37542:20140109:162930.410 End substitute_simple_macros() data:'{43681}=1&{43682}=0' 37539:20140109:162930.410 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0' 37542:20140109:162930.410 In substitute_simple_macros() data:'{43691}=1&{43692}=0' 37539:20140109:162930.410 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0' 37542:20140109:162930.410 End substitute_simple_macros() data:'{43691}=1&{43692}=0' 37539:20140109:162930.410 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0' 37542:20140109:162930.410 In substitute_simple_macros() data:'{43711}=1&{43712}=0' 37539:20140109:162930.410 zbx_substitute_functions_results() expression[18]:'({37601}#0&{37602}#0)|{37603}#0' => '(0#0&0#0)|0#0' -- 37539:20140109:163000.579 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:163000.579 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:163000.579 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:163000.579 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:163000.579 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:163000.579 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:163000.579 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:163000.579 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:163000.579 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:163000.579 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:163000.579 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' 37539:20140109:163000.579 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' -- 37539:20140109:163000.612 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0' 37539:20140109:163000.612 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0' 37539:20140109:163000.612 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0' 37539:20140109:163000.612 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0' 37539:20140109:163000.612 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0' 37539:20140109:163000.612 zbx_substitute_functions_results() expression[18]:'({37601}#0&{37602}#0)|{37603}#0' => '(0#0&0#0)|0#0' 37539:20140109:163000.612 zbx_substitute_functions_results() expression[19]:'({37616}#0&{37617}#0)|{37618}#0' => '(0#0&0#0)|0#0' 37539:20140109:163000.612 zbx_substitute_functions_results() expression[20]:'({37631}#0&{37632}#0)|{37633}#0' => '(0#0&0#0)|0#0' 37539:20140109:163000.612 zbx_substitute_functions_results() expression[21]:'({37646}#0&{37647}#0)|{37648}#0' => '(0#0&0#0)|0#0' 37539:20140109:163000.612 zbx_substitute_functions_results() expression[22]:'({37661}#0&{37662}#0)|{37663}#0' => '(0#0&0#0)|0#0' 37539:20140109:163000.612 zbx_substitute_functions_results() expression[23]:'({37676}#0&{37677}#0)|{37678}#0' => '(0#0&0#0)|0#0' -- 37548:20140109:163018.287 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37548:20140109:163018.287 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37548:20140109:163018.287 In substitute_simple_macros() data:'({37688}#0&{37689}#0)|{37690}#0' 37548:20140109:163018.287 End substitute_simple_macros() data:'({37688}#0&{37689}#0)|{37690}#0' 37548:20140109:163018.287 In substitute_simple_macros() data:'({37691}#0&{37692}#0)|{37693}#0' 37548:20140109:163018.287 End substitute_simple_macros() data:'({37691}#0&{37692}#0)|{37693}#0' 37548:20140109:163018.287 In substitute_simple_macros() data:'({37694}#0&{37695}#0)|{37696}#0' 37548:20140109:163018.287 End substitute_simple_macros() data:'({37694}#0&{37695}#0)|{37696}#0' 37548:20140109:163018.287 In substitute_simple_macros() data:'({37697}#0&{37698}#0)|{37699}#0' 37548:20140109:163018.287 End substitute_simple_macros() data:'({37697}#0&{37698}#0)|{37699}#0' 37548:20140109:163018.287 In substitute_simple_macros() data:'{37753}#1' 37548:20140109:163018.287 End substitute_simple_macros() data:'{37753}#1' -- 37548:20140109:163018.409 zbx_substitute_functions_results() expression[39]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0' 37548:20140109:163018.409 zbx_substitute_functions_results() expression[40]:'({37688}#0&{37689}#0)|{37690}#0' => '(0#0&0#0)|0#0' 37548:20140109:163018.409 zbx_substitute_functions_results() expression[41]:'({37691}#0&{37692}#0)|{37693}#0' => '(0#0&0#0)|0#0' 37548:20140109:163018.410 zbx_substitute_functions_results() expression[42]:'({37694}#0&{37695}#0)|{37696}#0' => '(0#0&0#0)|0#0' 37548:20140109:163018.410 zbx_substitute_functions_results() expression[43]:'({37697}#0&{37698}#0)|{37699}#0' => '(0#0&0#0)|0#0' 37548:20140109:163018.410 zbx_substitute_functions_results() expression[44]:'{37753}#1' => '1#1' 37548:20140109:163018.410 zbx_substitute_functions_results() expression[45]:'{37755}#1' => '1#1' 37548:20140109:163018.410 zbx_substitute_functions_results() expression[46]:'{37757}#1' => '1#1' 37548:20140109:163018.410 zbx_substitute_functions_results() expression[47]:'{37851}#1' => '1#1' 37548:20140109:163018.410 zbx_substitute_functions_results() expression[48]:'{38185}>60M' => '2039424>60M' 37548:20140109:163018.410 zbx_substitute_functions_results() expression[49]:'{38189}>60M' => '2607992>60M' -- 37539:20140109:163030.763 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:163030.763 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:163030.763 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:163030.763 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:163030.763 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:163030.763 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:163030.763 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:163030.763 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:163030.763 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:163030.763 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:163030.763 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' 37539:20140109:163030.763 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' -- 37539:20140109:163030.796 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0' 37539:20140109:163030.796 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0' 37539:20140109:163030.796 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0' 37539:20140109:163030.796 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0' 37539:20140109:163030.796 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0' 37539:20140109:163030.796 zbx_substitute_functions_results() expression[18]:'({37601}#0&{37602}#0)|{37603}#0' => '(0#0&0#0)|0#0' 37539:20140109:163030.796 zbx_substitute_functions_results() expression[19]:'({37616}#0&{37617}#0)|{37618}#0' => '(0#0&0#0)|0#0' 37539:20140109:163030.796 zbx_substitute_functions_results() expression[20]:'({37631}#0&{37632}#0)|{37633}#0' => '(0#0&0#0)|0#0' 37539:20140109:163030.796 zbx_substitute_functions_results() expression[21]:'({37646}#0&{37647}#0)|{37648}#0' => '(0#0&0#0)|0#0' 37539:20140109:163030.796 zbx_substitute_functions_results() expression[22]:'({37661}#0&{37662}#0)|{37663}#0' => '(0#0&0#0)|0#0' 37539:20140109:163030.796 zbx_substitute_functions_results() expression[23]:'({37676}#0&{37677}#0)|{37678}#0' => '(0#0&0#0)|0#0' -- 37539:20140109:163100.980 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:163100.980 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:163100.980 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:163100.980 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:163100.980 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:163100.980 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:163100.980 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:163100.980 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:163100.980 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:163100.980 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:163100.980 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' 37539:20140109:163100.980 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' -- 37539:20140109:163101.014 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0' 37539:20140109:163101.014 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0' 37539:20140109:163101.014 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0' 37539:20140109:163101.014 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0' 37539:20140109:163101.014 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0' 37539:20140109:163101.014 zbx_substitute_functions_results() expression[18]:'({37601}#0&{37602}#0)|{37603}#0' => '(0#0&0#0)|0#0' 37539:20140109:163101.014 zbx_substitute_functions_results() expression[19]:'({37616}#0&{37617}#0)|{37618}#0' => '(0#0&0#0)|0#0' 37539:20140109:163101.014 zbx_substitute_functions_results() expression[20]:'({37631}#0&{37632}#0)|{37633}#0' => '(0#0&0#0)|0#0' 37539:20140109:163101.014 zbx_substitute_functions_results() expression[21]:'({37646}#0&{37647}#0)|{37648}#0' => '(0#0&0#0)|0#0' 37539:20140109:163101.014 zbx_substitute_functions_results() expression[22]:'({37661}#0&{37662}#0)|{37663}#0' => '(0#0&0#0)|0#0' 37539:20140109:163101.014 zbx_substitute_functions_results() expression[23]:'({37676}#0&{37677}#0)|{37678}#0' => '(0#0&0#0)|0#0' -- 37539:20140109:163130.148 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:163130.148 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:163130.148 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:163130.148 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:163130.148 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:163130.148 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:163130.148 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:163130.148 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:163130.148 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:163130.149 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:163130.149 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' 37539:20140109:163130.149 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' -- 37539:20140109:163130.185 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0' 37539:20140109:163130.185 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0' 37539:20140109:163130.185 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0' 37539:20140109:163130.185 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0' 37539:20140109:163130.185 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0' 37539:20140109:163130.185 zbx_substitute_functions_results() expression[18]:'({37601}#0&{37602}#0)|{37603}#0' => '(0#0&0#0)|0#0' 37539:20140109:163130.185 zbx_substitute_functions_results() expression[19]:'({37616}#0&{37617}#0)|{37618}#0' => '(0#0&0#0)|0#0' 37539:20140109:163130.185 zbx_substitute_functions_results() expression[20]:'({37631}#0&{37632}#0)|{37633}#0' => '(0#0&0#0)|0#0' 37539:20140109:163130.185 zbx_substitute_functions_results() expression[21]:'({37646}#0&{37647}#0)|{37648}#0' => '(0#0&0#0)|0#0' 37539:20140109:163130.185 zbx_substitute_functions_results() expression[22]:'({37661}#0&{37662}#0)|{37663}#0' => '(0#0&0#0)|0#0' 37539:20140109:163130.185 zbx_substitute_functions_results() expression[23]:'({37676}#0&{37677}#0)|{37678}#0' => '(0#0&0#0)|0#0' -- 37539:20140109:163200.365 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:163200.365 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:163200.365 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:163200.365 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:163200.365 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:163200.365 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:163200.365 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:163200.365 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:163200.365 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:163200.365 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:163200.365 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' 37539:20140109:163200.365 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' -- 37539:20140109:163200.460 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0' 37542:20140109:163200.460 In __get_function_parameter_uint31() parameters:'600' Nparam:1 37539:20140109:163200.460 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0' 37542:20140109:163200.460 In substitute_simple_macros() data:'600' 37539:20140109:163200.460 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0' 37542:20140109:163200.460 __get_function_parameter_uint31() flag:0 value:600 37539:20140109:163200.460 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0' 37542:20140109:163200.460 End of __get_function_parameter_uint31():SUCCEED 37539:20140109:163200.460 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0' 37542:20140109:163200.460 In zbx_vc_get_value_range() itemid:44668 value_type:0 seconds:0 count:1 timestamp:1389270720 37539:20140109:163200.460 zbx_substitute_functions_results() expression[18]:'({37601}#0&{37602}#0)|{37603}#0' => '(0#0&0#0)|0#0' -- insert into history_uint (itemid,clock,ns,value) values (50776,1389270736,216547444,0),(41866,1389270736,218283977,156),(40096,1389270736,218680396,130344),(51316,1389270736,221803698,65288),(24166,1389270736,222678111,119536),(38296,1389270736,223005248,0),(35956,1389270736,223225387,0),(36796,1389270736,223452232,0),(41536,1389270736,223636334,176),(24856,1389270736,223779089,160),(44956,1389270736,224420511,0),(48676,1389270736,225006340,0),(49446,1389270736,225477070,2),(41896,1389270736,226250074,0),(39826,1389270736,226216829,0),(43876,1389270736,226632804,203856),(35056,1389270736,226681693,11000),(50656,1389270736,227073642,0),(45076,1389270736,227448270,0),(45416,1389270736,227558620,2),(36946,1389270736,227109680,0),(37216,1389270736,228895382,0),(33436,1389270736,230322379,0),(39136,1389270736,230848703,1),(48856,1389270736,230923014,0),(51256,1389270736,231254900,0),(37666,1389270736,231608017,0),(32716,1389270736,230668233,34496),(45976,1389270736,231940462,0),(38116,1389270736,232076792,0),(29656,1389270736,229882658,536),(43936,1389270736,231793236,1),(35686,1389270736,234583535,0),(49636,1389270736,235476386,0),(24796,1389270736,235424424,0),(24736,1389270736,236374824,0),(42916,1389270736,236786887,56416968),(48936,1389270736,236738278,2),(34516,1389270736,237776399,1),(49996,1389270736,237791764,0),(24916,1389270736,237311535,0),(24076,1389270736,238241821,0),(26416,1389270736,237991789,0),(36316,1389270736,238480958,0),(37486,1389270736,238277300,0),(39466,1389270736,238715904,0),(26656,1389270736,238782393,0),(45256,1389270736,239276310,776),(29536,1389270736,240124183,16),(41836,1389270736,239630824,2),(44356,1389270736,241770761,0),(48316,1389270736,242533428,26912),(48196,1389270736,243574342,378240),(46336,1389270736,242347371,1),(55576,1389270736,244129441,0),(48496,1389270736,242203218,776),(37576,1389270736,244651854,0),(24976,1389270736,244551562,4218112),(45496,1389270736,244438419,0),(37006,1389270736,244447079,1),(39736,1389270736,245862063,616),(37546,1389270736,246530305,5895344),(37156,1389270736,247403600,72),(47746,1389270736,247988590,0),(46996,1389270736,249327588,0),(48106,1389270736,249795524,0),(48256,1389270736,250095003,464),(39286,1389270736,250090534,56352),(26146,1389270736,250647588,0),(48526,1389270736,250691727,157116320),(50176,1389270736,250792578,19647016),(55756,1389270736,250883651,0),(49456,1389270736,251254369,2),(41476,1389270736,252243042,0),(26506,1389270736,252870496,0),(48376,1389270736,253809163,104),(46816,1389270736,254244972,256696),(50116,1389270736,251988820,80),(26596,1389270736,254243855,0),(49816,1389270736,254666814,0),(40736,1389270736,254834153,2),(37036,1389270736,255799080,0),(24556,1389270736,256664833,0),(45426,1389270736,256968503,2),(46696,1389270736,258211398,11449072),(24676,1389270736,258194916,0),(44176,1389270736,258508084,26584),(37846,1389270736,259548160,0),(36676,1389270736,259790091,2520072),(40676,1389270736,259798751,2),(29686,1389270736,260076160,691792208),(26236,1389270736,260388211,0),(48916,1389270736,260415030,21904),(50716,1389270736,260476490,0),(49336,1389270736,261018459,475072),(44536,1389270736,261096402,776),(40706,1389270736,262605811,2),(52336,1389270736,262654142,1),(44686,1389270736,262359132,0),(47176,1389270736,263534700,5828272),(43156,1389270736,264187577,0),(27526,1389270736,264378383,853078016),(36736,1389270736,264906662,0),(42646,1389270736,265251678,21973272),(51376,1389270736,265632733,0),(37096,1389270736,265689444,2),(47416,1389270736,265665698,0),(25036,1389270736,266139780,0),(45136,1389270736,266418028,160),(48946,1389270736,266430320,2),(33616,1389270736,267055818,20928),(50296,1389270736,267186561,123024),(39796,1389270736,267364517,0),(37336,1389270736,267542472,31314280),(33496,1389270736,268295641,13),(43336,1389270736,269118371,0),(42976,1389270736,270136098,1),(26776,1389270736,270150625,0),(48956,1389270736,272919134,2),(55336,1389270736,274937267,29),(35416,1389270736,276130715,5992),(46096,1389270736,279740671,70216),(39646,1389270736,292105091,200),(46817,1389270737,275045102,186144),(27527,1389270737,275114384,664936448),(40097,1389270737,275991870,290912),(39827,1389270737,276362308,0),(45077,1389270737,276715426,0),(49997,1389270737,277386461,0),(41867,1389270737,278275121,284),(50777,1389270737,280724595,0),(44537,1389270737,280966804,48080),(43157,1389270737,280979376,0),(36797,1389270737,281675833,0),(40427,1389270737,281993471,140592),(49457,1389270737,282546893,2),(38297,1389270737,283725255,0),(26657,1389270737,283850411,0),(46697,1389270737,284252976,30823440),(48497,1389270737,284832938,237288),(39137,1389270737,284991059,8),(46997,1389270737,285080735,0),(45497,1389270737,285128227,0),(48437,1389270737,286033091,8),(42647,1389270737,286372240,71141104),(51137,1389270737,287543897,13800),(37097,1389270737,287617091,2),(48937,1389270737,287929700,2),(37007,1389270737,288078323,1),(40517,1389270737,288306564,1),(37487,1389270737,288290361,0),(24167,1389270737,288758577,90288),(44687,1389270737,289142424,0),(55757,1389270737,289119516,0),(47747,1389270737,289135999,0),(50537,1389270737,290239491,100),(48197,1389270737,290882590,0),(45257,1389270737,290919745,138936),(26237,1389270737,291079542,5381736),(40727,1389270737,291387402,2),(24977,1389270737,293250209,0),(37217,1389270737,293275072,2166424),(33437,1389270737,293501358,0),(39467,1389270737,293334857,0),(24857,1389270737,293957841,0),(41477,1389270737,294000863,0),(24137,1389270737,293869282,65203488),(47177,1389270737,293828215,0),(24917,1389270737,294636419,0),(48317,1389270737,294704305,2),(34277,1389270737,296510959,1),(26597,1389270737,297397943,0),(48257,1389270737,297978743,145992),(48377,1389270737,298066184,184),(24077,1389270737,298269841,0),(40697,1389270737,298447238,2),(44177,1389270737,298706769,0),(24677,1389270737,299204038,0),(42977,1389270737,299949664,1),(44357,1389270737,300879111,0),(24797,1389270737,300612318,0),(46337,1389270737,300664280,1),(41837,1389270737,301285588,2),(32597,1389270737,301294807,0),(42917,1389270737,301636470,0),(45977,1389270737,302122566,0),(49637,1389270737,302543569,0),(37337,1389270737,302821258,44416),(51377,1389270737,303054248,0),(39737,1389270737,303176890,0),(26417,1389270737,303642591,0),(37037,1389270737,303970287,0),(36677,1389270737,304978795,0),(37847,1389270737,305667430,3040),(45427,1389270737,306235658,2),(46217,1389270737,306464179,8),(45767,1389270737,306976814,8),(48107,1389270737,307745906,0),(39287,1389270737,308967290,0),(26507,1389270737,309131836,0),(50717,1389270737,309782757,0),(34637,1389270737,310103748,4245368),(34517,1389270737,310261310,1),(49817,1389270737,310647951,0),(29687,1389270737,310814732,4960),(51257,1389270737,310759697,0),(36947,1389270737,311240484,0),(26147,1389270737,311514262,0),(47417,1389270737,311796980,21160),(32717,1389270737,312383646,4935616),(50657,1389270737,312966961,0),(35687,1389270737,313529043,0),(40487,1389270737,313564802,0),(35057,1389270737,313883837,0),(43877,1389270737,314407926,10169888),(44957,1389270737,316248942,0),(50297,1389270737,316123507,0),(39797,1389270737,316265145,0),(37157,1389270737,316913552,0),(35417,1389270737,317240409,0),(41537,1389270737,317926530,11746632),(40577,1389270737,317929882,2),(24737,1389270737,318460396,0),(29537,1389270737,318906822,32),(48857,1389270737,318911850,0),(32687,1389270737,319270555,6),(55577,1389270737,321200968,0),(52337,1389270737,321187279,1),(25037,1389270737,321221641,6570816),(24347,1389270737,321814733,1),(29657,1389270737,321678124,23160),(27497,1389270737,321676727,15315396608),(37577,1389270737,321781489,0),(38117,1389270737,323301794,0),(40637,1389270737,322889172,1),(49447,1389270737,323303470,2),(45417,1389270737,324167826,2),(45137,1389270737,324063064,5803768),(37667,1389270737,325473299,0),(33617,1389270737,325521908,2166992),(48677,1389270737,325559623,343360),(35957,1389270737,325828093,0),(48947,1389270737,326201883,1),(37547,1389270737,326437108,1497752),(55337,1389270737,326546620,30),(43337,1389270737,327023216,0),(50117,1389270737,327241121,0),(36317,1389270737,327515737,0),(41897,1389270737,330160766,0),(34697,1389270737,332744614,0),(34877,1389270737,333177909,1056),(48957,1389270737,333751166,2),(26777,1389270737,334443433,176),(36737,1389270737,335064182,0),(50778,1389270738,336712996,0),(49818,1389270738,337621212,0),(45498,1389270738,338368513,0),(26418,1389270738,338583345,0),(36948,1389270738,338828907,0),(47748,1389270738,339340424,0),(35688,1389270738,340252551,0),(46308,1389270738,340334405,292872),(32808,1389270738,340844526,3760),(40718,1389270738,340816031,2),(26508,1389270738,341353250,0),(25038,1389270738,341780399,40368248),(43878,1389270738,341817834,0),(48498,1389270738,342075968,2),(41838,1389270738,342932501,2),(29658,1389270738,343143701,536),(36318,1389270738,343265784,0),(37938,1389270738,345157644,133864),(47418,1389270738,345332527,464),(39828,1389270738,345393428,0),(37848,1389270738,345610495,200),(46158,1389270738,346701974,9552560),(24978,1389270738,346723206,0),(51258,1389270738,347112083,0),(44688,1389270738,347925873,0),(41898,1389270738,348512540,0),(55578,1389270738,348880743,0),(37488,1389270738,349819410,0),(39468,1389270738,350329810,0),(41538,1389270738,350979893,38585512),(26598,1389270738,351390839,0),(49998,1389270738,352143728,0),(50298,1389270738,352561099,0),(27468,1389270738,352562217,1389270738),(24798,1389270738,352892985,0),(40688,1389270738,353011156,1),(43338,1389270738,353628274,0),(41478,1389270738,354125264,2783640),(48318,1389270738,354518331,1),(48198,1389270738,354780096,0),(49458,1389270738,354999398,2),(48528,1389270738,356752693,282087560),(45418,1389270738,356821138,2),(50118,1389270738,356823093,1240),(45858,1389270738,356874217,0),(42648,1389270738,357313658,122185384),(49448,1389270738,357688566,2),(37218,1389270738,358277468,192),(50538,1389270738,358604325,1),(34278,1389270738,358838713,1),(26658,1389270738,358980071,168),(35958,1389270738,359273963,0),(48948,1389270738,359363919,1),(24858,1389270738,360896237,0),(27528,1389270738,360759906,97771520),(37158,1389270738,361138167,0),(50718,1389270738,361742992,0),(51378,1389270738,361840491,0),(39738,1389270738,361879881,15224),(33618,1389270738,362478002,432),(39798,1389270738,363054891,0),(26778,1389270738,363407729,709496),(55818,1389270738,363379513,7984),(45428,1389270738,363836555,2),(29538,1389270738,364552847,16760),(46998,1389270738,364940885,0),(45978,1389270738,364557316,0),(46398,1389270738,364801482,0),(36018,1389270738,364843666,11507760),(37098,1389270738,366453088,2),(55758,1389270738,367695425,0),(34518,1389270738,367658549,1),(47178,1389270738,368094637,0),(48938,1389270738,368376517,2),(37008,1389270738,368657000,1),(48738,1389270738,369374968,93080084),(48678,1389270738,369790943,2),(41388,1389270738,370554168,7),(24138,1389270738,370786879,3152536),(48378,1389270738,370995844,28144192),(32688,1389270738,371117927,10),(42918,1389270738,371358740,0),(51138,1389270738,371628886,0),(26148,1389270738,371887298,0),(33438,1389270738,372044302,0),(44358,1389270738,373091641,0),(24678,1389270738,373702334,0),(52338,1389270738,374279781,3068),(32718,1389270738,374823984,0),(40038,1389270738,375050550,1),(44958,1389270738,375269851,0),(35058,1389270738,375533572,0),(40338,1389270738,375701470,432504),(24168,1389270738,376605216,0),(24918,1389270738,377444429,0),(39288,1389270738,377500302,1646424),(38118,1389270738,377780226,0),(50658,1389270738,379029267,0),(44538,1389270738,379283769,2),(45078,1389270738,379873788,0),(38298,1389270738,380242271,0),(29688,1389270738,380548734,0),(48258,1389270738,380714118,2),(43158,1389270738,380909395,0),(26238,1389270738,381647198,54712),(44178,1389270738,381961204,0),(45258,1389270738,381963998,1),(46818,1389270738,382079376,9624),(24078,1389270738,382286944,0),(42978,1389270738,382588100,2),(49638,1389270738,382602347,0),(37668,1389270738,382908531,0),(48108,1389270738,383089281,0),(32598,1389270738,384479402,168),(37038,1389270738,385579541,0),(55338,1389270738,386118437,23),(40098,1389270738,396790463,11920),(37578,1389270738,398092305,7531472),(35418,1389270738,399309778,0),(37548,1389270738,875417775,5196296),(37538,1389270738,875409394,10893096),(55759,1389270739,288554920,176),(34699,1389270739,294619377,118704),(26779,1389270739,295926806,0),(48109,1389270739,301871416,0),(34519,1389270739,307939785,1),(40739,1389270739,312117691,2),(48499,1389270739,314904078,1),(35419,1389270739,318729984,0),(45079,1389270739,321111571,0),(48919,1389270739,326404143,0),(37219,1389270739,329166785,7413856),(41899,1389270739,329556499,0),(24859,1389270739,331307281,32300504),(46339,1389270739,332240639,8),(55579,1389270739,338700399,0),(40339,1389270739,356169099,0),(32719,1389270739,359020859,2168632),(51139,1389270739,361289583,0),(27469,1389270739,361658345,10737336320),(39799,1389270739,363514167,0),(45979,1389270739,364176542,0),(24349,1389270739,365175831,56852504),(26419,1389270739,366703120,31720),(41839,1389270739,368731869,2),(36949,1389270739,371471603,0),(43339,1389270739,371959095,0),(46999,1389270739,374074727,0),(39289,1389270739,374729000,36976),(48199,1389270739,376804683,0),(50779,1389270739,378296772,0),(44539,1389270739,381291846,1),(48859,1389270739,383095147,24),(26239,1389270739,383249916,304),(40429,1389270739,385718106,0),(37489,1389270739,389458247,0),(48379,1389270739,392042095,4514912),(24679,1389270739,392525396,0),(35059,1389270739,393774158,0),(43159,1389270739,395010908,0),(35689,1389270739,395479682,0),(29539,1389270739,395540863,31136),(24169,1389270739,395600647,0),(36319,1389270739,395697587,0),(26209,1389270739,395823022,7),(38119,1389270739,395737257,0),(44959,1389270739,396422260,0),(44359,1389270739,396677600,0),(40679,1389270739,396950819,2),(37099,1389270739,398175276,2),(49459,1389270739,398583708,2),(48739,1389270739,398729537,171154054),(37789,1389270739,398293448,9),(40009,1389270739,398954984,9),(37549,1389270739,400007353,5400768),(46309,1389270739,400118540,0),(36079,1389270739,400650451,428872),(34639,1389270739,400744597,4247912),(26149,1389270739,401115315,0),(47419,1389270739,402230540,18720),(37539,1389270739,403561994,722117640),(39469,1389270739,403475671,0),(44179,1389270739,403611163,14344),(50719,1389270739,403945283,0),(33619,1389270739,404462109,11753376),(50119,1389270739,404441995,62264),(51259,1389270739,405002122,0),(40399,1389270739,405184826,0),(35959,1389270739,406224903,0),(48259,1389270739,406927227,1),(42649,1389270739,407073893,35330304),(51319,1389270739,407389017,1),(37009,1389270739,407875671,1),(32689,1389270739,408183252,6),(45259,1389270739,410009462,1),(55339,1389270739,411765551,36),(51379,1389270739,412051341,0),(47179,1389270739,412291875,0),(40709,1389270739,412304167,2),(45419,1389270739,412240192,2),(39829,1389270739,412532408,0),(50659,1389270739,413646237,0),(44689,1389270739,413667748,0),(49999,1389270739,413626123,0),(37939,1389270739,413813018,0),(46399,1389270739,414299951,0),(24919,1389270739,414777666,0),(26509,1389270739,415066529,0),(36619,1389270739,415187215,0),(26659,1389270739,416045424,0),(39109,1389270739,415961894,976112),(24079,1389270739,416195164,0),(36019,1389270739,416855304,21242592),(27439,1389270739,419024295,1),(34279,1389270739,419611800,1),(40489,1389270739,419444460,0),(29659,1389270739,419759304,3156280),(49639,1389270739,420017717,0),(50299,1389270739,420114377,0),(45429,1389270739,420027774,2),(40099,1389270739,420454086,2392),(45889,1389270739,420761387,8),(48949,1389270739,420867825,1),(24979,1389270739,421482428,17791992),(49449,1389270739,421646416,2),(26599,1389270739,422071051,0),(32809,1389270739,422765273,0),(46819,1389270739,423099114,179880),(41239,1389270739,423669019,437656),(46159,1389270739,424044486,47241912),(32599,1389270739,424558797,0),(25039,1389270739,425457515,16128),(40519,1389270739,426322708,2),(55819,1389270739,426964410,0),(38299,1389270739,427277858,0),(45499,1389270739,427321718,0),(52339,1389270739,427446036,1),(29689,1389270739,427812563,10976856),(48679,1389270739,427856423,1),(45859,1389270739,428441693,0),(42979,1389270739,429583458,2),(49819,1389270739,429764766,0),(47749,1389270739,430041896,0),(33439,1389270739,430049439,184),(34879,1389270739,430666836,211656),(37159,1389270739,430680246,0),(39739,1389270739,431156004,0),(37579,1389270739,432247763,1),(37669,1389270739,432841693,0),(43879,1389270739,433802989,0),(48939,1389270739,434594151,2),(40999,1389270739,447962610,429224),(37039,1389270739,468127463,0),(26840,1389270740,338945961,36),(24080,1389270740,342557034,0),(41240,1389270740,343870609,0),(45080,1389270740,345557136,0),(44690,1389270740,350770648,0),(49640,1389270740,353451994,0),(48860,1389270740,353668782,14160),(26510,1389270740,357545811,0),(44360,1389270740,360253138,376),(36680,1389270740,361603868,0),(44180,1389270740,363101545,255408),(38120,1389270740,364457862,0); insert into history_text (id,itemid,clock,ns,value) values (11803150,50508,1389270737,351981417,'0'),(11803151,50533,1389270738,606272674,'SNMPv2-SMI::enterprises.9.9.41.2.0.1'),(11803152,26815,1389270739,955943373,'SNMPv2-SMI::enterprises.9.9.194.2.0.3'); ] 37495:20140109:163220.386 zbx_snmp_get_value() snmp_synch_response():0 37495:20140109:163220.386 In zbx_snmp_set_result() 37495:20140109:163220.386 End of zbx_snmp_set_result():SUCCEED 37495:20140109:163220.386 End of zbx_snmp_get_value():SUCCEED 37495:20140109:163220.386 In zbx_snmp_close_session() 37495:20140109:163220.386 End of zbx_snmp_close_session() 37495:20140109:163220.386 End of get_value_snmp():SUCCEED 37495:20140109:163220.386 End of get_value():SUCCEED -- 37547:20140109:163220.425 In zbx_vc_add_value() itemid:48957 value_type:3 timestamp:1389270737.333751166 37547:20140109:163220.426 End of zbx_vc_add_value():FAIL 37547:20140109:163220.426 In zbx_vc_add_value() itemid:26777 value_type:3 timestamp:1389270737.334443433 37547:20140109:163220.426 End of zbx_vc_add_value():FAIL 37547:20140109:163220.426 In zbx_vc_add_value() itemid:36737 value_type:3 timestamp:1389270737.335064182 37547:20140109:163220.426 End of zbx_vc_add_value():FAIL 37547:20140109:163220.426 In zbx_vc_add_value() itemid:50508 value_type:4 timestamp:1389270737.351981417 37547:20140109:163220.426 End of zbx_vc_add_value():FAIL 37547:20140109:163220.426 In zbx_vc_add_value() itemid:46410 value_type:0 timestamp:1389270735.254488299 37547:20140109:163220.426 End of zbx_vc_add_value():SUCCEED 37547:20140109:163220.426 In zbx_vc_add_value() itemid:32805 value_type:0 timestamp:1389270735.254488299 -- 37539:20140109:163230.638 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37549:20140109:163230.638 In evaluate_function() function:'17.3b.i.sw.1.local:icmppingsec[ ].max(120)' 37539:20140109:163230.638 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37549:20140109:163230.638 In evaluate_MAX() 37539:20140109:163230.638 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37549:20140109:163230.638 In __get_function_parameter_uint31() parameters:'120' Nparam:1 37539:20140109:163230.638 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37549:20140109:163230.638 In substitute_simple_macros() data:'120' 37539:20140109:163230.638 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37549:20140109:163230.638 __get_function_parameter_uint31() flag:0 value:120 37539:20140109:163230.638 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37549:20140109:163230.638 End of __get_function_parameter_uint31():SUCCEED 37539:20140109:163230.638 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' -- 37539:20140109:163230.697 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0' 37539:20140109:163230.697 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0' 37542:20140109:163230.697 In __get_function_parameter_uint31() parameters:'#2' Nparam:1 37549:20140109:163230.697 End of evaluate_function():SUCCEED value:'1' 37542:20140109:163230.697 In substitute_simple_macros() data:'#2' 37539:20140109:163230.697 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0' 37542:20140109:163230.697 __get_function_parameter_uint31() flag:1 value:2 37549:20140109:163230.697 In evaluate_function() function:'3.16.i.sw.1.local:.1.3.6.1.2.1.2.2.1.4.10001.last(0)' 37539:20140109:163230.697 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0' 37549:20140109:163230.697 In evaluate_LAST() 37539:20140109:163230.697 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0' -- 37539:20140109:163300.853 In substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:163300.853 End substitute_simple_macros() data:'{37511}#0&{37512}#0&{37513}=0' 37539:20140109:163300.853 In substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:163300.853 End substitute_simple_macros() data:'({37526}#0&{37527}#0)|{37528}#0' 37539:20140109:163300.853 In substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:163300.853 End substitute_simple_macros() data:'({37541}#0&{37542}#0)|{37543}#0' 37539:20140109:163300.853 In substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:163300.853 End substitute_simple_macros() data:'({37556}#0&{37557}#0)|{37558}#0' 37539:20140109:163300.853 In substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:163300.853 End substitute_simple_macros() data:'({37586}#0&{37587}#0)|{37588}#0' 37539:20140109:163300.853 In substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' 37539:20140109:163300.853 End substitute_simple_macros() data:'({37601}#0&{37602}#0)|{37603}#0' -- 37539:20140109:163300.886 zbx_substitute_functions_results() expression[13]:'{37511}#0&{37512}#0&{37513}=0' => '0#0&0#0&0=0' 37539:20140109:163300.886 zbx_substitute_functions_results() expression[14]:'({37526}#0&{37527}#0)|{37528}#0' => '(0#0&0#0)|0#0' 37539:20140109:163300.886 zbx_substitute_functions_results() expression[15]:'({37541}#0&{37542}#0)|{37543}#0' => '(0#0&0#0)|0#0' 37539:20140109:163300.886 zbx_substitute_functions_results() expression[16]:'({37556}#0&{37557}#0)|{37558}#0' => '(0#0&0#0)|0#0' 37539:20140109:163300.886 zbx_substitute_functions_results() expression[17]:'({37586}#0&{37587}#0)|{37588}#0' => '(0#0&0#0)|0#0' 37539:20140109:163300.886 zbx_substitute_functions_results() expression[18]:'({37601}#0&{37602}#0)|{37603}#0' => '(0#0&0#0)|0#0' 37539:20140109:163300.886 zbx_substitute_functions_results() expression[19]:'({37616}#0&{37617}#0)|{37618}#0' => '(0#0&0#0)|0#0' 37542:20140109:163300.886 timer #4 [processed 92 triggers, 0 events in 0.082713 sec, processing time functions] 37539:20140109:163300.886 zbx_substitute_functions_results() expression[20]:'({37631}#0&{37632}#0)|{37633}#0' => '(0#0&0#0)|0#0' 37542:20140109:163300.886 In process_time_functions() 37539:20140109:163300.886 zbx_substitute_functions_results() expression[21]:'({37646}#0&{37647}#0)|{37648}#0' => '(0#0&0#0)|0#0' -- 37511:20140109:163304.551 In zbx_waitpid() 37497:20140109:163304.551 zbx_snmp_get_value() snmp_synch_response():0 37479:20140109:163304.551 In activate_host() hostid:10444 itemid:47704 type:4 37499:20140109:163304.551 In zbx_snmp_get_value() oid:'.1.3.6.1.2.1.2.2.1.16.22' 37492:20140109:163304.551 End of activate_host() 37473:20140109:163304.551 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.8.26' oid:'.1.3.6.1.2.1.2.2.1.8.26' 37494:20140109:163304.551 In DCconfig_get_poller_items() poller_type:0 37491:20140109:163304.551 zbx_snmp_get_value() snmp_synch_response():0 37480:20140109:163304.552 In zbx_snmp_set_result() 37478:20140109:163304.551 End of DCconfig_get_poller_nextcheck():1389270784 37485:20140109:163304.551 End of zbx_snmp_set_result():SUCCEED -- 37511:20140109:163304.552 zbx_waitpid() killed by signal 15 37473:20140109:163304.552 In zbx_snmp_open_session() 37497:20140109:163304.552 In zbx_snmp_set_result() 37493:20140109:163304.552 In zbx_snmp_set_result() 37500:20140109:163304.552 End of zbx_snmp_set_result():SUCCEED 37476:20140109:163304.552 End of zbx_snmp_open_session() 37481:20140109:163304.552 zbx_snmp_get_value() snmp_synch_response():0 37480:20140109:163304.552 End of zbx_snmp_set_result():SUCCEED 37489:20140109:163304.552 get_value_snmp() standard processing 37485:20140109:163304.552 End of zbx_snmp_get_value():SUCCEED 37490:20140109:163304.552 In zbx_snmp_set_result() -- 37511:20140109:163304.552 End of zbx_waitpid():50338 37500:20140109:163304.552 End of zbx_snmp_get_value():SUCCEED 37494:20140109:163304.552 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.10015' 37488:20140109:163304.552 In zbx_snmp_translate() oid:'.1.3.6.1.2.1.2.2.1.10.4' 37495:20140109:163304.552 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.10002' 37484:20140109:163304.552 In zbx_snmp_get_value() oid:'.1.3.6.1.2.1.2.2.1.16.6' 37485:20140109:163304.552 In zbx_snmp_close_session() 37473:20140109:163304.552 SNMP [public@10.16.19.38:161] 37481:20140109:163304.552 In zbx_snmp_set_result() 37493:20140109:163304.552 End of zbx_snmp_set_result():SUCCEED 37491:20140109:163304.552 End of zbx_snmp_set_result():SUCCEED -- 37511:20140109:163304.552 End of zbx_execute_script():TIMEOUT_ERROR 37480:20140109:163304.553 In zbx_snmp_close_session() 37496:20140109:163304.552 In substitute_simple_macros() data:'public' 37494:20140109:163304.553 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10015' 37482:20140109:163304.552 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.6' 37479:20140109:163304.552 End of get_values():1 37486:20140109:163304.553 In zbx_snmp_set_result() 37485:20140109:163304.552 End of zbx_snmp_close_session() 37492:20140109:163304.553 End of DCconfig_get_poller_nextcheck():1389270784 37478:20140109:163304.553 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.7' 37501:20140109:163304.553 zbx_snmp_get_value() snmp_synch_response():0 -- 37511:20140109:163304.553 End of zbx_execute_script():TIMEOUT_ERROR 37486:20140109:163304.553 End of zbx_snmp_set_result():SUCCEED 37501:20140109:163304.553 In zbx_snmp_set_result() 37480:20140109:163304.553 End of zbx_snmp_close_session() 37492:20140109:163304.553 In get_values() 37493:20140109:163304.553 In zbx_snmp_close_session() 37486:20140109:163304.553 End of zbx_snmp_get_value():SUCCEED 37501:20140109:163304.553 End of zbx_snmp_set_result():SUCCEED 37494:20140109:163304.553 In substitute_simple_macros() data:'161' 37476:20140109:163304.553 In zbx_snmp_get_value() oid:'.1.3.6.1.2.1.2.2.1.16.10023' 37473:20140109:163304.553 get_value_snmp() standard processing -- 37511:20140109:163304.553 End of execute_script():TIMEOUT_ERROR 37492:20140109:163304.553 End of DCconfig_get_poller_items():1 37501:20140109:163304.553 In zbx_snmp_close_session() 37497:20140109:163304.553 In activate_host() hostid:10095 itemid:55384 type:4 37478:20140109:163304.553 In substitute_simple_macros() data:'public' 37499:20140109:163304.553 In zbx_snmp_set_result() 37496:20140109:163304.553 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10001' 37479:20140109:163304.553 In DCconfig_get_poller_items() poller_type:0 37473:20140109:163304.553 End of zbx_snmp_translate() oid_translated:'.1.3.6.1.2.1.2.2.1.8.26' 37491:20140109:163304.553 End of get_value_snmp():SUCCEED 37500:20140109:163304.553 End of get_value():SUCCEED -- 37511:20140109:163304.553 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x0]. Crashing ... 37481:20140109:163304.554 End of get_value():SUCCEED 37486:20140109:163304.554 End of zbx_snmp_close_session() 37501:20140109:163304.554 End of get_value_snmp():SUCCEED 37495:20140109:163304.554 SNMP [public@10.16.1.2:161] 37491:20140109:163304.554 End of get_value():SUCCEED 37477:20140109:163304.554 zbx_snmp_get_value() snmp_synch_response():0 37511:20140109:163304.554 ====== Fatal information: ====== 37485:20140109:163304.554 In activate_host() hostid:10121 itemid:48934 type:4 37478:20140109:163304.554 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.7' 37494:20140109:163304.554 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10015' 37511:20140109:163304.554 program counter not available for this architecture 37497:20140109:163304.554 End of activate_host() 37474:20140109:163304.554 zbx_snmp_get_value() snmp_synch_response():0 37499:20140109:163304.554 End of zbx_snmp_set_result():SUCCEED 37480:20140109:163304.554 In activate_host() hostid:10339 itemid:41944 type:4 37493:20140109:163304.554 End of get_value():SUCCEED 37491:20140109:163304.554 In activate_host() hostid:10131 itemid:49454 type:4 37500:20140109:163304.554 In activate_host() hostid:10103 itemid:24904 type:4 37497:20140109:163304.554 End of get_values():1 37482:20140109:163304.554 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.6' 37485:20140109:163304.554 End of activate_host() -- 37511:20140109:163304.554 === Registers: === 37481:20140109:163304.554 End of activate_host() 37490:20140109:163304.554 End of get_value():SUCCEED 37501:20140109:163304.554 End of get_value():SUCCEED 37496:20140109:163304.554 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.10.10001' oid:'.1.3.6.1.2.1.2.2.1.10.10001' 37478:20140109:163304.554 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.7' 37497:20140109:163304.554 In DCconfig_get_poller_nextcheck() poller_type:0 37478:20140109:163304.554 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.10.7' oid:'.1.3.6.1.2.1.2.2.1.10.7' 37499:20140109:163304.554 End of zbx_snmp_get_value():SUCCEED 37492:20140109:163304.554 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.20' 37511:20140109:163304.554 register dump not available for this architecture 37494:20140109:163304.554 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.10.10015' oid:'.1.3.6.1.2.1.2.2.1.10.10015' 37482:20140109:163304.554 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.6' 37493:20140109:163304.554 End of activate_host() 37479:20140109:163304.554 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.10044' 37481:20140109:163304.554 End of get_values():1 37477:20140109:163304.554 End of zbx_snmp_set_result():SUCCEED 37500:20140109:163304.554 End of activate_host() 37497:20140109:163304.554 End of DCconfig_get_poller_nextcheck():1389270784 37496:20140109:163304.554 In zbx_snmp_open_session() 37485:20140109:163304.554 In DCconfig_get_poller_nextcheck() poller_type:0 -- 37511:20140109:163304.554 === Backtrace: === 37486:20140109:163304.555 End of get_value():SUCCEED 37495:20140109:163304.554 In zbx_snmp_translate() oid:'.1.3.6.1.2.1.2.2.1.16.10002' 37490:20140109:163304.555 End of activate_host() 37472:20140109:163304.554 zbx_snmp_get_value() snmp_synch_response():0 37499:20140109:163304.554 End of zbx_snmp_close_session() 37482:20140109:163304.555 In get_value() key:'.1.3.6.1.2.1.2.2.1.10.6' 37491:20140109:163304.555 End of get_values():1 37482:20140109:163304.555 In get_value_snmp() key:'.1.3.6.1.2.1.2.2.1.10.6' oid:'.1.3.6.1.2.1.2.2.1.10.6' 37479:20140109:163304.555 In substitute_simple_macros() data:'161' 37475:20140109:163304.555 zbx_snmp_get_value() snmp_synch_response():0 -- 37511:20140109:163304.555 backtrace not available for this platform 37481:20140109:163304.555 End of DCconfig_get_poller_nextcheck():1389270784 37500:20140109:163304.555 In DCconfig_get_poller_nextcheck() poller_type:0 37475:20140109:163304.555 In zbx_snmp_set_result() 37480:20140109:163304.555 In get_values() 37482:20140109:163304.555 SNMP [public@10.16.1.40:161] 37485:20140109:163304.555 In DCconfig_get_poller_items() poller_type:0 37479:20140109:163304.555 In substitute_simple_macros() data:'public' 37492:20140109:163304.555 In substitute_simple_macros() data:'public' 37474:20140109:163304.555 End of get_value_snmp():SUCCEED 37490:20140109:163304.555 End of get_values():1 -- 37511:20140109:163304.555 === Memory map: === 37486:20140109:163304.555 End of activate_host() 37493:20140109:163304.555 End of DCconfig_get_poller_nextcheck():1389270784 37492:20140109:163304.555 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.20' 37478:20140109:163304.555 End of zbx_snmp_open_session() 37495:20140109:163304.555 End of zbx_snmp_translate() oid_translated:'.1.3.6.1.2.1.2.2.1.16.10002' 37490:20140109:163304.555 In DCconfig_get_poller_nextcheck() poller_type:0 37485:20140109:163304.555 End of DCconfig_get_poller_items():1 37494:20140109:163304.555 SNMP [public@10.16.10.2:161] 37481:20140109:163304.555 In get_values() 37479:20140109:163304.555 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.16.10044' -- 37511:20140109:163304.556 memory map not available for this platform 37501:20140109:163304.556 End of DCconfig_get_poller_nextcheck():1389270784 37477:20140109:163304.556 End of get_value_snmp():SUCCEED 37492:20140109:163304.556 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.20' 37499:20140109:163304.556 End of get_values():1 37472:20140109:163304.556 In zbx_snmp_close_session() 37479:20140109:163304.556 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.16.10044' 37476:20140109:163304.556 In zbx_snmp_set_result() 37485:20140109:163304.556 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.10003' 37493:20140109:163304.556 In DCconfig_get_poller_items() poller_type:0 37481:20140109:163304.556 In DCconfig_get_poller_items() poller_type:0 -- 37511:20140109:163304.556 ================================ 37493:20140109:163304.556 End of DCconfig_get_poller_items():1 37486:20140109:163304.556 In DCconfig_get_poller_nextcheck() poller_type:0 37500:20140109:163304.556 In get_values() 37476:20140109:163304.556 End of zbx_snmp_get_value():SUCCEED 37478:20140109:163304.556 In zbx_snmp_translate() oid:'.1.3.6.1.2.1.2.2.1.10.7' 37497:20140109:163304.556 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.2' 37490:20140109:163304.556 In get_values() 37472:20140109:163304.556 End of zbx_snmp_close_session() 37491:20140109:163304.556 In get_values() 37477:20140109:163304.556 End of activate_host() -- 37468:20140109:163304.558 One child process died (PID:37511,exitcode/signal:65280). Exiting ... 37474:20140109:163304.558 In get_values() 37479:20140109:163304.558 get_value_snmp() standard processing 37501:20140109:163304.558 In substitute_simple_macros() data:'161' 37472:20140109:163304.558 In activate_host() hostid:10291 itemid:39514 type:4 37500:20140109:163304.558 In substitute_key_macros() data:'.1.3.6.1.2.1.2.2.1.10.1' 37493:20140109:163304.558 In substitute_simple_macros() data:'public' 37473:20140109:163304.558 End of activate_host() 37476:20140109:163304.558 In activate_host() hostid:10327 itemid:41134 type:4 37490:20140109:163304.558 In substitute_simple_macros() data:'161' 37481:20140109:163304.558 End of substitute_key_macros():SUCCEED data:'.1.3.6.1.2.1.2.2.1.10.10121'
Only useful info from the comment above:
# grep " 37511" 37511:20140109:162802.956 trapper #5 [processing data] 37511:20140109:162802.959 Trapper got [{"request":"command","nodeid":0,"scriptid":"4","hostid":"10352"}] len 64 37511:20140109:162802.959 In node_process_command() 37511:20140109:162802.959 In execute_script() scriptid:4 hostid:10352 37511:20140109:162802.959 In zbx_execute_script() 37511:20140109:162802.959 In DBget_script_by_scriptid() 37511:20140109:162802.959 query [txnlev:0] [select type,execute_on,command,groupid from scripts where scriptid=4] 37511:20140109:162802.959 End of DBget_script_by_scriptid():SUCCEED 37511:20140109:162802.959 In check_script_permissions() groupid:0 hostid:10352 37511:20140109:162802.959 End of check_script_permissions():SUCCEED 37511:20140109:162802.959 In substitute_simple_macros() data:'/data/scripts/zabbix/show_ports.pl {HOST.CONN} | /usr/bin/column -t' 37511:20140109:162802.959 query [txnlev:0] [select type,useip,ip,dns from interface where hostid=10352 and type in (1,2,3,4) and main=1] 37511:20140109:162802.959 End substitute_simple_macros() data:'/data/scripts/zabbix/show_ports.pl 10.16.6.26 | /usr/bin/column -t' 37511:20140109:162802.959 In zbx_execute_script() 37511:20140109:162802.959 In zbx_popen() command:'/data/scripts/zabbix/show_ports.pl 10.16.6.26 | /usr/bin/column -t' 37511:20140109:162802.960 End of zbx_popen():7 37511:20140109:163304.551 In zbx_waitpid() 37511:20140109:163304.552 zbx_waitpid() killed by signal 15 37511:20140109:163304.552 End of zbx_waitpid():50338 37511:20140109:163304.552 End of zbx_execute_script():TIMEOUT_ERROR 37511:20140109:163304.553 End of zbx_execute_script():TIMEOUT_ERROR 37511:20140109:163304.553 End of execute_script():TIMEOUT_ERROR 37511:20140109:163304.553 Got signal [signal:11(SIGSEGV),reason:1,refaddr:0x0]. Crashing ... 37511:20140109:163304.554 ====== Fatal information: ====== 37511:20140109:163304.554 program counter not available for this architecture 37511:20140109:163304.554 === Registers: === 37511:20140109:163304.554 register dump not available for this architecture 37511:20140109:163304.554 === Backtrace: === 37511:20140109:163304.555 backtrace not available for this platform 37511:20140109:163304.555 === Memory map: === 37511:20140109:163304.556 memory map not available for this platform 37511:20140109:163304.556 ================================ 37468:20140109:163304.558 One child process died (PID:37511,exitcode/signal:65280). Exiting ...
This is a trapper !
And what we can do with it? Can you explain why trapper is interact with /data/scripts/zabbix/show_ports.pl.
show_ports.pl used only in context menus on maps.
you are using global script (defined in administration -> scripts)
I try repeat action /data/scripts/zabbix/show_ports.pl 10.16.6.26 but no errors. Last hour i updated net-snmp to 5.7 can it impact on problem?
what next? Did you need more info about trouble?
Anybody can answer me?
My 2.2.1 (on Oracle Linux 6) also crashed 4 times this weekend. I'll enable debug logging and hopefully can provide more information if it should happen again. I have objdump with log level 3 logs though - would it help, if I attach those?
What net-snmp version you have?
I have net-snmp 5.5(release 44.0.1.el6_4.4).
try update to 5.7 and reinstall zabbix.
Vekli, I think your last crash in trapper (with DebugLevel=4) is not related to SNMP version.
As you can see there was a trapper timeout (default is 300 seconds) for extremal script execution invoked as GUI script.
Theoretically it could be possible to emulate that case - try to reproduce it using simple "sleep 305" in the script.
Why all server down then one script is timed out, is it normal? We use same scripts on 2.0.8 and no errors. And after update net-snmp server work without errors.
Why all server down then one script is timed out, is it normal?
World is not free of bugs, and not only in zabbix 
In any case your script worked longer than allowed !
I'm not very sure that net-snmp upgrade had some impact on the crash possibility.
Continue to watch !
I think maybe I should create another ticket, since my crash looks a bit different.
It says [signal:11(SIGSEGV),reason:128,refaddr:(nil)] and the first process to go down is a history syncer.
Crash again. Same symptoms.
End of zbx_execute_script():TIMEOUT_ERROR
We found why script take too much time.
How we can change timeout in zabbix to bigger value?
And every starting after crash server work 10-15 min and stop collect data form hosts so after crash we restart server twice.
300 is maximum for trapper timeout
https://www.zabbix.com/documentation/2.2/manual/appendix/config/zabbix_server
stop collecting data - it's another topic, closer to a support area.
I have seen this problem
server crashes after the end of the script after a timeout
here is the process
37961 ? ? I 0:00.11 zabbix_server: trapper # 1 [processing data] (zabbix_server)
38597 ? ? I 0:00.02 / usr / local / bin / sudo / usr / local / bin / nmap-O 127.0.0.1
38598 ? ? Is 0:00.00 / usr / local / bin / sudo / usr / local / bin / nmap-O 127.0.0.1
38599 ? ? S 0:01.02 / usr / local / bin / nmap-O 127.0.0.1
and log
after 300s
37961:20140117:164634.277 failed to kill [/ usr / local / bin / sudo / usr / local / bin / nmap-O 127.0.0.1 2> & 1 ] [ 1 ] Operation not permitted
and after running the script server crashes
37961:20140117:170305.443 Got signal [signal: 11 (SIGSEGV), reason: 1 , refaddr: 0x0]. Crashing ...
37961:20140117:170305.443 ====== Fatal information: ======
37961:20140117:170305.443 program counter not available for this architecture
37961:20140117:170305.443 === Registers: ===
37961:20140117:170305.443 register dump not available for this architecture
37961:20140117:170305.443 === Backtrace: ===
37961:20140117:170305.443 backtrace not available for this platform
37961:20140117:170305.443 === Memory map: ===
37961:20140117:170305.443 memory map not available for this platform
37961:20140117:170305.443 ================================
37950:20140117:170305.450 One child process died (PID: 37961 , exitcode / signal: 65280 ) . Exiting ...
37950:20140117:170307.468 syncing history data ...
37950:20140117:170307.469 syncing history data done
37950:20140117:170307.469 syncing trends data ...
37950:20140117:170307.472 syncing trends data done
37950:20140117:170307.473 Zabbix Server stopped. Zabbix 2.2.1 (revision 40808 ) .
P.S. FreeBSD Zabbix 9.2-RELEASE FreeBSD 9.2-RELEASE # 0 r255898: Thu Sep 26 22:50:31 UTC 2013 root @ bak
e.isc.freebsd.org :/ usr / obj / usr / src / sys / GENERIC amd64
The crash is fixed in development branch svn://svn.zabbix.com/branches/dev/ZBX-7608
Released in:
pre-2.2.2rc1 r41969
pre-2.3.0 r41970
This seems to have also fixed ZBX-7522.