Problem

'Latest data' view does not load after upgrade from 4.4.7 to 5.0.2 with database server load going from 0.03 (only writes from Zabbix server) to 6.00+ after clicking 'latest data' link - seems to be long-running SELECT query on database

After some troubleshooting, seems to be caused by 2 things:

1. Search filter limit initially set to 1000 in 4.4.7 environment (worked perfectly fine)
2. New 'latest data' link on Monitoring > Hosts page

Steps below are taken after setting search filter limit to 100 and setting query timeout on database server to 60 seconds

Steps to reproduce:

1. Go to https://zabbix/zabbix.php?action=lat...w&filter_rst=1 - loads almost instantly
2. Go to some other page (configuration > host groups)
3. Go to monitoring > latest data - loads almost instantly
4. Within this view, filter for 1 host (no other filters), click apply - loads almost instantly
5. Go to some other page (configuration > host groups)
6. Go back to monitoring > latest data - loads almost instantly with the last known filters applied
7. Go to monitoring > hosts
8. Click 'latest data' for a host - starts loading, database load goes up, page never loads (backend timeout)
9. Now go to monitoring > latest data - same problem, doesn't load (+ database load)
10. Go again to the filter_rst link, works fine again as long as you don't go through monitoring > hosts or increase the system limit for search results

Result:

Database query timeout when clicking 'latest data' in Hosts overview:

Example of failing query:

SELECT itemid FROM history_uint WHERE itemid IN (113506,113507,113508,113510,113511,116959,116960,116961,116962,116963,116964,116965,116966,116967,116968,116969,116970,116971,116972,116973,116974,116975,116976,116977,116978,116979,116980,116981,116982,116983,116984,116985,116986,116987,116988,116989,116990,116991,116992,116993,116994,116995,116996,116997,116998,116999,117000,117001,117002,117003,117004,117005,117006,117007,117008,117009,117010,117011,117012,117013,117014,117015,117016,117017,117018,117019,117020,117021,117022,117023,117024,117025,117026,117027,117028,117029,117030,117031,117032,117033,117034,117035,117036,117037,117038,117039,117040,117041,117042,117043,117044,117045,117046,117047,117048,117049,117050,117051,117052,117053,117054,117055,117056,117057,117058,117059,117060,117061,117062,117063,117064,117065,117066,117067,117068,117069,117070,117071,117072,117073,117074,117075,117076,117077,117078,117079,117080,117081,117082,117083,117084,117085,117086,117087,117088,117089,117090,117091,117092,117093,117094,117095,117096,117097,117098,117099,117100,117101,117102,117103,117104,117105,117106,117107,117108,117109,117110,117111,117112,117113,117114,117115,117116,117117,117118,117119,117120,117121,117122,117123,117124,117125,117126,117127,117128,117129,117130,117131,117132,117133,117134,117135,117136,117137,117138,117139,117140,117141,117142,117143,117144,117145,117146,117147,117148,117149,117150,117151,117152,117153,117154,117155,117156,117157,117158,117159,117160,117161,117162,117163,117164,117165,117166,117167,117168,117169,117170,117171,117172,117173,117174,117175,117176,117177,117178,117179,117180,117181,117182,117183,117184,117185,117186,117187,117188,117189,117190,117191,117192,117193,117194,117195,117196,117197,117198,117199,117200,117201,117202,117203,117204,117205,117206,117207,117208,117209,117210,117211,117212,117213,117214,117215,117216,117217,117218,117219,117220,117221,117222,117223,117224,117225,117226,117227,117228,117229,117230,117231,117232,117233,117234,117235,117236,117237,117238,117239,117240,117241,117242,117243,117244,117245,117246,117247,117248,117249,117250,117251,117252,117253,117254,117255,117256,117257,117258,117259,117260,117261,117262,117263,117264,117265,117266,117267,117268,117269,117270,117271,117272,117273,117274,117275,117276,117277,117278,117279,117280,117281,117282,117283,117284,117285,117286,117287,117288,117289,117290,117291,117292,117293,117294,117295,117296,117297,117298,117299,117300,117301,117302,117303,117304,117305,117306,117307,117308,117309,117310,117311,117312,117313,117314,117315,117316,117317,117318,117319,117320,117321,117322,117323,117324,117325,117326,117327,117328,117329,117330,117331,117332,117333,117334,117335,117336,117337,117338,117339,117340,117341,117342,117343,117344,117345,117346,117347,117348,117349,117350,117351,117352,117353,117354,117355,117356,117357,117358,117359,117360,117361,117362,117363,117364,117365,117366,117367,117368,117369,117370,117371,117372,117373,117374,117375,117376,117377,117378,117379,117380,117381,117382,117383,117384,117385,117386,117387,117388,117389,117390,117391,117392,117393,117394,117395,117396,117397,117398,117399,117400,117401,117402,117403,117404,117405,117406,117407,117408,117409,117410,117411,117412,117413,117414,117415,117416,117417,117418,117419,117420,117421,117422,117423,117424,117425,117426,117427,117428,117429,117430,117431,117432,117433,117434,117435,117436,117437,117438,117439,117440,117441,117442,117443,117444,117445,117446,117447,117448,117449,117450,117451,117452,117453,117454,117455,117456,123990,124006,124153,124161,124169,124564,124565,124567,124568,125129,125145,125153,125185,125193,125217,125225,125233,125433,125434,125435,125436,125437,125438,125439,125440,125441,125442,125443,125444,125445,125446,125766,125767) GROUP BY itemid HAVING MAX(clock)>1594655454

Other observation:

• Filtering for host via Monitoring > Latest data generates this link:

  https://zabbix/zabbix.php?action=latest.view&filter_hostids%5B%5D=10597&filter_application=&filter_select=&filter_show_without_data=1&filter_set=1

• Clicking 'latest data' for same host in Monitoring > Hosts generates this link (notice the extra 0 in the filter_hostids parameter):

  https://zabbix/zabbix.php?action=latest.view&filter_set=1&filter_hostids%5B0%5D=10597

Expected:

• Normal and responsive 'latest data' loading via both general and hosts views
• Working 'latest data' page with global search limit set to 1000 instead of 100