[ZBX-6590] Improve doc regarding different data limits in zabbix Created: 2013 May 09 Updated: 2018 Oct 09 Resolved: 2018 Feb 10 |
|
Status: | Closed |
Project: | ZABBIX BUGS AND ISSUES |
Component/s: | Documentation (D) |
Affects Version/s: | None |
Fix Version/s: | 4.0 (plan) |
Type: | Documentation task | Priority: | Minor |
Reporter: | Oleksii Zagorskyi | Assignee: | Viktors Tjarve |
Resolution: | Fixed | Votes: | 2 |
Labels: | limits | ||
Remaining Estimate: | Not Specified | ||
Time Spent: | Not Specified | ||
Original Estimate: | Not Specified |
Issue Links: |
|
||||||||
Sprint: | Sprint 27 | ||||||||
Story Points: | 0 |
Description |
From https://www.zabbix.com/documentation/2.0/manual/introduction/whatsnew205 I believe it should be reflected also on https://www.zabbix.com/documentation/2.0/manual/config/items/userparameters Also, seems system.run[] key also has this limit -> should be reflected on https://www.zabbix.com/documentation/2.0/manual/config/items/itemtypes/zabbix_agent # zabbix_get -s localhost -k agent.version 2.0.7rc1 # ./zabbix_agentd20 -V Zabbix Agent (daemon) v2.0.7rc1 (revision 35520) (22 April 2013) Compilation time: May 9 2013 11:26:28 # ls -l /tmp/512* -rw-rw-r-- 1 zabbix zabbix 524287 May 9 11:56 /tmp/512K-1B.log -rw-rw-r-- 1 zabbix zabbix 524289 May 9 11:54 /tmp/512K+1B.log -rw-rw-r-- 1 zabbix zabbix 524288 May 9 11:54 /tmp/512K.log # zabbix_get -s localhost -k system.run["cat /tmp/512K-1B.log"] | wc -c 524287 # zabbix_get -s localhost -k system.run["cat /tmp/512K+1B.log"] | wc -c 17 # zabbix_get -s localhost -k system.run["cat /tmp/512K.log"] | wc -c 17 just in case: # zabbix_get -s localhost -k vfs.file.contents["/tmp/512K-1B.log"] | wc -c 17 17 bytes - it's "ZBX_NOTSUPPORTED" output: # zabbix_get -s localhost -k system.run["cat /tmp/512K+1B.log"] ZBX_NOTSUPPORTED UserParameter=filecat[*],cat $1 # zabbix_get -s localhost -k filecat["/tmp/512K-1B.log"] | wc -c 524287 # zabbix_get -s localhost -k filecat["/tmp/512K+1B.log"] | wc -c 17 # zabbix_get -s localhost -k filecat["/tmp/512K.log"] | wc -c 17 Also some doc additions discussed in https://support.zabbix.com/browse/ZBX-5383#comment-80376 Could someone add something more ? |
Comments |
Comment by Oleksii Zagorskyi [ 2013 May 09 ] |
Looks like the limit for system.run[] also increased in 2.0.5 version: But would be good to get a C dev confirmation. Probably it also (the increasing) worth to mention on the page https://www.zabbix.com/documentation/2.0/manual/config/items/itemtypes/zabbix_agent |
Comment by Oleksii Zagorskyi [ 2013 May 09 ] |
(1) Interesting note, at least for mysql backend - http://dev.mysql.com/doc/refman/5.5/en/storage-requirements.html In DB schema we use TEXT type for "value" column, so we cannot store more than 64K in history_text, history_log tables. Are values truncating before store in to DB ? asaveljevs See also martins-v Text data limits depending on DB type are documented for 3.0, 3.4, 4.0. RESOLVED zalex_ua CLOSED |
Comment by Andris Mednis [ 2013 May 13 ] |
"system.run[]" executes the specified command and intercepts its standard output. The output is processed as a text. The output size limit is 64 kB (up to version 2.0.4) and 512 KB (starting from version 2.0.5 and in trunk) and includes trailing whitespace. Trailing whitespace is truncated. If the command output is not text but binary data containing NULL bytes the results are unpredictable. martins-v Details about the output size limit and required text format added to system.run[] description: https://www.zabbix.com/documentation/2.0/manual/config/items/itemtypes/zabbix_agent Please review. andris If "system.run[]" command output exceeds 512 KB (actually, 524288 - 1 byte)(v.2.0.5 and in trunk) ZBX_NOTSUPPORTED is returned. zalex_ua Looks good. Probably CLOSED. |
Comment by Rick Montez [ 2013 May 13 ] |
Thanks Oleksiy & Martins, I guess we would then need to upgrade to 2.0.5. We currently have for Zabbix server: As for clients/agents we have some that appear to be running: On Solaris: Zabbix Agent (daemon) v2.0.0 (revision 27675) (21 May 2012) On Linux some have servers have: Examples:
Any words of wisdom on downloading/upgrading to the most current stable version of Zabbix? We'll start reading the documentation. Thanks again. Rick M. |
Comment by Oleksii Zagorskyi [ 2013 May 14 ] |
Issue resolved, except (1) and (2) |
Comment by Oleksii Zagorskyi [ 2013 Jul 25 ] |
(2) details from Similar discussion (odbc related) is martins-v Data limits for low-level discovery documented for 3.0, 3.4, 4.0. RESOLVED zalex_ua CLOSED |
Comment by viktorkho [ 2014 Dec 05 ] |
SPECIAL CASE Seems to be actual for any agent's userparameter, including LLD: # /usr/local/bin/my-lld-script | wc -c 3218151 # zabbix_get -s localhost -k my-lld-key ZBX_NOTSUPPORTED #tail /var/log/zabbix/zabbix_agentd.log Traceback (most recent call last): File "/usr/local/bin/scu-lld-triggers", line 89, in <module> print dumps(out_data, ensure_ascii=False).encode('utf8') IOError: [Errno 32] Broken pipe 53710:20141205:162332.827 command output exceeded limit of 512 KB # zabbix_agent --version Zabbix agent v2.2.6 (revision 48483) (27 August 2014) Compilation time: Aug 28 2014 10:11:26 But, if agent's userparameter implements LLD - not all of returned data will be stored in one cell of backend db, isn't it? |
Comment by Glebs Ivanovskis (Inactive) [ 2016 Aug 04 ] |
Dear viktorkho and all those who is interested! LLD rule result is not stored in DB, but is processed by the server "on the fly", so there is no limitation for the full size of LLD data if it comes to server directly. If it comes through proxy, it must be stored in proxy's DB and it will be truncated in the process (mildly to 64 Kchars or vigorously to 2048 bytes depending on proxy's backend). But it seems there is a limitation on LLD data line which should not be longer than 64 KB. |