Version:
# zabbix_server -V zabbix_server (Zabbix) 3.4.15
Conf:
LogFile=/var/log/zabbix/zabbix_server.log LogFileSize=100 PidFile=/var/run/zabbix/zabbix_server.pid SocketDir=/var/run/zabbix DBHost=localhost DBName=zabbix DBUser=zabbix DBPassword=zabbix VMwareCacheSize=512M SNMPTrapperFile=/var/log/snmptrap/snmptrap.log HousekeepingFrequency=1 MaxHousekeeperDelete=5000 CacheSize=1350M StartDBSyncers=4 HistoryCacheSize=36M HistoryIndexCacheSize=8M TrendCacheSize=38M ValueCacheSize=512M Timeout=4 AlertScriptsPath=/usr/lib/zabbix/alertscripts ExternalScripts=/usr/lib/zabbix/externalscripts LogSlowQueries=3000
Error message:
0.00" of type "string" is not suitable for value type "Numeric (float)" 122411:20190116:011858.552 __mem_malloc: skipped 2 asked 1699264 skip_min 441992 skip_max 965152 122411:20190116:011858.552 [file:dbcache.c,line:2800] zbx_mem_realloc(): out of memory (requested 1699264 bytes) 122411:20190116:011858.552 [file:dbcache.c,line:2800] zbx_mem_realloc(): please increase HistoryIndexCacheSize configuration parameter 122411:20190116:011858.552 === memory statistics for history index cache === 122411:20190116:011858.552 free chunks of size >= 256 bytes: 2 122411:20190116:011858.552 min chunk size: 441992 bytes 122411:20190116:011858.552 max chunk size: 965152 bytes 122411:20190116:011858.552 memory of total size 8388208 bytes fragmented into 74810 chunks 122411:20190116:011858.552 of those, 1407144 bytes are in 2 free chunks 122411:20190116:011858.552 of those, 5784120 bytes are in 74808 used chunks 122411:20190116:011858.552 ================================ 122411:20190116:011858.552 === Backtrace: === 122411:20190116:011858.553 20: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](zbx_backtrace+0x35) [0x560f38c16889] 122411:20190116:011858.553 19: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](__zbx_mem_realloc+0x14d) [0x560f38c12909] 122411:20190116:011858.553 18: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](+0xb857e) [0x560f38be557e] 122411:20190116:011858.553 17: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](+0xeb6ba) [0x560f38c186ba] 122411:20190116:011858.553 16: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](zbx_binary_heap_insert+0x69) [0x560f38c18c00] 122411:20190116:011858.553 15: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](+0xb87e5) [0x560f38be57e5] 122411:20190116:011858.553 14: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](+0xb8e7b) [0x560f38be5e7b] 122411:20190116:011858.553 13: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](dc_flush_history+0x47) [0x560f38be54b5] 122411:20190116:011858.553 12: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](+0xb79e0) [0x560f38be49e0] 122411:20190116:011858.553 11: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](+0xb7c0c) [0x560f38be4c0c] 122411:20190116:011858.553 10: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](dc_add_history+0x2a5) [0x560f38be53df] 122411:20190116:011858.553 9: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](+0x8ba6d) [0x560f38bb8a6d] 122411:20190116:011858.553 8: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](+0x8baca) [0x560f38bb8aca] 122411:20190116:011858.553 7: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](+0x8d4ee) [0x560f38bba4ee] 122411:20190116:011858.553 6: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](preprocessing_manager_thread+0x3bc) [0x560f38bbabd8] 122411:20190116:011858.553 5: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](zbx_thread_start+0x37) [0x560f38c23e1d] 122411:20190116:011858.553 4: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](MAIN_ZABBIX_ENTRY+0xc41) [0x560f38b6dbce] 122411:20190116:011858.553 3: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](daemon_start+0x325) [0x560f38c160d6] 122411:20190116:011858.553 2: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](main+0x312) [0x560f38b6cf8b] 122411:20190116:011858.553 1: /lib64/libc.so.6(__libc_start_main+0xf5) [0x7fa19d7b33d5] 122411:20190116:011858.554 0: /usr/sbin/zabbix_server: preprocessing manager #1 [queued 253, processed 32357 values, idle 4.759866 sec during 5.029157 sec](+0x346a9) [0x560f38b616a9] 122412:20190116:011858.560 cannot read preprocessing service request 122414:20190116:011858.560 cannot read preprocessing service request 122413:20190116:011858.560 cannot read preprocessing service request 122368:20190116:011858.560 One child process died (PID:122411,exitcode/signal:1). Exiting ...
If i change the HistoryIndexValue to 512M, zabbix is sending agent not reachable alert via mail.
And other problem is old agent ping alerts are not getting cleared please find the attachment for your kind reference