-
Type:
Incident report
-
Resolution: Unresolved
-
Priority:
Trivial
-
None
-
Affects Version/s: None
-
Component/s: None
-
None
-
Environment:zabbix-server-mysql:ubuntu-4.4.6
Steps to reproduce:
LLD was working as expected for quite a while. Suddenly, we've noticed that discovery doesn't seem to be working (especially/only for new hosts?). If we restart the zabbix_server daemon, LLD seems to pick up all the missed items/triggers/etc and work again as expected for some period of time.
Result:
This is the only interesting thing I've noticed in the log, though I'm not sure if it's related or not:
zabbix_server [315]: ERROR [file:lld_trigger.c,line:1855] Something impossible has just happened. 315:20200318:203517.232 === Backtrace: === 315:20200318:203517.232 12: /usr/sbin/zabbix_server: lld worker #2 [processed 78 LLD rules, idle 3.808461 sec during 5.317879 sec](zbx_backtrace+0x51) [0x55b764f86f5d] 315:20200318:203517.232 11: /usr/sbin/zabbix_server: lld worker #2 [processed 78 LLD rules, idle 3.808461 sec during 5.317879 sec](+0x141b3c) [0x55b764efbb3c] 315:20200318:203517.233 10: /usr/sbin/zabbix_server: lld worker #2 [processed 78 LLD rules, idle 3.808461 sec during 5.317879 sec](+0x141fad) [0x55b764efbfad] 315:20200318:203517.233 9: /usr/sbin/zabbix_server: lld worker #2 [processed 78 LLD rules, idle 3.808461 sec during 5.317879 sec](lld_update_triggers+0x256) [0x55b764f0017b] 315:20200318:203517.233 8: /usr/sbin/zabbix_server: lld worker #2 [processed 78 LLD rules, idle 3.808461 sec during 5.317879 sec](lld_process_discovery_rule+0x499) [0x55b764ed8dc7] 315:20200318:203517.233 7: /usr/sbin/zabbix_server: lld worker #2 [processed 78 LLD rules, idle 3.808461 sec during 5.317879 sec](+0x11c735) [0x55b764ed6735] 315:20200318:203517.233 6: /usr/sbin/zabbix_server: lld worker #2 [processed 78 LLD rules, idle 3.808461 sec during 5.317879 sec](lld_worker_thread+0x39d) [0x55b764ed6eba] 315:20200318:203517.233 5: /usr/sbin/zabbix_server: lld worker #2 [processed 78 LLD rules, idle 3.808461 sec during 5.317879 sec](zbx_thread_start+0x37) [0x55b764f95281] 315:20200318:203517.233 4: /usr/sbin/zabbix_server: lld worker #2 [processed 78 LLD rules, idle 3.808461 sec during 5.317879 sec](MAIN_ZABBIX_ENTRY+0x107c) [0x55b764dfbcce] 315:20200318:203517.233 3: /usr/sbin/zabbix_server: lld worker #2 [processed 78 LLD rules, idle 3.808461 sec during 5.317879 sec](daemon_start+0x30b) [0x55b764f866b5] 315:20200318:203517.233 2: /usr/sbin/zabbix_server: lld worker #2 [processed 78 LLD rules, idle 3.808461 sec during 5.317879 sec](main+0x335) [0x55b764dfac3c] 315:20200318:203517.233 1: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7f489aa31b97] 315:20200318:203517.233 0: /usr/sbin/zabbix_server: lld worker #2 [processed 78 LLD rules, idle 3.808461 sec during 5.317879 sec](_start+0x2a) [0x55b764df9afa]