[ZBX-12047] Zabbix agent cannot obtain information for a log file: no such file or directory Created: 2017 Apr 13  Updated: 2017 May 30  Resolved: 2017 Apr 27

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: Agent (G)
Affects Version/s: 3.0.8
Fix Version/s: None

Type: Incident report Priority: Critical
Reporter: Oleg Ivanivskyi Assignee: Unassigned
Resolution: Cannot Reproduce Votes: 0
Labels: logmonitoring
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Zabbix agent 2.4.8, 3.0.8

Attachments: PNG File example.png    
Issue Links:
Duplicate

 Description   

Zabbix agent reads several log files (e.g. "/var/log/zabbix/zabbix_server.log") and generates these errors. Example:

4366:20170412:100415.780 item "Zabbix server:log[/var/log/zabbix/zabbix_server.log,slow,,,skip,]" became not supported: Cannot obtain information for file "/var/log/zabbix/zabbix_server.log": [2] No such file or directory
4369:20170412:100421.933 item "Zabbix server:log[/var/log/zabbix/zabbix_server.log,slow,,,skip,]" became supported

Please take a look the screenshot for more details.

 Comments   
Comment by richlv [ 2017 Apr 13 ]

you might want to copypaste the messages for better searching

Comment by Vladislavs Sokurenko [ 2017 Apr 13 ]

Does the error happen when log has reached it's maximum size as per configuration file parameter? What if you use logrt key ?

Comment by Oleg Ivanivskyi [ 2017 Apr 14 ]

That Zabbix instance is not so big and it is almost impossible to reach maximum log file size every several minutes. I will double check this.
The "logrt" key has the same issue.

Comment by richlv [ 2017 Apr 14 ]

might be worth checking :

  • for multiple agents with the same hostname
  • syslog and selinux audit log (if applicable) on the target box
  • debuglevel4 for the agent in question
Comment by Oleg Ivanivskyi [ 2017 Apr 14 ]

SElinux is disabled and one agent is installed on the host. Debug example (agent version 2.4.8):

  2645:20170412:123926.824 active checks #1 [processing active checks]
  2645:20170412:123926.824 In process_active_checks() server:'127.0.0.1' port:10051)
  2645:20170412:123926.824 In process_logrt() is_logrt:0 filename:'/var/log/zabbix/zabbix_server.log' lastlogsize:47497859 mtime:0 error_count:0
  2645:20170412:123926.824 In add_logfile() filename:'/var/log/zabbix/zabbix_server.log' mtime:1491989965 size:47498058
  2645:20170412:123926.824 add_logfile() logfiles:0x2262ab0 logfiles_alloc:64
  2645:20170412:123926.824 End of add_logfile()
  2645:20170412:123926.824 setup_old2new: is_same_file(/var/log/zabbix/zabbix_server.log, /var/log/zabbix/zabbix_server.log) = 1
  2645:20170412:123926.824 process_logrt() old file list:
  2645:20170412:123926.824    nr:0 filename:'/var/log/zabbix/zabbix_server.log' mtime:1491989960 size:47497859 processed_size:47497859 seq:1 incomplete:0 dev:64772 ino_hi:0 ino_lo:449 md5size:512 md5buf:908bbcd608dc5ee838b76c7b219d598d
  2645:20170412:123926.824 process_logrt() new file list: (mtime:0 lastlogsize:47497859 start_idx:0)
  2645:20170412:123926.824    nr:0 filename:'/var/log/zabbix/zabbix_server.log' mtime:1491989965 size:47498058 processed_size:47497859 seq:0 incomplete:0 dev:64772 ino_hi:0 ino_lo:449 md5size:512 md5buf:908bbcd608dc5ee838b76c7b219d598d
  2645:20170412:123926.824 In process_log() filename:'/var/log/zabbix/zabbix_server.log' lastlogsize:47497859 mtime:0
  2645:20170412:123926.824 End of process_log() filename:'/var/log/zabbix/zabbix_server.log' lastlogsize:47498058 mtime:0 ret:SUCCEED
  2645:20170412:123926.824 End of process_logrt():SUCCEED error_count:0
  2645:20170412:123926.824 End of process_active_checks()

  2645:20170412:123931.826 active checks #1 [processing active checks]
  2645:20170412:123931.827 In process_active_checks() server:'127.0.0.1' port:10051)
  2645:20170412:123931.827 In process_logrt() is_logrt:0 filename:'/var/log/zabbix/zabbix_server.log' lastlogsize:47498058 mtime:0 error_count:0
  2645:20170412:123931.827 In add_logfile() filename:'/var/log/zabbix/zabbix_server.log' mtime:1491989969 size:47498764
  2645:20170412:123931.827 add_logfile() logfiles:0x2261070 logfiles_alloc:64
  2645:20170412:123931.827 End of add_logfile()
  2645:20170412:123931.827 setup_old2new: is_same_file(/var/log/zabbix/zabbix_server.log, /var/log/zabbix/zabbix_server.log) = 1
  2645:20170412:123931.827 process_logrt() old file list:
  2645:20170412:123931.827    nr:0 filename:'/var/log/zabbix/zabbix_server.log' mtime:1491989965 size:47498058 processed_size:47498058 seq:1 incomplete:0 dev:64772 ino_hi:0 ino_lo:449 md5size:512 md5buf:908bbcd608dc5ee838b76c7b219d598d
  2645:20170412:123931.827 process_logrt() new file list: (mtime:0 lastlogsize:47498058 start_idx:0)
  2645:20170412:123931.827    nr:0 filename:'/var/log/zabbix/zabbix_server.log' mtime:1491989969 size:47498764 processed_size:47498058 seq:0 incomplete:0 dev:64772 ino_hi:0 ino_lo:449 md5size:512 md5buf:908bbcd608dc5ee838b76c7b219d598d
  2645:20170412:123931.827 In process_log() filename:'/var/log/zabbix/zabbix_server.log' lastlogsize:47498058 mtime:0
  2645:20170412:123931.828 End of process_log() filename:'/var/log/zabbix/zabbix_server.log' lastlogsize:47498764 mtime:0 ret:SUCCEED
  2645:20170412:123931.828 End of process_logrt():SUCCEED error_count:0
  2645:20170412:123931.828 End of process_active_checks()

  2645:20170412:123936.830 active checks #1 [processing active checks]
  2645:20170412:123936.830 In process_active_checks() server:'127.0.0.1' port:10051)
  2645:20170412:123936.830 In process_logrt() is_logrt:0 filename:'/var/log/zabbix/zabbix_server.log' lastlogsize:47498764 mtime:0 error_count:0
  2645:20170412:123936.830 In add_logfile() filename:'/var/log/zabbix/zabbix_server.log' mtime:1491989975 size:47499460
  2645:20170412:123936.830 add_logfile() logfiles:0x2262ab0 logfiles_alloc:64
  2645:20170412:123936.830 End of add_logfile()
  2645:20170412:123936.830 setup_old2new: is_same_file(/var/log/zabbix/zabbix_server.log, /var/log/zabbix/zabbix_server.log) = 1
  2645:20170412:123936.830 process_logrt() old file list:
  2645:20170412:123936.830    nr:0 filename:'/var/log/zabbix/zabbix_server.log' mtime:1491989969 size:47498764 processed_size:47498764 seq:1 incomplete:0 dev:64772 ino_hi:0 ino_lo:449 md5size:512 md5buf:908bbcd608dc5ee838b76c7b219d598d
  2645:20170412:123936.830 process_logrt() new file list: (mtime:0 lastlogsize:47498764 start_idx:0)
  2645:20170412:123936.830    nr:0 filename:'/var/log/zabbix/zabbix_server.log' mtime:1491989975 size:47499460 processed_size:47498764 seq:0 incomplete:0 dev:64772 ino_hi:0 ino_lo:449 md5size:512 md5buf:908bbcd608dc5ee838b76c7b219d598d
  2645:20170412:123936.830 In process_log() filename:'/var/log/zabbix/zabbix_server.log' lastlogsize:47498764 mtime:0
  2645:20170412:123936.830 In process_value() key:'Zabbix server:log[/var/log/zabbix/zabbix_server.log,slow,,,skip,]' value:'  4364:20170412:123934.299 item "Zabbix server:log[/var/log/zabbix/zabbix_server.log,slow,,,skip,]" became not supported: Cannot obtain information for file "/var/log/zabbix/zabbix_server.log": [2] No such file or directory'
  2645:20170412:123936.831 In send_buffer() host:'127.0.0.1' port:10051 values:0/100
  2645:20170412:123936.831 End of send_buffer():SUCCEED
  2645:20170412:123936.831 buffer: new element 0
  2645:20170412:123936.831 End of process_value():SUCCEED
  2645:20170412:123936.831 End of process_log() filename:'/var/log/zabbix/zabbix_server.log' lastlogsize:47499460 mtime:0 ret:SUCCEED
  2645:20170412:123936.831 End of process_logrt():SUCCEED error_count:0
  2645:20170412:123936.831 End of process_active_checks()

  2645:20170412:123941.834 In process_active_checks() server:'127.0.0.1' port:10051)
  2645:20170412:123941.834 In process_logrt() is_logrt:0 filename:'/var/log/zabbix/zabbix_server.log' lastlogsize:47499460 mtime:0 error_count:0
  2645:20170412:123941.834 In add_logfile() filename:'/var/log/zabbix/zabbix_server.log' mtime:1491989979 size:47501097
  2645:20170412:123941.834 add_logfile() logfiles:0x2261070 logfiles_alloc:64
  2645:20170412:123941.834 End of add_logfile()
  2645:20170412:123941.834 setup_old2new: is_same_file(/var/log/zabbix/zabbix_server.log, /var/log/zabbix/zabbix_server.log) = 1
  2645:20170412:123941.834 process_logrt() old file list:
  2645:20170412:123941.834    nr:0 filename:'/var/log/zabbix/zabbix_server.log' mtime:1491989975 size:47499460 processed_size:47499460 seq:1 incomplete:0 dev:64772 ino_hi:0 ino_lo:449 md5size:512 md5buf:908bbcd608dc5ee838b76c7b219d598d
  2645:20170412:123941.834 process_logrt() new file list: (mtime:0 lastlogsize:47499460 start_idx:0)
  2645:20170412:123941.834    nr:0 filename:'/var/log/zabbix/zabbix_server.log' mtime:1491989979 size:47501097 processed_size:47499460 seq:0 incomplete:0 dev:64772 ino_hi:0 ino_lo:449 md5size:512 md5buf:908bbcd608dc5ee838b76c7b219d598d
  2645:20170412:123941.834 In process_log() filename:'/var/log/zabbix/zabbix_server.log' lastlogsize:47499460 mtime:0
  2645:20170412:123941.834 In process_value() key:'Zabbix server:log[/var/log/zabbix/zabbix_server.log,slow,,,skip,]' value:'  4369:20170412:123938.982 item "Zabbix server:log[/var/log/zabbix/zabbix_server.log,slow,,,skip,]" became supported'
  2645:20170412:123941.834 In send_buffer() host:'127.0.0.1' port:10051 values:0/100
  2645:20170412:123941.834 End of send_buffer():SUCCEED
  2645:20170412:123941.834 buffer: new element 0
  2645:20170412:123941.835 End of process_value():SUCCEED
  2645:20170412:123941.835 End of process_log() filename:'/var/log/zabbix/zabbix_server.log' lastlogsize:47501097 mtime:0 ret:SUCCEED
  2645:20170412:123941.835 End of process_logrt():SUCCEED error_count:0
  2645:20170412:123941.835 End of process_active_checks()
Comment by Oleksii Zagorskyi [ 2017 Apr 27 ]

Looked to the raw log file, I'm pretty sure there is a duplicated Active agent name in the network, plus monitoring server's log file by the same server daemon - really bad idea. Very easy to catch a loop, debug on server cannot be enabled at all.

I'm closing it as cannot reproduce, pretty sure it will be correct.

Generated at Wed May 21 06:50:57 EEST 2025 using Jira 9.12.4#9120004-sha1:625303b708afdb767e17cb2838290c41888e9ff0.