Uploaded image for project: 'ZABBIX BUGS AND ISSUES'
  1. ZABBIX BUGS AND ISSUES
  2. ZBX-25821

zabbix-agent2-plugin-nvidia-gpu kills zabbix-agent2

XMLWordPrintable

    • Icon: Problem report Problem report
    • Resolution: Unresolved
    • Icon: Major Major
    • 7.2.3rc1, 7.4.0alpha1 (master)
    • None
    • Agent2 plugin (N)
    • None
    • Ubuntu 24.04.1 LTS noble, x86_64
      zabbix 7.2.1 / MySQL
      5x NVIDIA GeForce RTX 3090 / driver NVIDIA_SMI 565.57.01 / CUDA version 12.7
    • Sprint candidates

      Steps to reproduce:

       

      /etc/zabbix/zabbix_agent2.d/plugins.d/nvidia.conf:
      Plugins.NVIDIA.System.Path=/usr/libexec/zabbix/zabbix-agent2-plugin-nvidia-gpu
      

       

      When zabbix_agent2 is starting, syslog is showing:

       

      2025-01-02T15:41:43.643960+01:00 <hostname> systemd[1]: Started zabbix-agent2.service - Zabbix Agent 2.
      2025-01-02T15:41:46.667783+01:00 <hostname> zabbix_agent2[680498]: 2025/01/02 15:41:46.666613 [NVIDIA] failed to kill plugin /usr/libexec/zabbix/zabbix-agent2-plugin-nvidia-gpu: Failed to kill plugin "/usr/libexec/zabbix/zabbix-agent2-plugin-nvidia-gpu" process: os: process already finished.
      2025-01-02T15:41:46.668043+01:00 <hostname> zabbix_agent2[680498]: zabbix_agent2 [680498]: ERROR: Cannot register plugins: failed to register metrics of plugin "NVIDIA": failed to start plugin: failed to create connection with plugin /usr/libexec/zabbix/zabbix-agent2-plugin-nvidia-gpu: failed to get connection within the time limit 3000000000.
      2025-01-02T15:41:46.671552+01:00 <hostname> systemd[1]: zabbix-agent2.service: Main process exited, code=exited, status=1/FAILURE
      2025-01-02T15:41:46.671761+01:00 <hostname> systemd[1]: zabbix-agent2.service: Failed with result 'exit-code'.
      

       

      Agent then keeps restarting but always fails. 

      Once I comment out the NVIDIA plugin from the nvidia.conf file:

      # Plugins.NVIDIA.System.Path=/usr/libexec/zabbix/zabbix-agent2-plugin-nvidia-gpu

      zabbix_agent2 starts normally. 

            sjurgensons Stanislavs Jurgensons
            rvorsten Ronald Vorstenbosch
            Team INT
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated: