Details

    • Type: Incident report
    • Status: Closed
    • Priority: Critical
    • Resolution: Duplicate
    • Affects Version/s: 3.4.3
    • Fix Version/s: None
    • Component/s: Server (S)
    • Labels:

      Description

      Dear Sirs,

      Please note that since we have upgraded zabbix from 3.2.6 to 3.4.3 , we have experienced an intermittent crash on zabbix server.
      we are solving the problem by restarting the running services.
      the logs shows that there'ss "too many open files", we have increased the open file limit but still crashing, although the files opened are not reaching the cap.

      Below are the logs of the latest crash, please advise if anything can be done to prevent this issue from happening again:

       22626:20171106:072016.091 server #2597 started [icmp pinger #326]
       22625:20171106:072016.091 server #2596 started [icmp pinger #325]
       22630:20171106:072016.091 server #2601 started [icmp pinger #330]
       22647:20171106:072016.092 server #2617 started [icmp pinger #346]
       22601:20171106:072016.092 server #2577 started [icmp pinger #306]
       22639:20171106:072016.092 server #2610 started [icmp pinger #339]
       22636:20171106:072016.094 server #2607 started [icmp pinger #336]
       22656:20171106:072017.059 server #2624 started [preprocessing worker #1]
       22657:20171106:072017.725 server #2625 started [preprocessing worker #2]
       22658:20171106:072017.733 server #2626 started [preprocessing worker #3]
       19062:20171106:072023.712 sending configuration data to proxy "Zabbix Access proxy" at "193.227.188.106", datalen 403791
       19032:20171106:072029.168 sending configuration data to proxy "Zabbix System proxy" at "194.126.19.42", datalen 1678500
       18978:20171106:072040.535 item "Nutanix system:cstControllerVMStatus[0733bc58-aaf7-4beb-8eaa-7e721cdc3749.]" became not supported: snmp_parse_oid(): cannot parse OID "cstControllerVMStatus.2".
      zabbix_server [22654]: failed to open log file: [24] Too many open files
      zabbix_server [22654]: failed to write [cannot accept incoming IPC connection: [24] Too many open files] into log file
       22656:20171106:072046.939 cannot read preprocessing service request
       22657:20171106:072046.939 cannot read preprocessing service request
       22658:20171106:072046.940 cannot read preprocessing service request
       20318:20171106:072046.941 cannot write to IPC socket: Broken pipe
       20176:20171106:072046.941 cannot write to IPC socket: Broken pipe
       20318:20171106:072046.942 cannot send data to preprocessing service
       20176:20171106:072046.942 cannot send data to preprocessing service
       20304:20171106:072046.942 cannot write to IPC socket: Broken pipe
       20304:20171106:072046.942 cannot send data to preprocessing service
       19965:20171106:072046.943 cannot write to IPC socket: Broken pipe
       19965:20171106:072046.943 cannot send data to preprocessing service
       19957:20171106:072046.943 cannot write to IPC socket: Broken pipe
       20316:20171106:072046.943 cannot write to IPC socket: Broken pipe
       19957:20171106:072046.943 cannot send data to preprocessing service
       20316:20171106:072046.943 cannot send data to preprocessing service
       17457:20171106:072046.944 One child process died (PID:22654,exitcode/signal:1). Exiting ...
       19811:20171106:072047.209 cannot write to IPC socket: Broken pipe
       19635:20171106:072047.212 cannot write to IPC socket: Broken pipe
       19614:20171106:072047.212 cannot write to IPC socket: Broken pipe
       20223:20171106:072047.214 cannot write to IPC socket: Broken pipe
       17457:20171106:072048.969 syncing history data...
       17457:20171106:072049.009 syncing history data done
       17457:20171106:072049.009 syncing trend data...
       17457:20171106:072052.278 syncing trend data done
       17457:20171106:072052.278 Zabbix Server stopped. Zabbix 3.4.3 (revision 73588).
      

      Thank you in advance

      Regards,

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                elias_a_h@hotmail.com elias abou hamad
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: