Zabbix Performance (history syncer 100%)

XMLWordPrintable

    • Type: Problem report
    • Resolution: Commercial support required
    • Priority: Critical
    • None
    • Affects Version/s: None
    • Component/s: Proxy (P), Server (S)
    • None

      Since November 2018 we have performance problems with Zabbix 3.4.10.
      Since this time, we made tuning for tcp connections, tuning in the OS (CentOS 6.9), tuning in the MariaDB conf, tuning in the Zabbix Server conf and tuning in the Zabbix Proxies conf.

      The following problem remains:

      2 times a day (5:22 p.m. and 8:22 p.m., we have different hours in the past) History Syncer reaches 100% and proxies become "NoDataProcessing".
      While history syncer is at 100% several "NoData" alarms start to appear.
      To recover, we stop the 2 major proxies, restart the server and raise the 2 proxies with a time interval.

      Number of hosts 6679
      Number of items 732813
      Number of triggers 358638
      Required server performance, new values per second 2695.54

      Hardwares (VM):

      • Server:
        CPU: 4 CPU
        Memory: 24GB
      • Database (Ver 15.1 Distrib 10.3.4-MariaDB, for Linux (x86_64) using readline 5.1):
        CPU: 8 CPUs
        Memory: 64GB
        Disk: SSD

      Infrastructure:

      1 Zabbix Server version 3.4.10 (lx-all-mon-zserver-01)
      1 Database Ver 15.1 Distrib 10.3.4-MariaDB (lx-all-mon-zdb-03)
      6 proxies for machines
      1 proxy for Databases monitoring
      1 proxy for webchecks

       

      Attachments:

      Server, proxies and database configurations.
      Server and database graphics

        1. database_12h.jpg
          126 kB
          webbix
        2. kl-apac-mon-zproxy-01.txt
          13 kB
          webbix
        3. lx-all-mon-zdb-03.txt
          1 kB
          webbix
        4. lx-all-mon-zproxy-01.txt
          17 kB
          webbix
        5. lx-all-mon-zserver-01.txt
          16 kB
          webbix
        6. lx-bra-mon-zproxy-01.txt
          13 kB
          webbix
        7. lx-db-mon-app-02.txt
          18 kB
          webbix
        8. lx-emea-mon-zproxy-01.txt
          17 kB
          webbix
        9. lx-hq-mon-zproxy-01.txt
          13 kB
          webbix
        10. lx-lat-mon-zpx-01.txt
          17 kB
          webbix
        11. singapore-vpstimwe.txt
          0.9 kB
          webbix
        12. zabbix_cache_1d.jpg
          123 kB
          webbix
        13. zabbix_cache_3d.jpg
          133 kB
          webbix
        14. zabbix_history_syncer_1d.jpg
          92 kB
          webbix
        15. zabbix_history_syncer_3d.jpg
          97 kB
          webbix
        16. zabbix_internal_process_1d.jpg
          146 kB
          webbix
        17. zabbix_internal_process_3d.jpg
          123 kB
          webbix
        18. zabbix_server_performance_1d.jpg
          88 kB
          webbix
        19. zabbix_server_performance_3d.jpg
          86 kB
          webbix
        20. zabbix_tables.txt
          5 kB
          webbix

            Assignee:
            Unassigned
            Reporter:
            webbix
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: