Uploaded image for project: 'ZABBIX BUGS AND ISSUES'
  1. ZABBIX BUGS AND ISSUES
  2. ZBX-3669

Impossible to track Hadoop processes existence because of too long cmd

XMLWordPrintable

    • Icon: Incident report Incident report
    • Resolution: Duplicate
    • Icon: Trivial Trivial
    • None
    • 1.8.4
    • Agent (G)
    • None
    • Debian Lenny 64 bit

      Hello,

      I'm trying to create an item to track existence of Hadoop processes which are running by user 'hadoop' and being a java processes. The item key is proc.num[java,hadoop,,"TaskTracker"]. The TaskTracker process definitely exists but Zabbix cant track it. It seems happens because of some internal 2048-bytes buffer which is used for storing process cmdline.

      This is example cmdline of my process:
      /usr/lib/jvm/java-6-sun/bin/java -Xmx2000m -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/usr/lib/hadoop-0.20/bin/../logs -Dhadoop.log.file=hadoop-hadoop-tasktracker-slave1.magic.iponweb.net.log -Dhadoop.home.dir=/usr/lib/hadoop-0.20/bin/.. -Dhadoop.id.str=hadoop -Dhadoop.root.logger=INFO,DRFA -Djava.library.path=/usr/lib/hadoop-0.20/bin/../lib/native/Linux-amd64-64 -Dhadoop.policy.file=hadoop-policy.xml -classpath /usr/lib/hadoop-0.20/bin/../conf:/usr/lib/jvm/java-6-sun/lib/tools.jar:/usr/lib/hadoop-0.20/bin/..:/usr/lib/hadoop-0.20/bin/../hadoop-0.20.1+169.127-core.jar:/usr/lib/hadoop-0.20/bin/../lib/commons-cli-1.2.jar:/usr/lib/hadoop-0.20/bin/../lib/commons-codec-1.3.jar:/usr/lib/hadoop-0.20/bin/../lib/commons-el-1.0.jar:/usr/lib/hadoop-0.20/bin/../lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop-0.20/bin/../lib/commons-logging-1.0.4.jar:/usr/lib/hadoop-0.20/bin/../lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop-0.20/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hadoop-0.20/bin/../lib/core-3.1.1.jar:/usr/lib/hadoop-0.20/bin/../lib/hadoop-0.20.1+169.127-fairscheduler.jar:/usr/lib/hadoop-0.20/bin/../lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop-0.20/bin/../lib/iponweb-hadoop-lib-1.6.jar:/usr/lib/hadoop-0.20/bin/../lib/jackson-core-asl-1.0.1.jar:/usr/lib/hadoop-0.20/bin/../lib/jackson-mapper-asl-1.0.1.jar:/usr/lib/hadoop-0.20/bin/../lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop-0.20/bin/../lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop-0.20/bin/../lib/jets3t-0.6.1.jar:/usr/lib/hadoop-0.20/bin/../lib/jetty-6.1.14.jar:/usr/lib/hadoop-0.20/bin/../lib/jetty-util-6.1.14.jar:/usr/lib/hadoop-0.20/bin/../lib/junit-4.5.jar:/usr/lib/hadoop-0.20/bin/../lib/kfs-0.2.2.jar:/usr/lib/hadoop-0.20/bin/../lib/log4j-1.2.15.jar:/usr/lib/hadoop-0.20/bin/../lib/mockito-all-1.8.2.jar:/usr/lib/hadoop-0.20/bin/../lib/mysql-connector-java-5.0.8-bin.jar:/usr/lib/hadoop-0.20/bin/../lib/oro-2.0.8.jar:/usr/lib/hadoop-0.20/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop-0.20/bin/../lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop-0.20/bin/../lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop-0.20/bin/../lib/xmlenc-0.52.jar:/usr/lib/hadoop-0.20/bin/../lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop-0.20/bin/../lib/jsp-2.1/jsp-api-2.1.jar org.apache.hadoop.mapred.TaskTracker

      How are you see it is pretty big - 2259 bytes long. If change my item key to something like proc.num[java,hadoop,,"slf4j-api-1.4.3.jar"] it works as it should because the 'slf4j-api-1.4.3.jar' fits into first 2048 bytes.

      May you, please remove this 2048bytes limit by increasing buffer size or some smarter solution?
      Thank you.

            Unassigned Unassigned
            dmusatov Dmitry Musatov
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

              Created:
              Updated:
              Resolved: