Announcement

Collapse
No announcement yet.

Calculate memory & CPU for applications in HDInsight

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

  • Calculate memory & CPU for applications in HDInsight

    My client is using HDInsight as their Big Data platform and as part of on-going system administration needs to record total memory and CPU consumption of various applications run through Spark. As the HDInsight product configuration and offering is slightly different, YARN does not contain the Job Tracker UI.

    Is there any way to capture memory and CPU? Is there a log that is maintained that can be leveraged to extract the information out?

    The cluster type and HDInsight version is Spark on Linux (HDI 3.4.1000.0)
Working...
X