In this post, we configure and visualize Spark metrics (e.g. Executor JVM Heap usage) for Spark application running on Amazon EMR (hereafter, EMR) using InfluxDB and Grafana as follows.

What we will do​

1. Setting up InfluxDB on Amazon EC2
2. Setting up Grafana on Amazon EC2
3. Configuring Spark Metrics
4. Monitoring Spark Application running on EMR