ONAP Kubernetes Usage with Grafana/Influxdb

The purpose of this is to measure the load that a complete ONAP platform puts on a Kubernetes multi-node cluster orchestrated and deployed by a Rancher instance. Due to the nature of the deployment in an OOM-based ONAP platform which uses HELM for deployment, it is useful to have a standard set of initial resource requirements so that we know how much should be initially allocated for the Kubernetes node availability so as to not bring the cluster to a failure state due to resource availability concerns.

Rancher’s default Kubernetes template provides three components that have been used here to measure metrics. All of them run on pods within the Kubernetes cluster so the cluster itself can control it:

• Heapster: This is a component that collects metrics and events from all the Kubernetes nodes. It is designed to be modular in a way that multiple backends are supported, such as InfluxDB (used here), Kakfa, ElasticSearch, Google Cloud Monitoring, etc.
  
  
• InfluxDB: This is the backend component that Heapster uses to store the collected metric data (i.e. Heapster’s Sink). It is a time-series database that can be queried by many visualization GUIs, including Grafana and Kibana.
  
  
• Grafana: This is the frontend component that queries InfluxDB to obtain the metrics collected by Heapster. It can contain many dashboards broken up into panels that can be customized to show all types of data provided by the backend data source.

In order to run these measurements, the following was applied:

• An 11-node Kubernetes cluster (as currently being tested by the Integration team) is suggested to deploy a complete ONAP platform
  • Docker version 17.03.2
  • Kubernetes version 1.8.10
    
    
• A single Rancher instance (v1.6.14)
  • Docker version 17.03.2
    
    
• The VM flavor for each of these VMs is OpenStack standard flavor “m1.xlarge” which is equivalent to 8 vCPUs, 16 GB RAM, 160 GB HDD
  
  
• ONAP "Beijing" Release (Complete, with all components enabled as part of the HELM chart deployment). Gerrit branch "BEIJING"

By using the components to measure resource usage (Heapster), store into a backend component (InfluxDB), and visualizing the data into a frontend (Grafana), the following relevant metrics were collected. NOTE: These metrics are from a complete ONAP instance as broken down into HELM chart components like in the Global/Master values.yaml, where all of these components are at an idle state.

OVERALL CLUSTER - CPU USAGE

OVERALL CLUSTER - FILESYSTEM USAGE

OVERALL CLUSTER - MEMORY (RAM) USAGE

OVERALL CLUSTER - NETWORK USAGE

RESOURCE USAGE CHART