Logging ELK Stack Installation

Owned by Michael O'Brien
Last updated: Sept 14, 2017
2 min read

This page details various ways of getting the Logging ELK stack up in ONAP

OOM - Out of the Box

Recommended

Install OOM - via ONAP on Kubernetes

# in oneclick dir ./createAll -n onap -a log onap-log elasticsearch-2934588800-4nlw2 1/1 Running 0 58m onap-log kibana-3372627750-23gpz 1/1 Running 0 58m onap-log logstash-1708188010-q0zgn 1/1 Running 0 58m



Standalone ELK stack

Docker Compose

(will not work with OOM/Rancher because we need the 1.12 version of docker.

Manual Installation

WIP





5601/app/kibana

248  cd /opt

  249  ls

  250  wget https://artifacts.elastic.co/downloads/logstash/logstash-5.4.3.deb

  251  curl https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-5.4.3.deb

  252  wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-5.4.3.deb

  253  wget https://artifacts.elastic.co/downloads/kibana/kibana-5.4.3-amd64.deb

  254  ls

  255  ls -la

  256  history

  257  sha1sum elasticsearch-5.5.2.deb

  258  ls

  259  sha1sum elasticsearch-5.4.3.deb

  260  sudo dpkg -i elasticsearch-5.4.3.deb

  261  vi /etc/elasticsearch/elasticsearch.yml 

  262  systemctl start elasticsearch

  263  systemctl status elasticsearch

  264  vi /etc/elasticsearch/elasticsearch.yml 

  265  ls /var/lib/elasticsearch/

  266  ls /var/log/elasticsearch/

  267  systemctl status elasticsearch

  268  systemctl stop elasticsearch

  269  systemctl start elasticsearch

  270  systemctl status elasticsearch

  271  systemctl status elasticsearch.service

  272  sudo journalctl -f

  273  java -version

  274  sudo apt-get install oracle-java8-installer

  275  sudo apt-get install default-jdk

  276  java -version

  277  systemctl start elasticsearch

  278  systemctl status elasticsearch

  279  curl localhost:9200

  280  history

  281  dir

  282  sha1sum logstash-5.4.3.deb

  283  sudo dpkg -i logstash-5.4.3.deb

  284  vi /etc/logstash/logstash.yml 

  285  ls /home/ubuntu/

  286  cp /home/ubuntu/sdc.conf 

  287  cp /home/ubuntu/sdc.conf .

  288  ls

  289  cd /etc/logstash/conf.d/

  290  cp /opt/sdc.conf .

  291  ls

  292  cd /opt

  293  systemclt start logstash

  294  systemctl start logstash

  295  systemctl status logstash

  296  curl localhost:9200/_cat/indices?v

  297  sha1sum kibana-5.4.3.deb

  298  ls

  299  sha1sum kibana-5.4.3-amd64.deb 

  300  sudo dpkg -i kibana-5.4.3-amd64.deb 

  301  vi /etc/kibana/kibana.yml 

  302  systemctl start kibana.service

  303  systemctl status kibana.service

  304  kubectl get pods --all-namespaces

  

root@ip-172-31-93-122:/opt# cd /etc/logstash/conf.d/



root@ip-172-31-93-122:/etc/logstash/conf.d# cp /opt/sdc.conf .

root@ip-172-31-93-122:/etc/logstash/conf.d# ls

sdc.conf

root@ip-172-31-93-122:/etc/logstash/conf.d# cd /opt

root@ip-172-31-93-122:/opt# systemclt start logstash

No command 'systemclt' found, did you mean:

Command 'systemctl' from package 'systemd' (main)

systemclt: command not found

root@ip-172-31-93-122:/opt# systemctl start logstash

root@ip-172-31-93-122:/opt# systemctl status logstash

logstash.service - logstash

Loaded: loaded (/etc/systemd/system/logstash.service; disabled; vendor preset: enabled)

Active: active (running) since Fri 2017-09-08 14:25:55 UTC; 5s ago

Main PID: 24460 (java)

Tasks: 25

Memory: 234.1M

CPU: 19.880s

CGroup: /system.slice/logstash.service

??24460 /usr/bin/java -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+DisableExplicitGC -Djava.awt.headless=true -Dfile.encoding=UTF-8 -XX:+HeapDu





Sep 08 14:25:55 ip-172-31-93-122 systemd[1]: Started logstash.





root@ip-172-31-93-122:/opt# curl localhost:9200/_cat/indices?v

health status index uuid pri rep docs.count docs.deleted store.size pri.store.size

yellow open logs-sdc-2017.09.08 c2bptrtITYqwJNLgDKgOJQ 5 1 162 0 641.5kb 641.5kb