Agenda

• New committers: @Geora Barsky, @Shane Daniel, @Prudence Au - we are now at 7

• Kubernetes demo of logging demo RI that uses the AOP wrapper of the Java SLF4J library - demo to Dave's team later this week

  • working but will be slightly refactored before merging https://gerrit.onap.org/r/#/c/57171/

  • works with or adjacent to onap deployment - shared k8s namespace, but not shared k8s release - as long as log-ls.onap DNS service entry resolves.

  • documented in ONAP Application Logging Specification v1.2 (Casablanca)#AddingFilebeattoanONAPKubernetesPOD and ONAP Development#DeveloperDeployment

• JIRA Board - https://jira.onap.org/secure/RapidBoard.jspa?rapidView=143&view=planning&selectedIssue=LOG-412&epics=visible

• Clamp, Logging and Pomba syncing on common ELK charts - found filebeat data dir typo (filebeat worked around it) - https://gerrit.onap.org/r/#/c/57225/

• Acumos and ONAP syncing - more next thu

• Sonar 88.7 from 80.7% (previously 90.7%) - build servers were down yesterday - https://sonar.onap.org/dashboard?id=org.onap.logging-analytics%3Alogging-analytics

  • use "run-sonar" to kick it in - verify that there was no hudson timeout - run again if so - https://jenkins.onap.org/view/logging-analytics/job/logging-analytics-sonar/

• logging spec implementation

• Logging Casablanca Scope
  
  

  • (all projects) logging deployment infrastructure integrity - LOG-487: LOG Pipeline Integrity: Docker to Filebeat to Logstash to ElasticSearch to KibanaClosed

  • (all projects) logging messages are in spec and leverage library - LOG-178: Log Specification Alignment - each onap componentClosed

  • security - aaf has just enabled certificate generation -  LOG-409: ELK securityClosed

    • https://lists.onap.org/g/onap-discuss/topic/fw_onap_aaf_now/23778621?p=,,,20,0,0,0::recentpostdate%2Fsticky,,,20,2,0,23778621

Notes

• Use draft reviews if there is any chance there is sensitive non-public content to be able to delete them

• Code coverage example - use eclEmma - to view granular coverage - example https://gerrit.onap.org/r/#/c/57245/5

  • from

  • Open

    

  • to

  • Open

    

• microservice | filebeat | logstash | elasticsearch | kibana pipeline observations

  • emptyDir volumes on the host VM

  • see mapping of container to uuid in kubelet/pods dir - candidate for a filebeat DaemonSet

  • # on one of the cluster vms root@ip-172-31-77-1:/var/lib/kubelet/pods# ls 16712945-8f46-11e8-bbfc-02a1d5a57c25/volumes/kubernetes.io~empty-dir/ onap-logdemonode-data-filebeat onap-logdemonode-logs root@ip-172-31-77-1:/var/lib/kubelet/pods# ls 16712945-8f46-11e8-bbfc-02a1d5a57c25/volumes/kubernetes.io~empty-dir/onap-logdemonode-logs/logdemonode/node/ -la -rw-r--r-- 1 root root 0 Jul 24 13:33 audit.log -rw-r--r-- 1 root root 15462147 Jul 24 14:35 debug.log

  • /var/onap/log volume on the filebeat container required to push logs to logstash

  • ubuntu@ip-172-31-77-1:~/_dev/20180719-log-137/oom/kubernetes$ kubectl exec -it onap-logdemonode-778c6d5dc6-cgdcv -n onap bash -c logdemonode-filebeat-onap bash-4.2$ cd /var/log/onap/logdemonode/node/ bash-4.2$ ls -la -rw-r--r-- 1 root root 0 Jul 24 13:33 audit.log -rw-r--r-- 1 root root 11075611 Jul 24 14:29 debug.log -rw-r--r-- 1 root root 0 Jul 24 13:33 error.log -rw-r--r-- 1 root root 0 Jul 24 13:33 metrics.log 2018-07-24T14:30:12.311Z|| ResponseCode=, InstanceUUID=e1243a81-20fe-4925-9db3-4df82653cee7, RequestID=0c1b6159-b717-4fba-a409-ad17f83fb47e, ServiceName=/logging-demo/rest/health/health, ResponseDescription=, InvocationID=d04bcac2-9a15-4425-bbfd-150b1f937279, Severity=, InvokeTimestamp=2018-07-24T14:30:12.311Z, PartnerName=, ClientIPAddress=10.42.0.1, ServerFQDN=dev.onap.info, StatusCode= EXIT

    
    
    

    
    
    

• notes

  • M2 on Thu

  • weekly pomba meet status - amanda and myself to check

  • ci-management jjb jenkins for https://git.onap.org/logging-analytics/pomba/pomba-audit-common/ dir (and all 6) - see https://gerrit.onap.org/r/#/c/56995/ - Ping Jessica

  • move 2 reviews to draft (both abandonded)