LOG Meeting Minutes 2019-03-19

LOG Meeting Minutes 2019-03-19

Meeting every 2 weeks at 1100 EST Tue - https://zoom.us/j/519971638 - backup is my https://zoom.us/j/7939937123 next meet on April 2nd

https://lists.onap.org/g/onap-discuss/topics

http://onap-integration.eastus.cloudapp.azure.com:3000/group/onap-integration

https://jira.onap.org/secure/RapidBoard.jspa?rapidView=143&view=planning.nodetail&epics=visible

Attendees

Dave Williamson  , Michael O'Brien ,  Lorraine A. Welch

15 min

Agenda

  • Meetings every 2 weeks now 

  • M3 passed 

  • Will fill in our state in Dublin Risks - especially our lack of resources available currently

  • Try to get some metric tie in - have been asked a couple times about non-application logs and metrics

  • Need to finish spec example

  • Review last week LOG Meeting Minutes 2019-03-05

  • Fix committer list

  • Had to delete our large CMR cluster on openlab to free up 224G for the integration team - will address OOM resources tomorrow

  • OOM meet tomorrow (Mike back on the 25th) - OOM Meeting Notes - 2019-03-20

  • Lorraine A. Welch setting up fluentd instance - nice

  • Michael O'Brien will try to key back pv/pvc work done internally to LOG persistence/rotation - including work from Lorraine A. Welch

 

Items

 

PRI

Title

Responsible

Status

OPEN

DONE

In Dublin

Last Worked on

Start

Notes

PRI

Title

Responsible

Status

OPEN

DONE

In Dublin

Last Worked on

Start

Notes

 

Security Vulnerability template

Michael O'Brien

Ongoing

IN

 

20190122

 

 

M1 template

Michael O'Brien

Prudence Au

DONE

IN

20190124

20190122

 

 

ONS NA 2019 April Talk proposal

Michael O'Brien

DONE

IN

 

20190122

pending 20190208 decision

https://lf-onap.atlassian.net/browse/LOG-947

 

Use manifest generation over raw oom values.yaml docker image tag names

Michael O'Brien

DONE

IN

20190124

20190117

pending documentation in RTD

Team,

    In the TSC it was decided to treat the diff between oom and the manifest by always running the manifest generated yaml in your deployments – you will not need to do this for master work – just for Casablanca and RC0-2 work

 

Working out the details in

https://jira.onap.org/browse/LOG-929

 https://onap.readthedocs.io/en/casablanca/submodules/integration.git/docs/index.html?highlight=manifest

/michael

 

S3P Logging compliance TSC/PTL

Michael O'Brien

IN PROGRESS

IN

20190115

20190114

PTL 2019-01-14

Log Streaming Compliance and API

discussed at last PTL meet with Jason Hunt

 

 

El-Alto 1.4 logging spec change - plan only

 

todo merge with Dave's below

Michael O'Brien

Dave Williamson

IN PROGRESS

IN

20190122

 

 

 

Dublin Scope Planning

 

Michael O'Brien

DONE

IN

20190124

 

https://lf-onap.atlassian.net/browse/LOG-707

Logging Dublin M1 Release Planning

 

RTD documentation

Michael O'Brien

OPEN

IN

20180129

 

Attending Thu 1130-1230 meets

 

restart log4j format and files

example

Michael O'Brien

IN PROGRESS

IN

201901115

20190108

https://gerrit.onap.org/r/#/c/62405/

for https://lf-onap.atlassian.net/browse/LOG-630

and

https://lf-onap.atlassian.net/browse/LOG-178

Log Streaming Compliance and API#DeploymentProfiles

 

Work with portal/sdk library

Michael O'Brien

IN PROGRESS

IN

20190129

20190115

Update: 20190129 - Existing eclipse environ for the RI being retrofitted

At the pom stage bringing in the jar via

portal/sdk in use by aai, dmaap, sdk, vid (vid link into so maybe?)

<groupId>org.onap.portal.sdk</groupId>

epic

https://lf-onap.atlassian.net/browse/LOG-600

Jira

https://lf-onap.atlassian.net/browse/PORTAL-348

review investigation in

Logging Developer Guide

Log Streaming Compliance and API#ExistingLibraryResearch\

Luke Parker discussion

need to use the portal library in an initiating project for tx processing

working likely with the SO team - via the work we are doing for them in https://gerrit.onap.org/r/#/c/69947/

(check the original spec - ODL specific - check appc/sdnc use of ccsdk)

 

 

 

 

New Committers

 

OPEN

 

20190115

 

We have room for 2-5 committers and will be reviewing the list

Logging Enhancements Project Proposal#KeyProjectFacts

add your details to

Logging Committer Promotion Requests

20190129 status - waiting on contributor documentation from each contributor

 

OPNFV/ONAP Paris

 

DONE

 

20190108

 

https://ddfplugfest19.sched.com/ Tue-Thu

Clover Gambia on prior https://zoom.us/j/115579117 - 7 hours ahead

https://ddfplugfest19.sched.com/event/K1Gy/opnfv-clover-utilizing-cloud-native-technologies-for-nfv

 

Security badging

Michael O'Brien

IN PROGRESS

IN

20190129

 

Need to restart this

 

Security Vulnerabilities

Michael O'Brien

Prudence Au

IN PROGRESS

IN

20190129

 

lower - but for M4

 

s3p Secure https endpoints

LOG + POMBA

for Jason Hunt

OPEN

IN

 

 

Discussion on whether we need to lock down the nodeport exposed ports

Can key off POMBA work already done

todo: get s3p page

 

Format compliance - working with AAI team

+ perf

Michael O'Brien

IN PROGRESS

IN

20190115

20181101

20190115 - casablanca cherry pick in queue logstack 5 to 3 and 1

https://gerrit.onap.org/r/#/c/75702/

(+) 20190109
from aai team
https://lf-onap.atlassian.net/wiki/display/DW/2019-01-17+AAI+Developers+Meeting+Open+Agenda
"hector has discovered that the stress test jar (liveness probe?) in aai-cassandra is hammering the cpu/ram/hd on the vm that aai is on - this breaks the etcd cluster (not the latency/network issues we suspected that may cause pod rescheduling) "

 

#6 on 2018-12-20 AAI Developers Meeting around https://lf-onap.atlassian.net/browse/LOG-376

Discussion with @Sanjay Agraharam and [~pau2882] on checking how cassandra is running on the vm and if debug levels are on should be verified

use labelling to split aai-cs and ls - no DaemonSet

Michael O'Brien to reduce core count for ls to 1 from 3

https://lf-onap.atlassian.net/browse/LOG-915

edited 2019-01-10 AAI Developers Meeting

for the 10th

 

AAI team - 2 types of logging AOP/non-AOP

 

OPEN

IN

 

20181101

#22 on 2018-12-20 AAI Developers Meeting

 

Logging requests from Vendors

 

OPEN

 

 

 

https://lf-onap.atlassian.net/browse/LOG-877

https://lf-onap.atlassian.net/browse/LOG-876

#15,19 and 37 on SP priorities for Dublin

 

LOG Streaming compliance

 

IN PROGRESS

IN

 

 

Log Streaming Compliance and API

https://lf-onap.atlassian.net/browse/LOG-487

https://lf-onap.atlassian.net/browse/LOG-487

https://lf-onap.atlassian.net/browse/LOG-852

and

PTL 2019-01-14

 

opentracing via

https://opentracing.io/

 

 

IN (planning/POC for sure)

20190123

 

@Sanjay

discuss integration - out of band processing - https://lf-onap.atlassian.net/browse/LOG-104

see zipkin arch https://zipkin.io/pages/architecture.html

possibly tie both as a client of es ?

Tie in to ONS NA 2019 April demo booth for LF

https://lists.onap.org/g/onap-discuss/message/15066?p=,,,20,0,0,0::Created,,opentracing,20,2,0,22460823

 

discussion - remove

 

 

 

20190108

 

discuss tick/tock logging spec behaviour - cassablanca implemented in dublin, dublin implemented in elalto

 

Log Checker

Cheuk Yiu Horace Ip

Lee Breslau

 

OUT

20190109

 

MIke to review with Horace

 

Search Guard

Michael O'Brien

OPEN

Maybe

20180109

 

https://lf-onap.atlassian.net/browse/LOG-494

 

spec changes for Dublin

Dave Williamson

 

IN (planning)

20190109

20190109

Dublin spec changes for Elalto

environment name

release name

check mail for reply Michael O'Brien

Prudence Au proposal of renaming the log file name itself for the release ie: 3.0.0-ONAP - will discuss later for next week

 

 

Cluster logging behaviour

S3P

Dave Williamson

Michael O'Brien

Prudence Au

 

IN

 

 

server name in clustered environments - I will add the details and the Jira right after this meet

 

 

LOG ELK stack indexing/dashboards

with Prometheus below

 

OPEN

IN

20190123

 

 

 

Casablanca 3.0.1 work until 10th Jan

Including POMBA

Michael O'Brien

DONE

 

20190122

20190113

https://lf-onap.atlassian.net/browse/LOG-913

revert Jira for data-router off TSC-92 -

pending merge of https://gerrit.onap.org/r/#/c/75999/

 

LOG openlab tenant devops

cluster creation/testing

Michael O'Brien

Done pending vFW

IN

 

 

We have 2 clusters a 1+4 and 1+13 used for testing deployments and running the vFW

Logging DevOps Infrastructure

 

Wiki edits, RTD review

Michael O'Brien

OPEN

IN

 

 

Requiring Updates, Merges or Marked Deprecated

 

Metric Streaming and Prometheus

Michael O'Brien

Vaibhav Chopra

IN PROGRESS

IN

20181207

 

https://lf-onap.atlassian.net/browse/LOG-911 - experimental chart on http://secure.solar:30000/graph

https://lf-onap.atlassian.net/browse/LOG-773

https://lf-onap.atlassian.net/browse/LOG-861

work with Vaibhav Chopra

https://lf-onap.atlassian.net/browse/OOM-1504

@Sanjay - note the prom chart assumes a k8s environment - what about bare metal

 

Finish SO filebeat additions

Michael O'Brien

IN PROGRESS

IN

20181207

 

https://lf-onap.atlassian.net/browse/SO-1110

https://gerrit.onap.org/r/#/c/69947/

 

Finish LOG common charts

Michael O'Brien

OPEN

OUT to El-alto

20190123

20181207

James MacNider - bring in Prianka's common eLK charts and use them in Clamp, LOG, SDC, POMBA

https://gerrit.onap.org/r/#/c/64767/

https://lf-onap.atlassian.net/browse/OOM-1276

rever to El-alto under https://lf-onap.atlassian.net/browse/LOG-936

 

 

Team Members Thank you and review

 

OPEN

IN

 

 

  • Shane Daniel to be removed - moved on to AI work - thanks for everything done for the logging and oom projects

  • Lee Breslau

  • Luke Parker 

  • Michael O'Brien 

  • Dave Williamson 

  • @Sanjay Agraharam

  • Lorraine A. Welch 

  • James MacNider 

  • Prudence Au 

  • Anthony Manuel 

  • Cheuk Yiu Horace Ip 

del

Review last 4 weeks since 

LOG Meeting Minutes 2018-12-05

 

IN PROGRESS

 

 

 

 

 

TSC/PTL meet actions

 

IN PROGRESS

 

 

 

 

OOM transfer chart ownership to teams
LOG is part of poc

Michael O'Brien

Mike Elliott

IN PROGRESS

IN

20190107

 

Starting - will have a training session - will send out any meetings to onap-discuss

We may have the same symlink repo folder like we do for doc

Last discussed TSC 20180109

 

OOM Deployment priority
base platform includes LOG

Michael O'Brien

Mike Elliott

IN PROGRESS

OUT

todo review with Mike Elliott

20190123

20181207

Q2) priority of system level containers like the ELK stack - OOM has a common services JIRA - DMaaP, AAF - TODO get JIRA - make sure log is in this!

There is a cd.sh retrofit that sequences the pods in order for deployment stability - this will be phased out when tiered deployment comes in

https://lf-onap.atlassian.net/browse/LOG-898

https://lf-onap.atlassian.net/browse/LOG-326

https://gerrit.onap.org/r/#/c/75422/ via ONAP Development#WorkingwithJSONPath

https://lf-onap.atlassian.net/browse/DCAEGEN2-1067

 

 

k8s manifest or oom values.yaml
for docker tags - truth

Michael O'Brien

IN PROGRESS

 

20190123

 

https://lf-onap.atlassian.net/browse/TSC-86

TODO: paste TSC review - manifest is truth

RTD doc link to run the script to get the yaml override

 

Nexus3 routing slowdown

Michael O'Brien

DONE

 

20181222

 

https://lf-onap.atlassian.net/browse/TSC-79

20181217-22

https://lf-onap.atlassian.net/browse/LOG-898

 

LOG compliance diagram/exercise

Michael O'Brien

@Sanjay Agraharam

IN PROGRESS

 

20181205

 

Log Streaming Compliance and API

part of prometheus work now

Sanjay - diagram FB must be split between using AOP and AOP+spec compliant - only this one should be green

 

 

 

 

 

 

 

 

 

Ongoing

 

 

 

 

 

 

 

CI/CD pipeline TSC poc

Michael O'Brien

IN PROGRESS

 

20180107

 

https://lf-onap.atlassian.net/browse/TSC-25

LOG is part of this poc

https://lists.onap.org/g/onap-discuss/topic/cd_task_force_tsc_25_meetings/29001640?p=,,,20,0,0,0::recentpostdate%2Fsticky,,,20,2,20,29001640

 

Notes

Comments