LOG Meeting Minutes 2019-01-22

LOG Meeting Minutes 2019-01-22

Meeting at 1100 EST Tue - https://zoom.us/j/519971638

https://lists.onap.org/g/onap-discuss/topics

http://onap-integration.eastus.cloudapp.azure.com:3000/group/onap-integration

https://jira.onap.org/secure/RapidBoard.jspa?rapidView=143&view=planning.nodetail&epics=visible

Agenda

Attendees

@Cheuk Yiu Horace Ip

@Michael O'Brien

@Prudence Au

Items

  • get committed resources for the next 2 months M1 to RC0 - so we can state what is in and out of the Dublin release
    9 weeks to april 4th

    • M2 - functionality freeze - 21 Feb
      M4 - April 4th 
      I have taken the liberty of adding some names - feel free to add your availability or edit this section - we will paraphrase it in the M1 report - Logging Dublin M1 Release Planning

    • @Michael O'Brien - 50% direct Logging work - really 40% dev/devops + 10% PTL/TSC/Project - the rest = related ONAP, CD, Doc, OOM, conference/customer,

    • @Prudence Au - doing half of the PTL work, template, meets, reviews - especially POMBA with @James MacNider on reviews - representing on most Thu POMBA meets

    • @Avdhut Kholkar 

    • @Luke Parker 

  • Finalize Dublin scope for M1 in 2 days
    Release Planning#DublinReleaseCalendar
    Logging Dublin Scope

  • New work for dublin

  • Review/consolidate JIRAs

  • opentrace - will try to get in by april - an LF project 

  • priority list

    • infrastructure - filebeat

    • format - via library - portal/sdk - minimal retrofit for markers/mdcs

    • all s3p - security, perf (aai-log-3**) - scaling - run with 1 logstash

    • Logstash used to be a Daemonset  - however the filebeat needs to a daemonset - instead of each sidecar - 1 container per vm - get story

    • Additional tools - get POC for each - determine which goes to production level

 

PRI

Title

Responsible

Status

Open

Done

In Dublin

Last Worked on

Start

Notes

PRI

Title

Responsible

Status

Open

Done

In Dublin

Last Worked on

Start

Notes

 

Security Vulnerability template

@Michael O'Brien

 

IN

 

20190122

 

 

M1 template

@Michael O'Brien

In Progress

IN

 

20190122

 

 

ONS NA 2019 April Talk proposal

@Michael O'Brien

Done

IN

 

20190122

 

 

Use manifest generation over raw oom values.yaml docker image tag names

@Michael O'Brien

In Progress

 

 

20190117

Team,

    In the TSC it was decided to treat the diff between oom and the manifest by always running the manifest generated yaml in your deployments – you will not need to do this for master work – just for Casablanca and RC0-2 work

 

Working out the details in

https://jira.onap.org/browse/LOG-929

 https://onap.readthedocs.io/en/casablanca/submodules/integration.git/docs/index.html?highlight=manifest

/michael

 

S3P Logging compliance TSC/PTL

@Michael O'Brien

 

IN

20190115

20190114

PTL 2019-01-14

discussed at last PTL meet with @Jason Hunt

 

 

El-Alto 1.4 logging spec change - plan only

 

todo merge with Dave's below

 

 

IN

20190122

 

 

 

Dublin Scope Planning

 

@Michael O'Brien

In Progress

IN

20190108

 

https://lf-onap.atlassian.net/browse/LOG-707

Logging Dublin M1 Release Planning

 

RTD documentation

 

 

IN

20180114

 

 

 

restart log4j format and files

example

@Michael O'Brien

In Progress

IN

201901115

20190108

https://gerrit.onap.org/r/#/c/62405/

for https://lf-onap.atlassian.net/browse/LOG-630

and

https://lf-onap.atlassian.net/browse/LOG-178

Log Streaming Compliance and API#DeploymentProfiles

 

Work with portal/sdk library

@Michael O'Brien

In Progress

IN

20190115

20190115

review investigation in

Logging Developer Guide

Log Streaming Compliance and API#ExistingLibraryResearch

 

New Committers

 

 

 

20190115

 

We have room for 2-5 committers and will be reviewing the list

Logging Enhancements Project Proposal#KeyProjectFacts

add your details to

Logging Committer Promotion Requests

 

 

OPNFV/ONAP Paris

 

Done

 

20190108

 

https://ddfplugfest19.sched.com/ Tue-Thu

Clover Gambia on prior https://zoom.us/j/115579117 - 7 hours ahead

https://ddfplugfest19.sched.com/event/K1Gy/opnfv-clover-utilizing-cloud-native-technologies-for-nfv

 

Security badging

@Michael O'Brien

In Progress

IN

 

 

 

 

Security Vulnerabilities

@Michael O'Brien

@Prudence Au

In Progress

IN

 

 

 

 

s3p Secure https endpoints

LOG + POMBA

for @Jason Hunt

Open

IN

 

 

Discussion on whether we need to lock down the nodeport exposed ports

Can key off POMBA work already done

todo: get s3p page

 

Format compliance - working with AAI team

+ perf

@Michael O'Brien

In Progress

IN

20190115

20181101

20190115 - casablanca cherry pick in queue logstack 5 to 3 and 1

https://gerrit.onap.org/r/#/c/75702/

(+) 20190109
from aai team
https://lf-onap.atlassian.net/wiki/display/DW/2019-01-17+AAI+Developers+Meeting+Open+Agenda
"hector has discovered that the stress test jar (liveness probe?) in aai-cassandra is hammering the cpu/ram/hd on the vm that aai is on - this breaks the etcd cluster (not the latency/network issues we suspected that may cause pod rescheduling) "

 

#6 on 2018-12-20 AAI Developers Meeting around https://lf-onap.atlassian.net/browse/LOG-376

Discussion with @Sanjay Agraharam and [~pau2882] on checking how cassandra is running on the vm and if debug levels are on should be verified

use labelling to split aai-cs and ls - no DaemonSet

@Michael O'Brien to reduce core count for ls to 1 from 3

https://lf-onap.atlassian.net/browse/LOG-915

edited 2019-01-10 AAI Developers Meeting

for the 10th

 

AAI team - 2 types of logging AOP/non-AOP

 

Open

IN

 

20181101

#22 on 2018-12-20 AAI Developers Meeting

 

Logging requests from Vendors

 

Open

 

 

 

https://lf-onap.atlassian.net/browse/LOG-877

https://lf-onap.atlassian.net/browse/LOG-876

#15,19 and 37 on SP priorities for Dublin

 

LOG Streaming compliance

 

In Progress

IN

 

 

https://lf-onap.atlassian.net/browse/LOG-487

https://lf-onap.atlassian.net/browse/LOG-487

https://lf-onap.atlassian.net/browse/LOG-852

and

PTL 2019-01-14

 

opentracing via

https://opentracing.io/

 

 

IN (planning/POC for sure)

20190123

 

@Sanjay

discuss integration - out of band processing - https://lf-onap.atlassian.net/browse/LOG-104

see zipkin arch https://zipkin.io/pages/architecture.html

possibly tie both as a client of es ?

Tie in to ONS NA 2019 April demo booth for LF

https://lists.onap.org/g/onap-discuss/message/15066?p=,,,20,0,0,0::Created,,opentracing,20,2,0,22460823

 

discussion - remove

 

 

 

20190108

 

discuss tick/tock logging spec behaviour - cassablanca implemented in dublin, dublin implemented in elalto

 

Log Checker

@Cheuk Yiu Horace Ip

@Lee Breslau

 

OUT

20190109

 

MIke to review with Horace

 

Search Guard

@Michael O'Brien

Open

Maybe

20180109

 

https://lf-onap.atlassian.net/browse/LOG-494

 

spec changes for Dublin

@Dave Williamson

 

IN (planning)

20190109

20190109

Dublin spec changes for Elalto

environment name

release name

check mail for reply @Michael O'Brien

@Prudence Au proposal of renaming the log file name itself for the release ie: 3.0.0-ONAP - will discuss later for next week

 

 

Cluster logging behaviour

S3P

@Dave Williamson

@Michael O'Brien

@Prudence Au

 

IN

 

 

server name in clustered environments - I will add the details and the Jira right after this meet

 

 

LOG ELK stack indexing/dashboards

with Prometheus below

 

Open

IN

20190123

 

 

 

Casablanca 3.0.1 work until 10th Jan

Including POMBA

@Michael O'Brien

DONE

 

20190122

20190113

https://lf-onap.atlassian.net/browse/LOG-913

revert Jira for data-router off TSC-92 -

pending merge of https://gerrit.onap.org/r/#/c/75999/

 

LOG openlab tenant devops

cluster creation/testing

@Michael O'Brien

Done pending vFW

IN

 

 

We have 2 clusters a 1+4 and 1+13 used for testing deployments and running the vFW

Logging DevOps Infrastructure

 

Wiki edits, RTD review

@Michael O'Brien

Open

IN

 

 

Requiring Updates, Merges or Marked Deprecated

 

Metric Streaming and Prometheus

@Michael O'Brien

@Vaibhav Chopra

In Progress

IN

20181207

 

https://lf-onap.atlassian.net/browse/LOG-911 - experimental chart on http://secure.solar:30000/graph

https://lf-onap.atlassian.net/browse/LOG-773

https://lf-onap.atlassian.net/browse/LOG-861

work with @Vaibhav Chopra

https://lf-onap.atlassian.net/browse/OOM-1504

@Sanjay - note the prom chart assumes a k8s environment - what about bare metal

 

Finish SO filebeat additions

@Michael O'Brien

In Progress

IN

20181207