Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Use just for today - real meeting busted - zoom.us/j/7939937123


Meeting every 2 weeks at 1100 EST Tue - https://zoom.us/j/519971638

...

https://jira.onap.org/secure/RapidBoard.jspa?rapidView=143&view=planning.nodetail&epics=visible

Agenda

  • Michael: status no progress on logging related jiras involving dublin scope (code/tech) last week
  • Passed M2
  • Discussed in TSC and PTL meets - issue related to manifest vs k8s values.yaml overrides for casablanca and CMR releases
  • In architecture review for M3 -  (Addressed comments) Logging Dublin M3 Architecture Review
  • Working more for OOM lately - Created RKE script to replace rancher - pending work is to test HA - https://gerrit.onap.org/r/#/c/79067/ for 
    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyOOM-1670
  • Assisting with ONS April demo prep - 2 or more ONAP installations working together - one as an edge cloud
  • Focused on onap devops - primarily for 2 customers deploying ONAP
  • 5G training next week
  • April 3-5 ONS
  • PTL position is open - let me know if anyone would like to take it.
  • Also quickly discussed idea of rolling LOG into OOM - should revisit
  • Pending committer for pomba - Committer Request for Trevor Tait and Committer Request for Pierre Rioux - will send out reviews once stats are completed - TSC review will be needed

Attendees 

Items

...

Status

Status
colourGreen
titleOpen

Status
colourBlue
titleDone

...

...

...

Status
colourBlue
titleDone

...

...

Status
colourBlue
titleDone

...

pending 20190208 decision

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-947

...

...

Status
colourBlue
titleDone

...

pending documentation in RTD

Team,

    In the TSC it was decided to treat the diff between oom and the manifest by always running the manifest generated yaml in your deployments – you will not need to do this for master work – just for Casablanca and RC0-2 work

 

Working out the details in

https://jira.onap.org/browse/LOG-929

 https://onap.readthedocs.io/en/casablanca/submodules/integration.git/docs/index.html?highlight=manifest

/michael

...

...

Status
colourYellow
titleIn Progress

...

PTL 2019-01-14

Log Streaming Compliance and API

discussed at last PTL meet with djhunt

Image Removed

El-Alto 1.4 logging spec change - plan only

todo merge with Dave's below

...

...

Status
colourYellow
titleIn Progress

...

Dublin Scope Planning

...

...

Status
colourBlue
titleDone

...

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-707

Logging Dublin M1 Release Planning

...

...

Status
colourGreen
titleOpen

...

restart log4j format and files

...

Attendees

Luke Parker , Prudence Au , Michael O'Brien , Sanjay,  Lorraine A. Welch

Agenda

Attendees 


Items


...

YellowIn Progress

https://gerrit.onap.org/r/#/c/62405/

for serverId630

and

PRITitleResponsible

Status

Status
colourGreen
titleOpen

Status
colourBlue
titleDone

In DublinLast Worked onStartNotes

Security Vulnerability templateOngoingIN
20190122

M1 template

Status
colourBlue
titleDone

IN2019012420190122

ONS NA 2019 April Talk proposal

Status
colour

Blue
title

Done

IN20190111520190108
Jira Legacy
serverSystem Jira

20190122

pending 20190208 decision

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-178

Log Streaming Compliance and API#DeploymentProfiles

Work with portal/sdk libraryMichael O'Brien

Status
colourYellow
titleIn Progress

IN2019012920190115

Update: 20190129 - Existing eclipse environ for the RI being retrofitted

At the pom stage bringing in the jar via

portal/sdk in use by aai, dmaap, sdk, vid (vid link into so maybe?)

Code Block
themeMidnight
<groupId>org.onap.portal.sdk</groupId>

epic

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-600

Jira

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyPORTAL-348

review investigation in

Logging Developer Guide

Log Streaming Compliance and API#ExistingLibraryResearch\

Luke Parker discussion

need to use the portal library in an initiating project for tx processing

working likely with the SO team - via the work we are doing for them in https://gerrit.onap.org/r/#/c/69947/

(check the original spec - ODL specific - check appc/sdnc use of ccsdk)

New Committers

Status
colourGreen
titleOpen

20190115

We have room for 2-5 committers and will be reviewing the list

Logging Enhancements Project Proposal#KeyProjectFacts

add your details to

Logging Committer Promotion Requests

20190129 status - waiting on contributor documentation from each contributor

OPNFV/ONAP Paris

947


Use manifest generation over raw oom values.yaml docker image tag names

Status
colourBlue
titleDone

IN2019012420190117

pending documentation in RTD

Team,

    In the TSC it was decided to treat the diff between oom and the manifest by always running the manifest generated yaml in your deployments – you will not need to do this for master work – just for Casablanca and RC0-2 work

 

Working out the details in

https://jira.onap.org/browse/LOG-929

 https://onap.readthedocs.io/en/casablanca/submodules/integration.git/docs/index.html?highlight=manifest

/michael


S3P Logging compliance TSC/PTL

Status
colourYellow
titleIn Progress

IN2019011520190114

PTL 2019-01-14

Log Streaming Compliance and API

discussed at last PTL meet with djhunt

Image Added



El-Alto 1.4 logging spec change - plan only


todo merge with Dave's below

Status
colourYellow
titleIn Progress

IN20190122


Dublin Scope Planning


Status
colourBlue
titleDone

20190108

https://ddfplugfest19.sched.com/ Tue-Thu

Clover Gambia on prior https://zoom.us/j/115579117 - 7 hours ahead

https://ddfplugfest19.sched.com/event/K1Gy/opnfv-clover-utilizing-cloud-native-technologies-for-nfv

Security badging

IN20190124

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-707

Logging Dublin M1 Release Planning


RTD documentation

Status
colourYellowGreen
titleIn ProgressOpen

IN20190129Need to restart thisSecurity Vulnerabilities20180129
Attending Thu 1130-1230 meets

restart log4j format and files

example

Status
colourYellow
titleIn Progress

IN20190129lower - but for M4

s3p Secure https endpoints

LOG + POMBA

for djhunt

Status
colourGreen
titleOpen

IN

Discussion on whether we need to lock down the nodeport exposed ports

Can key off POMBA work already done

todo: get s3p page

Format compliance - working with AAI team

+ perf

Status
colourYellow
titleIn Progress

IN2019011520181101

(plus) 20190115 - casablanca cherry pick in queue logstack 5 to 3 and 1

https://gerrit.onap.org/r/#/c/75702/

(+) 20190109
from aai team
https://wiki.onap.org/display/DW/2019-01-17+AAI+Developers+Meeting+Open+Agenda
"hector has discovered that the stress test jar (liveness probe?) in aai-cassandra is hammering the cpu/ram/hd on the vm that aai is on - this breaks the etcd cluster (not the latency/network issues we suspected that may cause pod rescheduling) "

#6 on 2018-12-20 AAI Developers Meeting around 20190111520190108

https://gerrit.onap.org/r/#/c/62405/

for

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-630

and

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-178

Log Streaming Compliance and API#DeploymentProfiles


Work with portal/sdk libraryMichael O'Brien

Status
colourYellow
titleIn Progress

IN2019012920190115LOG Streaming compliance

Update: 20190129 - Existing eclipse environ for the RI being retrofitted

At the pom stage bringing in the jar via

portal/sdk in use by aai, dmaap, sdk, vid (vid link into so maybe?)

Code Block
themeMidnight
<groupId>org.onap.portal.sdk</groupId>

epic

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-600

Jira

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-376

Discussion with @Sanjay Agraharam and [~pau2882] on checking how cassandra is running on the vm and if debug levels are on should be verified

use labelling to split aai-cs and ls - no DaemonSet

Michael O'Brien to reduce core count for ls to 1 from 3

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-915

edited 2019-01-10 AAI Developers Meeting

for the 10th

AAI team - 2 types of logging AOP/non-AOP

Status
colourGreen
titleOpen

IN20181101#22 on 2018-12-20 AAI Developers MeetingLogging requests from Vendors

Status
colourGreen
titleOpen

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-877

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-876

#15,19 and 37 on SP priorities for Dublin

PORTAL-348

review investigation in

Logging Developer Guide

Log Streaming Compliance and API#ExistingLibraryResearch\

Luke Parker discussion

need to use the portal library in an initiating project for tx processing

working likely with the SO team - via the work we are doing for them in https://gerrit.onap.org/r/#/c/69947/

(check the original spec - ODL specific - check appc/sdnc use of ccsdk)





New Committers

Status
colourGreen
titleOpen


20190115

We have room for 2-5 committers and will be reviewing the list

Logging Enhancements Project Proposal#KeyProjectFacts

add your details to

Logging Committer Promotion Requests

20190129 status - waiting on contributor documentation from each contributor


OPNFV/ONAP Paris

Status
colourBlue
titleDone


20190108

https://ddfplugfest19.sched.com/ Tue-Thu

Clover Gambia on prior https://zoom.us/j/115579117 - 7 hours ahead

https://ddfplugfest19.sched.com/event/K1Gy/opnfv-clover-utilizing-cloud-native-technologies-for-nfv


Security badging

Status
colourYellow
titleIn Progress

IN20190129
Need to restart this
Security Vulnerabilities

Status
colourYellow
titleIn Progress

IN

Log Streaming Compliance and API

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-487

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-487

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-852

and

PTL 2019-01-14

opentracing via

https://opentracing.io/

IN (planning/POC for sure)20190123

@Sanjay

discuss integration - out of band processing -

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-104

see zipkin arch https://zipkin.io/pages/architecture.html

possibly tie both as a client of es ?

Tie in to ONS NA 2019 April demo booth for LF

https://lists.onap.org/g/onap-discuss/message/15066?p=,,,20,0,0,0::Created,,opentracing,20,2,0,22460823

discussion - remove20190108

discuss tick/tock logging spec behaviour - cassablanca implemented in dublin, dublin implemented in elalto

Log CheckerOUT20190109MIke to review with HoraceSearch GuardMichael O'Brien

Status
colourGreen
titleOpen

Maybe20180109 Jira LegacyserverSystem JiraserverId20190129
lower - but for M4

s3p Secure https endpoints

LOG + POMBA

for djhunt

Status
colourGreen
titleOpen

IN

Discussion on whether we need to lock down the nodeport exposed ports

Can key off POMBA work already done

todo: get s3p page


Format compliance - working with AAI team

+ perf

Status
colourYellow
titleIn Progress

IN2019011520181101

(plus) 20190115 - casablanca cherry pick in queue logstack 5 to 3 and 1

https://gerrit.onap.org/r/#/c/75702/

(+) 20190109
from aai team
https://lf-onap.atlassian.net/wiki/display/DW/2019-01-17+AAI+Developers+Meeting+Open+Agenda
"hector has discovered that the stress test jar (liveness probe?) in aai-cassandra is hammering the cpu/ram/hd on the vm that aai is on - this breaks the etcd cluster (not the latency/network issues we suspected that may cause pod rescheduling) "


#6 on 2018-12-20 AAI Developers Meeting around

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-376

Discussion with @Sanjay Agraharam and [~pau2882] on checking how cassandra is running on the vm and if debug levels are on should be verified

use labelling to split aai-cs and ls - no DaemonSet

Michael O'Brien to reduce core count for ls to 1 from 3

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-494

spec changes for DublinIN (planning)2019010920190109

Dublin spec changes for Elalto

environment name

release name

check mail for reply Michael O'Brien

Prudence Au proposal of renaming the log file name itself for the release ie: 3.0.0-ONAP - will discuss later for next week

Cluster logging behaviour

S3P

IN

server name in clustered environments - I will add the details and the Jira right after this meet

LOG ELK stack indexing/dashboards

with Prometheus below

Status
colourGreen
titleOpen

IN20190123

Casablanca 3.0.1 work until 10th Jan

Including POMBA

DONE2019012220190113

-915

edited 2019-01-10 AAI Developers Meeting

for the 10th


AAI team - 2 types of logging AOP/non-AOP


Status
colourGreen
titleOpen

IN
20181101#22 on 2018-12-20 AAI Developers Meeting
Logging requests from Vendors

Status
colourGreen
titleOpen




Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-877

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-876

#15,19 and 37 on SP priorities for Dublin


LOG Streaming compliance

Status
colourYellow
titleIn Progress

IN

Wiki edits, RTD review

Status
colourGreen
titleOpen

INRequiring Updates, Merges or Marked DeprecatedMetric Streaming and Prometheus

Status
colourYellow
titleIn Progress

IN20181207

Log Streaming Compliance and API

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-913

revert Jira for data-router off TSC-92 -

pending merge of https://gerrit.onap.org/r/#/c/75999/

LOG openlab tenant devops

cluster creation/testing

Done pending vFWIN

We have 2 clusters a 1+4 and 1+13 used for testing deployments and running the vFW

Logging DevOps Infrastructure

487

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-487

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-852

and

PTL 2019-01-14


opentracing via

https://opentracing.io/



IN (planning/POC for sure)20190123

@Sanjay

discuss integration - out of band processing -

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-

911 - experimental chart on http

104

see zipkin arch https://

secure.solar:30000/graph

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-773

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-861

work with Vaibhav Chopra

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyOOM-1504

@Sanjay - note the prom chart assumes a k8s environment - what about bare metal

Finish SO filebeat additions
discussion - remove


20190108

discuss tick/tock logging spec behaviour - cassablanca implemented in dublin, dublin implemented in elalto


Log Checker
OUT20190109
MIke to review with Horace
Search Guard

Status
colourYellowGreen
titleIn ProgressOpen

INMaybe2018120720180109

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keySOLOG-1110

https://gerrit.onap.org/r/#/c/69947/

Finish LOG common charts

Status
colourGreen
titleOpen

OUT to El-alto2019012320181207

James MacNider - bring in Prianka's common eLK charts and use them in Clamp, LOG, SDC, POMBA

https://gerrit.onap.org/r/#/c/64767/

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyOOM-1276

rever to El-alto under

jira
494


spec changes for Dublin
IN (planning)2019010920190109

Dublin spec changes for Elalto

environment name

release name

check mail for reply Michael O'Brien

Prudence Au proposal of renaming the log file name itself for the release ie: 3.0.0-ONAP - will discuss later for next week



Cluster logging behaviour

S3P


IN

server name in clustered environments - I will add the details and the Jira right after this meet



LOG ELK stack indexing/dashboards

with Prometheus below


Status
colourGreen
titleOpen

IN20190123


Casablanca 3.0.1 work until 10th Jan

Including POMBA

DONE
2019012220190113

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyLOG-936

Team Members Thank you and review

Status
colourGreen
titleOpen

IN
  • Shane Daniel to be removed - moved on to AI work - thanks for everything done for the logging and oom projects
  • Lee Breslau
  • Luke Parker 

    913

    revert Jira for data-router off TSC-92 -

    pending merge of https://gerrit.onap.org/r/#/c/75999/


    LOG openlab tenant devops

    cluster creation/testing

    Done pending vFWIN

    We have 2 clusters a 1+4 and 1+13 used for testing deployments and running the vFW

    Logging DevOps Infrastructure


    Wiki edits, RTD reviewdel

    Review last 4 weeks since 

    LOG Meeting Minutes 2018-12-05

    Status
    colourGreen
    titleOpen

    IN

    Requiring Updates, Merges or Marked Deprecated
    Metric Streaming and Prometheus

    Status
    colourYellow
    titleIn Progress

    IN20181207

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    key

    TSC

    LOG-

    79https

    911
    - experimental chart on http://

    lists.onap.org/g/onap-discuss

    secure.solar:30000/graph

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyLOG-773

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyLOG-861

    work with Vaibhav Chopra

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyOOM-1504

    @Sanjay - note the prom chart assumes a k8s environment - what about bare metal


    Finish SO filebeat additions

    Status
    colourYellow
    titleIn Progress

    IN20181207

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keySO-1110

    https://gerrit.onap.org/r/#/c/69947/


    Finish LOG common charts

    Status
    colourGreen
    titleOpen

    OUT to El-alto2019012320181207

    James MacNider - bring in Prianka's common eLK charts and use them in Clamp, LOG, SDC, POMBA

    https://gerrit.onap.org/r/#/c/64767/

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyOOM-1276

    rever to El-alto under

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyLOG-936



    Team Members Thank you and review

    Status
    colourGreen
    titleOpen

    IN

    del

    Review last 4 weeks since 

    LOG Meeting Minutes 2018-12-05


    Status
    colourYellow
    titleIn Progress





    TSC/PTL meet actions

    Status
    colourYellow
    titleIn Progress





    OOM transfer chart ownership to teams
    LOG is part of poc

    Status
    colourYellow
    titleIn Progress

    IN20190107

    Starting - will have a training session - will send out any meetings to onap-discuss

    We may have the same symlink repo folder like we do for doc

    Last discussed TSC 20180109


    OOM Deployment priority
    base platform includes LOG

    Status
    colourYellow
    titleIn Progress

    OUT

    todo review with Mike Elliott

    2019012320181207

    Q2) priority of system level containers like the ELK stack - OOM has a common services JIRA - DMaaP, AAF - TODO get JIRA - make sure log is in this!

    There is a cd.sh retrofit that sequences the pods in order for deployment stability - this will be phased out when tiered deployment comes in

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyLOG-898

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyLOG-326

    https://gerrit.onap.org/r/#/c/75422/ via ONAP Development#WorkingwithJSONPath

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyDCAEGEN2-1067



    k8s manifest or oom values.yaml
    for docker tags - truth

    Status
    colourYellow
    titleIn Progress


    20190123

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyTSC-86

    TODO: paste TSC review - manifest is truth

    RTD doc link to run the script to get the yaml override


    Nexus3 routing slowdown

    Status
    colourBlue
    titleDone


    20181222
    CI/CD pipeline TSC poc

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyTSC-79

    20181217-22

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyLOG-898

    LOG compliance diagram/exercise

    Michael O'Brien

    @Sanjay Agraharam

    Status
    colourYellow
    titleIn Progress

    20181205

    Log Streaming Compliance and API

    part of prometheus work now

    Sanjay - diagram FB must be split between using AOP and AOP+spec compliant - only this one should be green

    Ongoing

    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyLOG-898


    LOG compliance diagram/exercise

    Michael O'Brien

    @Sanjay Agraharam

    Status
    colourYellow
    titleIn Progress

    20180107

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyTSC-25

    LOG is part of this poc

    https://lists.onap.org/g/onap-discuss/topic/cd_task_force_tsc_25_meetings/29001640?p=,,,20,0,0,0::recentpostdate%2Fsticky,,,20,2,20,29001640

    ...

    •  

    In Progress


    20181205

    Log Streaming Compliance and API

    part of prometheus work now

    Sanjay - diagram FB must be split between using AOP and AOP+spec compliant - only this one should be green










    Ongoing






    CI/CD pipeline TSC poc

    Status
    colourYellow
    titleIn Progress


    20180107

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyTSC-

    ...

    ...

    ...


    Notes