LOG Meeting Minutes 2019-02-05
Meeting at 1100 EST Tue - https://zoom.us/j/519971638
regular zoom has error "meeting in progress" - use my zoom for today https://zoom.us/j/7939937123
https://lists.onap.org/g/onap-discuss/topics
http://onap-integration.eastus.cloudapp.azure.com:3000/group/onap-integration
https://jira.onap.org/secure/RapidBoard.jspa?rapidView=143&view=planning.nodetail&epics=visible
Agenda
Attendees
Issues with the LF zoom meet for some delegates - may be due to the recent upgrade
@Luke Parker
@Spondon Dey
@Cheuk Yiu Horace Ip
@Michael O'Brien
@Prudence Au
@Dave Williamson
Sanjay Agraharam
@Lorraine A. Welch
Items
Plan for
current implementation
Future spec for el-alto for VNFs below
this week...
logging work
Dev environment back up - merging existing library - using vid-app-common as a template for usage of org.onap.portal.sdk
<epsdk.version>2.4.0</epsdk.version>
prepping for splitting repos - 1 per component - will need 8+
working with dmaap on charts and filebeat
pylog issues for vfc are transient LF issues - posting response (with multicloud)
release notes
scorecard for S3P
dcaegen2 work in https://lf-onap.atlassian.net/browse/DCAEGEN2-1166 under https://gerrit.onap.org/r/#/c/77910/
questions on logging format onap-discuss including hv-ves I need to address https://lists.onap.org/g/onap-discuss/message/14997?p=,,,20,0,0,0::Created,,log,20,2,20,29162034
Discussion on VNF logs (CLAMP) @Sanjay - with Alok Gupta
vnf behaviors on top of vnf events
dmaap TCA like events - look into capturing these
?add our own log tracing when VNFs react to events - another tracing EPIC we should look at
both for VES and non-VES format
There is a gap in tracing VNF behaviour - via 5G RAN -
cloud infrastructure logs - vm, k8s and cloud service logs (beyond the vm level) - CNI cloud-native plugins example
need to think more about combining the logs - at the same time as we currently just capture them.
Provide log requirements to VNF onboarding team.
@Spondon Dey - feeding in to CL, policy - scaling behaviour - onap to drive more
infrastructure work
Helm ownership -
CI/CD - going with Orange MQ robot for oom merges
Perf and mostly crashloop avoidance
Deploy changes for RHEL7.6
Deploy order work
ARM A1 testing of new containers from dockerhub on AWS
80g/vm images - reducing footprint, standard alpine java image, ARM/i64 compat
Nodeports for dmaap
Datalake (now part of DCAE) does not yet affect us but it will -
ONS April conference prep work
The rest of our backlog is still in progress - M2 is coming up on the 14th
last week....
get committed resources for the next 2 months M2 to RC0 - so we can state what is in and out of the Dublin release
9 weeks to april 4thM2 - functionality freeze - 21 Feb
M4 - April 4th
I have taken the liberty of adding some names - feel free to add your availability or edit this section - we will paraphrase it in the M1 report - Logging Dublin M1 Release Planning@Michael O'Brien - 50% direct Logging work - really 40% dev/devops + 10% PTL/TSC/Project - the rest = related ONAP, CD, Doc, OOM, conference/customer,
@Prudence Au - doing half of the PTL work, template, meets, reviews - especially POMBA with @James MacNider on reviews - representing on most Thu POMBA meets
@Avdhut Kholkar - thank you for all the commit reviews
@Luke Parker - co-PTL and reference code
Meeting at 1200 EST today on ARM docker images (affecting LOG images as we need to get the ARM layer into the image - wrap the dockerhub versions)
https://lf-onap.atlassian.net/browse/LOG-331Stop using "latest" for any image - lock down the version tag for testing stability - see our use of busybox
https://lf-onap.atlassian.net/browse/LOG-949Good news: We passed M1 last Thu
Dublin scope finalized for M1
Release Planning#DublinReleaseCalendar
Logging Dublin ScopeNew work for dublin
Assist in 5G edge work via OOM/AWS work - meet is at 1100 EST Wed with @Ramki Krishnan's team
plus metric capture via Prometheus -https://lf-onap.atlassian.net/browse/LOG-911
https://lf-onap.atlassian.net/browse/LOG-707
Review/consolidate JIRAs
opentrace - will try to get in by april - an LF project
priority list
infrastructure - filebeat sidecars (before DaemonSet refactor) - see Log Streaming Compliance and API
format - via library - portal/sdk - minimal retrofit for markers/mdcs - https://lf-onap.atlassian.net/browse/LOG-600
all s3p - security, perf (aai-log-3**) - scaling - run with 1 logstash
Logstash used to be a Daemonset - however the filebeat needs to a daemonset - instead of each sidecar - 1 container per vm - get story
Additional tools - get POC for each - determine which goes to production level
prometheus - requires coordination with oom and multicloud
log checker - pending
opentracing - us - https://lf-onap.atlassian.net/browse/LOG-104
search guard - us
PRI | Title | Responsible | Status Open Done | In Dublin | Last Worked on | Start | Notes |
|---|---|---|---|---|---|---|---|
| Security Vulnerability template | @Michael O'Brien | Ongoing | IN |
| 20190122 |
|
| M1 template | @Michael O'Brien @Prudence Au | Done | IN | 20190124 | 20190122 |
|
| ONS NA 2019 April Talk proposal | @Michael O'Brien | Done | IN |
| 20190122 | pending 20190208 decision |
| Use manifest generation over raw oom values.yaml docker image tag names | @Michael O'Brien | Done | IN | 20190124 | 20190117 | pending documentation in RTD Team, In the TSC it was decided to treat the diff between oom and the manifest by always running the manifest generated yaml in your deployments – you will not need to do this for master work – just for Casablanca and RC0-2 work
Working out the details in https://jira.onap.org/browse/LOG-929 /michael |
| S3P Logging compliance TSC/PTL | @Michael O'Brien | In Progress | IN | 20190115 | 20190114 | Log Streaming Compliance and API discussed at last PTL meet with @Jason Hunt 
|
| El-Alto 1.4 logging spec change - plan only
todo merge with Dave's below | @Michael O'Brien @Dave Williamson | In Progress | IN | 20190122 |
|
|
| Dublin Scope Planning
| @Michael O'Brien | Done | IN | 20190124 |
| |
| RTD documentation | @Michael O'Brien | Open | IN | 20180129 |
| Attending Thu 1130-1230 meets |
| restart log4j format and files example | @Michael O'Brien | In Progress | IN | 201901115 | 20190108 | https://gerrit.onap.org/r/#/c/62405/ for https://lf-onap.atlassian.net/browse/LOG-630 and |
| Work with portal/sdk library | @Michael O'Brien | In Progress | IN | 20190129 | 20190115 | Update: 20190129 - Existing eclipse environ for the RI being retrofitted At the pom stage bringing in the jar via portal/sdk in use by aai, dmaap, sdk, vid (vid link into so maybe?) <groupId>org.onap.portal.sdk</groupId>epic https://lf-onap.atlassian.net/browse/LOG-600 Jira https://lf-onap.atlassian.net/browse/PORTAL-348 review investigation in Log Streaming Compliance and API#ExistingLibraryResearch\ @Luke Parker discussion need to use the portal library in an initiating project for tx processing working likely with the SO team - via the work we are doing for them in https://gerrit.onap.org/r/#/c/69947/ (check the original spec - ODL specific - check appc/sdnc use of ccsdk)
|
| New Committers |
| Open |
| 20190115 |
| We have room for 2-5 committers and will be reviewing the list Logging Enhancements Project Proposal#KeyProjectFacts add your details to Logging Committer Promotion Requests 20190129 status - waiting on contributor documentation from each contributor |
| OPNFV/ONAP Paris |
| Done |
| 20190108 |
| https://ddfplugfest19.sched.com/ Tue-Thu Clover Gambia on prior https://zoom.us/j/115579117 - 7 hours ahead https://ddfplugfest19.sched.com/event/K1Gy/opnfv-clover-utilizing-cloud-native-technologies-for-nfv |
| Security badging | @Michael O'Brien | In Progress | IN | 20190129 |
| Need to restart this |
| Security Vulnerabilities | @Michael O'Brien @Prudence Au | In Progress | IN | 20190129 |
| lower - but for M4 |
| s3p Secure https endpoints LOG + POMBA | for @Jason Hunt | Open | IN |
|
| Discussion on whether we need to lock down the nodeport exposed ports Can key off POMBA work already done todo: get s3p page |
| Format compliance - working with AAI team + perf | @Michael O'Brien | In Progress | IN | 20190115 | 20181101 | 20190115 - casablanca cherry pick in queue logstack 5 to 3 and 1 https://gerrit.onap.org/r/#/c/75702/ (+) 20190109
#6 on 2018-12-20 AAI Developers Meeting around https://lf-onap.atlassian.net/browse/LOG-376 Discussion with @Sanjay Agraharam and [~pau2882] on checking how cassandra is running on the vm and if debug levels are on should be verified use labelling to split aai-cs and ls - no DaemonSet @Michael O'Brien to reduce core count for ls to 1 from 3 https://lf-onap.atlassian.net/browse/LOG-915 edited 2019-01-10 AAI Developers Meeting for the 10th |
| AAI team - 2 types of logging AOP/non-AOP |
| Open | IN |
| 20181101 | |
| Logging requests from Vendors |
| Open |
|
|
| https://lf-onap.atlassian.net/browse/LOG-877 https://lf-onap.atlassian.net/browse/LOG-876 #15,19 and 37 on SP priorities for Dublin |
| LOG Streaming compliance |
| In Progress | IN |
|
| Log Streaming Compliance and API https://lf-onap.atlassian.net/browse/LOG-487 https://lf-onap.atlassian.net/browse/LOG-487 https://lf-onap.atlassian.net/browse/LOG-852 and |
| opentracing via |
|
| IN (planning/POC for sure) | 20190123 |
| @Sanjay discuss integration - out of band processing - https://lf-onap.atlassian.net/browse/LOG-104 see zipkin arch https://zipkin.io/pages/architecture.html possibly tie both as a client of es ? Tie in to ONS NA 2019 April demo booth for LF |
| discussion - remove |
|
|
| 20190108 |
| discuss tick/tock logging spec behaviour - cassablanca implemented in dublin, dublin implemented in elalto
|
| Log Checker | @Cheuk Yiu Horace Ip @Lee Breslau |
| OUT | 20190109 |
| MIke to review with Horace |
| Search Guard | @Michael O'Brien | Open | Maybe | 20180109 |
| |