LOG Meeting Minutes 2019-03-19
Meeting every 2 weeks at 1100 EST Tue - https://zoom.us/j/519971638 - backup is my https://zoom.us/j/7939937123 next meet on April 2nd
https://lists.onap.org/g/onap-discuss/topics
http://onap-integration.eastus.cloudapp.azure.com:3000/group/onap-integration
https://jira.onap.org/secure/RapidBoard.jspa?rapidView=143&view=planning.nodetail&epics=visible
Attendees
Dave Williamson , Michael O'Brien , Lorraine A. Welch
15 min
Agenda
Meetings every 2 weeks now
M3 passed
Will fill in our state in Dublin Risks - especially our lack of resources available currently
Try to get some metric tie in - have been asked a couple times about non-application logs and metrics
Need to finish spec example
Review last week LOG Meeting Minutes 2019-03-05
Fix committer list
Had to delete our large CMR cluster on openlab to free up 224G for the integration team - will address OOM resources tomorrow
OOM meet tomorrow (Mike back on the 25th) - OOM Meeting Notes - 2019-03-20
Lorraine A. Welch setting up fluentd instance - nice
Michael O'Brien will try to key back pv/pvc work done internally to LOG persistence/rotation - including work from Lorraine A. Welch
Items
PRI | Title | Responsible | Status OPEN DONE | In Dublin | Last Worked on | Start | Notes |
|---|---|---|---|---|---|---|---|
| Security Vulnerability template | Michael O'Brien | Ongoing | IN |
| 20190122 |
|
| M1 template | Michael O'Brien Prudence Au | DONE | IN | 20190124 | 20190122 |
|
| ONS NA 2019 April Talk proposal | Michael O'Brien | DONE | IN |
| 20190122 | pending 20190208 decision |
| Use manifest generation over raw oom values.yaml docker image tag names | Michael O'Brien | DONE | IN | 20190124 | 20190117 | pending documentation in RTD Team, In the TSC it was decided to treat the diff between oom and the manifest by always running the manifest generated yaml in your deployments – you will not need to do this for master work – just for Casablanca and RC0-2 work
Working out the details in https://jira.onap.org/browse/LOG-929 /michael |
| S3P Logging compliance TSC/PTL | Michael O'Brien | IN PROGRESS | IN | 20190115 | 20190114 | Log Streaming Compliance and API discussed at last PTL meet with Jason Hunt
|
| El-Alto 1.4 logging spec change - plan only
todo merge with Dave's below | Michael O'Brien Dave Williamson | IN PROGRESS | IN | 20190122 |
|
|
| Dublin Scope Planning
| Michael O'Brien | DONE | IN | 20190124 |
| |
| RTD documentation | Michael O'Brien | OPEN | IN | 20180129 |
| Attending Thu 1130-1230 meets |
| restart log4j format and files example | Michael O'Brien | IN PROGRESS | IN | 201901115 | 20190108 | https://gerrit.onap.org/r/#/c/62405/ for https://lf-onap.atlassian.net/browse/LOG-630 and |
| Work with portal/sdk library | Michael O'Brien | IN PROGRESS | IN | 20190129 | 20190115 | Update: 20190129 - Existing eclipse environ for the RI being retrofitted At the pom stage bringing in the jar via portal/sdk in use by aai, dmaap, sdk, vid (vid link into so maybe?) <groupId>org.onap.portal.sdk</groupId>epic https://lf-onap.atlassian.net/browse/LOG-600 Jira https://lf-onap.atlassian.net/browse/PORTAL-348 review investigation in Log Streaming Compliance and API#ExistingLibraryResearch\ Luke Parker discussion need to use the portal library in an initiating project for tx processing working likely with the SO team - via the work we are doing for them in https://gerrit.onap.org/r/#/c/69947/ (check the original spec - ODL specific - check appc/sdnc use of ccsdk)
|
| New Committers |
| OPEN |
| 20190115 |
| We have room for 2-5 committers and will be reviewing the list Logging Enhancements Project Proposal#KeyProjectFacts add your details to Logging Committer Promotion Requests 20190129 status - waiting on contributor documentation from each contributor |
| OPNFV/ONAP Paris |
| DONE |
| 20190108 |
| https://ddfplugfest19.sched.com/ Tue-Thu Clover Gambia on prior https://zoom.us/j/115579117 - 7 hours ahead https://ddfplugfest19.sched.com/event/K1Gy/opnfv-clover-utilizing-cloud-native-technologies-for-nfv |
| Security badging | Michael O'Brien | IN PROGRESS | IN | 20190129 |
| Need to restart this |
| Security Vulnerabilities | Michael O'Brien Prudence Au | IN PROGRESS | IN | 20190129 |
| lower - but for M4 |
| s3p Secure https endpoints LOG + POMBA | for Jason Hunt | OPEN | IN |
|
| Discussion on whether we need to lock down the nodeport exposed ports Can key off POMBA work already done todo: get s3p page |
| Format compliance - working with AAI team + perf | Michael O'Brien | IN PROGRESS | IN | 20190115 | 20181101 | 20190115 - casablanca cherry pick in queue logstack 5 to 3 and 1 https://gerrit.onap.org/r/#/c/75702/ (+) 20190109
#6 on 2018-12-20 AAI Developers Meeting around https://lf-onap.atlassian.net/browse/LOG-376 Discussion with @Sanjay Agraharam and [~pau2882] on checking how cassandra is running on the vm and if debug levels are on should be verified use labelling to split aai-cs and ls - no DaemonSet Michael O'Brien to reduce core count for ls to 1 from 3 https://lf-onap.atlassian.net/browse/LOG-915 edited 2019-01-10 AAI Developers Meeting for the 10th |
| AAI team - 2 types of logging AOP/non-AOP |
| OPEN | IN |
| 20181101 | |
| Logging requests from Vendors |
| OPEN |
|
|
| https://lf-onap.atlassian.net/browse/LOG-877 https://lf-onap.atlassian.net/browse/LOG-876 #15,19 and 37 on SP priorities for Dublin |
| LOG Streaming compliance |
| IN PROGRESS | IN |
|
| Log Streaming Compliance and API https://lf-onap.atlassian.net/browse/LOG-487 https://lf-onap.atlassian.net/browse/LOG-487 https://lf-onap.atlassian.net/browse/LOG-852 and |
| opentracing via |
|
| IN (planning/POC for sure) | 20190123 |
| @Sanjay discuss integration - out of band processing - https://lf-onap.atlassian.net/browse/LOG-104 see zipkin arch https://zipkin.io/pages/architecture.html possibly tie both as a client of es ? Tie in to ONS NA 2019 April demo booth for LF |
| discussion - remove |
|
|
| 20190108 |
| discuss tick/tock logging spec behaviour - cassablanca implemented in dublin, dublin implemented in elalto
|
| Log Checker | Cheuk Yiu Horace Ip Lee Breslau |
| OUT | 20190109 |
| MIke to review with Horace |
| Search Guard | Michael O'Brien | OPEN | Maybe | 20180109 |
| |
| spec changes for Dublin | Dave Williamson |
| IN (planning) | 20190109 | 20190109 | Dublin spec changes for Elalto environment name release name check mail for reply Michael O'Brien Prudence Au proposal of renaming the log file name itself for the release ie: 3.0.0-ONAP - will discuss later for next week
|
| Cluster logging behaviour S3P | Dave Williamson Michael O'Brien Prudence Au |
| IN |
|
| server name in clustered environments - I will add the details and the Jira right after this meet
|
| LOG ELK stack indexing/dashboards with Prometheus below |
| OPEN | IN | 20190123 |
|
|
| Casablanca 3.0.1 work until 10th Jan Including POMBA | Michael O'Brien | DONE |
| 20190122 | 20190113 | https://lf-onap.atlassian.net/browse/LOG-913 revert Jira for data-router off TSC-92 - pending merge of https://gerrit.onap.org/r/#/c/75999/ |
| LOG openlab tenant devops cluster creation/testing | Michael O'Brien | Done pending vFW | IN |
|
| We have 2 clusters a 1+4 and 1+13 used for testing deployments and running the vFW |
| Wiki edits, RTD review | Michael O'Brien | OPEN | IN |
|
| |
| Metric Streaming and Prometheus | Michael O'Brien Vaibhav Chopra | IN PROGRESS | IN | 20181207 |
| https://lf-onap.atlassian.net/browse/LOG-911 - experimental chart on http://secure.solar:30000/graph https://lf-onap.atlassian.net/browse/LOG-773 https://lf-onap.atlassian.net/browse/LOG-861 work with Vaibhav Chopra https://lf-onap.atlassian.net/browse/OOM-1504 @Sanjay - note the prom chart assumes a k8s environment - what about bare metal |
| Finish SO filebeat additions | Michael O'Brien | IN PROGRESS | IN | 20181207 |
| |
| Finish LOG common charts | Michael O'Brien | OPEN | OUT to El-alto | 20190123 | 20181207 | James MacNider - bring in Prianka's common eLK charts and use them in Clamp, LOG, SDC, POMBA https://gerrit.onap.org/r/#/c/64767/ https://lf-onap.atlassian.net/browse/OOM-1276 rever to El-alto under https://lf-onap.atlassian.net/browse/LOG-936
|
| Team Members Thank you and review |
| OPEN | IN |
|
|
|
del | Review last 4 weeks since |
| IN PROGRESS |
|
|
|
|
| TSC/PTL meet actions |
| IN PROGRESS |
|
|
| |
| OOM transfer chart ownership to teams | Michael O'Brien Mike Elliott | IN PROGRESS | IN | 20190107 |
| Starting - will have a training session - will send out any meetings to onap-discuss We may have the same symlink repo folder like we do for doc Last discussed TSC 20180109 |
| OOM Deployment priority | Michael O'Brien Mike Elliott | IN PROGRESS | OUT todo review with Mike Elliott | 20190123 | 20181207 | Q2) priority of system level containers like the ELK stack - OOM has a common services JIRA - DMaaP, AAF - TODO get JIRA - make sure log is in this! There is a cd.sh retrofit that sequences the pods in order for deployment stability - this will be phased out when tiered deployment comes in https://lf-onap.atlassian.net/browse/LOG-898 https://lf-onap.atlassian.net/browse/LOG-326 https://gerrit.onap.org/r/#/c/75422/ via ONAP Development#WorkingwithJSONPath https://lf-onap.atlassian.net/browse/DCAEGEN2-1067
|
| k8s manifest or oom values.yaml | Michael O'Brien | IN PROGRESS |
| 20190123 |
| https://lf-onap.atlassian.net/browse/TSC-86 TODO: paste TSC review - manifest is truth RTD doc link to run the script to get the yaml override |
| Nexus3 routing slowdown | Michael O'Brien | DONE |
| 20181222 |
| https://lf-onap.atlassian.net/browse/TSC-79 20181217-22 |
| LOG compliance diagram/exercise | Michael O'Brien @Sanjay Agraharam | IN PROGRESS |
| 20181205 |
| Log Streaming Compliance and API part of prometheus work now Sanjay - diagram FB must be split between using AOP and AOP+spec compliant - only this one should be green |
|
|
|
|
|
|
|
|
| Ongoing |
|
|
|
|
|
|
| CI/CD pipeline TSC poc | Michael O'Brien | IN PROGRESS |
| 20180107 |
| https://lf-onap.atlassian.net/browse/TSC-25 LOG is part of this poc |
examples ONAP Culprit Locator
also the java code around https://git.onap.org/logging-analytics/tree/reference/logging-slf4j/src/test/resources/logback.xml