LOG Meeting Minutes 2019-03-05
Use just for today - real meeting busted - zoom.us/j/7939937123
Meeting every 2 weeks at 1100 EST Tue - https://zoom.us/j/519971638
https://lists.onap.org/g/onap-discuss/topics
http://onap-integration.eastus.cloudapp.azure.com:3000/group/onap-integration
https://jira.onap.org/secure/RapidBoard.jspa?rapidView=143&view=planning.nodetail&epics=visible
Attendees
@Luke Parker , @Prudence Au , @Michael O'Brien , Sanjay, @Lorraine A. Welch
Agenda
Meetings every 2 weeks now - next meeting the 19th
Need to accomidate @Luke Parker - who is up at 3 am right now in Australia - will be 1 in the morning until April - then 2am
ideas: Better to be up at 1-3 than 8am - keep at 11 for now
For NA - stays at 11 - but I will verify if we are on UTC
DST is coming this weekend - we should agree on the meeting time - Luke does not go DST for 3 more weeks
Michael: status no progress on logging related jiras involving dublin scope (code/tech) last week
Passed M2
Discussed in TSC and PTL meets - issue related to manifest vs k8s values.yaml overrides for casablanca and CMR releases -
In architecture review for M3 - (Addressed comments) Logging Dublin M3 Architecture Review
Working more for OOM lately - Created RKE script to replace rancher - pending work is to test HA - https://gerrit.onap.org/r/#/c/79067/ for https://lf-onap.atlassian.net/browse/OOM-1670
Assisting with ONS April demo prep - 2 or more ONAP installations working together - one as an edge cloud
Focused on onap devops - primarily for 2 customers deploying ONAP
5G training next week
April 3-5 ONS work
k8s infrastructure and
Logging will be a part of the demo - we will show the kibana logs during a vFW operation in an i-frame for the master and edge ONAP deploys
PTL position is open - let me know if anyone would like to take it.
Also quickly discussed idea of rolling LOG into OOM - should revisit
Pending committer for pomba - Committer Request for Trevor Tait and Pierre Rioux - Committer Request for [Logging-Analytics] - will send out reviews once stats are completed - TSC review will be needed
TODO I need to check MSB issues on onap-discuss -
Spondon - import the dashboard - fix the one on the wiki - @Lorraine A. Welch export to json first ONAP Culprit Locator
@Lorraine A. Welch question about changing the index for the db (Grafana for example) - @Timestamp timestamp for example - TODO - merge the 2 indexes -
Q) Sanjay: (opentracking related - picking up errors on stdout (err, out)
how:
(also review from 2 weeks ago - @Lorraine A. Welch System.out standardout - review in terms of not using a hardcoded file appender - in terms of syslogs
log retention on pod failure - those not mapped to PVs - including the current EmptyDir link between the sidecar - etherial PV - logs only end up in the elk stack
Look into PV/PVC structure for log retention instead of the default emptydir
see PV/PVC example . logs can go to the /dockerdatanfs)
https://git.onap.org/oom/tree/kubernetes/portal/charts/portal-mariadb/templates/deployment.yaml#n84
Topic: File retention
Q: rotation schedule, size of retention - what role does the PV on the ELK stack play compared to the individual source pod PVs
@Luke's example - discuss with @Mike Elliott - review a pending upstream contribution
variables set in
https://git.onap.org/logging-analytics/tree/reference/provider/helm/logback/chart/values.yaml#n14'
Review any issues with multiple providers in SDNC and APPC
@Lorraine A. Welch check https://www.loomsystems.com/blog/single-post/2017/01/30/a-comparison-of-fluentd-vs-logstash-log-collector
Attendees
Items
PRI | Title | Responsible | Status Open Done | In Dublin | Last Worked on | Start | Notes |
|---|---|---|---|---|---|---|---|
Security Vulnerability template | @Michael O'Brien | Ongoing | IN | 20190122 | |||
M1 template | @Michael O'Brien @Prudence Au | Done | IN | 20190124 | 20190122 | ||
ONS NA 2019 April Talk proposal | @Michael O'Brien | Done | IN | 20190122 | pending 20190208 decision | ||
Use manifest generation over raw oom values.yaml docker image tag names | @Michael O'Brien | Done | IN | 20190124 | 20190117 | pending documentation in RTD Team, In the TSC it was decided to treat the diff between oom and the manifest by always running the manifest generated yaml in your deployments – you will not need to do this for master work – just for Casablanca and RC0-2 work
Working out the details in https://jira.onap.org/browse/LOG-929 /michael | |
S3P Logging compliance TSC/PTL | @Michael O'Brien | In Progress | IN | 20190115 | 20190114 | Log Streaming Compliance and API discussed at last PTL meet with @Jason Hunt  | |
El-Alto 1.4 logging spec change - plan only todo merge with Dave's below | @Michael O'Brien @Dave Williamson | In Progress | IN | 20190122 | |||
Dublin Scope Planning | @Michael O'Brien | Done | IN | 20190124 | |||
RTD documentation | @Michael O'Brien | Open | IN | 20180129 | Attending Thu 1130-1230 meets | ||
restart log4j format and files example | @Michael O'Brien | In Progress | IN | 201901115 | 20190108 | https://gerrit.onap.org/r/#/c/62405/ for https://lf-onap.atlassian.net/browse/LOG-630 and | |
Work with portal/sdk library | @Michael O'Brien | In Progress | IN | 20190129 | 20190115 | Update: 20190129 - Existing eclipse environ for the RI being retrofitted At the pom stage bringing in the jar via portal/sdk in use by aai, dmaap, sdk, vid (vid link into so maybe?) <groupId>org.onap.portal.sdk</groupId>epic https://lf-onap.atlassian.net/browse/LOG-600 Jira https://lf-onap.atlassian.net/browse/PORTAL-348 review investigation in Log Streaming Compliance and API#ExistingLibraryResearch\ @Luke Parker discussion need to use the portal library in an initiating project for tx processing working likely with the SO team - via the work we are doing for them in https://gerrit.onap.org/r/#/c/69947/ (check the original spec - ODL specific - check appc/sdnc use of ccsdk) | |
New Committers | Open | 20190115 | We have room for 2-5 committers and will be reviewing the list Logging Enhancements Project Proposal#KeyProjectFacts add your details to Logging Committer Promotion Requests 20190129 status - waiting on contributor documentation from each contributor | ||||
OPNFV/ONAP Paris | Done | 20190108 | https://ddfplugfest19.sched.com/ Tue-Thu Clover Gambia on prior https://zoom.us/j/115579117 - 7 hours ahead https://ddfplugfest19.sched.com/event/K1Gy/opnfv-clover-utilizing-cloud-native-technologies-for-nfv | ||||
Security badging | @Michael O'Brien | In Progress | IN | 20190129 | Need to restart this | ||
Security Vulnerabilities | @Michael O'Brien @Prudence Au | In Progress | IN | 20190129 | lower - but for M4 | ||
s3p Secure https endpoints LOG + POMBA | for @Jason Hunt | Open | IN | Discussion on whether we need to lock down the nodeport exposed ports Can key off POMBA work already done todo: get s3p page | |||
Format compliance - working with AAI team + perf | @Michael O'Brien | In Progress | IN | 20190115 | 20181101 | 20190115 - casablanca cherry pick in queue logstack 5 to 3 and 1 https://gerrit.onap.org/r/#/c/75702/ (+) 20190109 #6 on 2018-12-20 AAI Developers Meeting around https://lf-onap.atlassian.net/browse/LOG-376 Discussion with @Sanjay Agraharam and [~pau2882] on checking how cassandra is running on the vm and if debug levels are on should be verified use labelling to split aai-cs and ls - no DaemonSet @Michael O'Brien to reduce core count for ls to 1 from 3 https://lf-onap.atlassian.net/browse/LOG-915 edited 2019-01-10 AAI Developers Meeting for the 10th | |
AAI team - 2 types of logging AOP/non-AOP | Open | IN | 20181101 | ||||
Logging requests from Vendors | Open | https://lf-onap.atlassian.net/browse/LOG-877 https://lf-onap.atlassian.net/browse/LOG-876 #15,19 and 37 on SP priorities for Dublin | |||||
LOG Streaming compliance | In Progress | IN | Log Streaming Compliance and API https://lf-onap.atlassian.net/browse/LOG-487 https://lf-onap.atlassian.net/browse/LOG-487 https://lf-onap.atlassian.net/browse/LOG-852 and | ||||
opentracing via | IN (planning/POC for sure) | 20190123 | @Sanjay discuss integration - out of band processing - https://lf-onap.atlassian.net/browse/LOG-104 see zipkin arch https://zipkin.io/pages/architecture.html possibly tie both as a client of es ? Tie in to ONS NA 2019 April demo booth for LF | ||||
discussion - remove | 20190108 | discuss tick/tock logging spec behaviour - cassablanca implemented in dublin, dublin implemented in elalto
| |||||
Log Checker | @Cheuk Yiu Horace Ip @Lee Breslau | OUT | 20190109 | MIke to review with Horace | |||
Search Guard | @Michael O'Brien | Open | Maybe | 20180109 | |||
spec changes for Dublin | @Dave Williamson |