OOM Meeting Notes - 2024-03-27
Attendee-List:
@Andreas Geißler
@Andrew Lamb
@Jack Lucas
@Marek Szwałkiewicz
@Mateusz Pilat
@Byung-Woo Jun
@Shrikant.Tarale
Agenda
Video:
Today's topic:
Patches:
Mongo resources correction: https://gerrit.onap.org/r/c/oom/+/137526
MR indepenency:
SO
Patch for SO-bpmn-infra (https://gerrit.onap.org/r/c/oom/+/137159?usp=search)
Policy
Patch for Policy (https://gerrit.onap.org/r/c/oom/+/137529?usp=search) → ongoing
NBI
Patch for NBI only in DT internal fork, as NBI in Archived mode)
TSC Decision request for "NewDelhi"
→ if we disable MR, should we disable NBI ?
HOLMES
No patch available, as not active
TSC Decision request for "NewDelhi"
→ if we disable MR, should we disable Holmes ?
SDNC
SDNC-DMAAP-Listener (to be checked)
Is the Listener required ?
currently listening on, but none topic exists:
DEBUG 2024-03-25 17:45:31.268 +0000 DmaapListener - Initializing consumer org.onap.ccsdk.sli.northbound.dmaapclient.OofPciPocDmaapConsumers(/opt/onap/sdnc/data/properties/dmaap-consumer-oofpcipoc.properties) DEBUG 2024-03-25 17:45:31.275 +0000 DmaapListener - Initializing consumer org.onap.ccsdk.sli.northbound.dmaapclient.A1AdapterPolicyDmaapConsumer(/opt/onap/sdnc/data/properties/dmaap-consumer-a1Adapter-policy.properties) DEBUG 2024-03-25 17:45:31.282 +0000 DmaapListener - Initializing consumer org.onap.ccsdk.sli.northbound.dmaapclient.CMNotifyDmaapConsumer(/opt/onap/sdnc/data/properties/dmaap-consumer-CMNotify.properties) DEBUG 2024-03-25 17:45:31.288 +0000 DmaapListener - Initializing consumer org.onap.ccsdk.sli.northbound.dmaapclient.SdncRANSliceDmaapConsumer(/opt/onap/sdnc/data/properties/dmaap-consumer-RANSlice.properties) ...INFO 2024-03-25 17:46:07.549 +0000 SdncDmaapConsumer - A1AdapterPolicyDmaapConsumer received ResponseMessage: No such topic exists.-[A1-P] INFO 2024-03-25 17:46:07.548 +0000 SdncDmaapConsumer - CMNotifyDmaapConsumer received ResponseMessage: No such topic exists.-[CM-NOTIFICATION] INFO 2024-03-25 17:46:07.551 +0000 SdncDmaapConsumer - SdncDhcpEventConsumer received ResponseMessage: No such topic exists.-[VCPE-DHCP-EVENT] INFO 2024-03-25 17:46:02.473 +0000 SdncDmaapConsumer - SdncLcmDmaapConsumer received ResponseMessage: No such topic exists.-[SDNC-LCM-READ] INFO 2024-03-25 17:46:02.472 +0000 SdncDmaapConsumer - OofPciPocDmaapConsumers received ResponseMessage: No such topic exists.-[SDNR-CL] INFO 2024-03-25 17:46:02.448 +0000 SdncDmaapConsumer - SdncRANSliceDmaapConsumer received ResponseMessage: No such topic exists.-[RAN-Slice-Mgmt]
TSC Decision request for "NewDelhi"
→ if we disable MR, should we disable SDNC DmaaP Listener ?
DCAEGEN2-Services MSs
dcae-ves-collector →
dcae-prh → , https://gerrit.onap.org/r/c/oom/+/137153
dcae-pmsh
dcae-tcagen2
dcae-son-handler
dcae-slice-analysis-ms
dcae-heartbeat
dcae-kpi-ms
dcae-datafile-collector
dcae-snmptrap-collector
(UPDATE info by DT) So there is a DCAE SDK for interaction with DMaaP.
We have changed the implementation of that SDK to talk to Kafka directly.
This new SDK is now used in VES collector and PRH services.
If other services are using the SDK to talk to DMaaP, they can use this new version now.
We have updated documentation of this SDK as well.https://docs.onap.org/projects/onap-dcaegen2/en/latest/sections/sdk/apis.htmlTSC Decision request for "NewDelhi"
→ if we disable MR, should we disable all DCAE MS, which are not migrated to native Kafka ?
Patch for imagePullSecet: https://gerrit.onap.org/r/c/oom/+/137537
DB Operators:
Postgres-operator → https://gerrit.onap.org/r/c/oom/+/136179?usp=search
needed patches for CPS, Multicloud, UUI
MariaDB Operator needs to be updated to 0.27.0
Means also update of CRD !!
Update of documentation and template (TBD)
MongoDB
Internal DB (Bitnami) update → https://gerrit.onap.org/r/c/oom/+/137439?usp=search
Operator (Percona) → (TBD) https://gerrit.onap.org/r/c/oom/+/136873?usp=search
Problem: does not support "unauthenticated" access as needed by NBI and MultiCloud
Add mongodb-init chart to be added (TBD)
Readiness patches for MariaDB-operator based components
https://gerrit.onap.org/r/c/oom/+/137498 flexible check target
better: more flexible ReadinessCheck to e.g. to wait for CR readiness (https://git.onap.org/oom/readiness/)
Implementation done in Version 16.0.2 (https://gerrit.onap.org/r/q/project:oom%252Freadiness)
Use new ReadinessCheck in OOM (https://gerrit.onap.org/r/c/oom/+/137573?usp=search)
SDNC API update
Sanket found the issues and we clarified with the CCSDK team, that the SO will be changed to be compatible with the RFC API
see: https://onapproject.slack.com/archives/C01CXF3JH2L/p1709822174923959
Sucessfully tested in oom-daily-master-sm
New patch planned for SO-bpmn
SDNC Bug:
DGBuilder not working → SDNC-1836: DGBuilder cannot display XML filesDelivered created
no further news..
Charts have host paths mounted (etc. /etc/localtime), which conflicts with common policies (at least in DT)
we need to check the OOM charts and remove these paths, if possible
e.g. https://gerrit.onap.org/r/c/oom/+/137479?usp=search (AAI)
Question: is the /etc/localtime required by components to set the timezone ?
Hardening Istio with SPIRE/SPIFFE (https://blog.spiffe.io/hardening-istio-security-with-spire-d2f4f98f7a63) → need to check within DT
Used in NephioFYI, Service Mesh + SPIFFE infrastructure ongoing study in Nephio, Study: Nephio security collaboration study
There is a separate study in Nephio for workload registration and workload/node attestation, https://docs.google.com/presentation/d/1L79WrZ64Uar3IrH-jL_IeQTlPoLtXGZKHIIfVCXLoco/edit#slide=id.g2c18d699447_0_40
System Platform Updates:
Update Kubernetes Version 1.28.6 → 1.29.x (?)
Istio Version 1.19.3 → 1.21.x (Would require configuration changes)
Operator Updates:
mariadb-operator (0.27.x)→ require patch to onap-common charts
strimzi-kafka (https://gerrit.onap.org/r/c/oom/+/137184?usp=search)
Keycloak/Oauth2Proxy/Realm
Update of Keycloak version OOM-3267: Update Keycloak to a new release (e.g. keycloakx)Closed
Update of Oauth2Proxy version (7.5.1) and update of configuration (check with @Mateusz Pilat ): OOM-3268: Update OauthProxy to the latest version and update configurationClosed
Received charts for "authentication" creating:
Keycloak deployment
Realm creation for keycloak
Oauth2 setup and configuration incl. Redis setup
Created a page to sum up the proposal (Improvement for NewDelhi Release)
Questions:
MeshConfig (see https://docs.onap.org/projects/onap-oom/en/latest/sections/guides/infra_guides/oom_infra_base_config_setup.html#istio-service-mesh=
vs. RequestAuthenticationOauth2-proxy config
Strimzi/Kafka Update
Currently testing strimzi-operator update and Kafka update 3.4.0→3.6.x
Possibly the MR is not compatible with a new Kafka version
I checked with @Fiachra Corcoran , he thinks Lifeness/Readiness probes
Tata (@ematpil ) install ONAP Montreal/London and made improvements
will show improvements Tata did and might contribute to OOM
Presentation shown: (Platform Customization-oom v2.pptx) .
→ Enhancements proposed:
Security enhancements (e.g. Keycloak/OAuthProxy, AuthorizationPolicy,...) eg: authentication.tar, oauth2 +KC research: rbac_research_wrap.pdf
Logging enhancements,...
Others:
Change "bash" to "sh"
Started by Orange, but not finished
Describe ONAP component deployment via ArgoCD
create "Application" config dir in oom repo ?
Open Jira issues:
T | Key | Summary | Assignee | Reporter | P | Status | Resolution | Created | Updated | Due |
---|---|---|---|---|---|---|---|---|---|---|
Alexander Dehn | Alexander Dehn | In Progress | Unresolved | Apr 27, 2023 | Apr 27, 2023 | |||||
service-mesh-wait-for-job-container fails, when no sidecar exists | Andreas Geissler | Andreas Geissler | Open | Unresolved | Apr 27, 2023 | Apr 27, 2023 | ||||
Alexander Dehn | Alexander Dehn | In Progress | Unresolved | Apr 25, 2023 | Apr 26, 2023 | |||||
Alexander Dehn | Herbert Eiselt | In Progress | Unresolved | Apr 24, 2023 | Apr 27, 2023 | |||||
Andreas Geissler | Andreas Geissler | Open | Unresolved | Apr 24, 2023 | Apr 24, 2023 | |||||
Marek Szwałkiewicz | Marek Szwałkiewicz | Open | Unresolved | Apr 24, 2023 | Apr 24, 2023 | |||||
Kiali Validation - KIA0601 - Port name must follow [-suffix] form | Fiete Ostkamp | Fiete Ostkamp | In Progress | Unresolved | Apr 19, 2023 | Apr 19, 2023 | ||||
Andreas Geissler | Andreas Geissler | Open | Unresolved | Apr 19, 2023 | Apr 19, 2023 | |||||
Fiachra Corcoran | Andreas Geissler | Open | Unresolved | Apr 13, 2023 | Apr 13, 2023 | |||||
Miroslav Masaryk | Miroslav Masaryk | Open | Unresolved | Apr 12, 2023 | Apr 13, 2023 | |||||
Andreas Geissler | Andreas Geissler | Open | Unresolved | Mar 31, 2023 | Apr 13, 2023 | |||||
Andreas Geissler | David McBride | In Progress | Unresolved | Mar 30, 2023 | Apr 26, 2023 | |||||
Andreas Geissler | David McBride | Open | Unresolved | Mar 30, 2023 | Mar 30, 2023 | Mar 23, 2023 | ||||
Andreas Geissler | Andreas Geissler | Open | Unresolved | Mar 21, 2023 | Mar 21, 2023 | |||||
The chartmuseum binary download URL not working in OOM deployment | Andreas Geissler | Sankar Palanivel | Open | Unresolved | Mar 09, 2023 | Apr 13, 2023 | ||||
Unassigned | Andrew Lamb | Open | Unresolved | Mar 06, 2023 | Mar 08, 2023 | |||||
Unassigned | Andrew Lamb | Open | Unresolved | Mar 06, 2023 | Mar 08, 2023 | |||||
Unassigned | Andrew Lamb | Open | Unresolved | Mar 06, 2023 | Mar 08, 2023 | |||||
Unassigned | Andrew Lamb | Open | Unresolved | Mar 06, 2023 | Mar 08, 2023 | |||||
Unassigned | Andrew Lamb | Open | Unresolved | Mar 06, 2023 | Mar 08, 2023 |
Showing 20 out of 103 issues Refresh
Backlog from older meetings (to be cleaned up)
Pending component fixes:
(2023-05-03: No update)
CDS-UI CCSDK-3814 - CDS-UI must be able to listen on HTTP Open → DT /TM has a look
maybe postpone to M
SO Monitor SO-4027 - Make SO-Service-Monitor ServiceMesh compatible Open → Byung mentioned, that E/// team try to resolve the issue (Byung's note: It was assigned to Viresh Navalli, Capgemini. E/// plans to assist Viresh as needed.)
→ postpone to MontrealCLI will not work without fix... ( OOM-3096 - [CLI] Remove AAF dependency Delivered )
UUI - not clear if working
Helm chart cleanup: OOM-2975 - Remove dependencies on AAF Open
(2023-05-10: No update)
Common → Andreas
Platform
MSB
VFC
Ingress enhancements for non-HTTP interfaces:
External Kafka access → https://gerrit.onap.org/r/c/oom/+/133767
SDNC CallHome (SSH) → part of https://gerrit.onap.org/r/c/oom/+/133861
Plan to update _ingress.tpl for Gateway-API support and AuthorizationPolicy
Oauth2-proxy setup (Andreas):
(2023-05-03: No update)
Documentation: Oauth2-Proxy implementation and configuration
Oauth2-Proxy: https://gerrit.onap.org/r/c/oom/+/130445
Adding Oauth2-proxy client to ONAP realm: https://gerrit.onap.org/r/c/oom/+/133699
To be started:
(2023-05-03: No update)
Ingress template improvements:
Remove unused components:
OOM-3074 - Remove components and options from charts Open
MariaDB:
OOM-3072 - Resolve and improve the existing MariaDB-Galera templates Open → DT (with TM) to investigate
Remove NodePort in Ingress environments:
OOM-3012 - Remove NodePort in Service definitions under ServiceMesh In Progress → will be automatically fixed with cleanups
UDP Ingress support:
UDP Nodeport support in _service-tpl OOM-3107 - Allow NodePorts for UDP services Open → can be closed
Possible solution: UDPRoute support in Gatway-API
Others:
(2023-05-03: No update)
SDC Listener HTTP issue SDC-4233 - SDC Distribution Client should work with lower-case Header entries Closed → Marek provided patch → merged, need to be released and can be used in the clients
When released, all clients need to be updated (CDS, AAI, Policy, SO, ...)
Create tickets for all clients....
2023-05-31: Discussed presentation to TSC/PTL meeting proposing a new global requirement to rely (exclusively) on service mesh mechanisms for intra-ONAP authentication and authorization (get rid of HTTP basic auth). To be presented to TSC on 2023-06-01.