2022-06-07 DCAE Meeting Notes

Bridge

[dcaegen2] Team ONAP11, TUESDAY UTC 14:30  (10.30 AM EDT)

ONAP Meeting 11 is inviting you to a scheduled Zoom meeting.

Join Zoom Meeting
https://zoom.us/j/98967242523?pwd=YmhlbGZGU0NjcFBnbDdCS3c1Nnk3UT09

Meeting ID: 989 6724 2523
Passcode: 899004

One tap mobile
+13126266799,,98967242523# US (Chicago)
+16465588656,,98967242523# US (New York)
Dial by your location
+1 312 626 6799 US (Chicago)
+1 646 558 8656 US (New York)
+1 301 715 8592 US (Germantown)
+1 253 215 8782 US (Tacoma)
+1 346 248 7799 US (Houston)
+1 669 900 6833 US (San Jose)
877 369 0926 US Toll-free
855 880 1246 US Toll-free
Meeting ID: 989 6724 2523
Find your local number: https://zoom.us/u/ad1U59khic?


ACTION REQUIRED BY ALL COMMUNITY MEMBERS

All attendees must set their Zoom name in First-name FAMILY-NAME (company) format

Recording:

DCAE_Weekly_06072022_video1007333845.mp4

Attendees:

Host: Vijay Kumar (AT&T)


Discussion Topics:


S.NO Time (est) Topics Requester/Assignee Notes/Links




Notes to moderator

  • Start recording
  • Participants List


Jakarata Release Updates

Completed

Ongoing

  • R10 Signoff - (05/12/2022, 06/02/2022, 06/09/2022) - DCAEGEN2-3173 
    • DCAEGEN2-3123 pending review comment addressal/gerrit merge; will reassign to Kohn as this should not be blocking the release.

Only bug-fixes can be merged for Jakata release; master branch can be used for post J release work



Kohn release


Kohn Release assessment
  1. EPIC DCAEGEN2-3119 created for DCAE Helm Transformation - Post migration and deferred activities
    1. DCAEGEN2-2774 - DCAE MS SVC template enhancement (question)
    2. DCAEGEN2-3087 - helm generator should use "log.path" rather than "logDirectory"  (Kohn) - WIP
    3. DFC test case (related to config update) disabled currently; will be added back in Kohn release INT-2074
  2. Add DCAE MS optional component under daily/weekly - https://github.com/onap/oom/blob/master/kubernetes/onap/resources/overrides/onap-all.yaml - WIP
    1. Dependency on SON-Handler and KPI ms (captured on next item below)
  3. Verify/cleanup DL-Feeder charts on consul config
  4. DCAEGEN2-3120 (IBN/CCVPN)- Enhance sliceanalysis MS to use DCAE SDK dmaap-client lib  -  Former user (Deleted)
    1. https://docs.onap.org/projects/onap-dcaegen2/en/latest/sections/sdk/index.html
  5. DCAEGEN2-3094 - DR Feed pub/sub (& secret) cleanup on helm uninstall - Jack Lucas  - WIP
  6. DCAEGEN2-3039 - DFC AAF dependency to be configurable (require non-TLS DR support - dependent on DMAAP-1714) Former user (Deleted)  WIP
  7. DCAEGEN2-3095 - RESTConf - Make certificate dependencies configurable  Former user (Deleted) Mukesh Paliwal 
  8. Sonar coverage improvements - https://sonarcloud.io/organizations/onap/projects?search=dcaegen2&sort=coverage - Vijay Kumar  to create jira's - DONE
  9. Other Jira: https://jira.onap.org/browse/DCAEGEN2-3144?filter=12436&jql=project%20%3D%20DCAEGEN2%20AND%20fixVersion%20%3D%20%22Kohn%20Release%22%20%20AND%20status%20not%20in%20(Closed)%20AND%20labels%20not%20in%20(relman%2C%20dcae-m1od-poc) - Vijay Kumar  will review/prioritize Kohn items for discussion by next meeting
  10. HV-VES CSIT updates (DCAEGEN2-3172)


Other usecase/function impacts




Add DCAE MS optional component under daily/weekly

Change : https://gerrit.onap.org/r/c/oom/+/129309 to enable all Ms in OOM/gating. SON_Handler and KPI-MS are disabled in latest patchset as temporary workaround until policy configuration dependency is resolved

Two options possible: 

Option#1 - Disable policy configuration from helm charts under oom as both MS comes up with default configuration successfully (and include in documentation to override values.yaml to include policy configuration)

Option#2 - Bootstrap the required policies in Policy Framework deployment under OOM



OGR integration 

Status on review tool integration 

  • Initial trail integration completed for VESCollector (java) and SNMPTrap (python) project repositories
  • Work-in-progress to integrate all other DCAE repo builds with OGR tool validation (currently set to non-blocking)
  • CI jobs will be updated around M2 to mandate OGR check complaince.

Refer https://github.com/TonyLHansen/onap-gerrit-review for list of checks instrumented




Kohn Impacts on Network Slicing & IBN

Review DCAE impact/work planned for Kohn

E2E_Network_Slicing_IBN_DCAE impacts -v1.pptx

E2E Slicing

IBN/CCVPN

  • Specific details reg realtime E2E slicing info subscription/processing to be documented (like details on which DCAE mS is impacted and what data from slicing will be retrieved and how it will be retrieved) Former user (Deleted) Dong Wang 


Meeting updateDCAE meeting for 06/14/2022 will be cancellled (due to conflicts with DDF/Porto event) - next meeting will be on 06/21/2022












Topics/Demos' for future meetings

<Topics can be added below by presenters as they are ready>

TBD - OpenSSF Best Practice Goals for DCAE and Secure programming consideration - Tony Hansen 

Upcoming vacations (committer)


Jakarta Artifacts Tracker


COMPONENTS (JAKARTA RLS VERSION)REVISED from Istanbul RLSSNAPSHOTNotes/ChangeLog
onap/org.onap.ccsdk.dashboard.ccsdk-app-os:1.4.4NO1.4.407/21/2021 - 1.4.4 released (Support for special char in generated PG password
which caused issues on Daily/gating runs)
05/04/2021 - 1.4.3 released
05/03/21  - 1.4.3 Dashboard user/pg insert error
onap/org.onap.dcaegen2.analytics.tca-gen2.dcae-analytics-tca-web:1.3.2YES1.3.23/18/22 - 1.3.2 released
2/21/22 - 1.3.2 vulnerability updates
09/07/21 - 1.3.1 (master) released (includes Update DCAE-SDK to load config and policies from mounted files + Vulnerabilities fixes + Add AaiSerializer to prevent the duplication entry + Fix AAI HTTPS connection issues)
onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.7.1YES
1.7.1

03/19/21 - 1.7.1 released to fix null pointer issues; merged into OOM

02/15/21 - 1.7.0 released
02/14/21 - 1.7.0 vulnerability updates
09/09/21 - 1.6.1 released
08/24/21 - 1.6.1 SDK version bump from 1.5.0 to 1.8.7 in order to enable config file support

onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:1.10.0YES1.10.02/24/21 - 1.10.0 released
2/23/21 - 1.10.0 vulnerability updates
2/21/21 - 1.10.0 (currently 1.9.2) scramsha-512 support added
onap/org.onap.dcaegen2.collectors.restconfcollector:1.3.2YES1.3.2 (jakarta)
1.2.7 (istanbul)
2/28/22 - 1.3.2 image release submission
## [1.3.2] - 2022/02/23
         - [DCAEGEN2-3043] - Vulnerability updates for J release (gson, logback-core)

## [1.3.1] - 2022/01/20
         - [DCAEGEN2-2857] - RESTConf - Switch CBS client library to 1.8.7 or higher
1/21/22 - 1.2.7. image released
1/18/22 - 1.3.0 base image update + 1.2.7 - log4j upgrade to 2.17.1

onap/org.onap.dcaegen2.collectors.snmptrap:2.0.6YES2.0.62/11/2022 - 2.0.6 released 02/09 (OOM update pending)
10/27/2021 - 2.0.6 - SNMP Trap collector - STDOUT complaince
07/22/2021 - 2.0.5 CBS client 2.2.1 upgrade
02/26/2021 - 2.0.4 release submitted
02/17/2021 - 2.0.4 py39 support + revise pysnmp version
onap/org.onap.dcaegen2.collectors.ves.vescollector:1.11.0YES1.11.02/14/22 - 1.11.0 vulnerability updates
1/28/22 - 1.11.0 switch VEScollector base image to integration onap image
1/20/22 - 1.10.3 released
1/19/22 - 1.10.3 log4j issue; upgrade to 2.17.1
12/18/2021 -1.10.2 released
12/14/2021 - 1.10.2 Remediation for Log4Shell vulnerability
onap/org.onap.dcaegen2.deployments.cm-container:4.6.1NO4.6.108/30/2021 - 4.6.1 released
08/25/2021 - 4.6.1 Upgrade clamp-plugin to 1.1.1 (Fix dcaepolicyplugin dependency)
06/10/2021 - 4.6.0 released
06/07/2021 - 4.6.0  dmaap-1.5.1 plugin inclusion

onap/org.onap.dcaegen2.deployments.consul-loader-container:1.1.1NO1.1.108/23/21 - 1.1.1 released
08/23/21 - introduce delete_key.sh to remove without error
02/8/21 - Support for yaml uplaod and consul key removal
onap/org.onap.dcaegen2.deployments.dcae-k8s-cleanup-container:1.0.0NO1.0.0
onap/org.onap.dcaegen2.deployments.healthcheck-container:2.4.0YES2.4.012/12/21 - 2.4.0 release (dynamic Add health checks for DCAE microservices deployed after
the initial installation of dcaegen2-services)
11/18/2021 - 2.3.0 released (enhanced logging + base image to latest node.js LTS release)
onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:3.3.6YES3.3.602/18/22 - 3.3.6 released
02/15/22 - 3.3.6 Fix for inventory upload issue
09/14/21 - 3.3.5 release (misc blueprint revision for istanbul)
09/08/21 - 3.3.4 released; OOM merge pending (new 3.3.5 to include misc blueprint updates)
onap/org.onap.dcaegen2.deployments.tls-init-container:2.1.0NO2.1.02/11 - 2.1.0 (dynamic cert)
<2/11 - 1.0.3 (El-alato)
onap/org.onap.dcaegen2.platform.configbinding:2.5.4NO2.5.409/14/21 - OOM change submitted under https://gerrit.onap.org/r/c/oom/+/124119
5/4/21 - 2.5.4 released; OOM update pending
3/29/21 - 2.5.4 change merged

onap/org.onap.dcaegen2.platform.deployment-handler:4.4.1NO4.4.12/24/21 - Consul removal in DH will be deferred
9/23 - 4.4.1 - default tenant_id fix

onap/org.onap.dcaegen2.platform.inventory-api:3.5.2NO3.5.23.5.2 - seccom vulnerability update
3.5.0 (Guilin) - exception 7/13 - 3.5.1 for classnotfound error

onap/org.onap.dcaegen2.platform.policy-handler:5.1.3NO5.1.30x/x//21 - 5.1.3 docker file issue with volumen mapping and required new container to be rebuild
03/05/21 - 5.1.2 released; OOM update pending

onap/org.onap.dcaegen2.platform.servicechange-handler:1.4.0NO1.4.0 7/17 - 1.4.0 for java11
8/6 - startup issue (DCAEGEN2-1718)
8/6- Version updated for re-release
onap/org.onap.dcaegen2.services.components.bbs-event-processor:2.1.1NO2.1.109/09/2021 - 2.1.1 released
04/12/2021 - 2.1.1 integration-java11:8.0.0 update

onap/org.onap.dcaegen2.services.heartbeat:2.3.1NO2.3.107/27/21 - 2.3.1 release 2.3.1 container
- Switch to CBS client lib 2.2.1
- Dockerfile update to remove volume mapping
- OJSI SQL security vulnerability fix
- Misc code cleanup
05/27/21 - 2.2.0 released
onap/org.onap.dcaegen2.services.mapper.vesadapter.universalvesadaptor:1.4.0YES1.4.0

03/29/22 - 1.4.0 released
03/29/22 - 1.4.0 introduced to fix CBS/consul lookup

02/28/22 - 1.3.3 release submitted
## [1.3.3] - 2022/02/23
         - [DCAEGEN2-3048] - Vulnerability fixes for J release (xstream,jackson-core,jackson-databind,gson)
1/21/22 - 1.3.2 released
1/18/22 - 1.3.2 log4j fix - upgrade to 2.17.1

onap/org.onap.dcaegen2.services.pm-mapper:1.8.0YES1.8.02/15/22 - 1.8.0 released
2/14/22 - Allow supports unauthenticated topic and connection without TLS
- Make cert paths field optional in configuration.
- Allow to skip ssl context load.
- Make PublisherConfig and SubscriberConfig fields optional.
- Remove Auth Header when AAF credentials are empty
1/24/22 - 1.8.0 CBS SDK integration
09/09/21 - 1.7.2 released
onap/org.onap.dcaegen2.services.prh.prh-app-server:1.8.0YES1.8.02/15/22 - 1.8.0 released
02/14/22 - 1.8.0 vulnerability updates
08/31/21 - 1.7.1 released
08/24/21 - 1.7.1 Update DCAE SDK version from 1.6.0 to 1.8.7
08/11/21 - 1.7.0 released
08/10/21 - 1.7.0 - switch AAI variable syntax from config + v11 to v23 apis
onap/org.onap.dcaegen2.services.son-handler:2.1.6YES2.1.63/18/22 - 2.1.6 released
2/14/2022 - 2.1.6 Vulnerability updates
2/10/22 - 2.1.6 Fix bug in triggering control loop for PCI collision/confusion - by replacing Config DB with CPS
10/22/21 - 2.1.5 fix for ves fault layout for collision detection (DCAEGEN2-2943)
09/09/21 - 2.1.4 released
onap/org.onap.dcaegen2.platform.mod.onboardingapi:2.13.0YES2.13.011/12/21 - 2.13.0 image released
09/23/21 - v3 spec integartion (helm support)
02/15/2021 - component spec schema fix to include required parameters for config_map support
01/29/2021 - component-spec-schema updated to support: kafka stream subscribes and publishes, config maps as volumes
onap/org.onap.dcaegen2.platform.mod.distributorapi:1.1.0NO1.1.09/14 - 1.1.0 released
8/19 - 1.1.0 python 3.8 support

onap/org.onap.dcaegen2.platform.mod.designtool-web:1.0.2NO1.0.23/30 - 1.0.2 - nonroot change
1.0.0-SNAPSHOT-20200217T165545Z
onap/org.onap.dcaegen2.platform.mod.genprocessor-http:1.0.2NO1.0.27/13 - 1.0.2 - Guilin sec vulnerability updates
3/30 - 1.0.1 - nonroot change
1.0.0-20200217T215940Z
onap/org.onap.dcaegen2.platform.mod.genprocessor-job:1.0.2NO1.0.27/8 - vulnerability update
3/30 - 1.0.1 - nonroot change
1.0.0-20200217T215940Z
onap/org.onap.dcaegen2.platform.mod.mod-registry:1.0.0NO1.0.01.0.0-SNAPSHOT-20200217T165545Z
onap/org.onap.dcaegen2.platform.mod.runtime-web:1.3.1YES1.3.2
1.2.4 (Istanbul)
3/4/22 - 1.3.2 release submitted
## [1.3.2] - 2022-01-04
- [DCAEGEN2-3028] Change version format to MMddHHmm (removed YY)
- [DCAEGEN2-3008] Update helmgen-core from snapshot to released version
- [DCAEGEN2-3088] Set spring-boot-maven-plugin to 2.6.2
- [DCAEGEN2-3052] Update helmgen-core to 1.0.3 (includes vulnerability fixes for J)
2/18/22 - 1.2.4 released
2/15/22 - 1.2.4 NFE exception fix on Istanbul branch
onap/org.onap.dcaegen2.services.datalakefeeder:1.1.1NO1.1.1 (Istanbul)08/02/2021 -1.1.1 fixed elasticsearch entry + Released
05/11/2021 - 1.1.1 DL feeder released (base image + non-root)
04/19/2021 - 1.1.1 - DL feeder  integration-java11:8.0.0 update + non rootdb (switch mariadb to pg)
04/12/21 - 1.1.1 - DES integration-java11:8.0.0 update + non rootdb (switch mariadb to pg)
2/24/2021 - 1.1.1 for non-root db access
7/29 - java11 upgrade; suggested 1.1.0 version
4/6  - 1.0.2 being released
3/21 - 1.0.2 for non-root
onap/org.onap.dcaegen2.services.datalakeadminui:1.1.1NO1.1.1  (Istanbul)09/03/21 - 1.1.1 released
04/12/21 - 1.1.1 - DES integration-java11:8.0.0 update + non rootdb (switch mariadb to pg)
2/24/2021 - 1.11 docker build error
9/11 - Std o/p log
4/6  - 1.0.2 being released
3/21 - 1.0.2 for non-root
onap/org.onap.dcaegen2.services.pmsh:2.2.2YES2.2.203/22/21 - 2.2.2 released
03/21/22 - 2.2.2 ## [2.2.2]
### Changed
* Bug fix for Create MG (DCAEGEN2-3118)
3/14/22 - 2.2.1 released
  * Swagger Indentation Error (DCAEGEN2-3103)
2/8/22 - 2.0.0 released
Nov-DEC/21 - 2.0.0 several changes (refer Changelog.md)
onap/org.onap.dcaegen2.platform.adapter.acumos:1.0.7YES1.0.702/24/22 - 1.0.7 released
12/15/2021 - 1.0.7 new v3 schema support for helm flow integration
09/13/2021 - 1.0.6 release file submitted; verified in Highstreet lab
onap/org.onap.dcaegen2.services.components.slice-analysis-ms:1.1.2YES1.1.2 

05/04/22 - 1.1.2 released
## [1.1.2] - 2022/05/01
         - [DCAEGEN2-3145](https://jira.onap.org/browse/DCAEGEN2-3145) - Filter RAN related service instances in AAI
         - [DCAEGEN2-3146](https://jira.onap.org/browse/DCAEGEN2-3146) - Fetch CU Cells instead of DU cells data for ML message processing
         - [DCAEGEN2-3147](https://jira.onap.org/browse/DCAEGEN2-3147) - Fix the message content that SLICEANALYSISMS sends to Policy for CCVPN bw adjustment and suppress exceptions and error in job builder

04/24/22 - 1.1.1 released         - [DCAEGEN2-3142]( DCAEGEN2-3142 - Getting issue details... STATUS ) - Filter data from AAI to avoid possible exceptions, remove null parameters in policy payload and add logs

03/22/22 - 1.1.0 released
[SLICEANALYSIS] Release image 1.1.0

    - Jakarta changes in slice-analysis-ms for IBN Cloud leased line update and CCVPN closed-loop.
3/16/22 - 1.1.0 CCPVN/IBM update under review
3/16/22 - 1.0.7 released
[SLICEANALYSIS] Release image 1.0.7

     - Use onap/integration-java11 image
     - Switch CBS client library to 1.8.7
     - Fix null pointer exception while fetching slice-config
     - Remove security vulnerabilities
     - Calculate slice utilization data
     - Migrate SliceAnalysis MS to use unauthenticated topic
     - Update onset message test data
2/10/22 - 1.0.7 vulnerability updates
12/16/21 - 1.0.7 use onap/integration-java11 image

onap/org.onap.dcaegen2.services.datalake.exposure.service:1.1.1NO1.1.1 (Istanbul)5/10/21 - 1.1.1 released (non root + base image change)
04/13/21 - 1.1.1 merged
04/12/21 - 1.1.1 - DES integration-java11:8.0.0 update + non rootdb (switch mariadb to pg)
onap/org.onap.dcaegen2.platform.ves-openapi-manager:1.1.0YES1.1.02/24 - 1.0.1 released 
02/19 - Introduced for H release
onap/org.onap.dcaegen2.deployments.dcae-services-policy-sync:1.0.1NO1.0.104/23/2021 - 1.0.1 released
04/22/2021 - 1.0.1 - include onap pem certificate + file umask fix
02/25/2021 - 1.0.0 released
onap/org.onap.dcaegen2.services.components.kpi-ms:1.0.4YES1.0.43/18/22 - 1.0.4 released
3/16/22 - 1.0.4 release in gerrit
2/10/22 - 1.0.4 vulnerability fixes
onap/org.onap.dcaegen2.platform.mod.auth-service:1.0.0POC1.0.1 (Not released04/30 - 1.0.1 : int base image 8.0.0
onap/org.onap.dcaegen2.platform.mod.catalog-service:1.0.0POC1.0.2 (Not released04/30 - 1.0.1 : int base image 8.0.0
onap/org.onap.dcaegen2.platform.mod.ui:1.0.0POC1.0.0 (Not released)
helmgenerator-core (java library)YES1.0.210/13/21 - [DCAEGEN2-2936] Convert streams_publishes and streams_subscribes json strings under applicationConfig to map
10/04/21 - *  [DCAEGEN2-2911] Refactor the code to make it more testable
    - Converted some static methods to instance methods
*  [DCAEGEN2-2911] Distributor throws an error if distribution fails
*  [DCAEGEN2-2917] Add helm repo registry step when initializing the helm client
    - Add "helm repo add ..."
    - Add "helm deployment update" before linting
Service  SDK : 1.8.8Yes1.8.802/09/21 - 1.8.8 released
02/08/21 - 1.8.8 - Spring-Boot version to 2.5.9
08/02/21 - 1.8.7 released
07/30/31 - 1.8.7 Make CBS-Client config and policy file paths configurable by environment variables

Istanbul Artifacts Tracker

https://docs.onap.org/projects/onap-dcaegen2/en/latest/sections/release-notes.html#deliverables


Open Action Items