2022-05-03 DCAE Meeting Notes

S.NO

 Time (est)

 Topics

 Requester/Assignee

 Notes/Links

Notes to moderator

• Start recording

• Participants List

Jakarata Release Updates

@Vijay Kumar 

Completed

• Release Planning: Jakarta

• R10 M1 -DCAEGEN2-2979 -  Rescheduled to 12/09/2021 

• ARC - ONAPARC-724 (Scheduled for 01/25/2022)

• R10 M2 - DCAEGEN2-3009  (01/27/2022) (02/03/2022)

• DCAE R10 Jakarta M2 Release Planning   

• Jakarta Impact View per Component

• R10 M3 - DCAEGEN2-3070  (03/03/2022 03/10/2022)

• R10 M4 - DCAEGEN2-3108  Feature Freeze (03/24/2022 → 03/31/2022)

• DCAE R10 Vulnerability - SECCOM Report (DCAEGEN2-3006)

Ongoing

• R10 RC - DCAEGEN2-3130 (04/28/2022 05/12/2022)

  • Documentation/RTD updates - 95%

  • Closure on OOM patches (supporting gating/test issues) 

  • Pairwise and integration test - DCAE Pair Wise Testing for Jakarta Release

    • Slicing Usecase - E2E Network Slicing Testing

    • IBN/CCVPN Test  - Integration Tests of IBN with CCVPN Use Case for Jakarta

  • Branching - 100%

    • Any new patch for Jakarta MUST be cherrypicked to/from "master" branch to Jakarta branch

• R10 Signoff - (05/12/2022, 06/02/2022)

Only bug-fixes can be merged for Jakata release; master branch can be used for post J release work

Open J issues

@Vijay Kumar 

Open

@Former user (Deleted)  will submit OOM patch and container release once https://gerrit.onap.org/r/c/dcaegen2/services/+/129037 is reviewed/merged (1.1.2)

Review Jakarta Stretch - goal EPIC/Stories

@Vijay Kumar 

-- Discussion deferred for next meeting – 

Review commitments/stretch-goal items from DCAE R10 Jakarta M2 Release Planning   

ML MS (REQ-1074)

1.  

   1. Latest patch submission pending review - https://gerrit.onap.org/r/c/dcaegen2/services/+/127490

      1. Should have all GR and BR code complaince requirements met. 

      2. Need detailed doc for deployment & integration in slice usecase documented in onap wiki

DCAEGEN2-2935 - Support configuration update through Configmap for DCAE service

(Kohn Release)

@Vijay Kumar @Jack Lucas 

-- Discussion deferred for next meeting – 

Review and finalize approach/design for Kohn release

--

Use CBS_CLIENT_CONFIG_PATH env to point to the file required to be sourced by SDK (e.g. /app-config-input/application_config.yaml)

Option#1 To update file mounted post secret replacement to be editable by application ID
Option#2 Put credential into separate file
Option#3 Expose Secret as ENV and let application handle substitution (removing envsubs from dcaegen2 common template)
Option#4 Global approach under OOM for all MS to handle secret which can supported via configmap (via operator)

Option#3 is preferred; dynamic DR provisioning solution may need to enhanced to create secrets (and let SDK do the substitutions)

Kohn Release assessment

-- Discussion deferred for next meeting – 

1. EPIC DCAEGEN2-3119 created for DCAE Helm Transformation - Post migration and deferred activities

   1. DCAEGEN2-2774 - DCAE MS SVC template enhancement

   2. DCAEGEN2-3087 - helm generator should use "log.path" rather than "logDirectory"  (Kohn)

   3. DFC test case (related to config update) disabled currently; will be added back in Kohn release (INT-2074)

2. Add DCAE MS optional component under daily/weekly 

3. Verify/cleanup DL-Feeder charts on consul config

4. DCAEGEN2-3120 (IBN/CCVPN)- Enhance sliceanalysis MS to use DCAE SDK dmaap-client lib  -  @Former user (Deleted)

5. DCAEGEN2-3094 - DR Feed pub/sub (& secret) cleanup on helm uninstall

6. DCAEGEN2-3039 - DFC AAF dependency to be configurable (require non-TLS DR support - dependent on DMAAP-1714)

7. DCAEGEN2-3095 - RESTConf - Make certificate dependencies configurable

8. Sonar coverage improvements - https://sonarcloud.io/organizations/onap/projects?search=dcaegen2&sort=coverage

Other Jira: https://jira.onap.org/browse/DCAEGEN2-3144?filter=12436&jql=project%20%3D%20DCAEGEN2%20AND%20fixVersion%20%3D%20%22Kohn%20Release%22%20%20AND%20status%20not%20in%20(Closed)%20AND%20labels%20not%20in%20(relman%2C%20dcae-mod-poc)

Other usecase/function impacts?

• DMAAP Strimzi migration (REQ-1207: DMaaP Enhancements for K releaseDonePreview)

Topics/Demos' for future meetings

<Topics can be added below by presenters as they are ready>

TBD - OpenSSF Best Practice Goals for DCAE and Secure programming consideration - @Tony Hansen 

@Vijay Kumar

NA

@Tony Hansen

NA

@Jack Lucas

NA

@Former user (Deleted)

NA

@Former user (Deleted)

NA

@Niranjana Y 

NA

COMPONENTS (JAKARTA RLS VERSION)

REVISED from Istanbul RLS

SNAPSHOT

Notes/ChangeLog

onap/org.onap.ccsdk.dashboard.ccsdk-app-os:1.4.4

NO

1.4.4

07/21/2021 - 1.4.4 released (Support for special char in generated PG password
which caused issues on Daily/gating runs)
05/04/2021 - 1.4.3 released
05/03/21  - 1.4.3 Dashboard user/pg insert error

onap/org.onap.dcaegen2.analytics.tca-gen2.dcae-analytics-tca-web:1.3.2

YES

1.3.2

3/18/22 - 1.3.2 released
2/21/22 - 1.3.2 vulnerability updates
09/07/21 - 1.3.1 (master) released (includes Update DCAE-SDK to load config and policies from mounted files + Vulnerabilities fixes + Add AaiSerializer to prevent the duplication entry + Fix AAI HTTPS connection issues)

onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:1.7.1

YES

1.7.1

03/19/21 - 1.7.1 released to fix null pointer issues; merged into OOM

02/15/21 - 1.7.0 released
02/14/21 - 1.7.0 vulnerability updates
09/09/21 - 1.6.1 released
08/24/21 - 1.6.1 SDK version bump from 1.5.0 to 1.8.7 in order to enable config file support

onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:1.10.0

YES

1.10.0

2/24/21 - 1.10.0 released
2/23/21 - 1.10.0 vulnerability updates
2/21/21 - 1.10.0 (currently 1.9.2) scramsha-512 support added

onap/org.onap.dcaegen2.collectors.restconfcollector:1.3.2

YES

1.3.2 (jakarta)
1.2.7 (istanbul)

2/28/22 - 1.3.2 image release submission
## [1.3.2] - 2022/02/23
         - [DCAEGEN2-3043] - Vulnerability updates for J release (gson, logback-core)

## [1.3.1] - 2022/01/20
         - [DCAEGEN2-2857] - RESTConf - Switch CBS client library to 1.8.7 or higher
1/21/22 - 1.2.7. image released
1/18/22 - 1.3.0 base image update + 1.2.7 - log4j upgrade to 2.17.1

onap/org.onap.dcaegen2.collectors.snmptrap:2.0.6

YES

2.0.6

2/11/2022 - 2.0.6 released 02/09 (OOM update pending)
10/27/2021 - 2.0.6 - SNMP Trap collector - STDOUT complaince
07/22/2021 - 2.0.5 CBS client 2.2.1 upgrade
02/26/2021 - 2.0.4 release submitted
02/17/2021 - 2.0.4 py39 support + revise pysnmp version

onap/org.onap.dcaegen2.collectors.ves.vescollector:1.11.0

YES

1.11.0

2/14/22 - 1.11.0 vulnerability updates
1/28/22 - 1.11.0 switch VEScollector base image to integration onap image
1/20/22 - 1.10.3 released
1/19/22 - 1.10.3 log4j issue; upgrade to 2.17.1
12/18/2021 -1.10.2 released
12/14/2021 - 1.10.2 Remediation for Log4Shell vulnerability

onap/org.onap.dcaegen2.deployments.cm-container:4.6.1

NO

4.6.1

08/30/2021 - 4.6.1 released
08/25/2021 - 4.6.1 Upgrade clamp-plugin to 1.1.1 (Fix dcaepolicyplugin dependency)
06/10/2021 - 4.6.0 released
06/07/2021 - 4.6.0  dmaap-1.5.1 plugin inclusion

onap/org.onap.dcaegen2.deployments.consul-loader-container:1.1.1

NO

1.1.1

08/23/21 - 1.1.1 released
08/23/21 - introduce delete_key.sh to remove without error
02/8/21 - Support for yaml uplaod and consul key removal

onap/org.onap.dcaegen2.deployments.dcae-k8s-cleanup-container:1.0.0

NO

1.0.0

onap/org.onap.dcaegen2.deployments.healthcheck-container:2.4.0

YES

2.4.0

12/12/21 - 2.4.0 release (dynamic Add health checks for DCAE microservices deployed after
the initial installation of dcaegen2-services)
11/18/2021 - 2.3.0 released (enhanced logging + base image to latest node.js LTS release)

onap/org.onap.dcaegen2.deployments.k8s-bootstrap-container:3.3.6

YES

3.3.6

02/18/22 - 3.3.6 released
02/15/22 - 3.3.6 Fix for inventory upload issue
09/14/21 - 3.3.5 release (misc blueprint revision for istanbul)
09/08/21 - 3.3.4 released; OOM merge pending (new 3.3.5 to include misc blueprint updates)

onap/org.onap.dcaegen2.deployments.tls-init-container:2.1.0

NO

2.1.0

2/11 - 2.1.0 (dynamic cert)
<2/11 - 1.0.3 (El-alato)

onap/org.onap.dcaegen2.platform.configbinding:2.5.4

NO

2.5.4

09/14/21 - OOM change submitted under https://gerrit.onap.org/r/c/oom/+/124119
5/4/21 - 2.5.4 released; OOM update pending
3/29/21 - 2.5.4 change merged

onap/org.onap.dcaegen2.platform.deployment-handler:4.4.1

NO

4.4.1

2/24/21 - Consul removal in DH will be deferred
9/23 - 4.4.1 - default tenant_id fix

onap/org.onap.dcaegen2.platform.inventory-api:3.5.2

NO

3.5.2

3.5.2 - seccom vulnerability update
3.5.0 (Guilin) - exception 7/13 - 3.5.1 for classnotfound error

onap/org.onap.dcaegen2.platform.policy-handler:5.1.3

NO

5.1.3

0x/x//21 - 5.1.3 docker file issue with volumen mapping and required new container to be rebuild
03/05/21 - 5.1.2 released; OOM update pending

onap/org.onap.dcaegen2.platform.servicechange-handler:1.4.0

NO

1.4.0 

7/17 - 1.4.0 for java11
8/6 - startup issue (DCAEGEN2-1718)
8/6- Version updated for re-release

onap/org.onap.dcaegen2.services.components.bbs-event-processor:2.1.1

NO

2.1.1

09/09/2021 - 2.1.1 released
04/12/2021 - 2.1.1 integration-java11:8.0.0 update

onap/org.onap.dcaegen2.services.heartbeat:2.3.1

NO

2.3.1

07/27/21 - 2.3.1 release 2.3.1 container
- Switch to CBS client lib 2.2.1
- Dockerfile update to remove volume mapping
- OJSI SQL security vulnerability fix
- Misc code cleanup
05/27/21 - 2.2.0 released

onap/org.onap.dcaegen2.services.mapper.vesadapter.universalvesadaptor:1.4.0

YES

1.4.0

03/29/22 - 1.4.0 released
03/29/22 - 1.4.0 introduced to fix CBS/consul lookup

02/28/22 - 1.3.3 release submitted
## [1.3.3] - 2022/02/23
         - [DCAEGEN2-3048] - Vulnerability fixes for J release (xstream,jackson-core,jackson-databind,gson)
1/21/22 - 1.3.2 released
1/18/22 - 1.3.2 log4j fix - upgrade to 2.17.1

onap/org.onap.dcaegen2.services.pm-mapper:1.8.0

YES

1.8.0

2/15/22 - 1.8.0 released
2/14/22 - Allow supports unauthenticated topic and connection without TLS
- Make cert paths field optional in configuration.
- Allow to skip ssl context load.
- Make PublisherConfig and SubscriberConfig fields optional.
- Remove Auth Header when AAF credentials are empty
1/24/22 - 1.8.0 CBS SDK integration
09/09/21 - 1.7.2 released

onap/org.onap.dcaegen2.services.prh.prh-app-server:1.8.0

YES

1.8.0

2/15/22 - 1.8.0 released
02/14/22 - 1.8.0 vulnerability updates
08/31/21 - 1.7.1 released
08/24/21 - 1.7.1 Update DCAE SDK version from 1.6.0 to 1.8.708/11/21 - 1.7.0 released08/10/21 - 1.7.0 - switch AAI variable syntax from config + v11 to v23 apis