Attachments (including meeting recording): 20200708 AAI Weekly Meeting.mp4

guochuyi and dhebeha mj brought some proposed AAI schema and edge rule changes to the meeting that need to be reviewed by our modeling experts that were not on the call. guochuyi & dhebeha mj have the action items to share the decks with William Reehil who will solicit input from @David Whitney and Chandra Cinthala

AAI proposal on E2E Network Slicing for R7-V1.2.pptx

AAI CNF Modeling

OPEN

aai ← link to the AAI weekly CNF call. This team will be doing modeling work to decide how CNFs will be modelled in AAI

aai/oom chart

Currently AAI manages our own helm chart as a submodule of oom, at Frankfurt release sign-off, the oom team will pull the aai charts back into the main repo. We will still have to maintain the aai/oom repo in case a patch is needed for elalto or frankfurt.

Jimmy contacted Sylvain on this topic, requesting they (oom team) handle this work and we support, awaiting response.

AAI PTL Election

James Forsyth

OPEN

Election season is underway and the AAI team will be accepting nominations for PTL. Eligible votes on PTL are AAI committers.

Jimmy is stepping down from ONAP PTL role and will not self nominating.

New Committer on AAI

DONE

James Forsyth is nominating William Reehil as an A&AI committer. There will be a vote on this by the A&AI committers and then approval from TSC.

Bill was approved by the TSC and is officially a committer! Congrats Bill

TSC Approved, and William Reehilself promoted to committer.

Guilin non-functional proposals

OPEN

Focus on seccom requirements done first, fixing haproxy
No root user in the docker - use integration team guidance for setting a USER in the Dockerfile rather than gosu (see aai-resources) and fix haproxy. We might consider adding aaiadmin to the base image, and then just set USER aaiadmin in Dockerfile
AAI-2822 - Getting issue details... STATUS
Move haproxy functionality into k8
Move aai/oom chart back to oom AAI-2914 - Getting issue details... STATUS
Move to Spring boot 2 (aai-parent inherits oparent:2.1.0)
Java 11 (oparent 3) - need to consider downstream dependencies on ONAP carrier partners
Use AAF certificate manager
Remove all hardcoded secrets
AAI needs to be able to run without AAF (means no HTTPS)
Upgrade to latest versions of 3rd party dependencies - EclipseLink and gremlin
Better coverage on javascript repos (graphgraph and sparky-fe)
Commit to a % increase in code coverage
SONAR bugs / security / code smells
Platform maturity - performance testing (Bell Canada has interest; if test suites could be upstreamed there could be resources to help us move our PM metrics up)
Security assurance document for CII badging

Guilin release - non-functional requirements proposed list

Guilin Functional requirements proposals

OPEN

Use Case Realization Meeting Register MoM

Guilin release - functional requirements proposed list - pay special attention to the "Documenting ONAP APIs" section by Andy Mayer. The team from Orange might be interested in developing tooling around generating a more user-friendly AAI API documentation section on readthedocs.

Requirements for inclusion of GraphGraph in Guilin release

OPEN

List goes here

Open Jira tickets as tasks for G release

AAI-2910 - Getting issue details... STATUS

AAI-2911 - Getting issue details... STATUS

AAI-2912 - Getting issue details... STATUS

AAI-2913 - Getting issue details... STATUS

Document AAI repo and microservice descriptions

Ondrej

OPEN

Put the link here for the document; we will share with the community and solicit feedback from repo/mS owners about the document.
AAI-2924 - Getting issue details... STATUS

Frankfurt Defects

key	summary	type	created	updated	due	assignee	reporter	priority	status	resolution

Refresh

SOTNNI use case

shashikanth.vh

https://gerrit.onap.org/r/c/aai/schema-service/+/102298

Service model and schema impact

Benjamin Cheung

Security Requirements for pods

James Forsyth

REQ-215 - Getting issue details... STATUS

Ondrej F

OPEN

Graphgraph not included in OOM deployment. How can we make it an essential part of the ONAP deployment.

Step 0: Make it stable. Fix the docker build Jenkins jobs for graphgraph, may need to upgrade to a version of npm to be acceptable to graphgraph. Needs to fit into the LF global-job jobs.

Brownfield / deployed / embedded inventory systems and AAI

Fred from Verizon

OPEN

How do we accelerate migration using A&AI and the RunTime DB solution

Proposed a topic to be explored by AI&I and other ONAP WGs.

High impact, common interest among most CSPs

Status Quo:

Most operators have multiple, siloed, possibly overlapping topology and inventory (domain specific) databases

Goal is to integrate ALL Inventory, and Topology databases into a Unified AI&I Architecture modeled DB which would contain ALL VNFs (VMs/Containers), PNFs, plus support easy expansion for future Inventory & Topology constructs/technologies.

May take considerable time/investment (both are short).

Targeted Objectives

Fast integration/consolidation time
Minimize impact to business systems during migration
Reduce throw away code
Reduce throw away integration work
Improve Service/Resource LCM & SA, especially for 5G

How to accelerate the migration to Unified Database?

Phased Externalization of key PNF/VNF/CNF attributes currently stored in multiple inventory and topology silos.
Simplify the eventual consolidation of Inventory and Topology DBs using proposed automation tools and advanced discovery capabilities supporting the above
Leverage AI&I and possibly the ONAP Runtime Config DB and other ONAP WGs to help solve the problem
Proposed topic can be explored by the AI&I and other ONAP WGs.
Need to expand this preliminary list

SONAR coverage report

James Forsyth

DONE

https://sonarcloud.io/organizations/onap/projects

AAI-2793 - Getting issue details... STATUS

James Forsyth, the main reason behind these discrepancies is the fact that SonarQube is based on version 6.7.1 and SonarCoud is version 8+

After migrating to SonarCloud, we fetch updates they do automatically without the need of doing any manual upgrade. Since we migrated, few things have changed. For example:

LF does no longer mark warnings in the reports, only pass or fail
LF is no longer able to manage individual quality profiles per language. Whatever latest support is there, we fetch this automatically in our side.
Jacoco plugin has changed quite a bit, we need to make sure our reports are now xml based instead of exec. I think this can be the main reason why you are facing coverage drops. Can you please check? This is what Sonar mentioned to me in detail:
- https://community.sonarsource.com/t/sonar-coverage-dropping-to-0-for-some-projects/18521/2

You can find more info in the wiki :https://wiki.onap.org/display/DW/SonarCloud+migration+from+SonarQube

Update 19 Feb: All Fixed except: aai-sparky-be, aai-esr-server and aai-validation. Jimmy is working on them.

Looking for volunteer to fix papyrus issue

OPEN

AAI-2771 - Getting issue details... STATUS

Graphgraph doesn't parse the latest AAI schema correctly. Need someone to investigate

Spring boot upgrade issue

DONE

AAI-2528 - Getting issue details... STATUS

AAI-2769 - Getting issue details... STATUS

2 Spring beans with the same name is disallowed in Spring boot 2

sparky and data-router certificate issue

Francis Paquette

IN PROGRESS

Sparky is using the AAF certificate interaction with Portal but a self-signed certificate to talk to search-data-service. The search-data-service key story was removed.

AAI-2765 - Getting issue details... STATUS

AAI-2766 - Getting issue details... STATUS

Collab efforts

James Forsyth

Giulio Graziani

Kuldeep Singh Negi

Former user (Deleted)

IN PROGRESS

Windriver Lab Change

James Forsyth

DONE

The Intel/Wind River lab was relocated into a new data center last week. The only change required to connect to the new location is to update the VPN IP in the .ovpn file. Here is the change:

[sgooch@atl-sgooch-lx ~]$ diff -u pod-onap-01.ovpn.org pod-onap-01.ovpn

--- pod-onap-01.ovpn.org 2020-01-13 13:03:03.960856010 -0500

+++ pod-onap-01.ovpn 2020-01-09 18:27:03.560549576 -0500

@@ -5,7 +5,7 @@

client

dev tun

proto tcp

-remote 192.55.48.241 443

+remote 146.152.204.133 443

resolv-retry infinite

auth-nocache

nobind

Discuss developers call time

James Forsyth

DONE

Tuesdays @ 9 AM US/Eastern, 19:30 India Standard Time

SO query in AAI

shashikanth.vh

DONE

NNI Use Case - discovering 2 topologies from the network

Use case is asking for the ability in AAI to link an underlay and overlay together by having a cousin relationship between 2 PNFs. Asking Chandra Cinthalato verify if that edge rule can be added for the Frankfurt release.

Per Chandra: "I think pnf -> pnf edge is redundant and not needed as we can traverse (thru a logical or physical interface) from pnf -> p-interface/l-interface -> pnf."

shashikanth.vh will let the AAI team know if that solves the problem

Chandra Cinthala please note: According to shashikanth.vh, the team requires a relationship from an overlay topology node to an underlay topology node; by using the p-interface in overlay we cannot traverse to underlay node. Suggest to allow an edge for PNF→PNF, which is consistent with RFC 8345 model

Search guard issue

Giulio Graziani

ON HOLD

Merged and released yesterday; issue is closed.

AAI-2617 - Getting issue details... STATUS

Tracking for Frankfurt:

AAI-2677 - Getting issue details... STATUS

Search guard container no longer available so elasticsearch-sg won't build. Search guard allows us to secure the elastic communication, which in older versions was not available but newer versions have support for secure communication.

https://www.elastic.co/blog/dear-search-guard-users

Consider opendistro as replacement for search-guard

Can we consider this one:

https://docs.search-guard.com/latest/search-guard-community-edition

E2E Network Slicing

LIN MENG

DONE

For the E2E Network Slicing use case for Frankfurt Release, we intend to leverage the nested service model work that has been going on since Dublin release. From A&AI perspective, we foresee that the schemas would have to be enhanced to cover network slicing models. We have considered A&AI to be a stretch goal for Frankfurt, though we are committing resources. So, we would like to start the discussion in the coming weeks, and subsequently implementation work to try our best to complete the implementation for Frankfurt. AAI-2600 has been created just to indicate the SDC impacts, we will update it with more details, and also join the A&AI weekly call during the next 1-2 weeks to discuss further.

Portal SDK Upgrade

James Forsyth

IN PROGRESS

AAI-2726 - Getting issue details... STATUS

Francis Paquette need evaluation of feasibility in Frankfurt for sparky

GraphGraph Image Missing in Nexus

Venkata Harish Kajur

OPEN

Graph Graph Images are missing from nexus and it needs to be resolved in order for elalto deployment to be successful.

OOM-2161

How did this docker image get pushed to nexus and why was it removed from nexus?

Graphgraph was removed from the default helm chart, but we still need to get these jobs fixed.

James Forsythwill look at it and ask Former user (Deleted)for guidance on this - looks like some jjbs are missing and configs are probably wrong, too.
Ondrej F will reach out to Pavel and see if we can figure out why the build and stage jobs are failing.

Data-router not starting

James Forsyth

IN PROGRESS

Assigned AAI-2727 - Getting issue details... STATUS to Steve Blimkie

AAI-2730 - Getting issue details... STATUS

Cassandra 3

James Forsyth

Venkata Harish Kajur

DONE

SDC wants to move up to Cassandra 3 in the shared db environment.

AAI-2731 - Getting issue details... STATUS

https://old-docs.janusgraph.org/0.3.2/version-compat.html

Java 11

James Forsyth

ON HOLD

Venkata Harish Kajur tried schema service, a couple of dependency changes were required to get it to start. Eclipselink that is currently configured is incompatible.

<groupId>javax.activation</groupId>
<artifactId>activation</artifactId>

is also incompatible

Needs more investigation for other repos

Need new common image (which Alpine image would we pick?)

AAI UI Issue

Former user (Deleted)

AAI Committers

James Forsythwill ask cl664y@att.comabout the status of a committer who has left the company (Tian Lee has left Amdocs, do we revoke committer status?)

Peng He is a potential committer on ESR (currently only Jimmy can commit ESR code)

Code Test Coverage

James Forsyth

Goal for Frankfurt is 55%

AAI-Common 58.7
AAI-Champ 58.3
AAI-DataRouter 58
AAI-GraphAdmin 56.6
Schema Service 56.7
Sparky 57.3
Spike 56.3

Steve Blimkie will check with architects around the utility of champ and spike in the context of ongoing support in ONAP
James Forsyth will set them to read-only (gizmo, champ, spike) and El Alto will be the final release version of those microservices AAI-2732 - Getting issue details... STATUS
James Forsyth will remove the jenkins jobs on those repos

AAI-2733 - Getting issue details... STATUS

sparky-fe AAI-2711 - Getting issue details... STATUS

graphgraph AAI-2713 - Getting issue details... STATUS

Upcoming R6 Functional Requirements

Benjamin Cheung

IN PROGRESS

Release 6 (Frankfurt) proposed use cases and functional requirements

Use Case Realization Call: September 25, 2019

AAI-2600 - Getting issue details... STATUS

We have created REQ-158 - for this use case. For AAI impacts, we have created AAI-2600 - A&AI support of Network Slicing Demo in Frankfurt.Reg. details of the AAI impacts, this is still being worked out, as there is an alternative proposal, and we are trying to align w.r.to scope & impacts. We will share more details in the coming days. The overall use case will also be presented to the Architecture Sub-committee for approval (based on the f2f discussions that happened in Antwerp 2 weeks ago).

AAI-2670 - Getting issue details... STATUS

James Forsyth No status yet, will ask on UCR call today

AAI-2671 - Getting issue details... STATUS

We are currently reviewing the list of items we found in the BBWF BBS testing and once we sort through them we will communicate the results back to ONAP community.

Regarding AAI specifically, we do not foresee any new requirements for Frankfurt, but we would like to conclude the review first before jumping to final conclusions.

AAI-2672 - Getting issue details... STATUS

James Forsyth No status yet, will ask on UCR call today. Followed up, no representation from use case. Will look for response via email.

AAI-2673 - Getting issue details... STATUS

We are not expecting any changes at this time. Tech Mahindra is working on populating a&ai with the VNF specific information from K8S. There is a chance that we realize some changes to the schema, but we don’t expect any changes to the code.

AAI-2674 - Getting issue details... STATUS

During run-time solution there are AAI impacts. Run-time solution is not planned for Frankfurt release. Only Import Service Catalog solution in SDC is targeted for F release.

AAI Impact highlights:

After Service Order decomposition in SO, CFS Service Instance details will be stored in AAI.

After response from 3^rd^ Party Domain, RFS instance details will be updated in AAI.

The sequence diagram depicts the run time view of Third Party Order Activation using the on-boarded service definition and highlights AAI impacts.

ReUse in AAI:

We plan to leverage the SPPartner model, created for CCVPN, to store the 3^rd^ Party details in AAI.

org.onap.aai.domain.yang.SpPartner present in aai-schema v15

James Forsyth Confirm on UCR call that this is object re-use and test only support from AAI

AAI-2623 - Getting issue details... STATUS

Have done some prototyping in Dublin to ingest topology from external controllers and show them in A&AI. Will need more work to act on notifications from controllers and keep the topology in sync

AAI-2678 - Getting issue details... STATUS

For the 5G Bulk PM use case in R6, I’m attaching a few slides showing how we think AAI can be used as part of the UC realization. We are currently making the following assumptions:

PNF and VNF models contain status attribute that can indicate when a new instance has been fully instantiated (may still require update to SO workflow)
AAI will send topology event on AAI-EVENT topic when status attributes are updated

Can you review the slides and the assumptions above and let us know if you see any issue. We can also setup a separate meeting if needed.

Note: I will share the same slides on the SO weekly meeting today.

Frankfurt Release Requirements

James Forsyth Follow up on URC call today

Migration

Ankit Bhatt

IN PROGRESS

What is the purpose of MigrateCloudRegionUpgradeCycle migrator in onap graphadmin migration framework?

Need William LaMont to check on this by 23 Oct 2019

From Casablanca to Dublin, should these be run?

v14/MigrateMissingFqdnOnPservers
v13/MigrateVnfcModelInvariantId
v13/MigrateModelVer

Migration will check if it's already been run, and won't run again.

Jira task created to track this: AAI-2689

API

Former user (Deleted)

Questions regarding how to use the api

AAI Graphical User Interface

Sparky Running on Node Port: 30220

AAI Schema Service

AAI Schema Service Use Case Proposals

AAF / AAUI data preload

Francis Paquette

Reneal Rogers

IN PROGRESS

Status on

AAI-2475 - Getting issue details... STATUS

AAF-986 - Getting issue details... STATUS

NexusIQ

James Forsyth

IN PROGRESS

Pain, pain, pain. 218 items that must be documented currently across the AAI repos, expanding all the time.

1) We need a repo strategy

2) We need a maintenance strategy

3) We need a versioning strategy

4) We need responsible parties for each repo / component

5) Strategy for oparent dependency management

ESR

James Forsyth

Bo Lv
Former user (Deleted)

IN PROGRESS

Need to know if the ZTE team who built ESR intends to continue to support this sub-project in Frankfurt. Multiple Jira issues were not worked in Dublin / El Alto, which leads me to think that the ESR project might need to be deprecated. Inviting Bo Lv and Former user (Deleted)to see what the current status is.

Hi, we didn't have resources for ESR in El Alto, and I(Huabing Zhao) and Lv Bo won't be able to contribute to ESR in F release, but Peng He will continue supporting ESR in F release on behalf of ZTE team. Please add him in the loop for the ESR related issues.

AAI-2653 - Getting issue details... STATUS

AAI-2640 - Getting issue details... STATUS

AAI Openlab Tenant Space

James Forsyth

IN PROGRESS

A kubernetes cluster is installed in WR using RKE

NFS node is 10.12.5.10

Followed these instructions https://docs.onap.org/en/latest/submodules/oom.git/docs/oom_setup_kubernetes_rancher.html?

Need to determine what gets installed, testing opportunities, CSIT, distribution flows, etc.

v17 schema for Frankfurt

shashikanth.vh

ON HOLD

Since the CCVPN SOTN proposal is in progress already, could we have the v17 schema introduced into master branch to receive the updates for Frankfurt release? AAI-2607 - Getting issue details... STATUS

See also AAI-CCVPN-Extension-SOTN Proposals for Frankfurt Release and AAI-2593 - Getting issue details... STATUS

AAI-2594 - Getting issue details... STATUS already added some v17 files but needs more work to be complete.

AAI Bugs

James Forsyth

IN PROGRESS

key	summary	type	created	updated	due	assignee	reporter	priority	status	resolution	fixversions

Refresh

Docker images not pushing

James Forsyth

DONE

docker pull nexus3.onap.org:10003/onap/babel:1.5.0 - 1.5.1 pushed, will be release version
docker pull nexus3.onap.org:10003/onap/aai-champ:1.5.1 - 1.5-STAGING-latest available, no tagged images

docker pull nexus3.onap.org:10003/onap/aai-gizmo:1.5.0 - 1.5.2 pushed, will be release version

docker pull nexus3.onap.org:10003/onap/aai-data-router:1.5.0 - 1.5.1, will be release version

docker pull nexus3.onap.org:10003/onap/aai-search-data-service:1.5.0 - 1.5-STAGING-latest available, no tagged images AAI-2595 - Getting issue details... STATUS

docker pull nexus3.onap.org:10003/onap/elasticsearch-sg:1.5.0 - same as search data service

docker pull nexus3.onap.org:10003/onap/aai-model-loader:1.5.0 - 1.5.1 will be release version

docker pull nexus3.onap.org:10003/onap/aai-spike:1.5.0 - 1.5.1 will be release version

docker pull nexus3.onap.org:10003/onap/aai-sparky-be:1.5.0 - 1.5-STAGING-latest, no tagged images

Want to migrate to an actively support maven docker plugin since Spotify docker plugin. Consider fabric.io - an example is aai/resources

Alpine images

Dmitry Puzikov (Deactivated)

DONE

Jenkins jobs needed to create / push the common alpine image that the AAI containers will use, still need this completed before we merge the outstanding commits.

AAI-2574 - Getting issue details... STATUS

AAI-2580 - Getting issue details... STATUS

GlowRoot

James Forsyth

Venkata Harish Kajur

OPEN

Consider adding glow root profiling for AAI Microservices

https://glowroot.org

Performance Issue

James Forsyth

OPEN

FREEMAN, BRIAN D reported that when there are ~2400 vservers returned in a closed loop custom query, AAI takes minutes to respond. We've discussed paging previously, any other ways to optimize this?

PUT 'https://aai.onap:8443/aai/v16/query?format=resource'

{"query":"query/closed-loop","start":"/cloud-infrastructure/cloud-regions/cloud-region/CloudOwner/RegionOne/tenants/tenant/28481f6939614cfd83e6767a0e039bcc/vservers/vserver/6ad9eb6b-d7fc-46d6-8617-4c9b46e7308b"}

Spring Boot 2

James Forsyth

IN PROGRESS

AAI-2111 - Getting issue details... STATUS

aai-common:1.5.2 (not released yet) will be the el-alto library for springboot 1.5.x microservices. There needs to be some urgency to migrate the microservices to spring boot 2, since 1.5.3+ will not be backward compatible and so dependent applications might not have security updates if they stay on 1.5.2. 1.6.0 (Frankfort, currently master branch) aai-common will be springboot 2 so microservices must be updated by Frankfurt. Springboot 1.5.21 is the latest (and last) version in the 1.5.x spring boot train.

Vetting DSL Queries

Manisha Aggarwal

William Reehil

OPEN

Will discuss strategies AAI will employ to protect itself from rogue queries.

New UI Features / Historical Tracking

William Reehil

Manisha Aggarwal

OPEN

The AT&T team has done an exciting POC at a sprint-a-thon event that they would like to share with the community.

ATT wants to contribute additional UI views to ONAP, want to discuss path forward

Link for self repo creation: https://lf-onap.atlassian.net/wiki/display/DW/Self+Repo+Creation+via+INFO.yaml

William/Jimmy will look into this for creating the new sparky extensions repository

2 Sonar Servers

William Reehil

OPEN

What are we doing about the deprecated sonar server, should we redirect the old url to the new sonarcloud.io url? Ask this on PTL call

Certificates (Who Owns Updating?)

OPEN

Ideally when container starts certs should be generated and mounted. (Need to define the approach and how to get it implemented) Amdocs used to handle the certificates for their contributed microservices, which they no longer support.

Risk

William Reehil

OPEN

Need to raise potential risks due to resource constraints on Guilin release on some non-functional requirements Guilin release - non-functional requirements proposed list

Create tickets for G release off of

type	key	summary	assignee	reporter	priority	status	resolution	created	updated	due

Refresh

epics for A&AI impacted areas, assign resources if available, raise risks if not

Open questions on REQ-361 - Continue hardcoded passwords removal TO DO

Followup with Sylvain Desbureaux on what apps alreaDY have automated certificate generation for a basis of how to achieve this

Attachments (including meeting recording): 20200708 AAI Weekly Meeting.mp4

Attendees:

William Reehil

Agenda Items:

Open Action Items

New Action items