2020-07-15 AAI Meeting Notes

Attachments (including meeting recording): 

20200715 AAI Weekly Meeting #1.mp4 (host's internet dropped)

20200715 AAI Weekly Meeting Part 2.mp4

Attendees:

William Reehil

@Rodrigo Lima

Chris Andre

Venkata Harish Kajur

Igor Dysko

dhebeha mj

Starec Vlastimil

@Yoonsoon Chang

@Anh Le

Kamel Idir

Shirley Morgan



Agenda Items:

R7 M1 milestone activities completed - stories here  AAI-2945 - Getting issue details... STATUS

AAI R7 Release Planning < FR & NFR here

Active and Available Inventory < FOSS

Project Maturity Review for AAI

AAI R7 Architecture Review - TBD < Architecture Subcomittee Review requested

Guilin Impact View per Component

AAI REST API Documentation - Guilin

Guilin Risks < Opened Risks


ESR -  putting into maintenance

Review any open topics and stories for Guilin.


StatusOPENIN PROGRESSON HOLDDONECANCELLED

START RECORDING

1
Network Splicing
OPEN

guochuyi and dhebeha mj brought some proposed AAI schema and edge rule changes to the meeting that need to be reviewed by our modeling experts that were not on the call. guochuyi & dhebeha mj have the action items to share the decks with William Reehil who will solicit input from @David Whitney and Chandra Cinthala

AAI proposal on E2E Network Slicing for R7-V1.2.pptx

2
AAI CNF Modeling
OPENAAI ← link to the AAI weekly CNF call. This team will be doing modeling work to decide how CNFs will be modelled in AAI
3
aai/oom chart

Currently AAI manages our own helm chart as a submodule of oom, at Frankfurt release sign-off, the oom team will pull the aai charts back into the main repo.  We will still have to maintain the aai/oom repo in case a patch is needed for elalto or frankfurt. 

Jimmy contacted Sylvain on this topic, requesting they (oom team) handle this work and we support, awaiting response. 

4
AAI PTL ElectionJames ForsythDONE

Election season is underway and the AAI team will be accepting nominations for PTL.  Eligible votes on PTL are AAI committers.

Jimmy is stepping down from ONAP PTL role and will not self nominating.

William Reehil was voted in as the new PTL.

5
New Committer on AAI
DONE

James Forsyth  is nominating William Reehil as an A&AI committer.  There will be a vote on this by the A&AI committers and then approval from TSC.  

Bill was approved by the TSC and is officially a committer!  Congrats Bill

TSC Approved, and William Reehilself promoted to committer.

6
Guilin non-functional proposals
OPEN
  • Focus on seccom requirements done first, fixing haproxy
  • No root user in the docker - use integration team guidance for setting a USER in the Dockerfile rather than gosu (see aai-resources) and fix haproxy. We might consider adding aaiadmin to the base image, and then just set USER aaiadmin in Dockerfile
  • AAI-2822 - Getting issue details... STATUS
  • Move haproxy functionality into k8 (question)
  • Move aai/oom chart back to oom AAI-2914 - Getting issue details... STATUS
  • Move to Spring boot 2 (aai-parent inherits oparent:2.1.0)
  • Java 11 (oparent 3) - need to consider downstream dependencies on ONAP carrier partners
  • Use AAF certificate manager
  • Remove all hardcoded secrets
  • AAI needs to be able to run without AAF (means no HTTPS)
  • Upgrade to latest versions of 3rd party dependencies - EclipseLink and gremlin
  • Better coverage on javascript repos (graphgraph and sparky-fe)
  • Commit to a % increase in code coverage
  • SONAR bugs / security / code smells
  • Platform maturity - performance testing (Bell Canada has interest; if test suites could be upstreamed there could be resources to help us move our PM metrics up)
  • Security assurance document for CII badging

Guilin release - non-functional requirements proposed list



7
Guilin Functional requirements proposals
OPEN

Use Case Realization Meeting Register MoM

Guilin release - functional requirements proposed list - pay special attention to the "Documenting ONAP APIs" section by Andy Mayer.  The team from Orange might be interested in developing tooling around generating a more user-friendly AAI API documentation section on readthedocs.

8
Requirements for inclusion of GraphGraph in Guilin release
OPEN

List goes here

Open Jira tickets as tasks for G release

AAI-2910 - Getting issue details... STATUS

AAI-2911 - Getting issue details... STATUS

AAI-2912 - Getting issue details... STATUS

AAI-2913 - Getting issue details... STATUS

9
Document AAI repo and microservice descriptionsOndrejOPEN

Put the link here for the document; we will share with the community and solicit feedback from repo/mS owners about the document.
AAI-2924 - Getting issue details... STATUS

10
Frankfurt Defects

key summary type created updated due assignee reporter priority status resolution
Loading...
Refresh

11
SOTNNI use case

https://gerrit.onap.org/r/c/aai/schema-service/+/102298


12
Service model and schema impactBenjamin Cheung

13
Security Requirements for podsJames Forsyth

REQ-215 - Getting issue details... STATUS

14

OPEN

Graphgraph not included in OOM deployment. How can we make it an essential part of the ONAP deployment.

Step 0: Make it stable.  Fix the docker build Jenkins jobs for graphgraph, may need to upgrade to a version of npm to be acceptable to graphgraph.  Needs to fit into the LF global-job jobs.  

15
Brownfield / deployed / embedded inventory systems and AAIFred from VerizonOPEN

How do we accelerate migration using A&AI and the RunTime DB solution

Proposed a topic to be explored by AI&I and other ONAP WGs.

High impact, common interest among most CSPs 

   

Status Quo:

Most operators have multiple, siloed, possibly overlapping topology and inventory (domain specific) databases

Goal is to integrate ALL Inventory, and Topology databases into a Unified AI&I Architecture modeled DB which would contain ALL VNFs (VMs/Containers), PNFs, plus support easy expansion for future Inventory & Topology constructs/technologies.  

May take considerable time/investment (both are short).

 

Targeted Objectives

  • Fast integration/consolidation time
  • Minimize impact to business systems during migration
  • Reduce throw away code
  • Reduce throw away integration work
  • Improve Service/Resource LCM & SA, especially for 5G

 

How to accelerate the migration to Unified Database?

  • Phased Externalization of key PNF/VNF/CNF attributes currently stored in multiple inventory and topology silos.
  • Simplify the eventual consolidation of Inventory and Topology DBs using proposed automation tools and advanced discovery capabilities supporting the above
  • Leverage AI&I and possibly the ONAP Runtime Config DB and other ONAP WGs to help solve the problem
  • Proposed topic can be explored by the AI&I and other ONAP WGs.
  • Need to expand this preliminary list
16
SONAR coverage reportDONE

https://sonarcloud.io/organizations/onap/projects

AAI-2793 - Getting issue details... STATUS

James Forsyth, the main reason behind these discrepancies is the fact that SonarQube is based on version 6.7.1 and SonarCoud is version 8+ 


After migrating to SonarCloud, we fetch updates they do automatically without the need of doing any manual upgrade. Since we migrated, few things have changed. For example:

  • LF does no longer mark warnings in the reports, only pass or fail
  • LF is no longer able to manage individual quality profiles per language. Whatever latest support is there, we fetch this automatically in our side.
  • Jacoco plugin has changed quite a bit, we need to make sure our reports are now xml based instead of exec. I think this can be the main reason why you are facing coverage drops. Can you please check? This is what Sonar mentioned to me in detail: 

You can find more info in the wiki :https://wiki.onap.org/display/DW/SonarCloud+migration+from+SonarQube

Update 19 Feb: All Fixed except: aai-sparky-be, aai-esr-server and aai-validation.  Jimmy is working on them.

17
Looking for volunteer to fix papyrus issue
OPEN

AAI-2771 - Getting issue details... STATUS

Graphgraph doesn't parse the latest AAI schema correctly.  Need someone to investigate

18
Spring boot upgrade issue
DONE

AAI-2528 - Getting issue details... STATUS

AAI-2769 - Getting issue details... STATUS

 2 Spring beans with the same name is disallowed in Spring boot 2


19
sparky and data-router certificate issueFrancis PaquetteIN PROGRESS

Sparky is using the AAF certificate interaction with Portal but a self-signed certificate to talk to search-data-service.  The search-data-service key story was removed.  

AAI-2765 - Getting issue details... STATUS

AAI-2766 - Getting issue details... STATUS


20
Collab effortsIN PROGRESS
21
Windriver Lab ChangeDONE

The Intel/Wind River lab was relocated into a new data center last week.   The only change required to connect to the new location is to update the VPN IP in the .ovpn file.  Here is the change:


[sgooch@atl-sgooch-lx ~]$ diff -u pod-onap-01.ovpn.org pod-onap-01.ovpn

--- pod-onap-01.ovpn.org   2020-01-13 13:03:03.960856010 -0500

+++ pod-onap-01.ovpn 2020-01-09 18:27:03.560549576 -0500

@@ -5,7 +5,7 @@

client

dev tun

proto tcp

-remote 192.55.48.241 443

+remote 146.152.204.133 443

resolv-retry infinite

auth-nocache

nobind

22
Discuss developers call timeDONETuesdays @ 9 AM US/Eastern, 19:30 India Standard Time
23
SO query in AAIDONE

NNI Use Case - discovering 2 topologies from the network

Use case is asking for the ability in AAI to link an underlay and overlay together by having a cousin relationship between 2 PNFs.  Asking Chandra Cinthalato verify if that edge rule can be added for the Frankfurt release.

Per Chandra: "I think pnf -> pnf edge is redundant and not needed as we can traverse (thru a logical or physical interface) from pnf -> p-interface/l-interface -> pnf."

Chandra Cinthala  please note: According to shashikanth.vh, the team requires a relationship from an overlay topology node to an underlay topology node; by using the p-interface in overlay we cannot traverse to underlay node.  Suggest to allow an edge for PNF→PNF, which is consistent with RFC 8345 model

24
Search guard issueGiulio Graziani ON HOLD

Merged and released yesterday; issue is closed. 

AAI-2617 - Getting issue details... STATUS

Tracking for Frankfurt:

AAI-2677 - Getting issue details... STATUS

Search guard container no longer available so elasticsearch-sg won't build.  Search guard allows us to secure the elastic communication, which in older versions was not available but newer versions have support for secure communication.

https://www.elastic.co/blog/dear-search-guard-users

Consider opendistro as replacement for search-guard

Can we consider this one:

https://docs.search-guard.com/latest/search-guard-community-edition

25
E2E Network SlicingLIN MENGDONEFor the E2E Network Slicing use case for Frankfurt Release, we intend to leverage the nested service model work that has been going on since Dublin release. From A&AI perspective, we foresee that the schemas would have to be enhanced to cover network slicing models. We have considered A&AI to be a stretch goal for Frankfurt, though we are committing resources. So, we would like to start the discussion in the coming weeks, and subsequently implementation work to try our best to complete the implementation for Frankfurt. AAI-2600 has been created just to indicate the SDC impacts, we will update it with more details, and also join the A&AI weekly call during the next 1-2 weeks to discuss further.
26
Portal SDK UpgradeIN PROGRESS

AAI-2726 - Getting issue details... STATUS

Francis Paquette  need evaluation of feasibility in Frankfurt for sparky

27
GraphGraph Image Missing in NexusVenkata Harish KajurOPEN

Graph Graph Images are missing from nexus and it needs to be resolved in order for elalto deployment to be successful.

OOM-2161

How did this docker image get pushed to nexus and why was it removed from nexus?  

Graphgraph was removed from the default helm chart, but we still need to get these jobs fixed.

  • James Forsythwill look at it and ask Former user (Deleted)for guidance on this - looks like some jjbs are missing and configs are probably wrong, too.
  • Ondrej F will reach out to Pavel and see if we can figure out why the build and stage jobs are failing.
28
Data-router not startingIN PROGRESS

Assigned  AAI-2727 - Getting issue details... STATUS  to Steve Blimkie

AAI-2730 - Getting issue details... STATUS

29
Cassandra 3DONE

SDC wants to move up to Cassandra 3 in the shared db environment.  

AAI-2731 - Getting issue details... STATUS

https://old-docs.janusgraph.org/0.3.2/version-compat.html


30
Java 11James ForsythON HOLD

Venkata Harish Kajur tried schema service, a couple of dependency changes were required to get it to start. Eclipselink that is currently configured is incompatible.  

<groupId>javax.activation</groupId>
<artifactId>activation</artifactId>

is also incompatible

Needs more investigation for other repos

Need new common image (which Alpine image would we pick?)

31
AAI UI Issue

32
AAI Committers

  • James Forsythwill ask cl664y@att.comabout the status of a committer who has left the company (Tian Lee has left Amdocs, do we revoke committer status?)

Peng He  is a potential committer on ESR (currently only Jimmy can commit ESR code)

33
Code Test Coverage

Goal for Frankfurt is 55%

AAI-Common 58.7
AAI-Champ 58.3
AAI-DataRouter 58
AAI-GraphAdmin 56.6
Schema Service 56.7
Sparky 57.3
Spike 56.3

  • Steve Blimkie will check with architects around the utility of champ and spike in the context of ongoing support in ONAP
  • James Forsyth will set them to read-only (gizmo, champ, spike) and El Alto will be the final release version of those microservices AAI-2732 - Getting issue details... STATUS
  • James Forsyth will remove the jenkins jobs on those repos 
AAI-2733 - Getting issue details... STATUS

sparky-fe  AAI-2711 - Getting issue details... STATUS

graphgraph  AAI-2713 - Getting issue details... STATUS

34
Upcoming R6 Functional RequirementsBenjamin CheungIN PROGRESS

Release 6 (Frankfurt) proposed use cases and functional requirements

Use Case Realization Call: September 25, 2019

AAI-2600 - Getting issue details... STATUS

We have created REQ-158 -  for this use case. For AAI impacts, we have created AAI-2600 - A&AI support of Network Slicing Demo in Frankfurt.Reg. details of the AAI impacts, this is still being worked out, as there is an alternative proposal, and we are trying to align w.r.to scope & impacts. We will share more details in the coming days. The overall use case will also be presented to the Architecture Sub-committee for approval (based on the f2f discussions that happened in Antwerp 2 weeks ago).

AAI-2670 - Getting issue details... STATUS

AAI-2671 - Getting issue details... STATUS

We are currently reviewing the list of items we found in the BBWF BBS testing and once we sort through them we will communicate the results back to ONAP community.

Regarding AAI specifically, we do not foresee any new requirements for Frankfurt, but we would like to conclude the review first before jumping to final conclusions.

AAI-2672 - Getting issue details... STATUS

  • James Forsyth No status yet, will ask on UCR call today.  Followed up, no representation from use case.  Will look for response via email.

AAI-2673 - Getting issue details... STATUS

We are not expecting any changes at this time. Tech Mahindra is working on populating a&ai with the VNF specific information from K8S. There is a chance that we realize some changes to the schema, but we don’t expect any changes to the code.

AAI-2674 - Getting issue details... STATUS

During run-time solution there are AAI impacts. Run-time solution is not planned for Frankfurt release. Only Import Service Catalog solution in SDC is targeted for F release.

AAI Impact highlights:

After Service Order decomposition in SO, CFS Service Instance details will be stored in AAI.

After response from 3^rd^ Party Domain, RFS instance details will be updated in AAI.

The sequence diagram  depicts the run time view  of Third Party Order Activation using the on-boarded service definition and highlights AAI impacts.

ReUse in AAI:

We plan to leverage the SPPartner model, created for CCVPN, to store the 3^rd^ Party details in AAI.

org.onap.aai.domain.yang.SpPartner present in aai-schema v15

  • James Forsyth Confirm on UCR call that this is object re-use and test only support from AAI

AAI-2623 - Getting issue details... STATUS

Have done some prototyping in Dublin to ingest topology from external controllers and show them in A&AI. Will need more work to act on notifications from controllers and keep the topology in sync

AAI-2678 - Getting issue details... STATUS

For the 5G Bulk PM use case in R6, I’m attaching a few slides showing how we think AAI can be used as part of the UC realization. We are currently making the following assumptions:

  • PNF and VNF models contain status attribute that can indicate when a new instance has been fully instantiated (may still require update to SO workflow)
  • AAI will send topology event on AAI-EVENT topic when status attributes are updated

Can you review the slides and the assumptions above and let us know if you see any issue. We can also setup a separate meeting if needed.

Note: I will share the same slides on the SO weekly meeting today.

Frankfurt Release Requirements

35
MigrationAnkit BhattIN PROGRESS

What is the purpose of MigrateCloudRegionUpgradeCycle migrator in onap graphadmin migration framework?

From Casablanca to Dublin, should these be run?

  • v14/MigrateMissingFqdnOnPservers
  • v13/MigrateVnfcModelInvariantId
  • v13/MigrateModelVer

Migration will check if it's already been run, and won't run again.

Jira task created to track this: AAI-2689

36
APIFormer user (Deleted)

Questions regarding how to use the api

AAI Graphical User Interface

Sparky Running on Node Port: 30220

AAI Schema Service

AAI Schema Service Use Case Proposals

37
AAF / AAUI data preloadIN PROGRESS

Status on 

AAI-2475 - Getting issue details... STATUS

AAF-986 - Getting issue details... STATUS

38
NexusIQIN PROGRESS

Pain, pain, pain.  218 items that must be documented currently across the AAI repos, expanding all the time.

1) We need a repo strategy 

2) We need a maintenance strategy

3) We need a versioning strategy

4) We need responsible parties for each repo / component

5) Strategy for oparent dependency management

39
ESRIN PROGRESS

Need to know if the ZTE team who built ESR intends to continue to support this sub-project in Frankfurt.  Multiple Jira issues were not worked in Dublin / El Alto, which leads me to think that the ESR project might need to be deprecated.  Inviting Bo Lv and Former user (Deleted)to see what the current status is.

Hi, we didn't have resources for ESR in El Alto, and I(Huabing Zhao) and Lv Bo won't be able to contribute to ESR in F release, but Peng He will continue supporting  ESR in F release on behalf of ZTE team. Please add him in the loop for the ESR related issues.

AAI-2653 - Getting issue details... STATUS

AAI-2640 - Getting issue details... STATUS



40
AAI Openlab Tenant SpaceIN PROGRESS

A kubernetes cluster is installed in WR using RKE

NFS node is 10.12.5.10

Followed these instructions https://docs.onap.org/en/latest/submodules/oom.git/docs/oom_setup_kubernetes_rancher.html?

Need to determine what gets installed, testing opportunities, CSIT, distribution flows, etc.

41
v17 schema for FrankfurtON HOLD

Since the CCVPN SOTN proposal is in progress already, could we have the v17 schema introduced into master branch to receive the updates for Frankfurt release? AAI-2607 - Getting issue details... STATUS

See also AAI-CCVPN-Extension-SOTN Proposals for Frankfurt Release and AAI-2593 - Getting issue details... STATUS

AAI-2594 - Getting issue details... STATUS already added some v17 files but needs more work to be complete.

42
AAI BugsIN PROGRESS

key summary type created updated due assignee reporter priority status resolution fixversions
Loading...
Refresh

43
Docker images not pushingJames ForsythDONE

docker pull nexus3.onap.org:10003/onap/babel:1.5.0 - 1.5.1 pushed, will be release version
docker pull nexus3.onap.org:10003/onap/aai-champ:1.5.1 - 1.5-STAGING-latest available, no tagged images

docker pull nexus3.onap.org:10003/onap/aai-gizmo:1.5.0 - 1.5.2 pushed, will be release version

docker pull nexus3.onap.org:10003/onap/aai-data-router:1.5.0 - 1.5.1, will be release version

docker pull nexus3.onap.org:10003/onap/aai-search-data-service:1.5.0 - 1.5-STAGING-latest available, no tagged images  AAI-2595 - Getting issue details... STATUS

docker pull nexus3.onap.org:10003/onap/elasticsearch-sg:1.5.0 - same as search data service

docker pull nexus3.onap.org:10003/onap/aai-model-loader:1.5.0  - 1.5.1 will be release version

docker pull nexus3.onap.org:10003/onap/aai-spike:1.5.0  - 1.5.1 will be release version

docker pull nexus3.onap.org:10003/onap/aai-sparky-be:1.5.0 - 1.5-STAGING-latest, no tagged images

Want to migrate to an actively support maven docker plugin since Spotify docker plugin.  Consider fabric.io - an example is aai/resources

44
Alpine imagesDmitry Puzikov (Deactivated)DONE

Jenkins jobs needed to create / push the common alpine image that the AAI containers will use, still need this completed before we merge the outstanding commits.

AAI-2574 - Getting issue details... STATUS

AAI-2580 - Getting issue details... STATUS

45
GlowRootOPEN

Consider adding glow root profiling for AAI Microservices 

https://glowroot.org

46
Performance IssueOPEN

FREEMAN, BRIAN D reported that when there are ~2400 vservers returned in a closed loop custom query, AAI takes minutes to respond.  We've discussed paging previously, any other ways to optimize this?

PUT 'https://aai.onap:8443/aai/v16/query?format=resource'


{"query":"query/closed-loop","start":"/cloud-infrastructure/cloud-regions/cloud-region/CloudOwner/RegionOne/tenants/tenant/28481f6939614cfd83e6767a0e039bcc/vservers/vserver/6ad9eb6b-d7fc-46d6-8617-4c9b46e7308b"}

47
Spring Boot 2James ForsythIN PROGRESS

AAI-2111 - Getting issue details... STATUS

aai-common:1.5.2 (not released yet) will be the el-alto library for springboot 1.5.x microservices.  There needs to be some urgency to migrate the microservices to spring boot 2, since 1.5.3+ will not be backward compatible and so dependent applications might not have security updates if they stay on 1.5.2.  1.6.0 (Frankfort, currently master branch) aai-common will be springboot 2 so microservices must be updated by Frankfurt.  Springboot 1.5.21 is the latest (and last) version in the 1.5.x spring boot train.

48
Vetting DSL QueriesOPENWill discuss strategies AAI will employ to protect itself from rogue queries. 
49
New UI Features / Historical TrackingOPEN

The AT&T team has done an exciting POC at a sprint-a-thon event that they would like to share with the community.

ATT wants to contribute additional UI views to ONAP, want to discuss path forward


Link for self repo creation: https://lf-onap.atlassian.net/wiki/display/DW/Self+Repo+Creation+via+INFO.yaml

William/Jimmy will look into this for creating the new sparky extensions repository

50
2 Sonar ServersOPENWhat are we doing about the deprecated sonar server, should we redirect the old url to the new sonarcloud.io url? Ask this on PTL call
51
Certificates (Who Owns Updating?)
OPENIdeally when container starts certs should be generated and mounted. (Need to define the approach and how to get it implemented) Amdocs used to handle the certificates for their contributed microservices, which they no longer support. 
52
RiskWilliam ReehilOPEN

Need to raise potential risks due to resource constraints on Guilin release on some non-functional requirements Guilin release - non-functional requirements proposed list

Create tickets for G release off of

type key summary assignee reporter priority status resolution created updated due
Loading...
Refresh

epics for A&AI impacted areas, assign resources if available, raise risks if not

Open questions on  REQ-361 - Continue hardcoded passwords removal TO DO

Followup with Sylvain Desbureaux on what apps alreaDY have automated certificate generation for a basis of how to achieve this

Open Action Items