2018-03-02 AAI Weekly Meeting Notes

Recordings

Recorded Session 2018-03-02

Attendees - 

  • @James Forsyth

  • @Former user (Deleted)

  • @Arul Nambi

  • @Former user (Deleted)

  • @Olaf Burdziakowski

  • @Dileep Ranganathan

  • @Tian Lee

  • @CT Paterson

  • @Venkata Harish Kajur

  • @Adrian Slavkovsky

  • @William LaMont

  • @William Reehil

  • @Sandeep Shah

  • @Francis Paquette

  • @Steve Blimkie

  • @Zi Li

  • @Giulio Graziani

  • @Pete Singhsumalee

  • @Richard Epp

  • Sunitha Araveti

  • Jwala Cheriyan

  • @Shirley Morgan

  • Dachang Yuan

Goals

  • Get status on AAI lab resources

  • Discuss MSB/AAF and establish clear direction on approach for Beijing

  • Status on Cassandra clustering

  • AAI Administrivia

Discussion items



Babel

Damian Nowak

@Tian Lee provided an overview of Babel. Damian requested documentation, @Tian Lee and @CT Paterson suggested some docs that can be provided.

Models come into AAI thru babel, so changes to the models must be made in SDC.

Nokia is interested in model changes for 5G PNF support.

Clarified difference between service/resource models and schema.

@Tian Lee working with Damian - adding model to OXM, liasing with SDNC for models containing pnfs - will run thru Babel to see if additional work is needed;

@Olaf Burdziakowski working with Damian Nowak regarding pnfs needed

3/02: Schema changes and defined APIs needed by next Thu (3/8). 



Licensing

@James Forsyth

Modified files should be tagged with a new date of 2017-2018.

Copyright © 2017-2018 AT&T Intellectual Property. All rights reserved.

AAI-747 - Change copyright year in license header on modified files to 2017-2018 Open

@James Forsyth will get clarification on what's needed for the various repos to satisfy the various orgs.

2/23: Jimmy has not found good solution yet.

3/02: Meeting to be scheduled between AT&T and AMDOCs regarding using license plugin and it's impact to other contributors - @James Forsyth



Nexus IQ

@James Forsyth

Anything Red for Security Issues and License Analysis need to be fixed in order to pass M4 (3/29).

Vulnerabilities due to AJSC need to have a plan on how to mitigate.

@James Forsyth has created parent story in JIRA for each repo; need each repo owner to bring us in to full compliance.  JIRA labels added: Security, AJSCDependency

By M3 (3/9) need to have plan on how to mitigate.

Nexus IQ higher priority than CII Badging.

@Venkata Harish Kajur to provide @Richard Epp with guidance on Spring Boot templates.

3/02: @Richard Epp uploaded spreadsheet containing next candidates if vulnerabilities still exist.



AJSC6

@Venkata Harish Kajur

@Venkata Harish Kajur to merge AJSC6 early next week in aai-common, re-run report

Team to add AJSC dependency to repo, then re-scan before any coding to determine results.

3/02: AJSC 6 vs Spring Boot for Beijing this late in the cycle; @Venkata Harish Kajur will try changing one file from AJSC to Spring Boot, re-run scan and report findings.

Concern raised by @Arul Nambi that AJSC 6 in ECOMP may be different than AJSC 6 Open source.



CII Badging

@James Forsyth

@Arul Nambi

Wiki page with instructions on the process: CII Badging Program

We have two CII Badging submissions currently active on CII Best Practice Badge Program: 1) AAI and 2) Sparky-fe

The team needs to decide how to split up the project - AAI is too big to fit under a single project.  @James Forsyth proposes the following breakdown for CII badging:

1) AAI core (REST providers and common code): @James Forsyth - Project created, ongoing progress.

  • aai-common

  • aai-resources

  • aai-traversal

  • gizmo

  • champ

  • graphadmin

2) GUI - @Arul Nambi - Need to include more repos to the current "front-end" project

  • sparky-fe

  • sparky-be

  • data-router

  • search-data-service

  • router-core

3) Model loader - @Tian Lee - Need to create projects

  • model-loader

  • babel


  • 4) Graph utils / eventing / logging - @Steve Blimkie - Need to create projects

  • spike

  • gap - @Tian Lee

  • graphgraph - Stretch for Beijing

  • event-client - @Tian Lee

  • rest-client



5) ESR - @Zi Li - Project is created, still ongoing process to meet all the requirements

  • esr-gui

  • esr-server



The idea is that we assign one key person who will be responsible for getting the badge on their set of repos.  This is just a suggestion, and I invite discussion, re-categorization, and complete rewrites. Owners of the sets can decide whether it makes sense to group sets into one CII badging request, or split. Every repo above must be included in 1 CII submission.

2/23:

Need readout next week per repo as to where we stand and how we can close before M4 (3/29).

@Zi Li and @Arul Nambi will work together to see if same kind of scan will work for both components

3/02: SONAR will not report on java script based so those need to be run manually via another tool locally.



AAI-494 - Improve API Swagger Documentation IN PROGRESS

@Richard Epp

@Former user (Deleted)

Issue 1 - Parsing of YAML file into RST format

@Richard Epp to send yaml file via email to Pavel and attach to wiki so all can see.

YAML file too large and resulting RST file cannot be read by readmedoc causing it to be unusable.

Issues parsing the YAML file into RST format - structure is not correct - structure of YAML file must follow SWAGGER structure.



Issue 2 - Exposing AAI Swagger through MSB

Suggestion of using MSB portal with link of file to readmedoc.

How to display REST APIs via the swagger UI integrated with MSB: https://lf-onap.atlassian.net/wiki/display/DW/Microservice+Bus+API+Documentation#MicroserviceBusAPIDocumentation-APIDefinitionandSwagger-UI

Will need to continue as open item until resolved.

Contact @Zi Li / @Former user (Deleted) for more information about integration. Just require the swagger JSON file for integration - @Richard Epp please provide the JSON to @Zi Li -

https://lf-onap.atlassian.net/wiki/display/DW/2018-02-02+AAI+Weekly+Meeting+notes?preview=%2F25429783%2F25432551%2FNetwork_v13.yaml

@Zi Li - please download the yaml file above and see if you can make use of it in MSB

Note: Alternate Swagger UI service already available.

Huabing - Please refer to the below comments for session sticky and AAF plugin progress

2018-02-16: Generator of the RST can't find the definitions (there is a getDefinitions and patchDefinitions) and parser can't deal with it. Generator only can parse ASCII and there are characters outside the ASCII set. PATCH and GET methods can possibly be split into their own files. @Richard Epp will look into installing swagger UI in Windriver lab; @Venkata Harish Kajur knows how to access, contact @Stephen Gooch for access

2/23:

@Richard Epp split up the files; @James Forsyth uploaded network put and get (RST files) which Passed.  Will do REST next.

@Richard Epp to get access to JIRA (LF)

@Venkata Harish Kajur to provide guidance to @Richard Epp on setting up Dev env locally.

3/02: @Richard Epp uploaded all RST files to wiki yesterday; not able to run GET commands, will work on Permissions issue.



Jenkins

@Venkata Harish Kajur

Release jenkins jobs are still failing.  Helpdesk ticket # 52082

Changes to AAI-COMMON not picked up by downstream projects (resources, traversal)

Unable to release aai-common, as cannot release multiple times, without incrementing the version.

Liasing with ONAP helpdesk about whether we can release multiple minor versions of an artifact.

Proposal for Monday PTL meeting to align SNAPSHOT strategy

@Venkata Harish Kajur to include @Steve Blimkie on email exhange with ONAP Help desk.

2018-02-16: @James Forsyth raised on the PTL call on Monday. Decision is to use SNAPSHOT for Beijing development, currently we're setting our snapshot as 1.2.1 Disabled the daily jobs (which fail because the snapshot/staging artifacts don't exist). Removed all amsterdam jjb jobs.

Need a better plan for Casablanca.

2/23: @Steve Blimkie will check on dependency and fix.



HPA

@Dileep Ranganathan

I would like to discuss about the Persistence of HPA related information in A&AI in the weekly meeting call.

I would like to discuss my proposal to capture the HPA capabilities in a generic way in A&AI as

represented here à https://wiki.onap.org/display/DW/Persistence+of+HPA+related+information+in+AAI

I would appreciate if we could include this in tomorrow’s meeting.

@Dileep Ranganathan presented   https://wiki.onap.org/display/DW/Persistence+of+HPA+related+information+in+AAI .  General discussion.

@Alex Vul met with OAF team yesterday to determine optimal way to consume info from A&AI, will go back

To OAF with using key value pairs; implementation needs to be agnostic and optimal.

Alex to post on wiki general format and value specifics; will meet with OAF on Mon on how to represent the values.

@Alex Vul to review changes with Christina for specific schema proposal

Functional requirements for HPA : https://lf-onap.atlassian.net/wiki/display/DW/Hardware+Platform+Enablement+In+ONAP

2018-02-16: Schema changes are done, need custom query to get the parent node from a given node. @Christina Monteleone and AAI team need to follow up on the custom query.

2/23:

Beijing is using V13; Amsterdam used V11; user can continue to use V11 however, for new functionality and schema changes will need V13

@James Forsyth to follow up with @Christina Monteleone.

3/02: HPA capabilities is by flavors; @James Forsyth to bring up to @Christina Monteleone at today's meeting and request her review of schema structure.



MSB Integration Status

@Former user (Deleted)

The MSB AAF auth plugin
Two-way SSL at MSB API Gateway
Any problems in the integration

AAI-671 - Replace HAPROXY with MSB OPEN Opened questions to be answered

Might need a plugin in MSB to achieve stickiness of requests

Huabing asked Jonathan Gathman about AAF API - further details required.

2018-02-16: @Adrian Slavkovsky  is waiting for MSB fixes - stickyness/ip_hash load balancing doesn't work. kube2msb registrator doesn't register ports correctly. We need to socialize the hostname that clients will use - follow up with @Former user (Deleted) and other teams about how this will work. @James Forsyth will raise the issue on next Monday's PTL call.

2/23: @Adrian Slavkovsky to follow-up and provide feedback next meeting.

2/28: Huabing update @Adrian Slavkovsky @James Forsyth

  • Stickyness/ip_hash load balancing and kub2msb registration are solved.

  • No Authentication&Authorization REST APIs from AAF can be used for MSB API Gateway auth plugin yet, we need to wait. It seems that AAF currently only support CADI and CADI approach requires every projects to do authentication and authorization seperately.

3/03: @Former user (Deleted) to fix issue with ip_hash.



Cassandra Clustering

@Former user (Deleted)

@Venkata Harish Kajur

Goal - provide HA to AAI

Issue 1 - remote storage

Meetings with @Michael O'Brien - (deprecated as of 20170508) - use obrienlabs

OOM team should check the video recording of the session

@@Michael O'Brien - (deprecated as of 20170508) - use obrienlabs will arrange further meeting on Monday

Issue 2 - simulating outage

Pavel + Harish will try to simulate on Monday

We have a 3 node replicated cluster configured with local storage; need to discuss if this will be adequate to the purpose of Beijing integration testing.

AAI-539 - Set up Cassandra docker images in 3 node cluster OPEN OOM-591 - AAI needs persistent volumes configured, need help with OS in lab REOPENED

@Michael O'Brien from OOM team will assist w/ OOM-591

@Michael O'Brien to respond back to Harish’s email and setup meeting on Monday 10 AM; Will put on OAM discussion page so others interested can attend. 

https://lists.onap.org/pipermail/onap-discuss/2018-February/007954.html

https://lists.onap.org/pipermail/onap-discuss/2018-February/007955.html

ONAP on Kubernetes on Windriver Titanium Cloud - Openlab#Openlab-20180205:AAIandOOMworkingsessiononCINDERKubernetesPV

https://lf-onap.atlassian.net/wiki/download/attachments/16268443/20180205_aai_oom_cinder_kubernetes_pv_work_session_1_of_2_zoom_0.mp4?version=1&modificationDate=1517867225191&api=v2

2016-02-16: Working cluster; titan + thrift allowed us to use Cassandra 3. Janus will not have thrift requirement.

2/23: @Venkata Harish Kajur has connection ready; will test after node fails; will work with @Former user (Deleted).

3/02: @Venkata Harish Kajur to test node failure next week and advise findings.

Action items

@Zi Li or other ESR rep will to start the CII Badging process for ESR https://bestpractices.coreinfrastructure.org/
@James Forsyth will set up a session with AAF to try authentication
@James Forsyth to look at AAI-671 to provide comments/clarifications back to @Adrian Slavkovsky
Rich Epp to send yaml file via email to @Former user (Deleted) and attach to wiki so all can see.
@Alex Vul to post on wiki general format and value specifics; will meet with OAF on Mon on how to represent the values.
@Michael O'Brien to respond back to @Venkata Harish Kajur’s email and setup meeting on Monday 10 AM; Will put on OAM discussion page so others interested can attend.
@James Forsyth - @Arul Nambi - would like to be included in planning/design/code submission.  Please add as reviewer.
@Richard Epp to work with @Zi Li on integration between Swagger and MSB using swagger.json

@Venkata Harish Kajur to add @Steve Blimkie to email exchange on ONAP Help desk issue with Jenkins
@Tian Lee and @CT Paterson to send Babel runbook and setup offline meeting for Q&A.
@James Forsyth will get clarification on what's needed for the various repos to satisfy the various orgs.
@Richard Epp will look into installing swagger UI in Windriver lab;

@Richard Epp Will check on non-ACII characters within generator
@Christina Monteleone and AAI team need to follow up on the custom query with @Dileep Ranganathan
@James Forsyth will raise the issue of hostnames need for MSB on next Monday's PTL call.
@James Forsyth to meet with AAF team on getting promised onboarding guide.
@Venkata Harish Kajur to provide @Richard Epp with guidance on Spring Boot templates.
@Venkata Harish Kajur to merge AJSC6 early next week in aai-common, re-run report
@Zi Li and @Arul Nambi will work together to see if same kind of scan will work for both components
@Richard Epp to get access to JIRA (LF)
@Venkata Harish Kajur to provide guidance to @Richard Epp on setting up Dev env locally.
@Steve Blimkie will check on dependency and fix in Jenkins.
@James Forsyth to follow up with @Christina Monteleone on HPA.
@Adrian Slavkovsky to follow-up and provide feedback next meeting on MSB.
@Venkata Harish Kajur has connection ready; will test after node fails; will work with @Former user (Deleted) on Cassandra.
@James Forsyth - Meeting to be scheduled between AT&T and AMDOCs regarding using license plugin and it's impact to other contributors
@Venkata Harish Kajur will try changing one file from AJSC to Spring Boot, re-run scan and report findings.
@James Forsyth to bring up to @Christina Monteleone HPA fcapabilities by flavor at today's meeting and request her review of schema structure.
@Former user (Deleted) to fix issue with ip_hash.