Versions Compared

Old Version 1

changes.mady.by.user Shirley Morgan

Saved on

compared with

New Version Current

changes.mady.by.user Keong Lim

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Attachments

Recording:

Recorded Session - 2019-05-29.mp4

Global JJB Discussion with LF 2019-05-28

AAI Data Modeling 2019-05-28.mp4

Attendees:

...

START RECORDING

...

We are not able to view any node data on AAI UI.  We need to understand the flow by which nodes are getting displayed over UI.  We have understood that the flow is like sparky-be-->search-data-->elastic-search→Cassandra. However; we fail to understand why default installation did not enabled elastic search to retrieve data from Cassandra? Any other config verification/enablement required for AAI UI to work would be helpful. 

http://<IP>:30220/rest/search/querysearch/

{

  "processingTimeInMs" : 65,

  "totalFound" : 0,

  "suggestions" : [ ]

}

22nd May: Made suggestion on https://lists.onap.org/g/onap-discuss/message/17162

...

Keong Lim

...

Comment on flagging Sonar reports as "false positives":

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-2459

Do we have access to do this ourselves or should we report these to Jess?

...

James Forsyth

...

https://wiki.onap.org/display/DW/Best+Practices

  • The Docker and Kubernetes engines may run as root until such time as the products support non-root execution.
  • Applications may run as root within a container.
  • The process ID of a container must not run as the root ID with the exception of containers supporting ONAP features that require the container to run as the root ID.
  • Containers may run with root privileges.
  • Project containers that run as the root ID must document this in the release notes along with the functionality that requires the container to run as the root ID.

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-2172

...

James Forsyth

...

Container Image Minimization Guidelines

James Forsyth will ask integration team if we can use the AAI tenant space in windriver environment

...

Former user (Deleted)

...

A 5-10 minute demo of GraphGraph.

Feedback needed!

...

JIRA Issue Count (in AAI project):

Jira Legacy
serverSystem Jira
jqlQueryproject = AAI AND issuetype = Bug and status not in (Closed, Delivered) ORDER BY fixVersion ASC, priority DESC, updated ASC
counttrue
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176

JIRA Issue Count (talking about AAI):

Jira Legacy
serverSystem Jira
jqlQueryproject != AAI AND (text ~ "AAI" OR text ~ "A?AI" OR text ~ "A??AI" OR text ~ "A???AI") AND issuetype = Bug and status not in (Closed,Delivered,Done) ORDER BY priority DESC, updated ASC
counttrue
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176

...

James Forsyth

...

Dublin artifacts are released and jjb jobs are updated to drop casablanca jobs and replace with dublin

We will change the sonar and clm jobs to use the dublin branch

  •  James Forsyth will see how other teams manage merging release bug/security/late feature change back to master

...

James Forsyth

...

Jira Legacy
serverSystem Jira
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-2406

Jira Legacy
serverSystem Jira
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-2411

Jira Legacy
serverSystem Jira
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-2402

...

James Forsyth

...

  •  James Forsythwill start a document with best practices and requirements for merging changes to the aai/oom submodule
  •  Team needs to document (perhaps change the AAI guide for OOM setup) the change to use the submodule in OOM

...

Former user (Deleted)

...

When is this going to be finished ARC AAI Component Description - Dublin ?

Note: I have no idea what it is, I just was asked to inquire

...

  • Encourage our clients to migrate off named query
    • To support Policy code change to custom queries
      Jira Legacy
      serverSystem Jira
      serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
      keyPOLICY-1266
      , could this be fixed?
      Jira Legacy
      serverSystem Jira
      serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
      keyAAI-2351
  • Trying for Silver badge and Level 2 on Security; 50% code coverage on repos
  • Resiliency and fault tolerance; meeting notice never published,
  • CSIT on OOM needs to cover more of the services

...

James Forsyth

Venkata Harish Kajur

...

  • Moving Helm charts into AAI repos
  •  Former user (Deleted) is the AAI contact for doing the helm chart migration, info passed along to Mike Elliot
  • Migration of the oom / aai charts to an new repo that we will have commit access to. Harish tried to preserve the history on the existing set of files, but there was no way to do it because the commit messages would violate the 50 character limit. So we will lose history on the commits and do the push as a new code drop.
  • Jessica found a way to do it
  • Not sure if this would be pushed into El Alto release

...

  • Volumed run-time generated certificates are possible
  •  

    James Forsyth will open Jira tickets to update the keystores in the master branches of the mS that use https

  •  

    Arul Nambi will do sparky-be, search-data-service, data-router, logging-service, router-core

  • GraphGraph is coming, depends on expanding schema-service API
  • RestClient updates are potentially being contributed by community members

...

James Forsyth

Keong Lim

William LaMont

Francis Paquette

Ondrej F

Venkata Harish Kajur

Chandra Cinthala

Jessica Gonzalez

Benjamin Cheung

CT Paterson

Manisha Aggarwal

Tian Lee

Steve Blimkie

William Reehil

soumya

Giulio Graziani

Shirley Morgan



START RECORDING

Champ slipped below 55% with latest commit.

  •  Tian Lee will do babel, model-loader, champ, gizmo, event-client, spike, rest-client, validation
  •  Arul Nambi will do sparky-be, search-data-service, data-router, logging-service, router-core
  •  James Forsyth create ticket for El Alto for sparky, rolling back because of sonar failure
  •  Venkata Harish Kajur will check aai-common, resources, traversal, graphadmin, cacher, schema-service (which probably already have the setting)
  •  Add thresholds to all repos that are above 55% so it doesn't happen again
  •  For setting the threshold on each repo, set it to the current percentage, so if it's is at 62.7%, set the threshold to 0.62
 

 <jacoco.line.coverage.limit>0.68</jacoco.line.coverage.limit>

Sonar job for Dublin has been changed to using line coverage.

1
Global JJB

James Forsyth

Sonatype's maven-staging-plugin will be disabled and we need to implement new LF jenkins jobs before mid-July

global-jjb Migration Tracker

Repos and do they use oparent:
./model-loader/pom.xml                        true
./graphgraph/pom.xml                          false
./graphadmin/pom.xml                          true
./esr-server/pom.xml                          true
./sparky-be/pom.xml                           true
./rest-client/pom.xml                         true
./aai-common/pom.xml                          true
./data-router/pom.xml                         false
./chameleon/pom.xml                           false
./sparky-fe/pom.xml                           false
./event-client/pom.xml                        true
./gallifrey/pom.xml                           false
./resources/pom.xml                           true
./router-core/pom.xml                         true
./gizmo/pom.xml                               true
./logging-service/pom.xml                     true
./babel/pom.xml                               true
./champ/pom.xml                               true
./traversal/pom.xml                           true
./spike/pom.xml                               true
./esr-gui/pom.xml                             true
./search-data-service/pom.xml                 false
./cacher/pom.xml                              true
./schema-service/pom.xml                      true
./validation/pom.xml                          true
2
UI Views

William Reehil

Manisha Aggarwal

ATT wants to contribute additional UI views to ONAP, want to discuss path forward
3
Understanding AAI UI retrieval of data from backendChandrashekhar Thakare

We are not able to view any node data on AAI UI.  We need to understand the flow by which nodes are getting displayed over UI.  We have understood that the flow is like sparky-be-->search-data-->elastic-search→Cassandra. However; we fail to understand why default installation did not enabled elastic search to retrieve data from Cassandra? Any other config verification/enablement required for AAI UI to work would be helpful. 

http://<IP>:30220/rest/search/querysearch/

{

  "processingTimeInMs" : 65,

  "totalFound" : 0,

  "suggestions" : [ ]

}

22nd May: Made suggestion on https://lists.onap.org/g/onap-discuss/message/17162

23rd May: was discussed at AAI Developers call. Is it OK now?

We need to understand how to verify if all the indexes are created. The main problem is AAI instance not able to retrieve data within 100 secs. Jimmy, Could you please point to any documentation ?

4
Run AAI containers as non-root user

James Forsyth

https://wiki.onap.org/display/DW/Best+Practices

  • The Docker and Kubernetes engines may run as root until such time as the products support non-root execution.
  • Applications may run as root within a container.
  • The process ID of a container must not run as the root ID with the exception of containers supporting ONAP features that require the container to run as the root ID.
  • Containers may run with root privileges.
  • Project containers that run as the root ID must document this in the release notes along with the functionality that requires the container to run as the root ID.

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-2172

5
Container Images

James Forsyth

Container Image Minimization Guidelines

James Forsyth will ask integration team if we can use the AAI tenant space in windriver environment

6
GraphGraph demo

Former user (Deleted)

A 5-10 minute demo of GraphGraph.

Feedback needed!

7
Bug Review

JIRA Issue Count (in AAI project):

Jira Legacy
serverSystem Jira
jqlQueryproject = AAI AND issuetype = Bug and status not in (Closed, Delivered) ORDER BY fixVersion ASC, priority DESC, updated ASC
counttrue
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176

keyAAI-2219
Code Block
  <execution>
                        <id>default-check</id>
                        <goals>
                            <goal>check</goal>
                        </goals>
                        <configuration>
                            <dataFile>${project.build.directory}/coverage-reports/jacoco.exec</dataFile>
                            <rules>
                                <!--  implementation is needed only for Maven 2  -->
                                <rule implementation="org.jacoco.maven.RuleConfiguration">
                                    <element>BUNDLE</element>
                                    <limits>
                                        <limit implementation="org.jacoco.report.check.Limit">
                                            <counter>LINE</counter>
                                            <value>COVEREDRATIO</value>
                                            <minimum>${jacoco.line.coverage.limit}</minimum>
                                        </limit>
                                    </limits>
                                </rule>
                            </rules>
                        </configuration>
                    </execution>
18Dublin Use Cases

James Forsyth

Epic-of-epics: JIRA Issue Count (talking about AAI):

Jira Legacy
serverSystem Jira
jqlQueryproject != AAI AND (text ~ "AAI" OR text ~ "A?AI" OR text ~ "A??AI" OR text ~ "A???AI") AND issuetype = Bug and status not in (Closed,Delivered,Done) ORDER BY priority DESC, updated ASC
counttrue
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176

8
Dublin branching

James Forsyth

Dublin artifacts are released and jjb jobs are updated to drop casablanca jobs and replace with dublin

We will change the sonar and clm jobs to use the dublin branch

  •  James Forsyth will see how other teams manage merging release bug/security/late feature change back to master
9
Gerrit Review
https://gerrit.onap.org/r/#/q/projects:aai10
Sonar Review
https://sonar.onap.org/projects?search=aai&sort=coverage11
Jenkins CLM Review
https://jenkins.onap.org/view/CLM/12
Blockers

James Forsyth

Jira Legacy
serverSystem Jira
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-2406

Jira Legacy
serverSystem Jira
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-2411

Jira Legacy
serverSystem Jira
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-2402

13
Helm Chart Transfer

James Forsyth

  •  James Forsythwill start a document with best practices and requirements for merging changes to the aai/oom submodule
  •  Team needs to document (perhaps change the AAI guide for OOM setup) the change to use the submodule in OOM
14
Status of ARC documentation

Former user (Deleted)

When is this going to be finished ARC AAI Component Description - Dublin ?

Note: I have no idea what it is, I just was asked to inquire

15
Dublin Status 1James Forsyth
  • Encourage our clients to migrate off named query
    • To support Policy code change to custom queries
      Jira Legacy
      serverSystem Jira
      serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
      keyPOLICY-1266
      , could this be fixed?
      Jira Legacy
      serverSystem Jira
      serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
      keyAAI-2351
  • Trying for Silver badge and Level 2 on Security; 50% code coverage on repos
  • Resiliency and fault tolerance; meeting notice never published,
  • CSIT on OOM needs to cover more of the services
16
Dublin Status 2 / OOM helm charts

James Forsyth

Venkata Harish Kajur

  • Moving Helm charts into AAI repos
  •  Former user (Deleted) is the AAI contact for doing the helm chart migration, info passed along to Mike Elliot
  • Migration of the oom / aai charts to an new repo that we will have commit access to. Harish tried to preserve the history on the existing set of files, but there was no way to do it because the commit messages would violate the 50 character limit. So we will lose history on the commits and do the push as a new code drop.
  • Jessica found a way to do it
  • Not sure if this would be pushed into El Alto release
17
Dublin Status 3James Forsyth
  • Volumed run-time generated certificates are possible
  •  

    James Forsyth will open Jira tickets to update the keystores in the master branches of the mS that use https

  •  

    Arul Nambi will do sparky-be, search-data-service, data-router, logging-service, router-core

  • GraphGraph is coming, depends on expanding schema-service API
  • RestClient updates are potentially being contributed by community members
18
Dublin Status 4James Forsyth
  • code coverage to 55% for Dublin
    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyAAI-
2107

5G Use Case (R4 Dublin)

BBS Broadband Service Use Case (Dublin)

CCVPN Use Case (Dublin)

Change Management Dublin Extensions

Fine Grain Placement Service (F-GPS) Edge Automation (Dublin)

OpenSource Access Manager (OSAM) Use Case

K8S based Cloud Region Support

Tony Noori from AT&T will identify the ONAP POC for system engineering for AAI modelling. This person will coordinate schema changes, watch the use case wiki, jira, perform gerrit reviews, etc.

Analysis: AAI R4 Use Case and Functional Requirements Impacts

JIRA Epics count: Jira LegacyserverSystem JirajqlQueryproject = AAI AND issuetype = Epic AND fixVersion = "Dublin Release" ORDER BY created DESC counttrue
  • 2219

Champ slipped below 55% with latest commit.

  •  Tian Lee will do babel, model-loader, champ, gizmo, event-client, spike, rest-client, validation
  •  Arul Nambi will do sparky-be, search-data-service, data-router, logging-service, router-core
  •  James Forsyth create ticket for El Alto for sparky, rolling back because of sonar failure
  •  Venkata Harish Kajur will check aai-common, resources, traversal, graphadmin, cacher, schema-service (which probably already have the setting)
  •  Add thresholds to all repos that are above 55% so it doesn't happen again
  •  For setting the threshold on each repo, set it to the current percentage, so if it's is at 62.7%, set the threshold to 0.62
  •  

     <jacoco.line.coverage.limit>0.68</jacoco.line.coverage.limit>

    Sonar job for Dublin has been changed to using line coverage.

    Code Block
      <execution>
                        <id>default-check</id>
                        <goals>
                            <goal>check</goal>
                        </goals>
                        <configuration>
                            <dataFile>${project.build.directory}/coverage-reports/jacoco.exec</dataFile>
                            <rules>
                                <!--  implementation is needed only for Maven 2  -->
                                <rule implementation="org.jacoco.maven.RuleConfiguration">
                                    <element>BUNDLE</element>
                                    <limits>
                                        <limit implementation="org.jacoco.report.check.Limit">
                                            <counter>LINE</counter>
                                            <value>COVEREDRATIO</value>
                                            <minimum>${jacoco.line.coverage.limit}</minimum>
                                        </limit>
                                    </limits>
                                </rule>
                            </rules>
                        </configuration>
                    </execution>


19
Dublin Use Cases

James Forsyth


Epic-of-epics:

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176

19El Alto StatusJames ForsythJ. Ram Balasubramanian
  • No 2 way TLS in Dublin; James Forsyth will socialize early in El Alto, Due
  • pnf-id change pushed to El Alto during Architecture review AAI R4 Architecture Review - 5 Mar 2019
    • API version update for El Alto should be co-ordinated for earlier in the cycleneeds a checklist of things to be updated, including yang classes Jira LegacyserverSystem JiraserverId4733707d-2057-3a0f-ae5e-4fd8aff50176keyAAI-2351

    keyAAI-2107

    5G Use Case (R4 Dublin)

    BBS Broadband Service Use Case (Dublin)

    CCVPN Use Case (Dublin)

    Change Management Dublin Extensions

    Fine Grain Placement Service (F-GPS) Edge Automation (Dublin)

    OpenSource Access Manager (OSAM) Use Case

    K8S based Cloud Region Support

    Tony Noori from AT&T will identify the ONAP POC for system engineering for AAI modelling. This person will coordinate schema changes, watch the use case wiki, jira, perform gerrit reviews, etc.

    Analysis: AAI R4 Use Case and Functional Requirements Impacts

    JIRA Epics count:

    Jira Legacy
    serverSystem Jira
    jqlQueryproject = AAI AND issuetype = Epic AND fixVersion = "
    El Alto
    Dublin Release" ORDER BY created DESC
    counttrue
    serverId4733707d-2057
    -3a0f-ae5e-4fd8aff50176

    20Selenium Tests in SparkyArul NambiWant to share in the community potential selenium changes for the sparky UI21

    Traversal Nodes query documentation

    -3a0f-ae5e-4fd8aff50176

    20
    El Alto StatusJames Forsyth
    • No 2 way TLS in Dublin; James Forsyth will socialize early in El Alto, Due
    • pnf-id change pushed to El Alto during Architecture review AAI R4 Architecture Review - 5 Mar 2019
    • API version update for El Alto should be co-ordinated for earlier in the cycle
      • needs a checklist of things to be updated, including yang classes
        Jira Legacy
        serverSystem Jira
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
      • serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
        keyAAI-
    2202
      • 2351


    JIRA Epics count:

    Jira Legacy
    serverSystem Jira

    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution

    jqlQueryproject = AAI AND issuetype = Epic AND fixVersion = "El Alto Release" ORDER BY created DESC
    counttrue
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176

    keyAAI-2383
    •  Documentation on the search/nodes-query API is missing. James Forsyth needs to find it and publish it.
    22AAI achitecture documentation

    Taranjit Singh (Deactivated)

    Understanding the architecture of AAI is not easy - hard to understand how the code is laid out and how things flow. Need documention which will describe how the microservices are connected, which repos support which functions, etc. Former user (Deleted) says that he had to reverse engineer the dependencies to see how the repos are connected. Recommended to focus on the resources repo for understanding the core function of AAI.

    23API version documentation

    Keong Lim

    Is v15 API for Dublin release? Jira LegacyserverSystem Jira21
    Selenium Tests in SparkyArul NambiWant to share in the community potential selenium changes for the sparky UI22

    Traversal Nodes query documentation

    J. Ram Balasubramanian

    Jira Legacy
    serverSystem Jira
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyAAI-2202
    Jira Legacy
    serverSystem Jira
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyAAI-1811

    Why does schema-service now have v16 files?

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyAAI-2161

    •  James Forsyth Document nodes wiki and add explanation about presence of the v15 file. Should add v14-v15 changes to release notes.
    24Resources Nodes query documentation incomplete

    Keong Lim

    Jira Legacy
    serverSystem Jira
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyAAI-2384

    API Documentation needs update, as both of these URL paths are equally valid:

    • /aai/v13/nodes/{plural}/{singular}
    • /aai/v13/nodes/{singular}

    See also: https://onap.readthedocs.io/en/casablanca/submodules/aai/aai-common.git/docs/AAI%20REST%20API%20Documentation/nodesQuery.html#api-uri

    • Add to the Dublin Release for the documentation of the singular nodes query
    25AAI Dublin wiki updates

    Team

    Added pages to AAI in Dublin Release

    Please keep these procedures up-to-date with latest Dublin code.

    26

    2383

    •  Documentation on the search/nodes-query API is missing. James Forsyth needs to find it and publish it.
    23
    AAI achitecture documentation

    Taranjit Singh (Deactivated)

    Understanding the architecture of AAI is not easy - hard to understand how the code is laid out and how things flow. Need documention which will describe how the microservices are connected, which repos support which functions, etc. Former user (Deleted) says that he had to reverse engineer the dependencies to see how the repos are connected. Recommended to focus on the resources repo for understanding the core function of AAI.

    24
    API version documentation

    Keong Lim

    Is v15 API for Dublin release?

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyAAI-1811

    Why does schema-service now have v16 files?

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyAAI-2161

    •  James Forsyth Document nodes wiki and add explanation about presence of the v15 file. Should add v14-v15 changes to release notes.
    25



    Open Action Items

    •  Tian Lee will do babel, model-loader, champ, gizmo, event-client, spike, rest-client, validation
    •  James Forsyth Documentation on the search/nodes-query API is missing.
    •  James Forsyth Document nodes wiki and add explanation about presence of the v15 file. Should add v14-v15 changes to release notes.
    •  James Forsyth will see how other teams manage merging release bug/security/late feature change back to master for Dublin release.



    Viewtracker report