Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Attachments

Recording:

AAI Weekly - 2019-08-07.mp4

Attendees:

START RECORDING

...

...

James Forsyth

...

Reshmasree c

...

68538894

Keong Lim  and FREEMAN, BRIAN D have both responded on mailing list, we need more info to be able to to troubleshoot this, it seems like its referencing repos that have not been in use Release 1 (Amsterdam) in Oct 2017.

31st Jul: Discussion on https://lists.onap.org/g/onap-users/topic/32571389 says it was resolved after tweaking the repository values in values.yaml

...

...

Francis Paquette

William LaMont

Dmitry Puzikov (Deactivated)

Keong Lim

Tian Lee

Zu Qiang

Giulio Graziani

Ondrej F

Manisha Aggarwal

Venkata Harish Kajur

Benjamin Cheung

Former user (Deleted)

Shirley Morgan

Himesh

ranvijay.s


START RECORDING

2420

James Forsyth is going to merge updates to JanusGraph, 0.2.0 → 0.2.3 in master, should be a drop in replacement.

FREEMAN, BRIAN D reported that when there are ~2400 vservers returned in a closed loop custom query, AAI takes minutes to respond.  We've discussed paging previously, any other ways to optimize this?

PUT 'https://aai.onap:8443/aai/v16/query?format=resource'

{"query":"query/closed-loop","start":"/cloud-infrastructure/cloud-regions/cloud-region/CloudOwner/RegionOne/tenants/tenant/28481f6939614cfd83e6767a0e039bcc/vservers/vserver/6ad9eb6b-d7fc-46d6-8617-4c9b46e7308b"}

key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution2111

aai-common:1.5.2 (not released yet) will be the el-alto library for springboot 1.5.x microservices.  There needs to be some urgency to migrate the microservices to spring boot 2, since 1.5.3+ will not be backward compatible and so dependent applications might not have security updates if they stay on 1.5.2.  1.6.0 (Frankfort, currently master branch) aai-common will be springboot 2 so microservices must be updated by Frankfurt.  Springboot 1.5.21 is the latest (and last) version in the 1.5.x spring boot train.

Global JJB transition Complete!

3rd July: raised

1
Alpine imagesDmitry Puzikov (Deactivated)

Jenkins jobs needed to create / push the common alpine image that the AAI containers will use, still need this completed before we merge the outstanding commits.

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-

3Performance Issue4Spring Boot 2James Forsyth
Jira Legacy
serverSystem Jira
columns

2574

2
Microservices enabled by default in aai/oom

The ones in bold will be turned "off" by default:

aai-babel               aai-elasticsearch       aai-modelloader         aai-search-data         aai-traversal

aai-champ               aai-gizmo               aai-resources           aai-sparky-be

aai-data-router         aai-graphadmin          aai-schema-service      aai-spike

We will add are release note about how to turn off the ones in italics for users that want a true minimum set without the UI

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-2548

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-

5Upcoming R6 Functional RequirementsBenjamin Cheung

Release 6 (Frankfurt) proposed use cases and functional requirements

Use Case Realization Call: July 24, 2019

6Round trip reverse engineering of the AAI data model
  •  We provided a parseable JSON schema.  Team wants follow up meeting, James Forsyth will set it up.
7Alpine imagesDmitry Puzikov (Deactivated)Jenkins jobs needed to create / push the common alpine image that the AAI containers will use, still need this completed before we merge the outstanding commits.8Microservices enabled by default in aai/oom

The ones in bold will be turned "off" by default:

aai-babel               aai-elasticsearch       aai-modelloader         aai-search-data         aai-traversal

aai-champ               aai-gizmo               aai-resources           aai-sparky-be

aai-data-router         aai-graphadmin          aai-schema-service      aai-spike

We will add are release note about how to turn off the ones in italics for users that want a true minimum set without the UI

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-2548

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-2549

9Global JJB Status10Vetting DSL QueriesWill discuss strategies AAI will employ to protect itself from rogue queries. 11AAI HistoryPhilip BlackwoodDiscuss and review Scenarios for using historical inventory and topology12Casablanca to Dublin MigrationAnkit Bhatt
Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-2507
based on Ankit's analysis that found the change in EdgeRules.

13Build stylesWe have too many ways to build and deploy artifacts, which makes it difficult and time-consuming.  Some of our artifacts are not backward compatible and we need to move everything up to released versions.14Alternative meeting system

Just in case Zoom problems continue, try this instead:

https://meet.jit.si/onapaai

15New UI Features / Historical Tracking

The AT&T team has done an exciting POC at a sprint-a-thon event that they would like to share with the community.

ATT wants to contribute additional UI views to ONAP, want to discuss path forward

16New support ticketing for LF

support.linuxfoundation.org

17Dublin IssueReneal Rogers

sparky-be expired certificate - status

  •  James Forsyth will add note to known issues using info provided by Reneal Rogersand Francis Paquette and make sure dublin docs branch is synced. 
    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyAAI-2489
     
    Jira Legacy
    serverSystem Jira
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyDOC-486
    - opened because the docs are not syncing even though dublin matches master
  •  Francis Paquette  will work 
    Jira Legacy
    serverSystem Jira
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyAAI-2490
18Dublin Issue

Jira Legacy
serverSystem Jira
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyPORTAL-596
 - In future, AAI team needs to open Jira bugs against systems that are misconfigured or missing data when we become aware of the issue.

19Global JJB

Sonatype's maven-staging-plugin will be disabled and we need to implement new LF jenkins jobs before mid-July

global-jjb Migration Tracker

Repos and do they use oparent:
./model-loader/pom.xml true ./graphgraph/pom.xml false ./graphadmin/pom.xml true ./esr-server/pom.xml true ./sparky-be/pom.xml true ./rest-client/pom.xml true ./aai-common/pom.xml true ./data-router/pom.xml false ./chameleon/pom.xml false ./sparky-fe/pom.xml false ./event-client/pom.xml true ./gallifrey/pom.xml false ./resources/pom.xml true ./router-core/pom.xml true ./gizmo/pom.xml true ./logging-service/pom.xml true ./babel/pom.xml true ./champ/pom.xml true ./traversal/pom.xml true ./spike/pom.xml true ./esr-gui/pom.xml true ./search-data-service/pom.xml false ./cacher/pom.xml true ./schema-service/pom.xml true ./validation/pom.xml true
20Dublin Blockers

Jira Legacy
serverSystem Jira
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-2406

Jira Legacy
serverSystem Jira
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-2411

Jira LegacyserverSystem Jiracolumnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution

2549

3
El Alto ReviewJames Forsyth

JIRA Epic/Story count:

Jira Legacy
serverSystem Jira
jqlQueryproject = AAI AND issuetype in (Epic,Story) AND fixVersion = "El Alto Release" ORDER BY created DESC
counttrue
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176

4
OOM staging branch

Seeking comments and reviews on OOM Repository for Release and Staging Environments Proposal

Will have impact on how the aai/oom repository is managed as well.

5
Janusgraph 0.2.3

Jira Legacy
serverSystem Jira
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-2420

James Forsyth is going to merge updates to JanusGraph, 0.2.0 → 0.2.3 in master, should be a drop in replacement.

6
Performance Issue

FREEMAN, BRIAN D reported that when there are ~2400 vservers returned in a closed loop custom query, AAI takes minutes to respond.  We've discussed paging previously, any other ways to optimize this?

PUT 'https://aai.onap:8443/aai/v16/query?format=resource'


{"query":"query/closed-loop","start":"/cloud-infrastructure/cloud-regions/cloud-region/CloudOwner/RegionOne/tenants/tenant/28481f6939614cfd83e6767a0e039bcc/vservers/vserver/6ad9eb6b-d7fc-46d6-8617-4c9b46e7308b"}

7
Spring Boot 2James Forsyth

Jira Legacy
serverSystem Jira
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-2111

aai-common:1.5.2 (not released yet) will be the el-alto library for springboot 1.5.x microservices.  There needs to be some urgency to migrate the microservices to spring boot 2, since 1.5.3+ will not be backward compatible and so dependent applications might not have security updates if they stay on 1.5.2.  1.6.0 (Frankfort, currently master branch) aai-common will be springboot 2 so microservices must be updated by Frankfurt.  Springboot 1.5.21 is the latest (and last) version in the 1.5.x spring boot train.

8
Upcoming R6 Functional RequirementsBenjamin Cheung

Release 6 (Frankfurt) proposed use cases and functional requirements

Use Case Realization Call: July 24, 2019

9
Round trip reverse engineering of the AAI data model

Moved to new meeting:

AAI Information Model Reverse Engineering Meeting

10
Global JJB Status

Global JJB transition Complete!


11
Vetting DSL QueriesWill discuss strategies AAI will employ to protect itself from rogue queries. 12
AAI HistoryPhilip BlackwoodDiscuss and review Scenarios for using historical inventory and topology13
Casablanca to Dublin MigrationAnkit Bhatt


3rd July: raised

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyAAI-

240221El Alto ReviewJames Forsyth

JIRA Epic/Story count:

Jira Legacy
serverSystem Jira
jqlQueryproject = AAI AND issuetype in (Epic,Story) AND fixVersion = "El Alto Release" ORDER BY created DESC
counttrue
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176

22El Alto StatusJames Forsyth
  • No 2 way TLS in Dublin; James Forsyth will socialize early in El Alto, Due
  • pnf-id change pushed to El Alto during Architecture review AAI R4 Architecture Review - 5 Mar 2019
  • API version update for El Alto should be co-ordinated for earlier in the cycleneeds a checklist of things to be updated, including yang classes
    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyAAI-2351
    23

    2507
    based on Ankit's analysis that found the change in EdgeRules.

    14
    Build stylesWe have too many ways to build and deploy artifacts, which makes it difficult and time-consuming.  Some of our artifacts are not backward compatible and we need to move everything up to released versions.15
    Alternative meeting system

    Just in case Zoom problems continue, try this instead:

    https://meet.jit.si/onapaai

    16
    New UI Features / Historical Tracking

    The AT&T team has done an exciting POC at a sprint-a-thon event that they would like to share with the community.

    ATT wants to contribute additional UI views to ONAP, want to discuss path forward

    17
    New support ticketing for LF

    support.linuxfoundation.org

    18
    Selenium Tests in SparkyArul Nambi

    Want to share in the community potential selenium changes for the sparky UI

    (bumped up, is it still relevant?)

    2419
    AAI achitecture documentation

    Understanding the architecture of AAI is not easy - hard to understand how the code is laid out and how things flow. Need documention which will describe how the microservices are connected, which repos support which functions, etc. Former user (Deleted) says that he had to reverse engineer the dependencies to see how the repos are connected. Recommended to focus on the resources repo for understanding the core function of AAI.

    (bumped up, is it still relevant?)

    2520
    Run AAI containers as non-root user

    https://wiki.onap.org/display/DW/Best+Practices

    • The Docker and Kubernetes engines may run as root until such time as the products support non-root execution.
    • Applications may run as root within a container.
    • The process ID of a container must not run as the root ID with the exception of containers supporting ONAP features that require the container to run as the root ID.
    • Containers may run with root privileges.
    • Project containers that run as the root ID must document this in the release notes along with the functionality that requires the container to run as the root ID.

    Jira Legacy
    serverSystem Jira
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
    keyAAI-2172

    2621
    Container Images

    Container Image Minimization Guidelines

    James Forsyth will ask integration team if we can use the AAI tenant space in windriver environment

    27Bug Review

    JIRA Issue Count (in AAI project):

    Jira Legacy
    serverSystem Jira
    jqlQueryproject = AAI AND issuetype = Bug and status not in (Closed, Delivered) ORDER BY fixVersion ASC, priority DESC, updated ASC
    counttrue
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176

    space in windriver environment

    22
    Bug Review

    JIRA Issue Count (talking about in AAI project):

    Jira Legacy
    serverSystem Jira
    jqlQueryproject != AAI AND (text ~ "AAI" OR text ~ "A?AI" OR text ~ "A??AI" OR text ~ "A???AI") = AAI AND issuetype = Bug and status not in (Closed, Delivered,Done) ORDER BY fixVersion ASC, priority DESC, updated ASC
    counttrue
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176

    28Dublin branching

    Dublin artifacts are released and jjb jobs are updated to drop casablanca jobs and replace with dublin

    We will change the sonar and clm jobs to use the dublin branch

    •  James Forsyth will see how other teams manage merging release bug/security/late feature change back to master
    29Gerrit Reviewhttps://gerrit.onap.org/r/#/q/projects:aai30Sonar Reviewhttps://sonar.onap.org/projects?search=aai&sort=coverage31Jenkins CLM Reviewhttps://jenkins.onap.org/view/CLM/32Status of ARC documentation

    When is this going to be finished ARC AAI Component Description - Dublin ?

    Note: I have no idea what it is, I just was asked to inquire

    33Dublin Status 1James Forsyth
    • Encourage our clients to migrate off named query
    • Trying for Silver badge and Level 2 on Security; 50% code coverage on repos
    • Resiliency and fault tolerance; meeting notice never published,
    • CSIT on OOM needs to cover more of the services
    34Dublin Status 3James Forsyth
    • Volumed run-time generated certificates are possible
    •  

      James Forsyth will open Jira tickets to update the keystores in the master branches of the mS that use https

    •  

      Arul Nambi will do sparky-be, search-data-service, data-router, logging-service, router-core

    • GraphGraph is coming, depends on expanding schema-service API
    • RestClient updates are potentially being contributed by community members
    35

    JIRA Issue Count (talking about AAI):

    Jira Legacy
    serverSystem Jira
    jqlQueryproject != AAI AND (text ~ "AAI" OR text ~ "A?AI" OR text ~ "A??AI" OR text ~ "A???AI") AND issuetype = Bug and status not in (Closed,Delivered,Done) ORDER BY priority DESC, updated ASC
    counttrue
    serverId4733707d-2057-3a0f-ae5e-4fd8aff50176

    23
    Gerrit Review
    https://gerrit.onap.org/r/#/q/projects:aai24
    Sonar Review
    https://sonar.onap.org/projects?search=aai&sort=coverage25
    Jenkins CLM Review
    https://jenkins.onap.org/view/CLM/26
    Status of ARC documentation

    When is this going to be finished ARC AAI Component Description - Dublin ?

    Note: I have no idea what it is, I just was asked to inquire

    27
    Code Coverage StatusJames Forsyth
    • code coverage to 55% for Dublin
      Jira Legacy
      serverSystem Jira
      serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
      keyAAI-2219

    Champ slipped below 55% with latest commit.

    •  Tian Lee will do babel, model-loader, champ, gizmo, event-client, spike, rest-client, validation
    •  Arul Nambi will do sparky-be, search-data-service, data-router, logging-service, router-core
    •  James Forsyth create ticket for El Alto for sparky, rolling back because of sonar failure
    •  Venkata Harish Kajur will check aai-common, resources, traversal, graphadmin, cacher, schema-service (which probably already have the setting)
    •  Add thresholds to all repos that are above 55% so it doesn't happen again
    •  For setting the threshold on each repo, set it to the current percentage, so if it's is at 62.7%, set the threshold to 0.62
    •  

       <jacoco.line.coverage.limit>0.68</jacoco.line.coverage.limit>

      Sonar job for Dublin has been changed to using line coverage.

      Code Block
        <execution>
                              <id>default-check</id>
                              <goals>
                                  <goal>check</goal>
                              </goals>
                              <configuration>
                                  <dataFile>${project.build.directory}/coverage-reports/jacoco.exec</dataFile>
                                  <rules>
                                      <!--  implementation is needed only for Maven 2  -->
                                      <rule implementation="org.jacoco.maven.RuleConfiguration">
                                          <element>BUNDLE</element>
                                          <limits>
                                              <limit implementation="org.jacoco.report.check.Limit">
                                                  <counter>LINE</counter>
                                                  <value>COVEREDRATIO</value>
                                                  <minimum>${jacoco.line.coverage.limit}</minimum>
                                              </limit>
                                          </limits>
                                      </rule>
                                  </rules>
                              </configuration>
                          </execution>


    3628



    Open Action Items

    ...