Holmes Deliverables for RC0 Milestone for Dublin



Practice Area

Checkpoint

Yes/No

Evidences

How to?

Practice Area

Checkpoint

Yes/No

Evidences

How to?

Product Management

Are all tasks associated with the release been marked as "Closed" in Jira?

Yes

Getting issues...



Have all findings from previous milestones been addressed?

NA





Development

Have all Defects of priority Highest and High been in status "Closed" in Jira?

NA





Are all JIRA issues used as a reference in a commit in status "Closed" in Jira?

Yes



Very often, some JIRA issue remains in status "Todo" in JIRA while the commit they are referenced to is successful.

Is there any pending commit related to Highest and High priority issues older than 36 hours in Gerrit? In case there are messages going back and forth between authors and reviewers, it is acceptable to be above 36 hours.

No



Gerrit Query: status:open label:verified -is:draft -label:Code-Review=-1 AND -label:Code-Review=-2  AND is:mergeable age:1week

Are all the Jenkins jobs successfully passed (verify + merge jobs)?

Yes

https://jenkins.onap.org/view/Merge-Jobs/

https://jenkins.onap.org/view/Merge-Jobs/

Has the project team reach the Automated Unit Test Code Coverage expectation? (Refer to artifacts available in Sonar)

Yes

Goal: 55% for Incubation project in the current release

Sonar

Guidance on Code Coverage and Static Code Analysis

Tools: Sonar

Has the team delivered all their release artifacts in Nexus Release repo?

There should be at least ONE version of each artifacts available in Nexus Release repo.

Yes



Refer to Independent Versioning and Release Process for procedure

Check the certification expiry of your application. It should be valid for the next 9 months after RC0.

Yes

https://gerrit.onap.org/r/85729

https://gerrit.onap.org/r/85730



Integration and Testing



Have all CSIT Use Cases (created by each project team) passed?



It should include at least 1 CSIT that will be run on



Lab-xxx-OOM-Daily Jenkins Job

Yes

Provide link to evidence. As things are moving fast, we want to ensure CSIT are still "green".



At RC0, has the Pair Wise testing table been filled out?

Yes

Integration Weather Board for Dublin Release

Need help from the AAI team. Emails have been sent but no applicable response has been made.

Update: the AAI team has provided their solution. Due to the public holiday in China, I'm out of office right now hence can not verify it. This will be done by May 8, hopefully. (need some time in case there are other contingencies.)

Update: Done May 5, 2019 



At RC0, have all OOM Release Healtcheck related to your project passed?

Yes





At RC0, is there a Docker image in Nexus Docker-Release repo available for each repository?

No

Due to the public holiday in China, I have no time to release the docker yet. This will be done by May 6.



Has the project code successfully passed the Daily Build process?

Yes



Goal is to ensure the latest project commit has not broken the Integration Daily Build 

Has the OOM deployment passed?

Yes

Ensure in Jenkins External Labs all Health Check pass.



Has the project passed the Integration Sanity Tests?

Yes



Integration sanity tests in Dublin Release cover:

  • ONAP deployment

  • All components health check

  • VNF onboarding and service creation for vFW use case

  • Model distribution for vFW

  • vFW instantiation

  • vFW closed loop

  • vFW deletion

No test failure reported on http://onapci.org/grafana/d/8cGRqBOmz/daily-summary?orgId=1

No Integration Blocking Issue with no workaround: Dublin Release Integration Test Blocking Issues

Documentation

For RC0, does the project team has solved their JIRA Documentation Tickets?

If not, what are the risks?

Yes



JIRA Query (Bugs Only)

project != "Sandbox Project" AND project != "ONAP TSC" AND project != CI-Management AND (labels = Documentation OR project = Documentation) AND issuetype= Bug AND  fixversion = "Dublin Release" AND status != Closed ORDER BY issuetype DESC, fixVersion ASC, status DESC, priority DESC, updated DESC

For RC1, has the team addressed all the remaining Documentation JIRA tickets ?





JIRA Query

project != "Sandbox Project" AND project != "ONAP TSC" AND project != CI-Management AND (labels=Documentation OR project=Documentation) AND status != Closed ORDER BY fixVersion ASC, status DESC, priority DESC, updated DESC

For RC1, is the project prepared for the upcoming 'Ready to review'?





Documentation related patches should be reviewed by the documentation team to make sure everyone follows style guides.

For RC2, has the team addressed all the remaining Documentation JIRA tickets identified during the review?





JIRA Query

project != "Sandbox Project" AND project != "ONAP TSC" AND project != CI-Management AND (labels=Documentation OR project=Documentation) AND status != Closed ORDER BY fixVersion ASC, status DESC, priority DESC, updated DESC