Policy R8 Honolulu Team Scrums

https://logs.onap.org/onap-integration/daily/

Check BOTH guilin, frankfurt and master Healthcheck

(NOTE: in future may need to check other tests)

policy-common-master-verify-java

policy-models-master-verify-java

PdpHeartbeats are not getting processed in PAP. After investigations, found that the policies list in PdpSubgroup (DB) is not matching with policies liast in PdpStatus (DMaaP). As a result of which the heartbeat processing fails and pdp update & pdp state change messages are sent back to PDP.

Fortunately the PDP's are not getting removed bcause they immediately reply back to PAP with succesfull response for pdp update & pdp state change. But the health & statistics are not updated in DB.

Started with POLICY-3227 - implementation of context album handling improvement in apex

Internal meetings

POLICY-3170: Review Comments 

Internal Task

3107: delta policies

pfpp lab full install

policy-k8s - work with ram on no-locking feature related

Internal Honolulu feature demo

POLICY-3202: Continued the testing of no locking feature. One observation is drools-PDP statistics are not incementing and shows all stats as 0.

Code reviews

Continue

Will sync up with Jorge on drools-pdp stats.

POLICY-3170: Review Comments 

Internal Task

pfpp windriver full lab honolulu reinstall

3202: install in oom policy-k8s the honolulu version once merged for Ram

POLICY-3202: Verified the drools-pdp no locking feature. It's finally working 

Thanks Jorge!

Code reviews & discussions with Ajith on the SSL Kafka work

3202:

drools-pdp review merged,

place drools-applications review only for honolulu (not needed in istambul).

test drools-pdp docker image and drools-applications oom k8s (master, honolulu not ready).

install in policy-k8s but wiht master (istanbul version).

pfpp windriver full lab honolulu reinstall outdated with dmaap certs.

3202: install in oom policy-k8s the honolulu version once merged for Ram to test.

Integration testing for the TOSCA CL PoC

Last batch of code for the POLICY-3129, refactoring the command line classes

POLICY-2899: audit details for deploy/undeploy

POLICY-3189: Factory class for the filters, patch set raised

POLICY-3059: persistence.xml changes

3202 - problems with service loader no loading no-lock classes

misc. lab support activitities

POLICY-3190: Improve context album handling in APEX during failure cases.

Looking into APEX Kafka plugin

POLICY-3170: patch will be raised today

Internal Task

oom snapshots istambul basic tests: xacml-pdp not coming (problem in config for istambul - opened POLICY-3199 - running ticket for istambul changes + review: https://gerrit.onap.org/r/c/oom/+/120577).   some issues with db config jobs but not sure if they are base to istambul or some other install problem.

cherry pick logback changes to honolulu/guilin (POLICY-3177)

test legacy-config (POLICY-2618) new feature in lab - OK

no-locking feature (POLICY-3144) issue loading class - looking into it after Ram reporting some problems in his testing

Investigated jenkins failures

POLICY-2059: common validation mechanism

Worked on testing no-locking feature in drools-pdp

Code reviews

POLICY-3190: Improve context album handling in APEX during failure cases.

Internal meetings.

POLICY-3170: Working on review comments

POLICY-3129 - working on the last package for review

2618:  legacy-config followed up review comments

set up lab istanbul snapshots

look at basic state of things with istanbul lab

backup

Code reviews

Internal control loop meetings

Mandatory trainings

Continue

Verify the no-locking feature in drools-pdp.

POLICY-3170: Review Raised

Internal Task and Training

continue with comments for 2618 and cherry pick of 3174-77 tickets if merged in oom the logback changes in master

look at backup of componets

POLICY-3172: empty coder broke apex & models junits

POLICY-3182: new version of maven resource plugin

POLICY-3198: use general event objects in op history classes

POLICY-3078: Worked with Francesco & Ajith of SSL support in Kafka plugin of apex-pdp. We divided the work in small sub tasks to attack one at a time. Also, create a setup internally at Bell for the same.

Attended the prioritization call for all DB related work.

Code reviews

Continue

Verify the no-locking feature in drools-pdp.

POLICY-3170: Support delta policies in APEX-PDP; review raised

Internal Task

2618:  legacy-config : junits

3174, 3176, 3177: logback: cherry pick to guilin and honolulu if merged by oom team

POLICY-3172: empty coder broke apex & models junits

POLICY-3182: new version of maven resource plugin

Internal sprint planning

Code reviews

Jira status of apex-pdp related work

Internal planning.

Started investigating into POLICY-3190: Improve context album handling in APEX during failure cases.

Internal Task

POLICY-3107: Support delta policies in PDPs; changes are made to handle the delta policies, currently testing the changes and adding unit tests.

OOM logback date timestamps.  Tickets: 3174 (apex), 3176 (drools), 3177 (pap).

Created base policy VM image: onap-policy-devlab-base-0.0, and make additional lab available based on it: devlab-1

Create a new image onap-policy-devlab-honolulu-0.0 based off onap-policy-devlab-base-0.0 to run periodic regression tests with policy components snapshots on a stable OOM base.

2618: continue development on legacy-config feature on drools pdp

POLICY-3172: empty json file

POLICY-3182: new npm repo

POLICY-3171: sporadic models junit test failures

POLICY-3179: use github as mirror

Internal demo & sprint ceremonies.

Code reviews

Helping w/ performance test of apex

Internal Task

POLICY-3107: Support delta policies in PDPs

devlab vm images

2618: legacy configuration as feature

POLICY-3160 - ash => sh

POLICY-3172: empty file in coder.decode()

Internal demo work

Code reviews 

Helping with APEX performance test - corrected the policy, set up CDS simulator etc.

POLICY-3173: Bug in APEX where it reports deployment as successful when it really failed; Fixed and raised a review.

Help Arkadiusz w/ performance test of apex

Internal Task

POLICY-3107: Support delta policies in PDPs

First half full of meetings

Code reviews (internally as well)

S3P work review

Tested and verified POLICY-3089 - Cleanup logs for success/failure consumers in apex-pdp

Internal tasks

Internal Task

POLICY-3107: Support delta policies in PDPs

continue 2618

set up no-locking in policy-k8s lab

S3P work reviews

Internal control loop work

Istanbul work items planning

Trying to reproduce POLICY-3089 - Cleanup logs for success/failure consumers in apex-pdp

Internal tasks

Internal Task

POLICY-3107: Support delta policies in PDPs

POLICY-3164: documentation updates

Internal training

POLICY-3089 Cleanup logs for success/failure consumers in apex-pdp

Internal tasks

POLICY-3110: PAP S3P Testing

• Docs reviews raised

POLICY-3107: Handling delta policies in apex-pdp

POLICY-3132: Apex-pdp documentation refers to missing logos.png (Review Merged)

Finished alignment of repos.

POLICY-2974: TOSCA POC demo of PMSH

policy-k8s reinstall latest oom - so issues.

onap-policy honolulu vm image work

POLICY-3164: documentation updates

POLICY-2542: PAP REST parameter validation

Internal training

Internal training

Code reviews (mainly the S3P one's)

Internal works.

Helping folks with test and reproducing POLICY-3066

POLICY-3110: PAP S3P Testing

• 72 Hour stability - 0 errors; 2.5 hour performance - 0 errors; 24* Hour stability (status apis included) - 0 errors

POLICY-3107: Handling delta policies in apex-pdp

POLICY-3132: Apex-pdp documentation refers to missing logos.png (Review Raised)

POLICY-3165: Add Policies Tree view

POLICY-3111- setting up S3P tests 

POLICY-3066 - investigate stack overflow bug in apex

Ran the performance tests without the monitoring decision policies, have th results recorded, currently attempting to see why the monitoring policy is failing, will run tests again if can make it pass.

For stack overflow issue, have docker running with Apex, will be attempting to get DMAAP simulator docker working also.

3108: s3p drools stability - completed

3111: s3p xacml stability  run completed + documentation

wrap up 3111 - port to honolulu

reinstall windriver tenants official to pick up dmaap cert. fixes, etc ..

OOO

Thurs and Friday

POLICY-3164: documentation updates

POLICY-2542: PAP REST parameter validation

Internal sprint planning and architecture work

Start discussions internally on Istanbul items that we can take 

Code reviews

Continue

Training today (30th Mar)

Moving apartment this week. Please consider delays in my responses.

POLICY-3110: PAP S3P Testing

POLICY-3107: Handling delta policies in apex-pdp

POLICY-3165: Add Policies Tree view

POLICY-3111- setting up S3P tests 

POLICY-3066 - investigate stack overflow bug in apex

Running performance tests

Setup local environment to replicate bug

3141: documentation no locking feature

s3p drools collect results (3108)

follow up on xacml issues Michael running into in windriver, started stability run (3111)

xacml s3p (stability) run analysis and results documentation

drools s3p results documentation

lab experiments for minilabs creation

Internal control loop work

Code reviews

POLICY-3110: PAP S3P Testing

• Tests finishing up
• Start Documentation
• Start performance testing

Continue

POLICY-3107: Handling delta policies in apex-pdp

POLICY-3095 - fixing bugs from sonarqube

POLICY-3111- setting up S3P tests 

Sonar is working again in build. Quality spec is different from when this task was run so new code smell warnings.

S3P tests still failed after update to latest Honolulu version, Jorge will be running tests in Wind River Lab to test if the issue is related to the K8s deployment being used. Possibly lacking resources.

Release: drools, drools-apps, OOM

Set up lab with no-locking feature for testing

POLICY-3108: S3P Stability run evaluating results and documentation

POLICY-3142: documentation no-locking feature

POLICY-3150: release process

POLICY-3152: preliminary release notes

POLICY-3145: should not allow self-signed certs by default

S3P issues

POLICY-3062: Cherrypick the changes to honolulu branch

Internal control loop work

Resolved issue with PAP Stability testing, running now

POLICY-3107: Working on handling delta policies in Apex

POLICY-3095 - fixing bugs from sonarqube

POLICY-3111- setting up S3P tests 

finish

Looking at Istanbul xacml jira's - will start next week.

POLICY-3159:  configuration for truststores/keystores - port to previous releases, there are some changes for OOM specific to honolulu+ as the gid/gid changed from ubuntu to alpine picking up the keystore (discovered after testing with latest istanbul drools image with no keystores).

lab work - latest snapshot honolulu images  - (POLICY-3146 don't see exceptions anymore)

Continue

POLICY-3152: preliminary release notes

POLICY-3158: investigate failure with default group

POLICY-3150: Release apex-pdp & distribution RC1 artifacts

POLICY-3062: Add default entry point to apex-pdp docker file

POLICY-3158: Investing PAP bug

PAP Stability Testing

POLICY-3095 - fixing bugs from sonarqube

POLICY-3111- setting up S3P tests 

POLICY-3108:  finished s3p - collecting outputs

Reinstalled policy in lab - latest snapshot honolulu images for PAP and PDP-D with latest (POLICY-3146)

S3P testing support to the folks 

Internal architecture work

Code reviews

POLICY-3158: Investing PAP bug

PAP Stability Testing

POLICY-3095 - fixing bugs from sonarqube

POLICY-3111- setting up S3P tests 

Errors appearing during tests

Continuing some code smell changes in Javascript

POLICY-3146:  set up snapshot in lab verify pdps losing connectivity ticket fix

Monitor s3p run (POLICY-3108)

S3P testing support to the folks 

Internal architecture work

Code reviews

POLICY-3111- setting up S3P tests 

3138:  telemetry breakage in new 1.8.1 image, packaged versions had changed underneath. - verified

started prep scenarions for drools-apps stability run

POLICY-3143: Remove keystore files from policy repos

POLICY-3147: xacml-pdp BusTopicParams

continue

POLICY-3146: sporadic loss of PAP-PDP connectivity

POLICY-3111- setting up S3P tests 

certificates updates (3139) honolulu+master

api: jmeter issue creating new native drools policies, seems to have broken since last release (new ticket 3144) - this is related to the issues that Francesco was running into for api stability run.

pap: keep seeing occasionally  with new released images  pap taking out pdps (new ticket 3146)

3138:  telemetry breakage in new 1.8.1 image, packaged versions had changed underneath.

start prep scenarions for drools-apps stability run

POLICY-3111- setting up S3P tests 

Internal control loop work

Ericsson open source conference presentation

Release of api 2.4.1 artifacts

Code reviews

POLICY-3105: branching

POLICY-3126: plug-in warnings

CSIT issues

gating issues

POLICY-2769: multiple PAPs

Release work for PAP

S3P for PAP

• Updating deployments (VMs)

POLICY-3095 - fixing bugs from sonarqube

POLICY-3111- setting up S3P tests 

finished 3114 ticket (always successful locking feature) 

lab work set up - dcae, cds components (work with Vijay and Ajith), pairwise

release

lab work continue

POLICY-3127: Release images

Investigated gating failure

RC0 JIRAs

Continue.

Policy-CDS pairwise testing.

Release work for PAP

POLICY-3110: PAP S3P Testing

• Updating tests with new APIs

Continue

Handle delta policies in apex

POLICY-3090: updated code review for reception package

POLICY-3113: SP3 testing configuration for env to run the tests

POLICY-3095 - fixing bugs from sonarqube

POLICY-3111- setting up S3P tests 

started with 3114 (no locking feature) 

started to look into ploy-k8s tenant to redo it for stability tests

put review out for 3114,

look into pairwise testing, what can be marked complete.

policy-k8s tenant

POLICY-3099: IQ scan issue

POLICY-3126: warnings about maven plug-ins

POLICY-3125: EntityNotFoundException in PAP

Internal works.

Started investigating into POLICY-3019 - Issue with parallel event execution in APEX.

POLICY-3110: PAP S3P Testing

• Updating tests with new APIs
• Updating PAP version in deployment

POLICY-3095 - fixing bugs from sonarqube

POLICY-3111- setting up S3P tests 

continue lab + start with 3114 (no locking feature)

Working on internal control loop use case.

Continue. 

POLICY-3019 - Issue with parallel event execution in APEX.

POLICY-3110: PAP S3P Testing

• Updating tests in the test plan for new response codes. 

Continue 3110

Start testing POLICY-3107: Support delta policies in PDPs

POLICY-3090: Code coverage for policy-distribution

Continue

POLICY-3095 - fixing bugs from sonarqube

POLICY-3111- setting up S3P tests 

lab tests - test with current drools snapshot - better but still issue with lock table being created (3117) - need to collect verbose shell trace.

3121: enable statistics viewing with telemetry shell

continue lab

start with 3114 (no locking feature)

POLICY-2969: Policy Model type handling for Topology template entities

Admin tasks and reviews

Working on internal control loop use case.

Start working on POLICY-3019 - Issue with parallel event execution in APEX.

POLICY-3110: PAP S3P Testing

POLICY-3107: Support delta policies in PDPs

POLICY-3090: Code coverage for policy-distribution

submitted code for review

Update code review from comments

Start work on reception package unit tests

POLICY-3111- setting up S3P tests 

POLICY-2969: Policy Model type handling for Topology template entities

Admin tasks and reviews

Internal work

Code reviews

POLICY-3110: PAP S3P Testing

POLICY-3107: Support delta policies in PDPs

POLICY-3095 - fixing bugs from sonarqube

POLICY-3111- setting up S3P tests 

Continue

POLICY-3117: pooling.locks not created

POLICY-2969: Policy Model type handling for Topology template entities

Admin tasks and reviews

Internal sprint planning

Mandatory trainings

Continue.

Will start working on POLICY-3019 - Issue with parallel event execution in APEX

POLICY-3110: PAP S3P Testing

Code Reviews

POLICY-3107: Support delta policies in PDPs

POLICY-3090: Code coverage for policy-distribution

Working on distribution-main package for code coverage

POLICY-3095 - fixing bugs from sonarqube

POLICY-3111- setting up S3P tests 

verify installation and run some tests

start with POLICY-3114, no locking feature.

POLICY-2969: Control Loop Supervision

Specify the PMSH use case using TOSCA

Admin tasks

Finish apex-pdp upgrade to Guilin 2.4.4. version internally.

Worked on prod outage issues

POLICY-3110: PAP S3P Testing

Code Reviews

POLICY-3107: Support delta policies in PDPs

Keep working on Sonar issues Policy Models; Looking at documentation for POLICY-3112

POLICY-3090: Code coverage for policy-distribution

Got the code to run with coverage on my environment

Working on main package for code coverage

release process

M3 JIRAs

POLICY-2969: Control Loop Supervision

Specify the PMSH use case using TOSCA

Admin tasks

POLICY-3028: Update info.yaml in policy framework repos

Code reviews

release process

M3 JIRAs

POLICY-2969: Control Loop Supervision: Specify the PMSH use case using TOSCA

Also completed structure of the Participant state management

POLICY-3088: Release maven artifacts and docker images of multiple repos.

Code reviews

Conference prep

Internal works.

Release of apex-pdp - stage-release job was failing due to a test failure. 

Created POLICY-3096 for this and fixed it.

Continue.

Internal.

release xacml, pdpd, and apps.

Tests

Release process

Continue

M3 JIRAs

POLICY-2969: Control Loop Supervision: Specify the PMSH use case using TOSCA

Also working on the structure of the Participant state management
TOSCA PoC Main commit

POLICY-2526: Review for swagger tags

Design and code discussions with multiple folks on PAP-PDP layer.

Code reviews

Finishing up POLICY-2526 - PAP deployment changes and doing some round of testing.

Internal task

Review Comments

Looking into upgrading Node JS version to fix sonar build jobs for policy-gui

3070 : pdp-type configuration in PDP-D

3033: PDP-D: drools-pdp and drools-apps reviews

POLICY-3063: a few sonars in policy-gui

POLICY-3085: xacml-pdp junit test failure on Windows OS

POLICY-3005: finished dependency upgrades

POLICY-2788: upgrade version of A&AI API

OLICY-2969: Control Loop Supervision: Specify the PMSH use case using TOSCA

Also working onthe structure of the Participant state management

Design discussions on multiple work going in PAP-PDP layer - supporting delta updates, deployment api changes, persist state during state change, pdpType vs PdpSubGroup etc.

Code reviews

Internal control loop work

Preparing for an open source conference talk

POLICY-2526 - PAP deployment API changes: Made changes to the registration and state change flow.

Updated documentations, csit and postman collection.

Resolved the policy-gui build errors

POLICY-2112: Resolving merge conflicts

Continue

Internal Training

POLICY-2810 time extensions

sonars for xacml-pdp and fix for extra "target" dir up a level

POLICY-3005: upgrade dependencies - address IQ issue in drools-pdp

POLICY-2905: fix gson adapter issue in apex-pdp.  Also more duplicate code in models

POLICY-2788: Upgrade A&AI version

POLICY-2906: sonars in apex-pdp

Apex integration with Kafka

Code reviews

Policy-3005: upgrade dependencies

POLICY-2904: sonars in various repos

Discussions on PAP API changes.

Internal architecture work

Code reviews 

Internal works and meetings.

POLICY-2526 - PAP deployment API changes - worked on review comments

POLICY-2112: Review comments

policy-gui job failing: Builds perfectly fine locally. It is failing in Jenkins at the point where webpack copies resource files.

Policy-3005: upgrade dependencies

POLICY-2904: sonars in various repos

Internal planning & architecture work

Code reviews 

POLICY-2526 - PAP deployment API changes

Internal works.

POLICY-2112: Review comments

policy-gui build failing

Design for PAP-PDP communication changes to accommodate delta policy updates - Support Policy Updates between PAP and the PDPs

Code reviews 

POLICY-2112: Working on review comments

Looking at why the policy-gui build is failing

Policy-3005: upgrade dependencies

POLICY-2904: sonars in various repos

Code reviews

Internal control loop work

POLICY-2526 - PAP deployment API changes.

Issue related to entrypoint while running APEX docker container

Internal Work

POLICY-2112: Working on comments

POLICY-2995: Bring the control loop common and models code into the tosca-poc branch of policy/clamp

POLICY-3035: JMS Security

Discussion with Ajith & JIm on PAP API changes. We finalized to go with PdpPolicyStatus model as of now.

Code reviews

Internal control loop notification work

POLICY-2883 - Fixing the bug identified during testing

POLICY-2526 - PAP deployment API changes.

POLICY-2112: Cleaned up some of the code and unit tests

WIP Review raised

Continue

Internal Training

After discussions with Jim & Ajith, updated the swagger for PAP deployment API changes.

Code reviews

Continue.

Also POLICY-2883 - identified a bug while testing this. So will look into this as well.

Internal Training

POLICY 2112: Fixing JUnit tests to match changes