Policy R4 Dublin - Team Scrums

Documentation - today is a hackathon for this.

RC1 checklist.

test and support + policies in active mode for pdp-d

continue

look into OJSI tickets.

Worked on xacml-pdp CSIT

Worked on 1754 after getting environment info

Make changes suggested by Jorge for 1760

Work on 1754

xacml-pdp CSIT

I am having an issue with CSIT.  The POLICY_PAP_IP will not populate when executing g"et-instance-ip.sh policy-pap" and causes the tests to fail.  I have submitted a review but have not added reviewers yet as I wanted to see it run on Jenkins in hopes that it was something with my local environment.

https://gerrit.onap.org/r/#/c/87584/

Test + Support + Security Issues evaluation - detected 2 false positives when testing against casablanca and master.

working on bugs - 1760 &

1754

Testing support, helping Ericsson folks for S3P setup of apex, helping Ajith on Pdp simulator.

Raised reviews to upgrade repos to released version of policy/parent & policy/commom. 

Documentation

JIRA backlog

Testing support

support and testing + review out to support policies in pdpd in passive state - merged

vFW to accommodate the payload

deploy issue found in integration testing

issue with CSIT from small change on REST PAP API.

work with Jorge testing

Note: OOO next week.

db connection bug + submitted other patch

1754: policyDelete legacy API

CSIT continue

Updated Legacy Operational policies to revert converstion of properties to JSON

Examined the exposed HTTP port JIRAs

estability for pap + helping ericsson team for estability and performance for apex

support debugging

test, support, environment set up, restart pdpd not going to the active state issue

policy-type-version fix merged

security code issues

security code issues

actions from CL subcommitteed

Testing + Support

continue

work with Jorge in certs.

Supported testing

Investigated db connection error on pdpx - logs were wiped so I was blocked here

Worked on CSIT tests for xacml-pdp

Work on deploying the dmaap simulator for CSIT tests in xacml-pdp

Support testing

continue rc0 checklist

documentation planning

new images testing, found problem with latest drools apps cl image, transitive dependency complaint, capabilities 1.4.0 through models and 1.4.0-SNAPSHOT.   Review

s3p tests investigation (look at casablanca) 

Finishing bug on xacml pdp

run csit, decision is passing

continue testing.

working w Liam.

working on checklist for rc0

work with integration team on api calls.

testing drools apps, focused on vcpe use case.

put code review out for noop sinks to aid debugging and testing

Updated custom query with AAI.   Issue with matching parameters in model.

AAI custom queries certification error.

continue

csit

test deployment of policies with Jim and Jorge

work on policy distribution on tosca parser

Testsuite work

More releasing of components today

Finish documentation

Alpine + CSIT changes - all CSIT passing now I believe.

Test, install lab with new images.

Support misc. activities.

Sick today - will be doing limited code review etc.

Need to start releasing some of the components: parent, common, and models first.

documentation

JIRA backlog

drl and misc changes + testing + changes and changes for additional docker simplification (making volume usage optional)

continue dev as mentioned

support other team maintenance activities - portal + merge jobs failures

Change to send policies with an empty list instead of null.

Tests in xacml pdp

continue both doc + security

may be look at the bugs

casablanca manintenance release - vFW debugging with integration team + documenting workaround to bypass portal in release notes.

telemetry api enhancements for lifecycle apis - under review

csit test cases - healthchecks - facing ssl issues

got access windriver lab

Documentation - continue

Security Checklist follow up - waiting for other team to respond

Casablanca Maintenance Release control loop issues

Testing pdp-d, some code changes on the pipe.

Put a few inspections out in a few repos

Follow up on casablanca support for integration.

Verify API working with Bilal's help.

Presentation.

Security Issues

RC0 Checklist

Documentation JIRA's

Spent sometime looking at the refactoring of alpine base images and reviews.   Made proposal on specific packaging separation for Policy OS and components and benefit of such.

Rerun some lab tests, see "issues" box.

Set up policy account in VM (standalone VM install) for easier testing of operating with policies on PDP-D site.

Need ownership for this ticket.

POLICY-1673: PDP-X-PAP Registration unsuccessful - Mike/Jim

POLICY-1674: PDP-A-PAP Registration unsucessful - Ajith

Should probably create one for API about 500 Policy Type creation

Security review - finish up wiki and work on JIRA's that may be addressed in Dublin.

JIRA backlog organization - Documentation JIRA's

POLICY-1663: oom api nodeport under review

POLICY-1664: docker-compose - old heat redo with new drools-apps image, review submitted, but may affect csit, need to figure out side effects before inviting folks to review.

POLICY-1651: csit from Pam rework and new drools csit - made a few changes to pull in new pdpd-cl image.

Junit tests, found a bug

Casablanca Maintenance Release

Drools/Drools-apps CSIT work

Security review - may result in high priority tasks

Help with Portal-554, work with Yang (integration) and Utkarsh - moved to Dublin (instead of Casablanca).

OOM latest - all components seem to go active message wise based on what I see over DMaaP topic.   However, there's some data in the database that couldn't correlate to the PDPs going active.   Need PAP subteam to look at it.   In general, we should all be looking at if its assigned component works as expected in the windriver lab to make sure.  

Minor change in OOM api chart, still have to push it through w OOM to make the helm API an external port (reachable from other windriver tenants for pairwise testing with CLAMP).

Look at CSIT work in the drools area from Pam and Bilal.

Support Pam in Casablanca Maintenance Release if needed.

Look at "usecases" templates and modify.

look at database and why not all pdps are registered

end-to-end tests.

Casablanca Maintenance Release

Drools/Drools-apps CSIT work

Security review - may result in high priority tasks

OOM Status - images running ok, passing healthcheck. Apex resolved.

XACML PDP - registration ok. Drools PDP - problem, not giving state change back. Open review on this. Apex PDP - will look at again to see if it goes active.

POLICY-1655 -

API working in CSIT - fixed an issue.

Preload policy types more efficient db call

Finish the rest of the test cases to ensure they run properly with new output.

Setting up environment for CSIT.

How to deploy?

Use java model provider api to make REST call to create policy

1643 - Dmaap simulator - moved into models, forgot to configure pap.

subgroup doesn't work (yet)

POLICY-1630: generate 1 year certs, cherry pick to casablanca release where they are needed for the new release.

OOM Test with latest patches, report problem in PAP with description message. Apex-pdp has bouncing issue. PDP-X is OK estable.

POLICY-1647: junits failure bc changes of models

checked in last review - fixed issue in compilation.

preloading policy types

csit tests with Bilal

continue working csit tests that don't require dmaap (decision api)

taking afternoon off today for family matter. CBR: 630.234.8676 if needed

dmaap simulator

code fix to allow null

PORTAL-554: latest casablanca release certificate investigation - Portal regenerate certs with different names, prevents GUI to work properly.

OOM: test with all patches under review: API, PAP: OK. PDP-X, and APEX-PDP bouncing. See windriver lab.

POLICY-1611: BRMSGW: dealing issues that show up from Alpine and drools-applications to models refactoring and code move. Few reviews out over the last few days.

POLICY-1642: under review, The latest move to models and AAI jaxb libraries caused a few issues on PDP-D CL APPS. It does not come up.

debugging OOM - consolidate all changes in one review.

Preload policy types in API server.

Work with Bilal, authentication issue, CSIT.

CSIT tests for AAI interface. Feedback from Bilal in CSIT. Feedback from Marco on AAI testing.

Work with Chenfei POST problems.

CSIT tests.

Minor changes to PAP.

Statistics and sonar issues.

continue, need some changes to topic.properties in xacml-pdp packages.

work on sonar issues and Junits in xacml-pdp

fix to remove version from pdp group.

review for dmaap simulator, it is in pap, may be put it dmaap?

Docker + OOM helm charts

Looking into apex pdp restart issue.

Test DMaaP simulator, debugging some REST calls.

changes in oom to support pdp-a.

fixing the bouncing issue

continue

sonars

oom testing w latest: problems: a) usecase not working, model move, b) brmsgw not working, ticket open.

apps changes

deploy - latest fixes

drools applications

hope to get apps repo working with tosca policieis

reload images in oom - latest status of things

changes to event manager + changes to make it configurable to aai cq.

changes in simulator.

double map issue that Pam reported.

undeploy provider

going over Jiras - 1444

group operations and broadcast, deciding what to do next.

csit failure for pdp-x

deploy/undeploy review

need to add a few things to the deploy/undeploy.

csit test

fixes for policy-id + version.

misc. reviews tidying

work w Mike

m4 checklist

1455: undeploy completion

switch to apps repo, new changes to support ToscaPolicies

reload lab with latest images, see where we stand

csit test failing in pdp-x

csit - api tests - written

finish up delete (= undeploy API)

group deploy/undeploy APIs

testing registration + group + state changes apis

some reviews going - configuration

work on reviews

oom charts config

POLICY-1264

POLICY-1440

M4 Checklist - not looking good

deploy

API operations + policy type.

Problems with queries.

need review for https://gerrit.onap.org/r/84785

https://gerrit.onap.org/r/84799

POLICY-1264 - clean up of drools-applications models etc.

POLICY-1440 initialization of applications and getting a decision

M4 Checklist

1624: support for policy deploy

need final changes in drools-applications and migration to models in terms of reviews and changes, before doing development there.

there's cyclic dependencies between drools-pdp and models, need to resolve.

1440 - continue packaging

drools-applications reviews -

1408 - enable in emage lifecycle api

oom lab - latest install, see my email about some issues with some images bouncing.

checked in changes per Jorge suggestions

Marco sent info on new query

Finish A&AI manager code using new query

Finish JUnit tests

Made the changes per scrum discussion

Wrote up the Undeploy Policy API code

Get the JUnit done

Will need to incorporate filtering changes

Comment: Probably want exact matches on the filters rather than regexp.

Per Liam: Ok to go ahead and change it to equals.

Push changes

Will work on the update listener

Finished coding

fixed bug for Chenfei, policy type yamls seem to have problems

Fix merge conflict and yaml's

JUnit tests

Do statistics post-M4

Jim, Ram, Chenfei - please look at filtering classes to make sure they are what you want.

1608: a) state machine reviewed and merged, b) review out - update messages

1608: Review for basic state machine for lifecycle api

Supporting vFirewall demo

Finished work for operational manager

Unit test cases done

Created new classes and kept old one as it is

How to check-in the new classes?

Vamshi waiting for review to be ready

A&AI data is not there yet

1460: Performance test for PAP

1458: Performance test for API

Junit tests are almost done for deploy

1443: pdp registration + heartbeat listener & handler review merged yesterday

review for deleting pdp-common from policy/common is merged

review for adding pdpHeartbeatIntervalMs in PdpUpdate message is merged

1443: continue to work on left over comments in the previous registration review.

Create PAP models as per proposed over email.

1668: support for state-change + junits - review shortly

casablanca demo issues - push-policies + gui access

1/2 reviews - modify existing codes for models.

junits for deploy ..

rename "casablanca" controller to "usecases"

Some reviews + new hardware

1452: pdp-status,

start working in pdp-update handler

POLICY-1608: dev

POLICY-1266: Looked at all A&AI classes that has to change.

Created new classes and not changing the old ones.

POLICY-1266: Working on event manager class.

Code reviews (don't wait for me) and PIP when time permits.

1608: refactoring + dev.

Sonar/comment issues, the merge failed on JUnits I will look into that.

Trying hooking the Decision API to the applications.

test oom install with Friday images - push failed on BRMSGW: POLICY-1611

OOM PDP-X remove NodePort configuration : review out.

OOM PDP-D-CL new image - simplification of helm chart: review out + PDPD APPS small change

1608: Junits.

Now that OOM merged, change integration docker manifest

BRMSGW push bug due to Alpine - probably is a configuration problem. Default libraries look into the wrong place. Java code will have to change to look into the right place.

prioritize the register/unregister review

operational policies working with provider, should work through REST.

review: takes policies of a type, puts into DB and tests output.

POLICY-1273/1471 - Handling errors or empty results.

1608: registration / skeleton lifecycle dev.

1608: junits

oom: pdp-x: tackle changes from review + test.

oom: pdpd-cl: switch image + test

oom: bring up with very latest.

look into next steps based on Liam's email.

build provider functions

after - db interactions.

discuss q's at end of meeting

POLICY-1273 - I think I am almost finished with the requirements part.

POLICY-1471 - Finish guard contents and add in placement application. Consolidate code and fill in the TODO's.

POLICY-1440 - If I have time this weekend I will hook in the Decision API.

1607: finish maintenance release

1293: work on error/warning message models

work with Bilal on Xacml CSIT failure

1608: development

1608: dev. continue

check healthcheck in pdp-x

continue

check w Jorge - test in oom lab

1495: refactor - models .. reviews out.

got DB populated !!

Work with Ajith on Apex PDP support

Looked into infrastructure for DMaaP communication for Registration.

Worked with Ram on TOK

continue dev. on 1273

casablanca release new artifacts

1608: development

Sonar issues with my Xacml submission and adding request/response decision payloads.

Schedule meeting with Josh to go over POLICY-1471 and his coordination work.

Casablanca Maintenance Jars

POLICY-1436 : completed OOM testing with PDP-X patch - all working - waiting for OOM team to merge.

POLICY-1608: Registration Start for PDP-D in progress, one review out for TopicClientSink.

POLICY-1608: continue

POLICY-1459: integrate new cl image into OOM

POLICY-1273 - Continue consolidating application code. May build an abstract class to share code instead of interface.

M4 checklist

POLICY-1604: openjdk8 not installing some libraries.

Test OOM Mike's patch, changes on top for review.

Complete testing w OOM

Registration w PAP (from PDP-D)

continue working on 1642.

algorithm to allocate policies to PDPs.

1560: cl images, code review out

design discussions

more tests db, etc .. with new image + oom (w. mike's)

pdpd registration

support legacy policies + serialization

got feedback from Pam/Liam

continue working on legacy serialization

disgest Liam's code

1542: classes for simple rest apis - ready to merge

stubbed api - deploy/undeploy ready to go

how to do locking discussion

continue 1542

Testing + Design discussions + Reviews

Put review out for PDPD-CL and replace in docker project for CSITs.

Try modified OOM helm charts from Mike in Labs.

Follow up additional design discussions.

new json ouputs for Liam's work

finialize design discussions and csit planning

AAF meet

Design/Review discussions

Set up OOM lab with latest (healtchecks passed, dmaap problem persists). Tested Mike's under review patch for pdp-x, issues in the chart, will follow up today.

Follow up with PDP-X OOM chart

Testing new PDPD-CL image, put review out.

AAI custom queries for control loop analysis - Need to add PUT method

Got AAI ouput test data to test custom queries on our side

Solved CSIT test issues + helm chart

Swagger API PDF Generated

1440: Decision API

PDP-X helm charts

1440: Decision API

Architecture Review

M3 checklist

CSIT tests

POLICY-1273 - will consolidate more code. But I have a lot of meetings today.

Catching up Design work + reviews + admin work

bring up lab w latest images, verify.

work on PDP-CL image.

continue design discussions.

test helm charts from Mike

AAF

1436: helm charts

reviews.

follow up on helm charts.

Swagger Decision API PDF for Pam.

1195: tosca model unit tests - accessing DB (pojos, and write to h2 db).

Serialization/Deserialization of json.

POLICY-1273 - Re-organize the code for re-use and add exceptions.

Goal is to get the monitoring application to load a new policy and make a decision on it.

Should applications be a singleton??

Release Xacml PDP 2.0.0 today

Test components to verify certificate expiration date (onap request). Some components, apex-pdp, api, distribution didn't come after https request, not sure if they may be configured with http instead.

Investigate CSIT failures, two problems: (a) stuck waiting for port 9091 and gets killed, (b) casablanca csit job points to master.

Problems from Alpine move:

PDP-D Applications code does not get loaded, amsterdam, and other features. There are differences in sort, grep, timeout, .. between Ubuntu and Alpine. POLICY-1577: should correct at least a first layer of these errors.

PAP does not come up, stuck waiting for mariadb (which is up), need to use nc as telnet used before behaved a little different in terms of output.

1560: tweaks for ci to trigger build creation against latest pdp-d.

1551: Alpine test run in OOM - healthchecks. Needed to do changes in docker and OOM for PDP and PE for JAVA_HOME.

CSIT tests.

1560: cont. dev.

1436: cont. review comments + REST API headers

Tosca models/dao continue.

Same provider interface.

1560: 2 reviews docker image, beefing up docker cl

start looking at it with custom query empty responses.

performance and stability tests.

need to wait a couple days to write csit tests in components (as components make progress on apis)

1436: addressing review comments.

work on helm charts.

1443: common client code under review

1541: started

1541: dev cont.

reviews

1560: getting rid of calling docker-install file at container initialization

POLICY 1441, 1442: Code review on Liam's reviews

POLICY-1270 will be closed

A&AI released schema service

No VNF's in database

Will try to use A&AI schema Java dependency and create the custom classes.

Test with NO VNf's in database

POLICY-1995 - testing with JSON in/out

POLICY-1541 - need api's done by M3

Will go back to POLICY-1443

1270: policy-api oom helm - merged.

1558: pdpd oom config helm - merged.

POLICY-1273 - The Policy Design

ONAP Architecture Review for tomorrow

Install oom mini lab in windriver. All existing images come up OK. Issues with DMaaP.

Tested PDPD-CL image, some issues inheriting form PDP-D latest image.

Continue working on OOM and PDPD-CL image.

I'll pull Chenfei's change in OOM to debug.

Look at AAI schema and writing java classes but just looking at schema.

Consult with Liam, may be able to provide feedback for xsd to pojo conversion.

1195: tosca model working with DAO.

work with tosca models from Pam

Main Focus:

Will try to finish POLICY-1456 (Documentation) and start

POLICY-1273 - The Policy Design

Copious spare time: POLICY-1507, POLICY-1539

Place under review:

POLICY-1543: PDP-X image build problem

POLICY-1524: pretty much complete with base refactoring efforts in PDP-D

POLICY-1543: PDP-D APPS use env variables set up by PDP-D for environment access.

POLICY-1459: testing with the new PDP-D-CL image and removal of some OOM scripts

POLICY-1270: Helm Charts for API

Work w Jorge - helm charts testing

Reviews, and catching up with code

OOO

Learn about robot framework and technology behind csit

Work w Chenfei on it

POLICY-1195 The DAO code is submitted and the Models repo is structured into modules to separate the base/DAO/TOSCA models.

Checkstyle error introduced:

https://wiki.onap.org/display/DW/Policy+Developer+Environment%3A+Setting+up+Eclipse https://wiki.onap.org/display/DW/Setting+Up+Your+Development+Environment#SettingUpYourDevelopmentEnvironment-IDE:Eclipse:SettingupEclipse

Fleshing out the TOSCA objects and annotating them with JPA annotations to do the schema. WIll work on it over weekend.

Plan is to move to gson based annotations that Jim put together

POLICY-1443: review for common PDP.

Add lombak info in

https://wiki.onap.org/display/DW/Policy+Developer+Environment%3A+Setting+up+Eclipse https://wiki.onap.org/display/DW/Setting+Up+Your+Development+Environment#SettingUpYourDevelopmentEnvironment-IDE:Eclipse:SettingupEclipse

Lots of meetings today:

Work on small issues:

POLICY-1507

POLICY-1547

POLICY-1556

1548: topic configuration

1524: env. PDP-D waiting for review

1270, help addressed comments

Understand Liam's code - models

1266: worked with Marco

building knowledge in existing code

1461: cont.

understand csit tests

work on csit

1436: creating images

blocked on https issues

need help on pdp-x image

Tackle security issues, lombak

M3 template

Need to present Thurs in architecture subcommittee - Work with Liam, Jorge.

Work with Bilal, implement CSIT tests, since 50% need to be implemented.

POLICY-1524: lab testing (installation restructuring including JVM settings, including memory)

Closed on Registration

POLICY-1524: cont. testing

POLICY-1454: PDP-D Register/Unregister

Work on Custom AAI integration in PDPD apps and potentially in models.

All 4 queries replaced by 1 , custom AAI.

POLICY-1436: cont.

CSIT

POLICY-1264: Working on Models. DAO Model working

Blocked review still open

Reviews

PAP-PDP interfaces

Many meetings today to further refine requirements for Scale Out and Model Driven Control Loops.

API Page - Adjust the metadata per requirements

POLICY-1538 - cherry pick to Casablanca Maintenance (YES we are being asked to do this)

Testing: Verify Policy instantiation and policy deployment with latest load. Amsterdam controller comes up with new policies.

POLICY-1524: dev. work.

Registration discussions

Close on basic registration.

POLICY-1524: hopefully can close on PDP-D.

Initiate discussion on how to retrieve policies (post registration)

Registration work.

POLICY-1444: deploy/undeploy dev. work

Close on Registration work.

POLICY-1444: deploy/undeploy dev. work

POLICY-1516: under review.

POLICY-1436: waiting for 1516 merged.

CSIT running in local VM issues.

Registration flows.

POLICY-1516, POLICY-1436: cont.

CSIT tests.

Registration.

POLICY-1264. Modelling.

Bringing JPA to model project, ported from APEX.

DB schema not needed.

Continue POLICY-1264 for modelling.

Continue architecture discussions.

POLICY-1483: helm chart for PAP.

Looking at API review from Chenfei.

DB schema, piggyback on Liam's work.

Start looking into PAP/PDP exchanges.

DB schema, piggyback on Liam's work.

Architecture review

Registration Proposal

POLICY-1524: PDP-D core: use dyamic environment vars when possible instead of installation ones.

POLICY-1529: PDP-D: APPS: use dyamic environment vars when possible instead of installation ones.

Work with team APIs

POLICY-1459: continue development

Will set additional time after scrum for team to discuss design and API resolution issues.

Let's start with the simplest sunny day scenarios and evolve from there.

POLICY-1266: Code review.

AAI updated schema and will update custom query code early this week.

POLICY-1436: https/aaf subtask

POLICY-1516: decision api -

POLICY-1436, 1516: dev, trying to submit

PDP-X: CSIT failing looking into it.

Looking at modeling, found tosca library for java, need to look if can incorporate it.

Tosca library in ONAP uses javascript. ONAP found artifacts don't seem to fit the bill.

POLICY-1480: review - jjb for csit

POLICY-1483: helm chart - reviewers pap

POLICY-1537: ci changes, POLICY-1534, POLICY-1517: merged

POLICY-1459: continue development

PDP Registration

POLICY-1516: plugin experiments

POLICY-1473: architecture

POLICY-1540: sec jars, zookeeper, apex

POLICY-1480: swagger + csit ready

POLCIY-1537: ci changes

CSIT changes

POLICY-1534, POLICY-1517: waiting

POLICY-1515: entry points and POJOS under models for policy-types - development

CSIT wiki

POLICY-1458: pushed changes for review

POLICY-1460: almost done, waiting for other review to be pushed.

POLICY-1444: PAP deploy/undeploy

code reviews

POLICY-1516: Decision API - commit review. Workon swagger annotations. Started to work on plugin functionality.

POLICY-1436: CSIT

POLICY-1480: swagger to PAP API under review

CSIT - POLICY-1480

Jenkins Jobs

Helm charts

Security cont.

Look at sonar coverage for M2

Go through Architecture, API pages

CSIT doc. changes

POLICY-1534: decouple actual topics from template topics - under review

POLICY-1517: moving installation configuration to environment variables - second review

CSIT + Architecture wiki reviews

POLICY-1517 additional changes

POLICY-1266: communication with AAI - they will provide library jars

Looking at existing code

POLICY-1516: decision policy stubbed out, issues w swagger against reference API component. Legacy PDP-X uses spring framework to render swagger html UI.

POLICY-1473: Architecture + finished API page;

CLM issue - apache zookeeper library in APEX

POLICY-1473: Architecture page cont.

CLM zookeeper resolution.

Out of Office