Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

RefBlocking?StatusComponentDescription/Notes
8
OpenDR

11/21: How to handle registration / provisioning of a new dr-node instance to an existing and/or "edge" DR deployment.

Dominic Lunanuova recommended to use bus-controller api. Existing script in OOM BusController deploy.

Is there a k8s way to do this "registration / unregistration"?

12/5: Deploy DR node, thinking on how you register to the API of BusController -

12/12: Similar issues across ONAP teams - continue to discuss with OOM team

DMAAP-534 

01/28: Mail thread in relation to this - should DR move to CADI to incorporate AAF roles (good idea!)

Sunil might run through on Fri

02/01: CADI - Steps sent onto Mariusz

Role based access will remain under AAF

02/04: DR looking into integrating AAF for provisioning via BC

02/06: Fiachra in discussions with Sunil to resolve and need to contact AAF but we already have certificates

02/11: Dom to ask Roman to attend to explain ECOMP strategy for Publisher api access. These changes could be ported back to DR code base.

02/13: Internally Romans team have done it for both prov and publish API - Roman willing to forward on the solution it back to ONAP

DR Team will implement it

02/15: Prashant - need to structure -walkthrough from very high level

02/20: Dom to track down files as per requested

02/22: All files sent - team to continue implementation

Dom to see if he can get Prashant to have chat with Fiachra

02/27: Meetings proceeded - keeping open until implementation complete

03/01: Work ongoing -

03/08: testing on windriver environment - take a call offline

03/13: Mail chain - Still blocked (Sunil to assist after call)

03/15: Issue resolved, so progress being made - mail chain

03/15 Fiachra to request port for dr-node

and Sunil to request AAF team to take snapshot of permissions/roles

26
OpenDMaaP

01/22: Component creation in Jira for DMaaP project:

I do not posses "Project" admin rights in JIRA, I only posses DMaaP board rights

27
OpenAll

Swagger implementation?

01/28: Swagger is a requirement for Dublin Release (S3P requirements) ?

What are the expectations here? Whom can we discuss with? - Sofia Wallin,

01/30: Rich Bennett Mail on this - still cryptic - is it Mandatory - requirement in Platform Maturity

02/06: Dom sent mail looking for clarification - Erik has yet to respond?

02/20: Still no word

02/22: Erik to document what is required

02/27: Still nothing from Erik documented

03/01: Tom to chase Erik up

03/08: Erik to documented beginning of next (hopefully)

03/13: Attend documentation this week

03/15: read the docs vs swagger files and what are they exactly looking for

30
OpenAll

02/01: Adolfo Perez-Duran

The CIA team is preparing to submit contributions to DMAAP to migrate the base images to ONAP Normative Container Base Images.

This migration is expected to reduce the image footprint and to enable multi-cpu architecture support for Dublin

We expect the work to be minimally disruptive and to coordinate changes with tour team.

ubuntu v alpine the talk continues

02/13: Lots of chat on discuss chat - need it to settle down before we implement

02/20: Frank Sandoval [mailto:frank.sandoval@oamtechnologies.com] to provide an update !

02/20: Dom, Conor & Sunil to assist here

Mandar to raise at TSC to see if the right course of action

02/22: Change image &

 Impacts: Hold off - will these reduce the container footprint? -Dosen't look likely, it is more to be uniform across ONAP

1) suggested we change our Maven approach to use "fabric" plugin instead of spotify (support for this has discontinued) plugin

2) use docker file instead of POM is recommended from spotify (currently we don't use except CSIT environment)

02/27: lets pose question to frank

02/27: Alpine is the decision for Dublin

03/01: Questions mailed to Frank - awaiting response

see confluence spac

testing changes - and need to send gerrit review to Dom

03/08: Frank made changes in relation to Alpine images only

(unit test seems ok, built in jenkins - images not pushed to docker repo - investigation ongoing?

Dom to check CSIT tests,

Gerry to see if DR have similar issue)

03/13: Need to chase up with Frank in relation to jenkins build not pushing up images

new image name is bc - oom changes pending

03/15: Frank merged 4 commits today, Dom & Sunil to be put on review

31BlockedOpenAll

02/04: Discussion on Edge deployment commitments.

Centralized ONAP Deployment (DMAAP + DCAE)

DCAE k8s deployment - Epic

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyDCAEGEN2-1152

DFC -

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyDCAEGEN2-1156

PM Mapper -

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyDCAEGEN2-1158

DFC + Mapper instantiated at edge, central or both - dependency on DR and MR

Service provider provision topic

Work on it and review progress at M3

02/06: is there a central registry - AAI (Vijay in communication with them)

How do you retrieve edge locations? a label/name is what we need (need to be consistent with DCAE)

Secondary consideration : how do we deploy component in edge and are aware of these - managing HELM charts?

2/8: Dom started to capture approach based on ongoing meetings with OOM: DMaaP Edge Deployment

02/13: Edge Deployment group asked for page to be reviewed with their team - DOM to forward out meeting call to all

02/15: OOM meeting  - Experiment with edge, DMaaP have voluntereed to assist here 

lets wait for answer to whether or not to split out components might be solution going forward

02/20: Mike to discuss further - OOM

02/22: Mike still investigating this topic further

Fiachra to look into why DR is structured the way it is? -see 02/27

OOM losing personnel - CNI in particular to get HA K8s up and running - keep an eye on

02/27: might have a solution for this part - mariadb sub requirement under dr-prov, issue in relation to helm with regard this

OOM meeting - 3-4 to discuss further

03/01: Mike to attend on Monday

03/04: Mike is holidays week 11-12, need to ensure Conor commit gets merged

Dom & Sunil have changes to follow suit after Conor's merge

03/06: James Mckinder (OOM team) having issues - potentially - not cleaned correctly - to be discussed at OOM meeting

03/08: Code has been merged to facilitate component deployment in diff sites

release name has release and component name in them - this is causing an issue for configMap at DMAAP level 

helm install vs helm deploy work differently - potential a bug in helm deploy

  • can disable components to only deploy individual components (aids testing greatly)
  • component changes: helm variables expand are getting long, e.g. filebeat configmap for datarouter at dmapp resource level - component expands out to include component name - potentially move filebeat down into relevant level (keep all dmaap components independent - )

03/15: Dom has done some great work on post install script - plan is to get the components and discuss plan going forward


32
OpenAll

No more running as root on containers

Proposed Updates to Release Templates (Dublin) - Security Questions

Is it required for M2 ?

02/11 Doesn't need to be implemented by M2, nice to have for M4. (Try to plan for M4).

Here's the link to the Jira where applications are being asked to update their impact and concerns regarding this item.

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keySECCOM-111

02/13: Dublin timeframe - Not mandatory, if possible complete, if not have a backlog item for El Alto

Mandar to update ticket

02/15: ticket updated to work on this in El Alto - Mandar to ask reporter how do we interpret this ticket?

  created ticket in backlog

02/27: Is this related to Alpine solution - not clear

New requirement : Wanted position to be part of Dublin

03/04: Action to start investigating - how will this be verified - Mandar

03/08: krzysztof to write script to enable verifcation -mandar to chase up

03/13: Mail forward onto team

35
OpenLogging

02/15: Mail sent from Emmett - any feedback in relation to this?

Is it Mandatory or not?

Manageability as part of platform maturity requirements

Target level is 2 for Dublin - mandatory

02/27: Create EPIC -

03/11: Epic created in Jira :

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyDMAAP-1077

03/15: appears to be a stetch goal for existing components

36BlockingOpenDR

DR AAF Certificates expired - DR broken in Casablanca now.

Possibly generate new certs.

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyDMAAP-1048

02/22: Johnaton to supply fresh ones

02/27: Certs updated and merged for Dublin & Casablanca

Need to get new artifacts released per release - mail sent to Ram/Mandar

03/01: Artifacts released - Code up and awaiting merge and release documents updates needed

03/04: Master - code needs to be merged in OOM

Casablanca - Process (Post maintenance release process to be determined) to get change into this release - 3.0.1 tag is already created - due to be discussed at PTL meeting  

----------

Dmaap 1066 follow up to see if related - replica DB failed to come up (Closed)

Dmaap 1076

03/15: An overall ticket - to bundle all changes in together - Mandar to source ticket (power point in relation to release?)

update from Mandar: https://jira.onap.org/secure/attachment/13434/Prosal%20for%20a%20TSC%20Policy%20on%20ONAP%20Release%20Maintenance-pa5.pptx

37
OpenAll03/15: 55% code coverage target is for M4
40
OpenAll

03/15: All to review and report back

ARC DMaaP Component Description - Dublin

41
OpenAll3/18: New ask from security team. HTTP ports should not be exposed for any of the components. Only HTTPS ports should be exposed. Action for all to remove exposure of component's HTTP port by M4-Dublin


Closed Items:

RefBlocking?StatusComponentDescription/Notes
1
ClosedAll

Scaled & Distributed Datarouter Solution.

10/24: Fiachra sent additional questions to OOM team on auto-scaling solution. also, OOM-8 tracking auto-scaling.

11/7: Additional considerations: spool directory persistence, stateful sets, and SSL certificates.

11/26: OOM JIRA for Geo-Rep

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyOOM-346

11/26: Dom to coordinate with DCAE on Edge deployment

11/28: DCAE intend to deploy at edge for Dublin but still unclear as to how.

12/03: OOM call - follow up call with Mike Elliot next Wed, Single K8 that expands multiple sites

If not deployed in edge will it be in central solely

Requirements per components (DCAE included) - need to compile list

01/07: Single k8s solve multi site - geo-diversity k8s deployment

diff solutions for prov and node

Similar problem for MR

OOM Geo-Red Active-Active via Affinity/AntiAffinity to be reviewed

01/28: Sunil to run through Demo - Friday Slot

2
ClosedDR

What is the purpose of the "groups" attribute in a subscriber?

10/22: Matt/Kim to investigate

10/24: mechanism to associate many subs to a single group. Matt to send description.

11/21: Fiachra observes that this looks more like some additional authorization method. Good to get confirmation from Matt/Kim on this.

11/28: Roman - confirms auth for sub/feed modification.

3
ClosedAll

Use of HTTPS in dev/test environments. See Fiacha's email.

"Quick question on how we are testing the DR flows.

This only applies to local deploy & test. Robot CSIT would require investigation on how to implement TLS.

 

At present we default to "--insecure" curl option using the "-k" flag.

Is this valid or should we be using some sort of TLS auth?

 

We can export the IntermediateCA from the cert chain and pass it via the "--cacert" flag for curl.

Should this be the default way of testing DR if all end users will be required to use TLS?

 

//Fiachra"

10/31: Dom: http is convenient for dev/test, but at least CSIT should confirm that TLS is enabled on all API endpoints.

11/21: Plan to implement TLS in csit. Investigate how DR clients are using CA certs at present.

12/10: DR working on this to date - will follow up with issue, publish upon resolution

01/23 : Code up for review to test in next few days

02/13: Code up for review - remove CSIT test from Casablanca

4
ClosedAll

11/12: As we consider scaling, are we defining any true load testing scenarios? And what are the tools we are using?

11/26: Sunil - JMeter used as test tool.

11/28: Work ongoing for k8s scaling in Dublin.

5
ClosedPTL

11/21: Look out for email about participating in Dublin Release for M0 milestone. Bhanu to inquire w PTL team since she might be on vacation.

12/5: Bhanu to follow up and send mail to register interest in participation

12/10: Projects already involved - assumed that they want to continue

6
ClosedPTL

11/21: Follow up on committer promotion requests: Sunil, Dom, Connor

Committer Promotion Request - Dominic Lunanuova

Committer Promotion Request - Conor Ward

Sunil Unnava Committer Promotion Request for [DMaaP]

Committer Promotion Request - Migdal Marcin

12/5: Need to make existing committers inactive

12/10: Follow up with Ram

12/12: Ram working on solution

01/07: Bhanu to follow up

01/14: Voting process - Ram to remove some old committers but still will be available

01/16: Working through some open items - Approval for some

01/21: No change in gerritt status - can we follow up on this

01/23: This might be sorted for Conor/Dom/Sunil - others have request in

01/28: Mandar to follow up with Ram

02/13: Election is complete, Mandar to follow up with TSC

7
ClosedDR

11/21: Toby: PM Mapper desires a subscriber delivery function similar to kafka consumer groups. i.e. multiple subs to same feed - only 1 gets delivery. How to implement this? (Is group attribute useful?)

11/28:

9
ClosedDR

DR TLS

10/20: Fiachra initiated an email thread about how Datarouter components might scale, which interfaces require TLS, and how certificates need to be managed.

10/22: Dom suggested we include kubernetes design considerations, and try to identify specific use cases to drive requirements on AAF (assumed CA capability)

10/22: Dom to document AT&T ECOMP conventions for certificates

ECOMP conventions:(assumes VM per component) for SSL certificates:

    • CN = hostname.deploymentDomain
    • SAN = serviceName.deploymentDomain (used for MR and DR Prov servers - clients reference the serviceName, which needs to be provisioned in DNS)
      ....doesn't really help us think through the problem for DR Node.

11/21: TLS solution between DR components and any clients of the API (DCAE Data File Collector, DCAE PM Mapper).

Jonathan Gathman mentions AAF Certificate Manager which is available for auto config in Casablanca. Several strategies available:- Common SAN in x509s, NFS cert store, etc.

Ramprasad Koya / Bhanu Ramesh Recommendation is to involve PTLs in Dublin planning for component security requirements.

12/10: SecCom discussing this

01/09: Tony Hansen - AAF supplier of SSL certs & AAF & Istio how the relationship between them - wait till M2

01/21: greater uncertainty in relation to istio in Dublin release? (Mike Elliot)

01/23: DCAE : At F2F in Paris - istio implemented as a sidecar - OOM don't know how to deploy using k8s

Status quo impact on DMAAP -  if istio is implemented aaf will need to alter

Mandar can u check with TSC committee? Is ISTIO a proposal or mandatory for Dublin? and if so is there any expected impacts

02/01: Not mandatory - POC in progress Istio

02/06: No Dublin Impact

10
ClosedAll

DR statefulness

11/21: Reviewing requirements for statefulness of multiple components. For DR, files in transit need to persist.

11/26: Preliminary plan is to use StatefulSet in K8s.

11/28 StatefulSet with Headless service for DR in Dublin

11
ClosedAll

11/26: Confirm OOM K8s deployment strategy. Single cluster?

11/28: Single K8s cluster deployment confirmed.

12
ClosedAll

11/28: Check with ONAP sprint timings and should we sync with that?

12/10: Tom to chase up

13
ClosedDR

12/03: PM Mapper acknowledgment - mail from DOM (a hack - can we recommend alternative)

DR not originally designed for this functionality

12/10: New API ("Privileged") - Private
Document proposal !! Mark to send around pictorial

Whose impacted by this !

12/12: Alternative soln proposed - need to investigate and get apps on board

01/09: assumption dcae ms shall have not persistence - false assumption DCAE team

01/14: individual DCAE components have some persistence, but state/persistence across components  it will not have

Option B is the agreed plan going forward

14
ClosedAll

12/5: Fixing code smells in advance of critical and blocking bugs - can we merge the code?

use caution!!!!! time consuming and not very productive

Bhanu to raise at PTL call to add meaningful code only

Anyone wishing to contribute must be willing to participate in call

Bhanu unavailable after 18th -

01/14: Sonar warning fixes -discussion on ONAP discuss - to be eradicated (need to be part of use case to be involved)

01/16:

Jira Legacy
serverSystem Jira
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyDMAAP-929
as a recent example

15
ClosedAll

12/10: New bridge needed asap for DMaaP to open up discussions to all community

01/07: Follow up with Catherin lefevre

01/14: Kenny Paul Zoom Bridge working on it

01/16: 1 slot - available (Bhanu to update time slot)

01/21: Mon/Wed/Fri - see above logisitcs for times or Community Meetings & Calendar

16
ClosedDR

12/10: Marcin to update Node Servlet to improve logging

12/17: Marcin sent on mail and is to create Jira ticket to track changes - 

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyDMAAP-923

17
ClosedDR

Compressed/decompressed - not a new service ? Whose impacted by this

extend provisioning API (optional parameter) -  only support gzip decompression

12/12: more value outboard the service going forward

17/12: data quality checks - trying to avoid

solution to think long term

01/14: For now, Implement as part of DR functionality whilst aligning with AT&T and to ensure it is extensible & ease of extraction

18
ClosedAll

12/10: Helm Charts OOM location folder?

Central charts  - OOM to decide upon?

Mark Scott to investigate if answer can be given by OOM

01/07: one set of charts with variable(what is this variable) for central vs edge

01/09: What OOM Jira ticket is related to this - post clear comment OOM

01/14: While the timing of 

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyOOM-1249
is relevant to the answer for Issue 18, 

I think 

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyOOM-1572
gets more to the heart of the questions we have.

DOM created sub-task  

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyOOM-1579
- any clarification/points we need addressed - we should state here

19
ClosedDR

Issue in onap-discuss with Casablanca - DR not instantiating correctly.

Workaround posted into onap-discuss.

Investigating cause of issue

01/07: SO having similar issues with MariaDB

 - not much follow up on discuss board

01/16 : in contact with OOM team in relation to this

01/21:

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyDMAAP-964
handling this

01/28: Integration team going to create a new ticket? - 

https://jira.onap.org/browse/DMAAP-1010 ??

02/06: Hoping OOM can assist - issue seems to happen on an AWS platform

Integration team tested against WindRiver

Sunil has seen in his local environment - He will share the link

Going forward we are going to try the timeout solution.

02/11 common mariadb-galera chart now used in oom, testing that.

02/13: Passing in OOM environment last couple of days

Will continue to monitor it to see if it can be reproduced.

02/15: Tom to mail Mike in relation to https://jenkins.onap.org/view/External%20Labs/job/lab-windriver-oom-daily/ failures

02/20: Licence Expired - Johnaton to supply new set- 1048

20
ClosedMR

Authentication -Tomasz to create new Jira and to cater for basic auth

AAF team to dynamically generate certificates - generic issues Tomasz to cross check with AAF team

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyDMAAP-865
Tomasz updated based on Sunil review
01/14:  Work to be delayed for few weeks

21
ClosedAll

Milestone 1: 17/jan

Jira Epics and user stories need to be created by this date

01/07: Bhanu to chat with PTLs to see about platform maturity

01/16: M1 Postponed by a week I think (see https://lists.onap.org/g/onap-release/topic/29128816 for further details) - new date  

To be reviewed and updated by Monday

22
Closed5G Use Case

Heat vs Helm? can we remove the heat discussion altogether

Tom to get back

02/13: Catherine confirmed OOM is only way forward in Dublin

23
ClosedAll

Remove any tagged stories/tasks in casablanca/beijing release - if important enough we can tag with Dublin

status != Closed AND status != Done AND project != "Sandbox Project" AND project != CI-Management AND project != "ONAP TSC" AND project = DMAAP and fixVersion != "Dublin Release"  ORDER BY priority DESC, updated DESC

Sunil & Bhanu to take off line for now - in relation to MR

24
ClosedAll

Windriver environment - need to inform to Stephen Gooch if we require access to these environments prior to end of week

01/28: Mandar sent mail

25
ClosedDR

01/22: No permission to view security vulnerabilities in relation to

https://jenkins.onap.org/view/CLM/job/dmaap-datarouter-maven-clm-master/

Solution in Casablanca was to get Dom/Sunil to go walk us through each vulnerability detected by CLM scan

01/23: Conor now has permission to access these scans - so no longer an issue

28
ClosedBC

Should we create a ticket - for BC to sync with MR/DR (an enhancement)

02/05: Jira created

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyDMAAP-1021

29
ClosedAll

do we need to support the previous releases - Mandar to follow up

01/30: Catherine to bring up with TSC - Upgrade tickets to Casablanca (NO is the answer for now)

33
ClosedAll

02/13: Docker Hub - Paul to send on mail

02/15: PTL to create own id, Mandar has created

ONAP - discuss mail from Jessica

Need to change Docker tags - all

02/22: Gerry in talks with Sunil - might need to alter approach if fabric plugin is way forward

02/22 Gerry to stick with spofity plugin

02/27: Parent pom mightn't be possible with multi component modules - still investigating

03/01: Work ongoing

03/04: Commit up for review

03/06: verification ongoing

03/08: closing as been tracked by aplin vs ubuntu discussion with CIA team

34
ClosedDR

02/13: Dynamic handling of feed creation/subscribing to feed

BC API has a 2 step reg processes

query on feed name

determine feed ID

add subscriber to feed ID

an enhancement: support optional feed name in the addition to subscription API

02/15: Dom to create Jira Ticket for enhancement

Jira Legacy
serverSystem Jira
serverId4733707d-2057-3a0f-ae5e-4fd8aff50176
keyDMAAP-1045

02/20: this ticket, no impact on DR

38
Closed

03/04: Need to try and arrange a meeting with Mike Elliot and Sunil to represent from a MR point, Mandar to see if Friday is suitable -  see what happens at today's meeting

03/13: Meeting happened - operational reqs - doesn't make much sense

they will introduce Jira tickets - we will review and if we agree then we will proceed *El Alto timeframe

39
ClosedAll03/06: M3 template and discussion next Monday


Other Notes:

  • Thanks to the education from Team Fortress, Dom recognized the great Irish sport of hurling on an American cartoon, but still confused the name with that thing they do in Canada!