2019-05-16 AAI Developers Meeting
Attachments (including meeting recording)
Status | Open | In Progress | On Hold | Done | Cancelled |
|---|
Agenda Items
START RECORDING
Title | Responsible | Status | Last discussed | Notes | |
|---|---|---|---|---|---|
| 1 | Unreleased docker images in helm chart | Team | Open | 2019-05-16 | Merge change if artifacts are released in timely fashion, need to add release notes (or documentation somewhere) on the various options in the helm charts, things like replica count for cassandra local/shared, enabling/disabling sidecar, aaf, etc. |
| 2 | Optimise ad-hoc retrieval of any resource with any of its cousin relationships | @Keong Lim | Open | Raised as JIRA case https://lf-onap.atlassian.net/browse/AAI-2437 but holding back the gerrit review until after the Dublin branch is cut so it doesn't count against release criteria. Would like to gather opinions on the implementation (see the comments in the JIRA case). The query has been tested in my dev environment but unsure if the query is done the best way. @soumyais invited to a future session to discuss further | |
| 3 | Dublin Branching | @James Forsyth | In Progress | 2019-05-09 | El Alto runs Jun - Sep - technical debt and S3P/deployability release Frankfurt starts in Sep As of now, master will accept feature development for Frankfurt We tag dublin at release time (early June) The Dublin branch becomes El Alto (similar to a Dublin Maintenance Release) El Alto changes will be cherry picked back to master |
| 4 | Review El Alto proposals | AAI Epics in JIRA: | |||
| 5 | Cached vs realtime connection | @Keong Lim | Done | 9th May 2019 | Have been testing with Traversal custom queries and Resources bulkadd API. It appears that the caching causes a delay of approx. 1 to 10 seconds between creating new objects in Resources API and observing them in Traversal API (seems to have 2 or 3 modes which are fairly consistent). What is the reasoning for using cached rather than realtime connection mode for some clients but not others? Cache being out-of-date would seem to be a cause of problems. There is some discrepancy in the default configs for AAI microservices:
Apparently the HTTP header "Real-Time: true" can be used to force a realtime connection. Would this refresh the Traversal cache so that all clients can immediately observe new objects? (Further testing shows the cache is not refreshed; should this be raised in a JIRA bug?) Is there some way to know how far behind a cached connection is from realtime? e.g. by observing the latest resource-version value? Would want to avoid polling the microservice. Assuming that the "Real-Time" header has not been specified, is there any part of the response that indicates whether a "Real-Time" connection was used by default or not? |
| 6 | debugging Traversal custom query problem | @Keong Lim | Done | 10th May 2019 | Calling Traversal custom query with curl: curl --verbose --silent --insecure --user AAI:AAI --header 'Accept: application/json' --header 'X-TransactionId: testaai' --header 'Content-Type: application/json' --header 'X-FromAppId: AAI' --header 'Real-Time: true' --upload-file data-customquery-count-vnf.json https://<IPADDR>:30233/aai/v14/queryRequest body for PUT is: {
"start": [
"network/generic-vnfs/generic-vnf/test-bulkadd-gvnf-4"
],
"query": "query/count-vnf-byVnfType"
}Response returns error: {
"requestError": {
"serviceException": {
"messageId": "SVC3002",
"text": "Error writing output performing %1 on %2 (msg=%3) (ec=%4)",
"variables": [
"GET",
"v14/query",
"Internal Error:java.lang.ClassCastException: java.util.HashMap$Node cannot be cast to org.apache.tinkerpop.gremlin.structure.Vertex",
"ERR.5.4.4000"
]
}
}
}Stored-query definition appears to be: "count-vnf-byVnfType":{
"stored-query":"builder.getVerticesByProperty('aai-node-type', 'generic-vnf').groupCount().by('vnf-type').store('x').unfold()"
}How do I debug/fix this query? 9th May: @Venkata Harish Kajur could you take a quick look at this and email me? @Keong Lim This custom query seems to only support one format which is the console. The reason is the output of this query just return a list of counts grouped by vnf type. It doesn't make sense to be able to support any other format. The default format I believe is the graphson so thats why its failing. Add the query parameter format=console and it should fix this issue. We should probably update the documentation to say that this custom query will only be working with format=console 10th May: added to https://lf-onap.atlassian.net/browse/AAI-2408. Also raised https://lf-onap.atlassian.net/browse/AAI-2417 |
| 7 | GraphGraph demo | @Former user (Deleted) | In Progress | 2nd May 2019 | A 5-10 minute demo of GraphGraph https://lf-onap.atlassian.net/browse/AAI-531. Feedback needed! |
| 8 | AAI Modeling Multi-part key for schema elements | @Keong Lim | In Progress | 25th Apr 2019 | From https://lists.onap.org/g/onap-discuss/topic/31317665 Discussion: The cloud-region schema element is unusual in that it has a two-part key i.e. "cloud-owner" and "cloud-region-id". There are not many other usages of it ("ctag-pool" , "service-capability" and "route-target" are three others, out of over 100 other schema elements) Is it possible to enhance the error message to indicate that part of the key value is missing from the relationship-data? https://lf-onap.atlassian.net/browse/AAI-2391 Is it time to deprecate the relationship-data and switch over to using the related-link only? Is there any modeling guidance that would steer new designs away from using multi-part key for schema elements? Are there other caveats to using the multi-part key design for schema elements? Can we get feedback from @Chandra Cinthalaon the key design for multi-part keys and whether this will be more common going forward? See also email from @Marco Platania in https://lists.onap.org/g/onap-discuss/topic/31385256 |
| 9 | Return codes and messages for WS | @Former user (Deleted) | In Progress | 25th Apr 2019 | Is there a guide for the description of the error message and the error codes? How are new error states (message + code) added? @William LaMont will send @James Forsyth the output of a script that formats the error.properties file to make a wiki page and readthedocs @James Forsyth should commit that script and create a wiki for the error properties |
| 10 | AAI test data bootstrap | @Keong Lim | In Progress | 25th Apr 2019 | 3rd May: See also AAI Simulator in Policy: https://gerrit.onap.org/r/gitweb?p=policy/models.git;a=blob;f=models-interactions/model-simulators/src/main/java/org/onap/policy/simulators/AaiSimulatorJaxRs.java;hb=HEAD . Was recently updated for custom query https://gerrit.onap.org/r/#/q/pramod+custom and contains hard-coded AAI data/schema. Maybe discuss with @Pamela Dragosh about how this data is maintained? 25th Apr: Wiki page OOF - HPA guide for integration testing updated for https://gerrit.onap.org/r/#/c/86588/ Similarly, @Scott Seabolt and @J / @Joss Armstrong wrote for APPC Sample A&AI Data Setup for vLB/vDNS for APPC Consumption and Script to load vLB into AAI:
Similarly: Related https://lf-onap.atlassian.net/browse/AAI-1948 on the brittleness of the ReadTheDocs links to data files. One for VIM: How-To: Register a VIM/Cloud Instance to ONAP and https://lf-onap.atlassian.net/browse/AAI-1928 Potential issues:
Possible solution/action: Look at the examples API and possibly enhance it to get the desired behavior Collect all the known data samples, commit to test-config repo, update the teams/wiki to point to test-config repo instead of keeping private stash of AAI data https://lf-onap.atlassian.net/browse/AAI-2399 |
| 11 | Purpose of fields in AAI | @Keong Lim | In Progress | 18th April 2019 | @Dénes Németh wrote in https://lf-onap.atlassian.net/browse/AAI-1104:
Questions: 1. Is AAI intended to strictly prescribe how the fields are used and what contents are in the values? Even if (1) is true, AAI is not really in any position to enforce how clients use the data, so really (2) is always true and we need to consult the original producers of the data and the ultimate consumers of the data to document their intended meanings. How do we push to have documentation on the purpose and meaning of the fields in AAI? Where does all this documentation go? Should the documentation be backed up by validation code? See also discussion about AAI in 2018-11-28 ExtAPI Meeting notes 29th Nov: Started on new wiki page AAI Schema Producer-Consumer Pairings 18th Apr: Can we have this documentation go into ONAP in a generic way? 24th Apr: See also questions about "sw-version" in https://lf-onap.atlassian.net/wiki/display/DW/5G+-+PNF+Plug+and+Play?focusedCommentId=16367935 |
| 12 | range query | @Keong Lim | In Progress | 7th Feb 2019 |
Invite @Arul Nambi and @CT Paterson to next week's dev call to talk about how sparky/elastic does partial/range matches |
| 13 | 2 Types of logging in A&AI WS | @Former user (Deleted) | On Hold | 1st Nov 2018 | There are 2 types of logging in the services
Is that correct? Shouldn't there be just 1 type? 1st Nov: After Casablanca release investigate logging guidelines and figure out what library to use in order to unify logging within A&AI 26th Nov: See also ONAP Application Logging Specification - Post Dublin 29th Nov: how does this fit with https://lf-onap.atlassian.net/browse/LOG-877 ? |
| 14 | Schema-service roadmap | @James Forsyth @Former user (Deleted) | On Hold | 21st Mar 2019 | 31st Jan 2019: The schema-service is ready. Currently it provides file-sharing capabilities in terms of schema/edgerule files. In order for GraphGraph to take advantage of the schema parsing/processing in schema-service additional abstractions have to be implemented on top of the crude file2string functionality currently in schema-service. @Venkata Harish Kajurwill ask @Manisha Aggarwalif the current functionality of the schema-service is the final version for Dublin and if there will be further enhancements in next releases. GraphGraph needs the following functionality: @Venkata Harish Kajur and @Manisha Aggarwal What is missing in schema service that is needed in graphgraph is the following:
20. Mar 2019: Open questions for schema-service:
21st Mar 2019: Based on @William Reehil comments https://lf-onap.atlassian.net/wiki/display/DW/AAI+Schema+Service?focusedCommentId=16325457 what is "our future proposed functionality"? |
| 15 | New AAF Certificates at startup | On Hold | 24th Jan 2019 | AAF will generate certificates to the be used by the containers at startup; AAI services should use the run-time generated certs instead of the ones that are in the repos or oom charts. In dublin the services will mount a volume with certificates. This is on the roadmap for Dublin as a feature.
@James Forsythwill ask Jonathan Gatham when the certificate init image is going to be available in ONAP and wether it is documented Jan 31, 2019 | |
| 16 | Change PNF to use pnf-id as unique key | @Benjamin Cheung @Chesla Wechsler @David Perez Caparros @Former user (Deleted) @Matthieu Geerebaert | On Hold | 7th March 2019 | Potentially breaking change: https://lf-onap.atlassian.net/browse/AAI-2096 / blocked by https://lf-onap.atlassian.net/browse/ONAPARC-409 See also:
Questions:
@William LaMont will check for existing migration utility that handles this use case (changing the key from one existing attribute to another). Changes to pnf object in all oxm versions would be needed, and a migration similar to what was done in UrlMigration but limited to pnf node-type to update the aai-uri, and a schema mode to add an index on pnf-id. @James Forsyth will socialize the breaking change on the PNF in the next PTL call so clients can prepare to do a search for ?pnf-name=${pnf-name} instead of /pnfs/pnf/${pnf-name}. They also need to handle doing the PUT operation differently - Added to PTL agenda PTL 2019-02-19 |
| 17 | A&AI monitoring and failure prevention initiative | @Keong Lim | On Hold | 24th Jan 2019 | @Mike Elliott wrote in OOM Meeting Notes - 2018-12-5
Keep an eye out for new issues! This should be part of a larger A&AI monitoring and failure prevention initiative! |
| 18 | AAI HAProxy and 2-way-TLS | @Former user (Deleted) | On Hold | 29th Nov | Technical solution to either decommission the proxy or make design changes to AAF to enable client side certificates. After VF2F we will know if this is a requirement in Dublin. We discuss after this date. question raised: MSB - would client authentication be supported? @James Forsythcreates a task for encryption of communication between A&AI services and Cassandra Jan 24, 2019 @Tian Lee and @Steve Blimkie to report on the Amdocs managed A&AI microservice wheter they support criteria from the Dublin S3P requirements Jan 31, 2019 |
| 19 | AAI too slow for OOF/HAS | @Keong Lim | On Hold | 25th Apr 2019 | Under OOF Homing and Allocation Service (HAS) section, @Dileep Ranganathan wrote about Project Specific enhancements:
See also https://lf-onap.atlassian.net/browse/OPTFRA-268 / https://lf-onap.atlassian.net/browse/OPTFRA-291 Similarly to the "AAI too slow for Holmes" item below, this introduction of extra caching of AAI data is a worrisome development and sad indictment of the performance of the system architecture. For holmes, we could possibly create a custom query to address it. What can we do about this? Would the AAI Cacher https://lf-onap.atlassian.net/browse/AAI-1337 help to improve performance? |
| 20 | MultiCloud usage of AAI for HPA telemetry/time-series data to OOF | @Keong Lim | On Hold | 18th April 2019 | @Bin Yang and @Lianhao Lu (Deactivated) wrote in https://lf-onap.atlassian.net/browse/MULTICLOUD-274:
and
and
Some concerns:
|
| 21 | AAI Backup and Restore | @Keong Lim | On Hold | 10th Jan 2019 | @FREEMAN, BRIAN D asked on Re: Backup and Restore Solution: ONAP-OOM :
What is the AAI strategy for backup and restore? What is the overall ONAP strategy for backup and restore? Should it be unified with the data migration strategy as per "Hbase to Cassandra migration" on 2018-11-14 AAI Meeting Notes? @James Forsythwill raise the topic of having backups and restore functionality in ONAP - if it is feasible, on the roadmap and what others PTL think Jimmy didn't directly raise the topic but there was movement - @Keong Lim asked "if istio service mesh is a no-go, is there a replacement for secure onap communications? is backup/restore/upgradability included in s3p?" @Michael O'Brien replied that a reference tool set for backup and restore was introduced in Casablanca: Backup and Restore Solution: ONAP-OOM @Mike Elliott said he would look at Brian's question, AAI will provide support as needed. |
| 22 |