...
- Lab status
- Istanbul daily & weekly
- SDC onboarding stabiliy test regression
- DCAE tests cloudify → helm status Krzysztof Kuzmicki
- Jakarta
- review of the tests to be included in CI (in/out/refactoring) in daily and weekly Morgan Richomme : jakarta_ci_evolution.pdf
- Lab status
- We have a stable 2 labs with tests:
- Nokia lab has issues with message-router - for some reason it doesn't start properly Krzysztof Kuzmicki
- Krzysztof Kuzmicki DCAE update
- DCAE is ready to remove cloudify support – tests need to be updated. Krzysztof Kuzmicki is working on that
- New Python tests:
- multi_vnf - failed due to bug in code, needs to be retested again before include in Daily CI Michał Jagiełło
- cds_resource_resolution - failed due to incorrect return value. Needs to be debugged and fixed/bug in CDS needs to be reported Michał Jagiełło
- Neng usage:
- We have a few questions about neng (network-name-gen):
- is it possible to use it during the service instantiation?
- how to use that?
- Main with questions about that needs to be sent to Seshu Kumar Mudiganti and Dan Timoney
- We have a few questions about neng (network-name-gen):
- Istanbul release RC
- Offtop:
- https://github.com/unlenen/onap-as-a-service tool to create ONAP resources by Nebi Volkan ÜNLENEN
...
- SECCOM: discussion about
- Using integration images as the best practice (global requirement in the future)
Jira Legacy server System Jira serverId 4733707d-2057-3a0f-ae5e-4fd8aff50176 key INT-2000 - list of the requirements for the images - posted on the seccom repository https://github.com/onap/integration-seccom/blob/master/recommended_versions.yaml
- add the test to check the base image for the projects
- can be done both on Jenkins for any Dockerfile changes (create a new one or edit already exists) and also for the daily
- support prometheus
- Prometheus shouldn't be a part of ONAP because it's a just one of tools that could be used to collect metrics and shows dashboards
- There is an idea to provide a Wiki with all the instructions how to deploy Prometheus, which dashboards should be included etc.
- Prometheus shouldn't be a part of ONAP because it's a just one of tools that could be used to collect metrics and shows dashboards
- Using integration images as the best practice (global requirement in the future)
- Lab status
- Nowadays there is no "clean" daily (mostly because the Nexus issues)
- latest weekly looks OK https://logs.onap.org/onap-integration/weekly/onap_weekly_pod4_master/2021-10/16_02-51/
- Morgan Richomme stability tests issues
Jira Legacy server System Jira serverId 4733707d-2057-3a0f-ae5e-4fd8aff50176 key SO-3791 - after 35h test starts failing
- Istanbul release RC
- https://wiki.onap.org/questions
...
- rouzaut Security tests
Jira Legacy server System Jira serverId 4733707d-2057-3a0f-ae5e-4fd8aff50176 key INT-1995
- Lukasz Rajewski Multicloud azure issues
- Lab status
- Failuers on both DT and Nokia labs
- Due to Vexxhost migration a lot of tests failing - there were no docker images
- Istanbul release
- Robot gating
- Plan to create a gating for robot tests - discussion with Sylvain Desbureaux needed if we could do that - gating is already heavy loaded
...
- Lab status
- several issues on both Orange and DT - now it looks stable
- Changes in ONAP release process Release Process
- Needs to be clarified with David McBride about "Complete E2E testing"
- Integrtion can be resposible only for the automated tests
- We can only rely on the assurance of those responsible for the use case that they have carried out the tests and they are working correctly if they have not automated the process and shared it with the Integration team
- Needs to be clarified with David McBride about "Complete E2E testing"
- DT tests not performed due to change in helm push plugin - https://github.com/chartmuseum/helm-push/
- there is no more `helm push` command
- OOM Makefile uses that command https://gerrit.onap.org/r/gitweb?p=oom.git;a=blob;f=kubernetes/Makefile;h=d994397269d8cdcdb7837f6d8c0c81fc7e714ba1;hb=refs/heads/master#l84
- Get rid of VID:
- VID healtcheck removed and pnf-registrate change also made - wait for DT tests results
- Python ONAP SDK instantiation requires VID objects - it has to be refactored and mark VID module as deprecated → Draft: Resolve "Mark VID as deprecated" (!275) · Merge requests · Orange-OpenSource / lfn / onap / python-onapsdk · GitLab
- Python ONAP SDK:
- new maintainer candidate Michal Chabiera !!!
- before new version release we should remove VID package I think Draft: Resolve "Mark VID as deprecated" (!275) · Merge requests · Orange-OpenSource / lfn / onap / python-onapsdk · GitLab
- new branch - Istanbul
- Repositories archived:
- Update on Pythonsdk_tests gating Morgan Richomme
- Update on helm based components in tests Krzysztof Kuzmicki
- NSA/CISA kubernetes hardening guidance https://kubernetes.io/blog/2021/10/05/nsa-cisa-kubernetes-hardening-guidance/ - there is a tool which can be used to check the cluster security
- We will have a guest next week - rouzaut will talk about the solutions we could use to automate security tests
- Kenny Paul will do a research about a tool to share the knowledge about issues on ONAP. We all agreed that the use of mailing lists is not convenient and it would be good to have a tool to report bugs in ONAP and present possible solutions
- It's needed to get the response from Seshu Kumar Mudiganti if we should change the number of replicas in SO's maria -
Jira Legacy server System Jira serverId 4733707d-2057-3a0f-ae5e-4fd8aff50176 key INT-1925
...
- Action points
- Question on ESR removal (side effects on smoke tests)
- gating OK + verif on DT daily => green light to remove this component, oom waiting for Michał Jagiełło green light on the gerrit https://gerrit.onap.org/r/c/oom/+/123812
- Question on ESR removal (side effects on smoke tests)
- Admin
- new PTL congratulations Michał Jagiełło all INFO.yaml shall be good
- archiving of integration repositories...if no activity since ...1 year? Morgan Richomme
Jira Legacy server System Jira serverId 4733707d-2057-3a0f-ae5e-4fd8aff50176 key INT-1975 - pythonsdk gating chain pythonsdk_tests_gating.pdf
- Seshu Kumar Mudiganti asked for rerun basic_vm stability tests both with 1 and 3 replicas of mariadb_galera
- demo scancode.io? Former user (Deleted)
- The curious case of basic_vm_macro Andreas Geißler
- Andreas found an issue with basic_vm_macro test - looks like parameters used during the service instantiation are not used -> fixed by https://gerrit.onap.org/r/c/testsuite/pythonsdk-tests/+/123890
- Istanbul
- review David's JIRA
- weather board???
- doc....
- any news from the use case?
- most of the projects released first version of new dockers..even so
- Data creation project (Michal Chabiera python code / Piotr Stanior DT code / ..) - official doc clearly no more accurate - moved into next week agenda
- Openstack/Kubernetes supported version, shall we precise, shall we plan tests (with which resources?)
- Operation document ?
- component update?
- backup and restore ?
- troubleshooting
- ...
- review David's JIRA
- jakarta
...
- Kenny Paul will work on the bridge extension (Done)
- Istanbul Integration Blocking points
- Michał Jagiełło - will follow up about pfn registration & pfn macro
- Labs Status - ONAP reporting
- Orange Daily (ChrisC , Xue Gao) - Master view
- DT (Andreas Geißler will check the jobs)
- Nokia (Need to follow up with damian.nowak)
- Ms Azure - https://logs.onap.org/onap-integration/daily/onap_oom_staging_azure_1/2021-04/09_12-18/
installation done on the 9th of April (94 days of uptime)
For the results of the gate it is in the gerrit, look for Azure3 or Azure 4 in the gerrit logs (as it is a pool of gating labs, you have 50% of chance today as we have 2 orange and 2 Azure gating labs up and running)
e.g. Azure 4 result for patchset https://gerrit.onap.org/r/c/oom/+/120213
https://logs.onap.org/onap-integration/gating//120213-7/index.html
- Need to check with Eric Debeau, Sylvain Desbureaux about the expectations
- Healthcheck Infrastructure Results - Xtesting ONAP Results
- Andreas Geißler will look at where the traces are for infrastructure-healthcheck/k8s-teardown
- Security Checks - Istanbul Acceptance Criteria (Eric Debeau is following up)
- Main Integration Tasks - Agile Board - ONAP JIRA - None of us can access to the Board - to be followed up with Morgan Richomme, Sylvain Desbureaux
- Michał Jagiełło - Need to follow-up with the OOM regarding services that are not initialized (no pod assignment, etc.) - helm chart maybe not up-to-date?
- Can we establish the list ?
...
- Introduction of Carriers Integration Leadership - define role/responsabilities based on Min. TSC scope + Team's wishes
#1 Ensure that the Gating is up and running and daily results are available and identify any blocker by raising JIRA ticket
...
#3 Help to include in CI Chains any new automated test developed by the ONAP Use Case/Requirement Integration Lead and/or any project team
- Admin
- INFO.yaml updated
- Istanbul
- Update on DCAE migration
- CDS tests in Istanbul
- update stability/resiliency
- AoB
...
- Action point follow-up
- Morgan Richomme dig a little bit to understand if CSIt use cases it corresponds to active use cases > not done
- Lukasz Rajewski slide deckLukasz Rajewski vFW CNF Use Case Demo > done
- Konrad Bańka Lukasz Rajewski Morgan Richomme estimate what is missing for integration in CI > not done
- Morgan Richomme send a mail to the community to get feedback on this xNF status page > not done
- Admin
- SECCOM reco / baseline images
- Patch created based on SECCOM reco
- Baseline images created (currently in gate) https://gerrit.onap.org/r/c/integration/docker/onap-java11/+/121545, https://gerrit.onap.org/r/c/integration/docker/onap-python/+/121544
- repo cleanup
- #action all cleanup the repo (integration/testsuite/Demo) and remove in master what is not used for istanbul/honolulu
- versioning
- xtesting images can be created now - 1.7.0 created for guilin..bad version 7.0.0 shall be created as well as 8.0.0 for honolulu (shall be possible now..)
- in progress....
- onapsdk => new version for guilin (7.6.0) and for honolulu (8.0.0)
- agreed => 2 versions needed #action michal create the 2 tags (7.6.0=8.0.0)
- xtesting images can be created now - 1.7.0 created for guilin..bad version 7.0.0 shall be created as well as 8.0.0 for honolulu (shall be possible now..)
- Future PTL: how to move forward: houston.pdf
- SECCOM reco / baseline images
- Honolulu
- integration of pnf_macro
- issue with mongo service when run in // with pnf-registrate, #action Krzysztof and Michal specify the service to be unique and linked to the use case
- stability integration in CI
- now included in weekly master chain
- currently limited to 24 because the system is breaking before 72h
- DB tuning in progress
- no more Maria DB issue, issues on ONAP side (SO or subsequent component for instantiation tests and data middleware for SDC)
- now included in weekly master chain
- move back to pythonsdk xtesting version corresponding to the chain version (was master for all) => guilin backporting required
- that is why we need a "good" version for onapsdk..guilin is consuming guilin xtesting, honolulu/honlulu, master/master
- resiliency follow-up -teasing for next week presentation by Natacha Chéreau
- see you next week for a short presentation and a demo
- integration of pnf_macro
- Istanbul
- discussions on CI/CD category:
- shall we split smoke into smoke (E2E test to validate the release) and use cases
- stability category added in honolulu, shall we add a resiliency category or put them all together
- postponed to next week
- onap-k8s update
- add the generation of a onap_versions.json to automate the container tracking
- onap_versions.json generated => shall be able to track the docker version changes on daily
- onapsdk main dev for Istanbul Michał Jagiełło
- #action michal send a mail to indicate main topic for onapsdk in istanbul
- dcae test update Krzysztof Kuzmicki
- postponed
- Epic for istanbul to be created
- discussions on CI/CD category:
- AoB
- Thanks Lasse Kaihlavirta for the great work done since more than 2 years for integration project.
...
Action point follow-up
- Lukasz Rajewski prepare a demo on test automation managed by Lukasz..why it could not be integrated in CI for the moment (reflexion for Istanbul)
- Morgan Richomme sent a mail to PTL on good practice. Reminder that no patch in gate oldes than x months is a criteria for milestones..it is clearly not respected.
- Lasse Kaihlavirta plan a 20' section for a full session
- Admin
- committers
- baseline images
- repo cleanup
- Status on CSIT Lasse Kaihlavirta : CSIT status after Honolulu.pptx
- CPS = Showcase example, everything is fine
- CCSDK previous showcase, still requires distributtion of docker builds, not possible to rebuild locally
- DMaaP (dmaap/buscontroller moved), OPTF (optf/odf and optf/has already moved), SDNC (almost finished but still some failures) transition in progress
- AAI mumtitenancy done outside ONAP planned to be incoprorated into aai/resources and aai/traversal => use of scala+gatling (examples based on robot so far)
- Policy: CSIT moved to reir repositories but tests do not follow reco (test after merge, not project specific, jjb fully specific
- Still some active projects with old design (DCAEGEN2, Modeling, Multicloud, OOM-platform-cert-service, SO)
- Usecase #action Morgan Richomme dig a little bit to understand if it corresponds to active use cases
- VFC and VID do not seem really maintained
- VNFSDK: only images for frankfurt => not maintained
- CSIT tests disabled (aaf, appc, clamp, music)
- clamp moved to SDC => what does it mean from a CSIT perspective
- Demo vFW CNF Lukasz Rajewski Konrad Bańka
- slide deck: #action Lukasz Rajewski vFW CNF Use Case Demo
- use case partially automated but would require a KUD (test cannot use a ns of the existing k8s hosting ONAP)
- As the use case is maintained and includes regularly feature changes, it woudl be interesting to include it in CI..to show that it is red/green as part of the use cases (more than smoke tests)
- #action Morgan Richomme Konrad Bańka Lukasz Rajewski estimate what is missing for integration in CI
- Open question and where the status of the xNF shall be available for ONAP admin..not clear status of the service/vnf/module was available in VID, some test status was available in SDC but not sure to know where the info on the status of the xNF would be the more accurate #action Morgan Richomme send a mail to the community to get feedback on this xNF status page
- AoB
...
- all the INFO.yaml actions will be performed once
- PTL no candidate => escalation done to TSC
- xtesting docker release
- new way, need to twist the scripts but could be OK. Need to fix guilin CI chain first (issue due to new pbr value)
- baseline images: wait for seccom reco for istanbul
- Morgan Richomme contact Seccom to prepare baseline images. Former user (Deleted) indicates that we need to discuss offline especially for the python image.
- Honolulu
- regression on multicloud-k8s / pnf-macro
issue due to helm format, no error with the helm charts sued for Lukasz's use case. Fix done, docker images must be regeneratedJira Legacy server System Jira serverId 4733707d-2057-3a0f-ae5e-4fd8aff50176 key MULTICLOUD-1348 - action Lukasz Rajewski prepare a demo on test automation managed by Lukasz..why it could not be integrated in CI for the moment (reflexion for Istanbul)
- master-weekly
- tern
- should be fully OK next week
- last results : https://logs.onap.org/onap-integration/weekly/onap_weekly_pod4_master/2021-05/07_22-21/security/tern/index.html
- Former user (Deleted) indicates that anothe resource from Saùmsung is working on the topic to improve the images. No feedback from the PTL.Morgan Richomme indicates that he reports the issue to PTL during PTL meeting. Not normal to have no feedback (e.g. CLI improvement patch in gate for a long time), David McBride sent a mail to Former user (Deleted) #action morgan sent a mail to PTL on good practice. Reminder that no patch in gate oldes than x months is a criteria for milestones..it is clearly not respected.
- stability tests
- update on MariaDB tuning => reduce the replica of non core components/removal of appc/... see stability_follow-up 2-2.pdf
- redimensioning is enough to avoid DB crash but recommendation to TSC to reduce replica for non core components 15 instances of Maria DB => 15x30 Go of additional RAM needed to avoid crash in load conditions...9 nodes cassandra...
- stability tests are now performed on each weekly => results are here: https://logs.onap.org/onap-integration/weekly/onap_weekly_pod4_master/2021-05/07_22-21/stability_tests/
- choice of the figures for weekly
- start with instantiation to avoid lots of models in SDC
- 10 instantiation in // during 24h (basic_vm / a la carte bpmn)
- then 5 onboarding in // during 24h
- needs to add basic_vm_macro if stability reached on first instantiation
- DB tuning
- suggestions from Samuel Liard to modify Maria Db and Cassandra DB default configuration: https://gerrit.onap.org/r/c/oom/+/121229/10
- all integration committers are using teh default DB values on their lab, no specific tuning, only the nb of compoentns may be reduced (because not used)
- update on MariaDB tuning => reduce the replica of non core components/removal of appc/... see stability_follow-up 2-2.pdf
- tern
- CSIT status after Honolulu (we may have to reserve some time for this so not necessarily today): Integration (WIP)
- introduction to the status of CSIT at the end of Honolulu
- #action Lasse Kaihlavirta plan a 20' section for a full session
- regression on multicloud-k8s / pnf-macro
...
- Action point follow-up
- Morgan Richomme review Integration simu and release versions if possible + update doc accordingly
- not done yet..several issues on LF (SSO, Nexus, gerrit,..)
- Morgan Richomme create a JIRA for basic_vm_macro
- not needed last results with CCSDK fix look good
- Former user (Deleted) finalize push to LF back end
- test in progress on weekly master..config is good
- Morgan Richomme create resiliency chapter in doc and initiate Jira for confirmed issue (appears at least 2 times), restart of a controller still to be done to complete the test.
- done see next section
- Krzysztof Kuzmicki create a wiki page in Istanbul page for robot refactoring follow-up
- Krzysztof Kuzmicki create a wiki page in Istanbul page for DCAE migration
- Morgan Richomme review Integration simu and release versions if possible + update doc accordingly
- Admin
- INFO.yaml updated needed (NS repo have no yaml + status of the project)
- Commiter Promotion Request for Bartosz Gardziejewski: results 10 Yes on 10
- Commiter Promotion Request for Alexander Mazuruk: results 4 Yes on 4
- PTL election: call for self nomination sent
- all operations on INFO.yaml will be done at the same time
- note Lasse Kaihlavirta indicated that he also will step down in 1 month
- Honolulu
- status:board review https://jira.onap.org/secure/RapidBoard.jspa?rapidView=229
- few JIRA still open # action all move or closed the JIRA in honolulu
- release testsuite 1.8.0 done
- just merged
- doc updated
- done
- Remaining work on tests
- macro issues Lukasz Rajewski
stability/resiliency tests
Maria DB galera troubleshooting
- honolulu_sign-off.pdf
- stability_follow-up.pdf
- Honolulu: Lessons Learned
- #action report your feedback on honolulu lesson learned
- status:board review https://jira.onap.org/secure/RapidBoard.jspa?rapidView=229
- Istanbul
- New Jira board created: https://jira.onap.org/secure/RapidBoard.jspa?rapidView=233
- brainstorm on new use cases for Istanbul open => https://etherpad.anuket.io/p/onap_integration_istanbul
- participants indicate their top 3 priorities for honolulu
- AoB
...
- Action point follow-up
- Morgan Richomme review Integration simu and release versions if possible + update doc accordingly
- not done, will be done after doc, stability and resiliency testing #reaction
- Lukasz Rajewski properly tag SO bugs to reference them as blocking in Integration blicking table
- SO bugs do not appear in Honolulu Integration Blocking Points => to be crosscheck with Lukasz Rajewski
- if SDNC-1515 merged and pnf-simu OK in honoluluMorgan Richomme add pnf-macro to CI
- honolulu daily shows that the basic_vm_macro issue is not really fully fixed => #action Morgan Richomme create a JIRA for basoc_vm_macro
- Morgan Richomme grant access to ChrisC to check the status of SDC/DB
- done see section on SDC stability test
- Morgan Richomme retry and wait for the 5 minutes (Eviction timeout) then investigate on the networking issue
- done, Jira completed
- Morgan Richomme check ansible image availability for chained-ci
- doneAndreas Geißler gave a new try, still issue but not related to teh image. open question: shall we also reference the image in the CI page of the release?
- Morgan Richomme review Integration simu and release versions if possible + update doc accordingly
- Admin
- INFO.yaml updated needed (NS repo have no yaml + status of the project)
- Commiter Promotion Request for Bartosz Gardziejewski: please vote before end of the week. BTW if other committer proposal => feel free to suggest (to replace Pawel, Marcin and partly Thierry)
- Honolulu
- status:board review https://jira.onap.org/secure/RapidBoard.jspa?rapidView=229
- release testsuite 1.8.0 under built
- in progress https://gerrit.onap.org/r/c/testsuite/+/120960, once merged, submit a patch to OOM
- Remaining work on tests
- macro issues Lukasz Rajewski
- pnf-macro test to be done on master before integration in CI (working fine in guilin)
- basic_vm_macro good results on guilin but not so good on master/honolulu => JIRA created
Jira Legacy server System Jira serverId 4733707d-2057-3a0f-ae5e-4fd8aff50176 key SDNC-1529
- tern: test run in CI but results not pushed yet to LF Backend => WIP to manage properly the push to lf backend. On last honolulu and master-weekly, artifacts were produced and pushed manually #action Former user (Deleted) finalize push to LF back end
stability/resiliency tests
Resiliency test
- worker node restart (thanks Bartek Grzybowski for the full analysis) => how do we follow, shall we create Jiras?
- test done, eviction looks good. some issues detected on some pods but not always trivial to reproduce may depend on the associated evicted pods. sometimes Init error, sometimes pod Running but exception..sometimes first eviction look good, but second seems to be fail... different cases referenced in Honolulu Resiliency and Backup and Restore test
- for SDC issue, the restart may be due to teh fact that the SDC is trying to recreate tables that already exist in cassandra
- #action Morgan Richomme create resiliency chapter in doc and initiate Jira for confirmed issue (appears at least 2 times), restart of a controller still to be done to complete the test.
stability tests
- SDC tests: 72h 5 parallel on boarding INT-1912 - SDC Stability test: success rate drops after ~ 500 onboarding Open
- ChrisC reports that it was useful to detect new issues, especially the continuous time increasing that my be lead to teh DB and/or a middle ware layer (explicit exception seen)
- plan to integrate such test in weekly as part of benchmark test
- instantiation tests
- 48h 5 parallel basic_vm (initial issue on SDNC (fixed by restart) then regular timeout value then internal openstack issues INT-1918 - Stability tests: // instantiation Open
- more timeout than in guilin, need to be confirmed with a 1 test (no parallelization), mariadbgalera issue observed on some replica
- 72h 1 test basic_vm => problem with mariadb galera, results will not be as good as in guilin run
- issue with mariadbgalera after 24h (but tests run after the 48h tests..) once finished (thurday morning => reinstallation of honolulu weekly to reproduce the tests with the last dockers
- mariadb galera workaround reported by Bell to OOM, seems to improve the overall quality of gate but trigger an new issue on CDS. tradefoff between redundancy and efficiency not clear
- macro issues Lukasz Rajewski
- documentation update started but not finished => https://gerrit.onap.org/r/c/integration/+/120236
- estimation 2-3 days still needed to compelte the doc / release note + testsuite integration
- Istanbul
- New Jira board created: https://jira.onap.org/secure/RapidBoard.jspa?rapidView=233
- robot refacroting..it eems we have a plan (Krzysztof Kuzmicki )
- discussion by mail, #action Krzysztof Kuzmicki crerate a wiki page in Istanbul page
- migration of DCAE from cloudify to helm chart..first analysis by Krzysztof Kuzmicki , impacts to be planned on several tests
- discussion by mail, #action Krzysztof Kuzmicki crerate a wiki page in Istanbul page
- New CSIT (AAI, CDS,..)
- AAI is folowwing the SDC way (Maven based), for CDS it shoudl be possible to reuse what Lasse Kaihlavirta suggested. AAI team contacted SDC
- brainstorm on new use cases for Istanbul open => https://etherpad.anuket.io/p/onap_integration_istanbul
- all review the page, it is an etherpad..so do not refrain yourself..put everything you have in mind
- AoB
- Lasse Kaihlavirta closed the CSIT refactoring EPIC
- Lasse Kaihlavirta also disabled useless SO CSIT tests (with very old images) - the Jira was closed without action by Seshu Kumar Mudiganti so we remove some jobs as they are meaningless (test with casablanca images)
- Lasse Kaihlavirta add a browser cleanup on robot healthcheck (vid) to save resource, it will be integrated in 1.8.0
...
- Action point follow-up
- Michał Jagiełło pnf_macro add processing for pnf_macro to wait for a clean startup of the simulator (currently time based, and it seems that it takes more time than expected)
- Not done
- Morgan Richomme cleanup basic_clamp and re-run it on a daily master
- Done
- Michał Jagiełło complete basic_vm_macro
- In progress, issue in SDNC:
Jira Legacy server System Jira serverId 4733707d-2057-3a0f-ae5e-4fd8aff50176 key SDNC-1515
- In progress, issue in SDNC:
- Morgan Richomme create wiki page to reference the GUI endpoints to be tested
- Done Honolulu UIs
- all review the wiki page and add the links of the GUI you are using
- Morgan Richomme create a wiki page to improve the process on test integration in CSIT and/or CI from third parties
- all review/complete the wiki on process to integrate new external tests in CSIT or CI
- Morgan Richomme initiate an official page on simulator
- Krzysztof Kuzmicki complete the official simulator page with NS illustration
- To be Done
- Bartek Grzybowski review the official simu page (list of usable simu)
- Done
- Illia Halych review the official simu page (pythonsdk wrapper)
- To be Done
- Michał Jagiełło pnf_macro add processing for pnf_macro to wait for a clean startup of the simulator (currently time based, and it seems that it takes more time than expected)
- Admin
- Illia Halych officially new Integration commiter, welcome !
- No update on xtesting docker release
- LF IT backend , not possible to move logs, no cleanup mechanism (manual cleanup needed)
- Honolulu
- status:board review https://jira.onap.org/secure/RapidBoard.jspa?rapidView=229&selectedIssue=INT-1842
- action #all review your Jira ticket move to instanbul or close
- Daily Honolulu CI/CD chain created
- Remaining work on tests
basic_clamp: integrated in CI, several successful runs, but improvements needed to manage exceptions (Policy/DCAE/CLamp) => https://gerrit.onap.org/r/c/testsuite/pythonsdk-tests/+/120234
basic_vm_macro (replace vfw_macro): in progress still some issues on the daily honolulu
pnf_macro => add mechanism to have a better control of the pnf simu launch (timer is not enough) => # action Michal
refactoring of 5gbulkpm => #action Krzysztof => test done this afternoon => merged
tern: test declared in CI, but issue => # action morgan & Alexander
stability tests
I started the first resiliency tests: TEST-308 - [Resiliency] Evaluate ONAP behavior on k8s worker node restart
- Other labs are experiencing different issues
- Nokia => pod remain in stuck
- #action Daniel, Andreas create a JIRA ticket for each resiliency test
- #action morgan create a wiki page to consolidate resiliencey tests
- Other labs are experiencing different issues
stability I planned to regive a try to Natacha's suite as soon as the other tests are OK
- to be tried asap: if enough resources => weekly Honolulu to be launched on Wednesday
consolidation of versions: I was waiting for the come back of Pawel but as far as I understood, you will move to othe r challenges soon.. :) so I need to review that
better exception catching
integration of the GUI part to generate an html reporting (for the moment I usually replay manually the tests, get the results and apply the GUI processing manually)
removal of the submodule: test in progress (seems there was an import in the simu step), once done we could review our docker build (to remove the developer mode) but we shall not forget to adapt xtesting-onap according ly (/Src/onaptests/src/onaptests => /usr/lib/python3.8/sites-available/onaptests
- #action morgan review the patch dealing with sumbmodule removal + cherry + adapt xtesting-onap
CDS / CSIT => will not have the resource to do it for Honolulu => move to Istanbul
GUI tests: wait for completion of the Wiki page and see if enough bandwidth => move to instanbul
- documentation update started
- honolulu branching done
- release testsuite 1.8.0 to be done
- status:board review https://jira.onap.org/secure/RapidBoard.jspa?rapidView=229&selectedIssue=INT-1842
- Istanbul
- requests from new project (OOF, AAI) "on how to bring new tests to integration" => How to help projects to integrate their tests in Integration?
- Discussion on the support for AAI gatling tests. By default the multitenancy support is disabled and they require a keycloak third party
- first issue is the test env => we coudl imagine to have a daily scenario daily_master_multitenancy but we need to take care of the resources. Until we cannot rely on the windriver lab, it will be hard to create new scenarios...
- installation of keycloak shall be done in a tooling namespace through a helm chart => OOM
- Mohammad Hosnidokht indicated that gatling part is almost automated (docker verifying the roles)
- William Reehil indicated that it will probably break the other tests
- it is probably more relevant to start by creating a CSIT test (fonctional test) with AAI + keycloak rather than a daily..
- #action Morgan Richomme complete wiki instanbul page to track this scenario
- run robot tests out of onap namespace: How to run the tests out of the ONAP cluster?
- requests from new project (OOF, AAI) "on how to bring new tests to integration" => How to help projects to integrate their tests in Integration?
- AoB
- Michał Jagiełło pnf_macro add processing for pnf_macro to wait for a clean startup of the simulator (currently time based, and it seems that it takes more time than expected)
- Michał Jagiełło complete basic_vm_macro
- all review the wiki page and add the links of the GUI you are using
- all review/complete the wiki on process to integrate new external tests in CSIT or CI
- Krzysztof Kuzmicki complete the official simulator page with NS illustration
- Illia Halych review the official simu page (pythonsdk wrapper)
- all review your Jira ticket move to instanbul or close
- Morgan Richomme review the patch dealing with sumbmodule removal + cherry + adapt xtesting-onap
- Morgan Richomme complete wiki instanbul page to track this scenario
...
- Action point follow-up
- Morgan Richomme action morgan initiate Illia Halych committer promotion procedure
- done
- Morgan RichommeMichał Jagiełło develop basic_vm_macro and basic_cbf_macro
- basic_vm ready to be tested, basic_cnf shall be very closed
- Morgan Richommecontact Lasse Kaihlavirta to see if CDS regression could be integrated in CSIT
- done, no bandwidth available, Jira created
- Morgan RichommeAndreas Geißlerlist UI and create a healthcheck test to check the availability of the UI
- done, see next section
- Morgan Richomme action morgan initiate Illia Halych committer promotion procedure
- Admin
- Committer promotion: formal vote initiated Committer Promotion Request for Integration Illia Halych
- vote in progress, please committer vote before the end of the week
- testing docker discussion (formating, unexpected removal of daily build dockers,..)
- 2 tickets created on LF
- "fresh" xtesting dockers disappear time to time on the nexus https://jira.linuxfoundation.org/plugins/servlet/theme/portal/2/IT-21812
- "impossible to release because the tag format of the snapshot docker does not respect some rules" => https://jira.linuxfoundation.org/plugins/servlet/theme/portal/2/IT-21710
- xtesting dockers are rebuilt daily based on the branches (guilin/master end of branches of all the components embedded in the docker), CI or end users cannot guess the format imposed by the LF rules (used for components e.g. 6.0-STAGING-20210315T185806Z)
- 2 tickets created on LF
- Committer promotion: formal vote initiated Committer Promotion Request for Integration Illia Halych
...
- sequential versus parallel
- tests planned to move to E2E sequential to avoid side effect due to parallelization. Parallel tests could be done on weekly...need to fist master and gating chains first.
- sequential versus parallel
- tests update (Michał Jagiełło 15' )
- pnf (macro flow)
- ready to be tested (logger fixed)
- #action morgan test basic-pnf on daily
- exceptions not caught
- patch provided
- basic_clamp
- almost there: last issue due to DCAE TCA, seems tehre is a regression on dcae due to python2.7 / Python3 =>
. Wait for fix before retrying.Jira Legacy server System Jira serverId 4733707d-2057-3a0f-ae5e-4fd8aff50176 key INT-1822
- almost there: last issue due to DCAE TCA, seems tehre is a regression on dcae due to python2.7 / Python3 =>
- wrapper
- OK, question on where to host the helm charts for the simulator (pnf and future one)
- #action contact OOM team => similar question than the for CDS mock objects
- it is possible to remove the submodule - just be carefull, once removed => possible to deploy onapsdk as a "standard module" no more as developer module => impact on xtesting-onap as the paces will be different
- pnf (macro flow)
- Backup/restore Morgan Richomme 15' Backup_and_restore_discussion.pdf
- discussion on a realistic use case...
- backup and restore seems too optimistic
- consensus to work on the resiliency of the core component
- #action Andreas Geißler warning shall be added in the documentation, as aarna network is not really usable for a real backup/restore (more some examples to use velero)
- Companies that tried velero has issues due to teh fact that ONAP is not really cloud native
- discussion on a realistic use case...
- AoB
- cmpv2 about to be moved from healthcheck to smoke
- Krzysztof Kuzmicki indicates that 5Gbulkpm will be updated ..may have some turbulences during the update
...
- Action point follow-up
- AP1: morgan_orange publish video and slideck on the how to
- done: Youtube video link, discussions in progress at LFN level to suggest how to publish such videos per community channel
- AP2: morgan_orange plan a new slot with praveen
- no feedback from praveen v , need to replan a slot
- AP3: morgan_orange send mail to suggest repo, and if OK => create teh repo
- mail sent to Konrad Bańka , wait for green light before creating the new repo
- AP4: morgan_orange anser to the mail for pnf-simu evolution and plan a formal agreement from committer next week
- see next section
- AP5: natacha add the _v to manage the settings path in order to retrieve the pythonsdk logs
- done but side effect due to the fact that the settings in master are in /Src/onaptests/src/onaptests and not under /usr/lib/python3.8 in xtesting
- AP1: morgan_orange publish video and slideck on the how to
- Admin
- new ietf repo created, Bartek Grzybowski added JS linter, first upload in progress
- Guilin CI chain
- ~ OK http://testresults.opnfv.org/onap-integration/results/index-onap_daily_pod4_guilin-ONAP-oom.html
- Certificates CDS-UI expires in 3 days and VID in 29 days
- Error due to 500 from SDC
- Master chain
- pythonsdk tests broken during 2-3 days due to the introduction of onapsdk 7.4 (onapsdk custom exceptions were no more caught in onaptests)
- problem affecting all the gating chains
- Comments from Lukasz Rajewski on the slack channel => quid about the history, free account does not provide long retention period #action 8
- Honolulu
- Discussion on a recovery pipeline / resiliency tests (Marek Szwałkiewicz Morgan Richomme
- Epic created on Honolulu Resiliency and Backup and Restore test
- several tasks to perform tests
- Please do not hesitate to use the JIRA if you are performing such tests in your lab
- Epic created on Honolulu Resiliency and Backup and Restore test
- Discussion on CI/CD chain evolution (Morgan Richomme )honolulu_ci_evolution_08022021.pdf
- Krzysztof Kuzmicki indicates that dcae-mod shall be tested also through a new healthcheck test
- FWCL not possible to integrate in CI straightforward - preprovisionned resources needed, dependencies on installation (documented),
- Not sure if FW (macromode) will bring more than basic_VM + PNF and note sure Andreas Geißler will have resource to deal with it
- VCPE TOSCA (CLI) was not possible to run it on daily labs (running onwly on tester lab), improvements were planned in Guilin (seems to be done). #action 1
- #agreed No objection from the new categories and new tests for Honolulu branch
- for tern/scancode: watch out the versions of the OS, Debian9 is too old. #action 2
- Security
- versions: last update
- test created by Paweł Wieczorek
- waiver list introduced in Honolulu (patch merged)
- New GUI suggested more explicit that the json file: https://logs.onap.org/onap-integration/weekly/onap_weekly_pod4_master/02-11-2021_22-02/security/versions/versions/
- still lots of java 8 and python 2.7...
- very few projects seem to use the baseline images (that are up to date..)
- versions: last update
- Pythonsdk
- removal of the submodule?
- #agree remove the pnf submodule as soon as possible, be careful with the side effects on xtesting dockers / xtesting-onap ansible roles as we coudl move back from src/onaptests to /usr/lib/python3.8 path
- status on the wrapper (helm2/helm3)
- Illia Halych indicates that there is a client supporting helm2 and one supporting helm3 but not both
- #agree consider only helm3
- Add the statement in the README (as for the python min version 3.7 (same as pythonsdk)
- #action 3
- status on the tests basic_pnf, basic_clamp
- problem for basic_pnf seems to be fixed, patch merged on SDC
- see if the basic_pnf could be introduced in CI (test it first manually on daily weekly then add teh job xtesting-onap project that defines the CI chain) #action 4
- Improve reporting
- reporting may be misleading as it indictaes only the results of resource creation. We recently got an issue when deleting the resources => all the reporting is green even if there was an error during vfModule deletion. Michał Jagiełło submitted a patch to consider deletion in reporting #action 5
- Solution to limit issues on master gate (gating on pythonsdk?, versioning,..)
- pnf-simu > nf-simu: formal review
- #agreed
- demo to be planned next week #action6
- Discussion on a recovery pipeline / resiliency tests (Marek Szwałkiewicz Morgan Richomme
- AoB
- Marcin Przybysz indicates that a discussion is needed on VID. Vid new UI is needed for PNF macromode tests but old UI is needed for vFWCL..how do we manage that
- Michał Jagiełło tried to setup the new VID uI (VID 7.0.2) but has issue, Marcin Przybysz indicates that some flags have to be tuned #action 7
- actions for next meeting
- AP1: Morgan Richomme : contact vcpe tosca team to get their position in Honolulu (
)Jira Legacy server System Jira serverId 4733707d-2057-3a0f-ae5e-4fd8aff50176 key TEST-239 - AP2: Former user (Deleted) : get the list of projects using the baseline images
- AP3: Illia Halych amend https://gerrit.onap.org/r/c/testsuite/pythonsdk-tests/+/117192 for helm3 support
- AP4: Morgan Richomme test basic_pnf on Orange daily master with onaptests:master
- AP5: Michał Jagiełło Morgan Richomme test carefully before submitting until we got a gate to do it...
- AP6: Krzysztof Kuzmicki prepare a 10 minutes demo on pnf-simu to nf-simu (explaning the graph shared by mail)
- AP7: Marcin Przybysz plan a demo of VID new UI, how to launch it, how it is used in PNF macromode + see with VID how we can manage tests that are using legacy VID..
- AP8: Morgan Richomme contact Kenny Paul for the status of the slack chan
- AP1: Morgan Richomme : contact vcpe tosca team to get their position in Honolulu (
...
- Action point follow-up
- Admin
- Honolulu
- demo 5g-core-nf simu (praveen v ) 20'
- demo ORAN A1-based Closed Loop (Konrad Bańka ) 20' A1 Policy Enforcement PoCv1.pptx
- demo stability test launcher (Natacha Chéreau )10'
- AoB
(18:02:16) collab-meetbot: Meeting ended Wed Feb 10 17:02:15 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)
(18:02:16) collab-meetbot: Minutes: http://ircbot.wl.linuxfoundation.org/meetings/onap-int/2021/integration_weekly_meeting_10_2_2021/onap-int-integration_weekly_meeting_10_2_2021.2021-02-10-16.44.html
(18:02:16) collab-meetbot: Minutes (text): http://ircbot.wl.linuxfoundation.org/meetings/onap-int/2021/integration_weekly_meeting_10_2_2021/onap-int-integration_weekly_meeting_10_2_2021.2021-02-10-16.44.txt
(18:02:16) collab-meetbot: Log: http://ircbot.wl.linuxfoundation.org/meetings/onap-int/2021/integration_weekly_meeting_10_2_2021/onap-int-integration_weekly_meeting_10_2_2021.2021-02-10-16.44.log.html
...
- Action point follow-up
- Admin
- new repo follow-up
- Honolulu
- demo PNF (Michał Jagiełło )
- discussion on simulators
- simulator wrapper in pythonsdk-tests (Illia Halych)
- Preparation vEvent
- AoB
(18:57:32) collab-meetbot: Minutes: http://ircbot.wl.linuxfoundation.org/meetings/onap-int/2021/integration_weekly_meeting_27_01_2021/onap-int-integration_weekly_meeting_27_01_2021.2021-01-27-17.29.html
(18:57:32) collab-meetbot: Minutes (text): http://ircbot.wl.linuxfoundation.org/meetings/onap-int/2021/integration_weekly_meeting_27_01_2021/onap-int-integration_weekly_meeting_27_01_2021.2021-01-27-17.29.txt
(18:57:32) collab-meetbot: Log: http://ircbot.wl.linuxfoundation.org/meetings/onap-int/2021/integration_weekly_meeting_27_01_2021/onap-int-integration_weekly_meeting_27_01_2021.2021-01-27-17.29.log.html
...
- Action point follow-up
- Admin
- new repo follow-up
- new Real time support channel: slack (already exists), publick rocket chat, mattermost, ....
- Honolulu
- demo PNF (Michał Jagiełło )
- discussion on simulators
- simulator wrapper in pythonsdk-tests (Illia Halych)
- CSIT redesign updates (Lasse Kaihlavirta)
- stability/resiliency testing (Natacha Chéreau )
- Update on Tern tests (Former user (Deleted) )
- Preparation vEvent
- AoB
(17:40:10) collab-meetbot: Minutes: http://ircbot.wl.linuxfoundation.org/meetings/onap-int/2021/integration_weekly_meeting_20_01_2021/onap-int-integration_weekly_meeting_20_01_2021.2021-01-20-16.06.html
(17:40:10) collab-meetbot: Minutes (text): http://ircbot.wl.linuxfoundation.org/meetings/onap-int/2021/integration_weekly_meeting_20_01_2021/onap-int-integration_weekly_meeting_20_01_2021.2021-01-20-16.06.txt
(17:40:10) collab-meetbot: Log: http://ircbot.wl.linuxfoundation.org/meetings/onap-int/2021/integration_weekly_meeting_20_01_2021/onap-int-integration_weekly_meeting_20_01_2021.2021-01-20-16.06.log.html
...
- demo tests DataFileCollector (Krzysztof Gajewski ) 10'
- Guilin Maintenance Release
- Preparation vEvent
- AoB
(16:26:02) collab-meetbot: Minutes: http://ircbot.wl.linuxfoundation.org/meetings/onap-int/2021/integration_weekly_meeting_13_1_2021/onap-int-integration_weekly_meeting_13_1_2021.2021-01-13-14.51.html
(16:26:03) collab-meetbot: Minutes (text): http://ircbot.wl.linuxfoundation.org/meetings/onap-int/2021/integration_weekly_meeting_13_1_2021/onap-int-integration_weekly_meeting_13_1_2021.2021-01-13-14.51.txt
(16:26:03) collab-meetbot: Log: http://ircbot.wl.linuxfoundation.org/meetings/onap-int/2021/integration_weekly_meeting_13_1_2021/onap-int-integration_weekly_meeting_13_1_2021.2021-01-13-14.51.log.html
...