Integration weekly meetings 2021 archives
Dec 8, 2021
A&AI load test
Robot refactor:
create a separate branch of xtesting repo to remove Python 2.7
we plan to remove as many things as possible from xtesting
will be best if we could remove https://gerrit.onap.org/r/admin/repos/testsuite/python-testing-utils dependency
Dec 1, 2021
Lab status
several errors in all the labs
no run since the 28 on DT side
last run on orange not very good because the tests were not launched properly (ONAP looks OK) results on the dashboard are ppor because the tests were not run => no results..refactoring of teh dashbaord could make sense to ignore tests when not executed..
data-provider in gate: https://gerrit.onap.org/r/c/integration/data-provider/+/125975
Feedback from AAI team on AAI stability tests, ATT performs benchmarking tests and indicates that they have about 5M nodes in their production instance.
@Former user (Deleted) is back, update on scancode soon
@Lukasz Rajewski @Michal Chabiera updated on onapsdk planned
OOM migration from gerrit to gitlab in progress, if OK some of our gitlab repo coudl be hosted under LFN umbrella
@Krzysztof Kuzmicki main focus on DCAE test migration, OOM patch in gate (DCAE HC FAIL but a priori not related to the patch...oom_redploy)
@Morgan Richomme shares view of an internal user guide that could be partly upstreamed if people agrees => main question do we have a list of the officially supported GUI? there is a gap between the usable GUI and all the exposed svc.
minor fixes in
weekly/versions: chaneg of the success criteria (https://gitlab.com/Orange-OpenSource/lfn/onap/integration/onap-version-status/-/tree/master/onap_check_versions)
onap-k8s: integration job now ignored (https://gitlab.com/Orange-OpenSource/lfn/tools/kubernetes-status)
Nov 24, 2021
Lab status
DCAE tests cloudify → helm status @Krzysztof Kuzmicki
Remove @Former user (Deleted) from the commiters list
data-provider release - Green light from the DT
Nov 17, 2021
Integration feature/changes plans for Jakarta - brainstorm
Rename tests names to be more self-described (like basic_cds -> cds_cba_enrichment) – High
Review healthcheck core components – High
Switch to DCAE Helm (cloudify deprecation) – High
Add test for the loop (basic_loop working name) – High
Add test for CNF macro instantiation – High
Test GUI endpoints & document available ONAP’s GUIs – High
Use kubescape tool – deprecate root_pods and unlimited_pods tests – High
Run tests out of “onap” namespace – Medium
Tern deprecation (use Scancode.io) – Medium
Resiliency tests – memory/cpu node hog, node drain, backup & restore – Low
Add multi_vnf_ubuntu_macro test – Low
Use testsuite/cds in tests CI (prepare the pythonsdk-tests scenarios) – Low
Data-provider tool release – Low
ONAP k8s CRDs – Low
Automate use cases (SON, 5G slicing, CCVPN) – Low
Refactor robot – Low
DCAE tests cloudify → helm status @Krzysztof Kuzmicki
tests removed from master CI pipeline
basic_clamp
5gbulkpm
cmpv2
dcaemod healthcheck
tests are going to be updated to use helm and added back to the pipeline
Basic CNF test evolution @Lukasz Rajewski
new tests are going to be provided
Results of the stability tests @Morgan Richomme
basic_onboard back global success rate 96%
List of GUIs to be monitored (see question on slack) / demo gatus? @Morgan Richomme
Nov 10, 2021
Lab status
Istanbul daily & weekly
SDC onboarding stabiliy test regression
DCAE tests cloudify → helm status @Krzysztof Kuzmicki
Jakarta
review of the tests to be included in CI (in/out/refactoring) in daily and weekly @Morgan Richomme : jakarta_ci_evolution.pdf
Oct 27, 2021
Lab status
We have a stable 2 labs with tests:
Nokia lab has issues with message-router - for some reason it doesn't start properly @Krzysztof Kuzmicki
@Krzysztof Kuzmicki DCAE update
DCAE is ready to remove cloudify support – tests need to be updated. @Krzysztof Kuzmicki is working on that
New Python tests:
multi_vnf - failed due to bug in code, needs to be retested again before include in Daily CI @Michał Jagiełło
cds_resource_resolution - failed due to incorrect return value. Needs to be debugged and fixed/bug in CDS needs to be reported @Michał Jagiełło
Neng usage:
We have a few questions about neng (network-name-gen):
is it possible to use it during the service instantiation?
how to use that?
Main with questions about that needs to be sent to @Seshu Kumar Mudiganti and @Dan Timoney
Istanbul release RC
Offtop:
https://github.com/unlenen/onap-as-a-service tool to create ONAP resources by @Nebi Volkan ÜNLENEN
Oct 20, 2021
SECCOM: discussion about
Using integration images as the best practice (global requirement in the future) https://lf-onap.atlassian.net/browse/INT-2000
list of the requirements for the images - posted on the seccom repository https://github.com/onap/integration-seccom/blob/master/recommended_versions.yaml
add the test to check the base image for the projects
can be done both on Jenkins for any Dockerfile changes (create a new one or edit already exists) and also for the daily
support prometheus
Prometheus shouldn't be a part of ONAP because it's a just one of tools that could be used to collect metrics and shows dashboards
There is an idea to provide a Wiki with all the instructions how to deploy Prometheus, which dashboards should be included etc.
Lab status
Nowadays there is no "clean" daily (mostly because the Nexus issues)
latest weekly looks OK https://logs.onap.org/onap-integration/weekly/onap_weekly_pod4_master/2021-10/16_02-51/
@Morgan Richomme stability tests issues
after 35h test starts failing
Istanbul release RC
Oct 13, 2021
@rouzaut Security tests
@Lukasz Rajewski Multicloud azure issues
Lab status
Failuers on both DT and Nokia labs
Due to Vexxhost migration a lot of tests failing - there were no docker images
Istanbul release
Robot gating
Plan to create a gating for robot tests - discussion with @Sylvain Desbureaux needed if we could do that - gating is already heavy loaded
Oct 6, 2021
Lab status
several issues on both Orange and DT - now it looks stable
Changes in ONAP release process Release Process
Needs to be clarified with @David McBride about "Complete E2E testing"
Integrtion can be resposible only for the automated tests
We can only rely on the assurance of those responsible for the use case that they have carried out the tests and they are working correctly if they have not automated the process and shared it with the Integration team
DT tests not performed due to change in helm push plugin - https://github.com/chartmuseum/helm-push/
there is no more `helm push` command
OOM Makefile uses that command https://gerrit.onap.org/r/gitweb?p=oom.git;a=blob;f=kubernetes/Makefile;h=d994397269d8cdcdb7837f6d8c0c81fc7e714ba1;hb=refs/heads/master#l84
Get rid of VID:
VID healtcheck removed and pnf-registrate change also made - wait for DT tests results
Python ONAP SDK instantiation requires VID objects - it has to be refactored and mark VID module as deprecated → Draft: Resolve "Mark VID as deprecated" (!275) · Merge requests · Orange-OpenSource / lfn / onap / python-onapsdk · GitLab
Python ONAP SDK:
new maintainer candidate @Michal Chabiera !!!
before new version release we should remove VID package I think Draft: Resolve "Mark VID as deprecated" (!275) · Merge requests · Orange-OpenSource / lfn / onap / python-onapsdk · GitLab
new branch - Istanbul
Repositories archived:
Update on Pythonsdk_tests gating @Morgan Richomme
Update on helm based components in tests @Krzysztof Kuzmicki
NSA/CISA kubernetes hardening guidance https://kubernetes.io/blog/2021/10/05/nsa-cisa-kubernetes-hardening-guidance/ - there is a tool which can be used to check the cluster security
We will have a guest next week - @rouzaut will talk about the solutions we could use to automate security tests
@Kenny Paul (Deactivated) will do a research about a tool to share the knowledge about issues on ONAP. We all agreed that the use of mailing lists is not convenient and it would be good to have a tool to report bugs in ONAP and present possible solutions
It's needed to get the response from @Seshu Kumar Mudiganti if we should change the number of replicas in SO's maria - https://lf-onap.atlassian.net/browse/INT-1925
Sep 29, 2021
Lab status
All daily labs are OK
ONAP codebase license scan:
Integration
Testsuite
No issue reported on repositories under Integration responsability
VID is going to be marked as unmaintained and remove from release:
https://gerrit.onap.org/r/c/testsuite/pythonsdk-tests/+/124507 - pythonsdk-tests change to not use VID API.
in Python ONAP SDK instantiation requires VID objects - it has to be refactored and mark VID module as deprecated
Test done on DT daily (after patch in pythonsdk) with no portal/vid
Portal and VID Healthcheck are FAIl (normal)
pnf-registrate is fail (call to VID)
VID is used in the init.sh script that is still used by ONAP end users
As a consequence removing VID would need adaptation in pnf-registrate and probably in other robot based tests leveraging the init script.
Action @Michał Jagiełło @Krzysztof Kuzmicki evaluate the risk...
No feedback on the archiving of the following repositories:
No feedback
Note that one repo is finally empty..as the initial code was not passing the verification job and was never amended by the author. It is always difficult to be sure when we create the repo, but we could evantually use a public gitlab repo as a first step to evaluate the code before creating resources for ..nothing in ONAP?
Action @Michał Jagiełło create a ticket to LF to arhive these repositories
Action @Morgan Richomme once officially archive, remove the reference in the integration documentaiton
@Morgan Richomme ran successfully CPS healthcheck test!
Official docker generated: nexus3.onap.org:10003/onap/xtesting-smoke-usecases-robot-py3:master
Action Morgan integrate case in CI (already tested in the weekly run this weekend) then in dashboard
Update on Pythonsdk_tests gating @Morgan Richomme
mechanism seems OK now https://gitlab.com/Orange-OpenSource/lfn/ci_cd/chained-ci/-/pipelines/379154288
watch changes intestsuite/pythonsdk_tests
build of pythonsdk docker on the fly
use this docker during testing part
First results with 123869-1 but lots of red...patch or still issues, to be investigated https://gitlab.com/Orange-OpenSource/lfn/onap/xtesting-onap/-/pipelines/379369426
doc
refactoring of the dependencies as a LF IT changes broke all the doc build chain (ODL , ONAP,..) not the first time....
Cedric Ollivier (OPNFV/Anuket) fixed similar issues in OPNFV 3 years ago, he suggested the way to follow to be as clean as possible => 2 patches merged in Integration to validate
Misc
Julien is leaving bell, thanks for the short but great contributions. He initiated the handover to Bell's colleagues. We hope we could verify his last patch through the new gate...
Sep 22, 2021
Admin
Lab status
Data provider repo creation - under review https://gerrit.linuxfoundation.org/infra/c/releng/info-master/+/68853
Istanbul
Openstack/Kubernetes supported version, shall we precise, shall we plan tests (with which resources?)
Openstack - need to be precised
MSB K8S - helm packages <= 3.5, could be higher version if not any 3.5+ featue is used
Integration of CPS test in CI @Morgan Richomme
CPS tests require newer version of Robot library (Python 3 based, where we currently use Python 2 based one)
Istanbul
@Morgan Richomme provide a change https://gerrit.onap.org/r/c/integration/xtesting/+/124428 where CPS tests are going to be executed using separate image (with Python 3.X)
Jakarta
robot tests should be migrated to use newer Robot library (Python 3 based) so CPS tests could be executed with the rest of the robot tests
Jakarta
@Vijay Kumar DCAE plan to drop cloudify packages support at the begging of Jakarta
@Krzysztof Kuzmicki already working on the tests migration to use helm charts
there is a risk that tests start failing because of that. We need:
migrate tests to use helm charts before cloudify support ends
remove from testsuite tests that use cloudify
the second opiton can be chosen only if the migration cannot take place
the team has an idea to create a place where users can share problems they encountered while working with onap and solutions
using mailing lists is inconvenient
users could also share an ideas and solutions which are already used by them, that could help sharing a knowledge
needs to be discussed with doc team @Thomas Kulik @Eric Debeau / other PTLs
@Bartek Grzybowski mention about https://gerrit.onap.org/r/admin/repos/oom/offline-installer repo where many useful tools are
Sep 15, 2021
Admin
archiving of integration repositories...if no activity since ...1 year? - report created by @Morgan Richomme
Repositories which are going to be archived short list - need to be discussed via mailing list
Istanbul
CPS: demo on staging Azure by @Aditya Puthuparambil (evaluation complexity for CI integration in Istanbul) @Morgan Richomme
looks it could be used as an integration test "healthcheck" category if it won't use docker-compose but real CPS instance
review David's JIRA
many of tasks can be closed (some of them were already closed by David)
Data provider demo @Piotr Stanior
DT is going to release that tool to ONAP's gerrit
Robot pod deprecation
DT tests are executed with disabled robot - let's check the results in one week
Sep 8, 2021
pre meeting on CI introduction: CI-CD_introduction.pdf video: https://logs.onap.org/onap-integration/presentations/integration_introductin_CI_09082021.mp4
Action points
Question on ESR removal (side effects on smoke tests)
gating OK + verif on DT daily => green light to remove this component, oom waiting for @Michał Jagiełło green light on the gerrit https://gerrit.onap.org/r/c/oom/+/123812
Admin
new PTL congratulations @Michał Jagiełło all INFO.yaml shall be good
archiving of integration repositories...if no activity since ...1 year? @Morgan Richomme https://lf-onap.atlassian.net/browse/INT-1975
pythonsdk gating chain pythonsdk_tests_gating.pdf
@Seshu Kumar Mudiganti asked for rerun basic_vm stability tests both with 1 and 3 replicas of mariadb_galera
demo scancode.io?