{"type":"doc","content":[{"type":"extension","attrs":{"extensionType":"com.atlassian.confluence.macro.core","extensionKey":"toc","parameters":{"macroParams":{},"macroMetadata":{"macroId":{"value":"63b3e4d2-d687-4daa-8952-640f377c33eb"},"schemaVersion":{"value":"1"},"title":"Table of Contents"}}}},{"type":"heading","attrs":{"level":1},"content":[{"text":"Introduction","type":"text"}]},{"type":"paragraph","content":[{"text":"Sonar requires the coverage files to be provided during the project scan. Those data files are generally recorded by plugins, servers, interpreters, ... when executing the tests and made accessible to the sonar scanner.","type":"text"}]},{"type":"paragraph","content":[{"text":"This depends of the language and packager (like maven/gradle, ..) used in the project to execute the tests and build the artifacts.","type":"text"}]},{"type":"paragraph","content":[{"text":"Sonar recognizes 2 types of testing that can be executed in a build for the coverage report, and it computes the union of the unit and integration test results.","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Unit tests","type":"text","marks":[{"type":"strong"}]},{"type":"hardBreak"},{"text":"It tests the classes or methods directly, generally by using specific test framework (Junit, testNG, etc ...)","type":"text"},{"type":"hardBreak"},{"text":"The \"container framework\" used behind the scene (Spring/ JBoss/ EJB or whatever) ","type":"text"},{"text":"SHOULD NOT","type":"text","marks":[{"type":"strong"}]},{"text":" be used in the Unit test scope.","type":"text"},{"type":"hardBreak"},{"text":"External calls to test servers or third party components/anything ","type":"text"},{"text":"MUST NOT","type":"text","marks":[{"type":"strong"}]},{"text":" be done here. These type of tests should be executable by anybody locally in an IDE.","type":"text"},{"type":"hardBreak"},{"text":"Due to that, it's sometimes required to make use of mock frameworks to replace the code that can't be triggered because it does require unreachable components","type":"text"},{"type":"hardBreak"},{"text":"The mocking","type":"text"},{"text":" SHOULD NEVER","type":"text","marks":[{"type":"strong"}]},{"text":" consume the developer's bandwidth, that means mocking the code should be straight-forward. ","type":"text"},{"type":"hardBreak"},{"text":"Don't waste your time into a complicated implementation, for that there is a second test phase called \"integration tests\"","type":"text"},{"type":"hardBreak"},{"type":"hardBreak"},{"text":"Also ","type":"text"},{"text":"DO NOT","type":"text","marks":[{"type":"strong"}]},{"text":" add \"isTest\" flag in your code to replace the mock, this is a common test anti pattern that leads to useless tests.","type":"text"},{"type":"hardBreak"},{"type":"hardBreak"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Integration tests","type":"text","marks":[{"type":"strong"}]},{"type":"hardBreak"},{"text":"It tests the code within the \"container framework\" and can make use of 3rd party components, like databases.","type":"text"},{"type":"hardBreak"},{"text":"The 3rd party components could be emulated, or even better, could be physically mounted locally, with the help of a docker engine for instance.","type":"text"},{"type":"hardBreak"},{"text":"The life-cycle of the those 3rd party components can be initiated/shut-downed by the build itself in a \"Pre-integration/Post-integration\" phase.","type":"text"},{"type":"hardBreak"},{"type":"hardBreak"}]}]}]},{"type":"paragraph","content":[{"text":"Here are some tips to setup that coverage per packager and per language","type":"text"}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"For Maven","type":"text"}]},{"type":"paragraph","content":[{"text":"When using MAVEN, at least one pom.xml must be defined, the project contains normally a central pom.xml that is used to build the entire project (it can contain multiple maven sub-modules)","type":"text"}]},{"type":"paragraph","content":[{"text":"In this pom.xml, the sonar plugin must be defined, the command ","type":"text"},{"text":"mvn sonar:sonar","type":"text","marks":[{"type":"em"}]},{"text":" will then execute the scan","type":"text"}]},{"type":"codeBlock","attrs":{"language":"xml"},"content":[{"text":"\n\torg.sonarsource.scanner.maven\n\tsonar-maven-plugin\n \tx.x\n","type":"text"}]},{"type":"paragraph","content":[{"text":"There is also a need to setup some properties for SONAR in order to indicate how the scans should be done, this include the coverage data files that must be used","type":"text"}]},{"type":"codeBlock","attrs":{"language":"xml"},"content":[{"text":"\n....\n jacoco\n \n ${project.reporting.outputDirectory}/jacoco-ut/jacoco.xml\n\n....\n","type":"text"}]},{"type":"paragraph","marks":[{"type":"indentation","attrs":{"level":1}}],"content":[{"type":"hardBreak"}]},{"type":"paragraph","content":[{"text":"Note that if you import the org.onap.oparent.oparent those settings are already included, so there is no need to add them unless you want to override those settings","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Java","type":"text","marks":[{"type":"em"},{"type":"strong"}]}]},{"type":"paragraph","content":[{"text":"For java there are different plugins/properties that must be included in the pom.xml to execute the tests and record the coverage during the execution","type":"text"}]},{"type":"paragraph","content":[{"text":"Maven Properties","type":"text","marks":[{"type":"strong"}]}]},{"type":"codeBlock","attrs":{"language":"xml"},"content":[{"text":"\n...\n jacoco\n ${project.build.directory}/surefire-reports\n ${project.reporting.outputDirectory}/jacoco-ut/jacoco.xml\n ${project.version}\n \n java\n src/main/resources/**\n...\n","type":"text"}]},{"type":"paragraph","content":[{"text":"Surefire (Unit tests)","type":"text","marks":[{"type":"strong"}]}]},{"type":"paragraph","content":[{"text":"This one is used to execute the unit tests, various config are available depending of the project need (","type":"text"},{"text":"https://maven.apache.org/surefire/maven-surefire-plugin/index.html","type":"text","marks":[{"type":"link","attrs":{"href":"https://maven.apache.org/surefire/maven-surefire-plugin/index.html"}}]},{"text":")","type":"text"}]},{"type":"codeBlock","attrs":{"language":"xml"},"content":[{"text":"\n\torg.apache.maven.plugins\n\tmaven-surefire-plugin\n\tX.XX.X\n\t\n\t\t1\n\t\ttrue\n\t\tfalse\n\t\n","type":"text"}]},{"type":"paragraph","content":[{"text":"Failsafe (Integration tests)","type":"text","marks":[{"type":"strong"}]}]},{"type":"paragraph","content":[{"text":"This one is used to execute the integration tests, various config are available depending of the project need (","type":"text"},{"text":"https://maven.apache.org/surefire/maven-failsafe-plugin/index.html","type":"text","marks":[{"type":"link","attrs":{"href":"https://maven.apache.org/surefire/maven-failsafe-plugin/index.html"}}]},{"text":")","type":"text"}]},{"type":"codeBlock","attrs":{"language":"xml"},"content":[{"text":"\n org.apache.maven.plugins\n maven-failsafe-plugin\n X.XX.X\n \n \n integration-tests\n \n integration-test\n verify\n \n \n \n ${project.build.directory}/classes\n \n \n **/*ItCase.java\n \n 1\n false\n false\n \n \n \n","type":"text"}]},{"type":"paragraph","content":[{"text":"Jacoco","type":"text","marks":[{"type":"strong"}]}]},{"type":"paragraph","content":[{"text":"This one is used to record the coverage of the unit tests and integration tests, also a result merge for the developer IDE (","type":"text"},{"text":"https://www.eclemma.org/jacoco/trunk/doc/maven.html","type":"text","marks":[{"type":"link","attrs":{"href":"https://www.eclemma.org/jacoco/trunk/doc/maven.html"}}]},{"text":")","type":"text"}]},{"type":"codeBlock","attrs":{"language":"xml"},"content":[{"text":"\n org.jacoco\n jacoco-maven-plugin\n 0.8.2\n \n true\n \n org.onap.*\n \n surefireArgLine\n \n \n \n pre-unit-test\n \n prepare-agent\n \n \n ${project.build.directory}/coverage-reports/jacoco.exec\n \n \n \n \n pre-integration-test\n pre-integration-test\n \n prepare-agent\n \n \n ${project.build.directory}/coverage-reports/jacoco-it.exec\n \n \n \n \n \n merge\n \n post-integration-test\n \n \n \n ${project.build.directory}/coverage-reports\n \n *.exec\n \n \n \n ${project.build.directory}/jacoco-dev.exec\n \n \n \n","type":"text"}]},{"type":"paragraph","content":[{"text":"Note that for the integration tests, it could more complex than the following Jacoco plugin usage.","type":"text"}]},{"type":"paragraph","content":[{"text":"If it's a remote server or anything else the jacoco agent must be provided to the running JVM to do the coverage recording (","type":"text"},{"text":"https://www.eclemma.org/jacoco/trunk/doc/agent.html","type":"text","marks":[{"type":"link","attrs":{"href":"https://www.eclemma.org/jacoco/trunk/doc/agent.html"}}]},{"text":"), then brought back to build folder.","type":"text"}]},{"type":"paragraph","content":[{"text":"Docker Plugin (Integration tests)","type":"text","marks":[{"type":"strong"}]}]},{"type":"paragraph","content":[{"text":"This plugin can be used to start containers before doing the integration tests. The following example starts Mariadb and Python before the integration tests phase.","type":"text"}]},{"type":"codeBlock","attrs":{"language":"xml"},"content":[{"text":"\n io.fabric8\n docker-maven-plugin\n 0.26.0\n \n true\n 1.23\n \n \n library/mariadb:10.1.11\n mariadb\n \n \n secret\n \n mariadb\n \n \n ${project.basedir}/extra/sql/:/docker-entrypoint-initdb.d\n ${project.basedir}/extra/docker/mariadb/conf1:/etc/mysql/conf.d\n \n \n \n socket: '/var/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution\n 600000\n \n \n ${docker.mariadb.port.host}:3306\n \n \n \n \n library/python:2-slim\n python\n \n python\n \n \n ${project.basedir}/src/test/resources/http-cache/:/usr/src/http-cache-app\n ${project.basedir}/src/test/resources/http-cache/example/:/usr/src/http-cache-app/data-cache\n \n \n \n \n \n 8080\n \n direct\n \n 120000\n \n \n ${docker.http-cache.port.host}:8080\n \n /usr/src/http-cache-app\n \n ./start_http_cache.sh ${python.http.proxy.param} --python_proxyaddress=localhost:${docker.http-cache.port.host}\n \n \n \n \n \n \n docker-start-for-it\n pre-integration-test\n \n start\n \n \n \n docker-stop-for-it\n post-integration-test\n \n stop\n \n \n \n","type":"text"}]},{"type":"paragraph","content":[{"type":"hardBreak"}]}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Javascript","type":"text","marks":[{"type":"em"},{"type":"strong"}]}]},{"type":"paragraph","content":[{"text":"For the javascript testing, the goal is to use JEST framework to execute the unit testing and record the coverage (Mocking is also possible with JEST)","type":"text"}]},{"type":"paragraph","content":[{"text":"The setup is based on NPM, so it uses a maven plugin that handles that (similar idea to docker-maven-plugin in the Integration testing)","type":"text"}]},{"type":"paragraph","content":[{"text":"Beforehand the Javascript code must be copied to the target folder, plus the package.json file that will be used by NPM","type":"text"}]}]}]},{"type":"paragraph","content":[{"type":"hardBreak"}]},{"type":"paragraph","content":[{"text":" ","type":"text"},{"text":" NOTE :","type":"text","marks":[{"type":"strong"}]},{"text":" For SonarCloud Users or SonarQube 7.8+, there is a need to have the node.js executable available on the build node, the frontend-maven-plugin below does install it as part of the build","type":"text"}]},{"type":"codeBlock","attrs":{"language":"xml"},"content":[{"text":" \n \n \n src/test/javascript\n \n **/**.json\n \n true\n ${project.build.directory}/my-ui\n \n \n src/main/resources/META-INF/resources/designer\n false\n ${project.build.directory}/my-ui/designer\n \n ","type":"text"}]},{"type":"paragraph","content":[{"type":"hardBreak"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"Maven properties","type":"text"}]},{"type":"paragraph","content":[{"text":"By default do not specify any language to SONAR so that it can scan all languages used in the project","type":"text"}]},{"type":"codeBlock","attrs":{"language":"xml"},"content":[{"text":" ${project.build.directory}/my-ui/coverage/lcov.info\n ${project.version}\n src/main,${project.build.directory}/my-ui/designer\n\t\t\n\t\t src/main/resources/**,**/my-ui/designer/lib/*\n\t\t\n\t\t${project.build.directory}/my-ui/node/node\n\n","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"type":"hardBreak"},{"text":"frontend-maven-plugin","type":"text"}]},{"type":"paragraph","content":[{"text":"This one is used to setup the required libraries and environment to execute the test under JEST framework ((","type":"text"},{"text":"https://github.com/eirslett/frontend-maven-plugin","type":"text","marks":[{"type":"link","attrs":{"href":"https://github.com/eirslett/frontend-maven-plugin"}}]},{"text":")","type":"text"}]},{"type":"codeBlock","attrs":{"language":"xml"},"content":[{"text":" \n com.github.eirslett\n frontend-maven-plugin\n 1.6\n \n ${project.build.directory}/my-ui\n ${project.build.directory}/my-ui\n ${maven.test.skip}\n \n\n \n \n install_node_and_npm\n \n install-node-and-npm\n \n test\n \n v8.11.1\n 5.6.0\n \n \n \n npm_install\n \n npm\n \n test\n \n install\n \n \n \n npm_test\n \n npm\n \n test\n \n run-script test:coverage\n \n \n\n \n ","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"Package.json","type":"text"}]},{"type":"paragraph","content":[{"text":"This file must be stored in your project and will be used by the Npm maven plugin to setup the javascript environment.","type":"text"}]},{"type":"paragraph","content":[{"text":"Here is an example to setup an angular environment, others libraries can be setup depending of the need","type":"text"}]},{"type":"codeBlock","attrs":{"language":"xml"},"content":[{"text":"{\n \"scripts\": {\n \"test\": \"jest\",\n \"test:watch\": \"jest --watch\",\n \"test:coverage\": \"jest --coverage\"\n },\n \"jest\": {\n \"verbose\": true,\n \"coverageDirectory\": \"${project.build.directory}/my-ui/coverage\",\n \"collectCoverageFrom\": [\n \"**/designer/**/*.{js,jsx}\",\n \"!**/designer/lib/**\"\n ],\n \"rootDir\": \"${project.build.directory}/my-ui\",\n \"roots\": [\n \"${project.basedir}/src/test/javascript/\",\n \"/designer/\"\n ],\n \"moduleDirectories\": [\n \"${project.build.directory}/my-ui/node/node_modules\",\n \"${project.build.directory}/my-ui/node_modules\",\n \"/designer\"\n ],\n \"coverageReporters\": [\n \"lcov\"\n ]\n },\n \"devDependencies\": {\n \"angular\": \"1.3.2\",\n \"angular-resource\": \"1.3.2\",\n \"angular-cookies\": \"1.3.2\",\n \"angular-route\": \"1.3.2\",\n \"angular-mocks\": \"1.3.2\",\n \"angular-animate\": \"1.3.2\",\n \"angular-sanitize\": \"1.3.2\",\n \"angular-touch\": \"1.3.2\",\n \"angular-dialog-service\": \"5.3.0\",\n \"angular-loading-bar\": \"0.9.0\",\n \"jquery\": \"3.3.1\",\n \"popper.js\": \"1.14.4\",\n \"bootstrap\": \"4.1.1\",\n \"angular-ui-bootstrap\": \"2.5.6\",\n \"jest\": \"^23.6.0\",\n \"jest-cli\": \"^21.2.1\"\n }\n}\n\n\n","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"Javascript test Example","type":"text"}]},{"type":"paragraph","content":[{"text":"Here is a short example of an angular controller test","type":"text"}]},{"type":"codeBlock","attrs":{"language":"javascript"},"content":[{"text":"require('jquery/dist/jquery.min.js');\nrequire('angular/angular.min.js');\nrequire('angular-mocks/angular-mocks.js');\nrequire('angular-route/angular-route.min.js');\nrequire('angular-resource/angular-resource.min.js');\nrequire('angular-cookies/angular-cookies.min.js');\nrequire('angular-animate/angular-animate.min.js');\nrequire('angular-sanitize/angular-sanitize.min.js');\nrequire('angular-touch/angular-touch.min.js');\nrequire('popper.js/dist/umd/popper.min.js');\nrequire('bootstrap/dist/js/bootstrap.min.js');\nrequire('angular-ui-bootstrap/dist/ui-bootstrap-tpls.js');\nrequire('angular-loading-bar/src/loading-bar.js');\nrequire('angular-dialog-service/dist/dialogs.js');\nrequire('scripts/app.js');\nrequire('scripts/DashboardCtrl.js');\n\n\ndescribe('Dashboard ctrl tests', function() {\n\n beforeEach(angular.mock.module('clds-app'));\n\n var $controllerService;\n\n beforeEach(angular.mock.inject(function(_$controller_) {\n $controllerService = _$controller_;\n }));\n\n describe('$scope.showPalette', function() {\n\n it('test showPalette', function() {\n\n var $scopeTest = {};\n var $rootScopeTest = {};\n var $resourceTest = {};\n var $httpTest = {};\n var $timeoutTest = {};\n var $locationTest = {};\n var $intervalTest = function(){};\n var $controllerDashboard = $controllerService('DashboardCtrl', {\n '$scope' : $scopeTest,\n '$rootScope' : $rootScopeTest,\n '$resource' : $resourceTest,\n '$http' : $httpTest,\n '$timeout' : $timeoutTest,\n '$location' : $locationTest,\n '$interval' : $intervalTest\n });\n $scopeTest.showPalette();\n expect($rootScopeTest.isModel).toEqual(true);\n });\n });\n});","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"Concrete example","type":"text"}]},{"type":"paragraph","content":[{"text":"For more information, here are some examples of javascript coverage integration :","type":"text"}]},{"type":"paragraph","content":[{"text":"CLAMP:","type":"text"}]},{"type":"paragraph","content":[{"text":"https://gerrit.onap.org/r/#/c/70581/1","type":"text","marks":[{"type":"link","attrs":{"href":"https://gerrit.onap.org/r/#/c/70581/1"}}]},{"type":"hardBreak"},{"type":"hardBreak"},{"text":"(add your project Review here)","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Python","type":"text"}]},{"type":"paragraph","content":[{"text":"Your ","type":"text"},{"text":"pom.xml","type":"text","marks":[{"type":"code"}]},{"text":" file needs to specify several sonar properties. In particular, the ","type":"text"},{"text":"","type":"text","marks":[{"type":"code"}]},{"text":" variable specifies the location of the ","type":"text"},{"text":"coverage.xml","type":"text","marks":[{"type":"code"}]},{"text":" file that is generated by ","type":"text"},{"text":"tox","type":"text","marks":[{"type":"code"}]},{"text":". (Previous versions of sonar used the singular form of this variable; make certain that it has an \"s\" at the end of its name.)","type":"text"}]},{"type":"codeBlock","attrs":{"language":"xml"},"content":[{"text":" \n UTF-8\n .\n xunit-results.xml\n coverage.xml\n py\n python\n **/**.py\n tests/*,setup.py\n ","type":"text"}]},{"type":"paragraph","content":[{"text":"Your ","type":"text"},{"text":"tox.ini","type":"text","marks":[{"type":"code"}]},{"text":" file should list both ","type":"text"},{"text":"py36","type":"text","marks":[{"type":"code"}]},{"text":" and ","type":"text"},{"text":"py37","type":"text","marks":[{"type":"code"}]},{"text":". Because some of our build environments might be missing one of these python versions, you may also set the ","type":"text"},{"text":"skip_missing_interpreters","type":"text","marks":[{"type":"code"}]},{"text":" variable to ","type":"text"},{"text":"true","type":"text","marks":[{"type":"code"}]},{"text":".","type":"text"}]},{"type":"codeBlock","attrs":{"language":"plaintext"},"content":[{"text":"[tox]\nenvlist = py36,py37\nskip_missing_interpreters = true","type":"text"}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"For Gradle","type":"text"}]},{"type":"paragraph","content":[{"text":"Section TDB","type":"text"}]}],"version":1}

Browser not supported