2021-06-03 14:05:00,144 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | false | | DEPLOY_SCENARIO | k8-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 1CZWD42LT2KJ | | NODE_NAME | lf-virtual1-6 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest- | | | kubernetes/1CZWD42LT2KJ/functest-kubernetes-opnfv- | | | functest-kubernetes-cnf-v1.21-cnf_testsuite-run-7 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest- | | | kubernetes/1CZWD42LT2KJ/functest-kubernetes-opnfv- | | | functest-kubernetes-cnf-v1.21-cnf_testsuite-run-7 | +-------------------------+------------------------------------------------------------+ 2021-06-03 14:05:00,159 - xtesting.ci.run_tests - INFO - Loading test case 'cnf_testsuite'... 2021-06-03 14:05:00,222 - xtesting.ci.run_tests - INFO - Running test case 'cnf_testsuite'... 2021-06-03 14:05:02,023 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-testsuite setup Successfully created directories for cnf-testsuite Global helm found. Version: v3.3.1 Local helm found. Version: v3.3.1 Global kubectl found. Version: 1.21 No Local kubectl version found Global git found. Version: 2.30.2 No Local git version found All prerequisites found. Setup complete 2021-06-03 14:05:25,459 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-testsuite cnf_setup cnf-config=cnf-testsuite.yml Successfully created directories for cnf-testsuite Successfully setup coredns 2021-06-03 14:11:58,727 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-testsuite workload ✔️ PASSED: hostPath volumes not found 🖥️ 💾 Statelessness final score: 5 of 10  ✔️ PASSED: No privileged containers 🔓🔑 Security final score: 5 of 5  ✔️ PASSED: Replicas increased to 3 📦📈 ✔️ PASSED: Replicas decreased to 1 📦📉 Scalability final score: 20 of 35  ✔️ PASSED: No IP addresses found ✔️ PASSED: Helm liveness probe found ⎈🧫 ✔️ PASSED: Helm readiness probe found ⎈🧫 ✔️ PASSED: NodePort is not used ✔️ PASSED: No hard-coded IP addresses found in the runtime K8s configuration ✔️ PASSED: CNF Rollback Passed No Secret Volumes or Container secretKeyRefs found for resource: {kind: "Deployment", name: "coredns-coredns"} ⏭ SKIPPED: Secrets not used 🧫 To address this issue please see the USAGE.md documentation  ✖️ FAILED: Found mutable configmap(s) ⚖️ ✔️ PASSED: CNF for Rolling Update Passed ✔️ PASSED: CNF for Rolling Downgrade Passed ✔️ PASSED: CNF for Rolling Version Change Passed Configuration Lifecycle final score: 40 of 46  ✔️ PASSED (by default): No install script provided Successfully created directories for cnf-testsuite ✔️ PASSED: Helm Chart exported_chart Lint Passed ⎈📝☑️ ✖️ FAILED: Published Helm Chart Not Found ⎈📦🌐 SKIPPED: Helm Deploy Installability final score: 9 of 20  ✔️ PASSED: Image size is good 🐜 ⚖️👀 ✔️ PASSED: CNF had a reasonable startup time 🚀 Microservice final score: 10 of 10  ✔️ PASSED: pod_network_latency chaos test passed 🗡️💀♻️ ✔️ PASSED: Application pod is healthy after high CPU consumption 📦💻🐷📈 ✔️ PASSED: Replicas available match desired count after container kill test 🗡️💀♻️ ✔️ PASSED: disk_fill chaos test passed 🗡️💀♻️ Resilience final score: 10 of 10  Final workload score: 109 of 136 CNFManager::Points::Results.have been saved to results/cnf-testsuite-results-20210603-140525-467.yml 2021-06-03 14:11:58,763 - functest_kubernetes.cnf_conformance.conformance - INFO - +-------------------------------------------------------------+-----------------+ | NAME | STATUS | +-------------------------------------------------------------+-----------------+ | volume_hostpath_not_found | passed | | privileged | passed | | increase_capacity | passed | | decrease_capacity | passed | | ip_addresses | passed | | liveness | passed | | readiness | passed | | nodeport_not_used | passed | | hardcoded_ip_addresses_in_k8s_runtime_configuration | passed | | rollback | passed | | secrets_used | skipped | | immutable_configmap | failed | | rolling_update | passed | | rolling_downgrade | passed | | rolling_version_change | passed | | install_script_helm | passed | | helm_chart_valid | passed | | helm_chart_published | failed | | reasonable_image_size | passed | | reasonable_startup_time | passed | | pod_network_latency | passed | | chaos_cpu_hog | passed | | chaos_container_kill | passed | | disk_fill | passed | +-------------------------------------------------------------+-----------------+ 2021-06-03 14:11:58,764 - xtesting.ci.run_tests - INFO - Test result: +-----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------+------------------+------------------+----------------+ | cnf_testsuite | functest | 06:58 | PASS | +-----------------------+------------------+------------------+----------------+ 2021-06-03 14:11:59,275 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-testsuite cnf_cleanup cnf-config=cnf-testsuite.yml Successfully cleaned up coredns