2021-02-03 01:40:35,093 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | k8-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 0UZU36BQ9UUY | | NODE_NAME | lf-virtual1-5 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest- | | | kubernetes/0UZU36BQ9UUY/functest-kubernetes-opnfv- | | | functest-kubernetes-cnf-leguer-cnf_conformance- | | | run-26 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest- | | | kubernetes/0UZU36BQ9UUY/functest-kubernetes-opnfv- | | | functest-kubernetes-cnf-leguer-cnf_conformance- | | | run-26 | +-------------------------+------------------------------------------------------------+ 2021-02-03 01:40:35,109 - xtesting.ci.run_tests - INFO - Loading test case 'cnf_conformance'... 2021-02-03 01:40:35,237 - xtesting.ci.run_tests - INFO - Running test case 'cnf_conformance'... 2021-02-03 01:40:37,769 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance setup Successfully created directories for cnf-conformance Global helm found. Version: v3.3.1 Local helm found. Version: v3.3.1 Global wget found. Version: 1.20.3 No Local wget version found Global curl found. Version: 7.69.1 No Local curl version found Global kubectl found. Version: 1.20 No Local kubectl version found Global git found. Version: 2.26.2 No Local git version found All prerequisites found. % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 640 100 640 0 0 2379 0 --:--:-- --:--:-- --:--:-- 2388 60 9.8M 60 6125k 0 0 7571k 0 0:00:01 --:--:-- 0:00:01 7571k 100 9.8M 100 9.8M 0 0 9.8M 0 0:00:01 0:00:01 --:--:-- 19.9M Setup complete 2021-02-03 01:41:21,369 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance cnf_setup cnf-config=cnf-conformance.yml Successfully created directories for cnf-conformance 2021-02-03 01:45:44,839 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance workload ✔️ PASSED: hostPath volumes not found 🖥️ 💾 Statelessness final score: 5 of 10 ✔️ PASSED: No privileged containers 🔓🔑 Security final score: 5 of 5 ✔️ PASSED: Replicas increased to 3 📦📈 ✔️ PASSED: Replicas decreased to 1 📦📉 Scalability final score: 20 of 25 ✔️ PASSED: No IP addresses found ✔️ PASSED: Helm liveness probe found 🧫 ✔️ PASSED: Helm readiness probe found ✔️ PASSED: NodePort is not used install.go:172: [debug] Original chart version: "" install.go:189: [debug] CHART PATH: /root/.cache/helm/repository/coredns-1.13.8.tgz ✔️ PASSED: No hard-coded IP addresses found in the runtime K8s configuration ✔️ PASSED: CNF coredns-coredns Rollback Passed ✔️ PASSED: CNF coredns-coredns Rolling Update Passed ✔️ PASSED: CNF coredns-coredns Rolling Downgrade Passed ✔️ PASSED: CNF coredns-coredns Rolling Version Change Passed Configuration Lifecycle final score: 40 of 40 ✔️ PASSED (by default): No install script provided Successfully created directories for cnf-conformance ✔️ PASSED: Helm Chart cnfs/coredns/helm_chart/coredns Lint Passed ✔️ PASSED: Published Helm Chart Found ✔️ PASSED: Helm deploy successful Installability final score: 20 of 20 ✔️ PASSED: Image size is good 🐜 ⚖️👀 Warning: resource clusterroles/coredns-coredns is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. Warning: resource clusterrolebindings/coredns-coredns is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. ✔️ PASSED: CNF had a reasonable startup time 🚀 Warning: resource configmaps/coredns-coredns is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. Warning: resource services/coredns-coredns is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. Warning: resource deployments/coredns-coredns is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. Microservice final score: 10 of 10 Warning: apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition Error from server (AlreadyExists): error when creating "https://raw.githubusercontent.com/chaos-mesh/chaos-mesh/v0.8.0/manifests/crd.yaml": customresourcedefinitions.apiextensions.k8s.io "iochaos.pingcap.com" already exists Error from server (AlreadyExists): error when creating "https://raw.githubusercontent.com/chaos-mesh/chaos-mesh/v0.8.0/manifests/crd.yaml": customresourcedefinitions.apiextensions.k8s.io "kernelchaos.pingcap.com" already exists Error from server (AlreadyExists): error when creating "https://raw.githubusercontent.com/chaos-mesh/chaos-mesh/v0.8.0/manifests/crd.yaml": customresourcedefinitions.apiextensions.k8s.io "networkchaos.pingcap.com" already exists Error from server (AlreadyExists): error when creating "https://raw.githubusercontent.com/chaos-mesh/chaos-mesh/v0.8.0/manifests/crd.yaml": customresourcedefinitions.apiextensions.k8s.io "podchaos.pingcap.com" already exists Error from server (AlreadyExists): error when creating "https://raw.githubusercontent.com/chaos-mesh/chaos-mesh/v0.8.0/manifests/crd.yaml": customresourcedefinitions.apiextensions.k8s.io "stresschaos.pingcap.com" already exists Error from server (AlreadyExists): error when creating "https://raw.githubusercontent.com/chaos-mesh/chaos-mesh/v0.8.0/manifests/crd.yaml": customresourcedefinitions.apiextensions.k8s.io "timechaos.pingcap.com" already exists Cloning into '/var/lib/xtesting/results/cnf_conformance/tools/chaos_mesh'... Note: switching to 'tags/v0.8.0'. You are in 'detached HEAD' state. You can look around, make experimental changes and commit them, and you can discard any commits you make in this state without impacting any branches by switching back to a branch. If you want to create a new branch to retain commits you create, you may do so (now or later) by using -c with the switch command. Example: git switch -c Or undo this operation with: git switch - Turn off this advice by setting config variable advice.detachedHead to false HEAD is now at 0d10282 Add a new `StressChaos` to generate plenty of stresses (#332) (#454) Error: cannot re-use a name that is still in use ✔️ PASSED: Replicas available match desired count after network chaos test 📶☠️ ✔️ PASSED: Application pod is healthy after high CPU consumption 📦💻🐷📈 ✔️ PASSED: Replicas available match desired count after container kill test 🗡️💀♻️ Resilience final score: 15 of 20 Final workload score: 115 of 125 Results have been saved to results/cnf-conformance-results-20210203-014121-375.yml 2021-02-03 01:45:44,867 - functest_kubernetes.cnf_conformance.conformance - INFO - +-------------------------------------------------------------+----------------+ | NAME | STATUS | +-------------------------------------------------------------+----------------+ | volume_hostpath_not_found | passed | | privileged | passed | | increase_capacity | passed | | decrease_capacity | passed | | ip_addresses | passed | | liveness | passed | | readiness | passed | | nodeport_not_used | passed | | hardcoded_ip_addresses_in_k8s_runtime_configuration | passed | | rollback | passed | | rolling_update | passed | | rolling_downgrade | passed | | rolling_version_change | passed | | install_script_helm | passed | | helm_chart_valid | passed | | helm_chart_published | passed | | helm_deploy | passed | | reasonable_image_size | passed | | reasonable_startup_time | passed | | chaos_network_loss | passed | | chaos_cpu_hog | passed | | chaos_container_kill | passed | +-------------------------------------------------------------+----------------+ 2021-02-03 01:45:44,867 - xtesting.ci.run_tests - INFO - Test result: +-------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------------+------------------+------------------+----------------+ | cnf_conformance | functest | 05:09 | PASS | +-------------------------+------------------+------------------+----------------+ 2021-02-03 01:45:50,087 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance cnf_cleanup cnf-config=cnf-conformance.yml Successfully cleaned up coredns