2020-12-09 23:15:59,289 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | k8-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 061QPFMQKBNT | | NODE_NAME | lf-virtual1-3 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest- | | | kubernetes/061QPFMQKBNT/functest-kubernetes-opnfv- | | | functest-kubernetes-cnf-jerma-cnf_conformance- | | | run-16 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest- | | | kubernetes/061QPFMQKBNT/functest-kubernetes-opnfv- | | | functest-kubernetes-cnf-jerma-cnf_conformance- | | | run-16 | +-------------------------+------------------------------------------------------------+ 2020-12-09 23:15:59,293 - xtesting.ci.run_tests - DEBUG - No env file /var/lib/xtesting/conf/env_file found 2020-12-09 23:15:59,293 - xtesting.ci.run_tests - DEBUG - Test args: cnf_conformance 2020-12-09 23:15:59,302 - xtesting.ci.run_tests - INFO - Loading test case 'cnf_conformance'... 2020-12-09 23:15:59,327 - xtesting.ci.run_tests - INFO - Running test case 'cnf_conformance'... 2020-12-09 23:16:02,195 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance setup Successfully created directories for cnf-conformance Global helm found. Version: v3.3.1 Local helm found. Version: v3.3.1 Global wget found. Version: 1.20.3 No Local wget version found Global curl found. Version: 7.66.0 No Local curl version found Global kubectl found. Version: 1.17+ No Local kubectl version found Global git found. Version: 2.22.4 No Local git version found All prerequisites found. % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 658 100 658 0 0 2674 0 --:--:-- --:--:-- --:--:-- 2674 2 9.8M 2 202k 0 0 215k 0 0:00:46 --:--:-- 0:00:46 215k 100 9.8M 100 9.8M 0 0 6956k 0 0:00:01 0:00:01 --:--:-- 19.0M Setup complete 2020-12-09 23:16:52,428 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance cnf_setup cnf-config=cnf-conformance.yml Successfully created directories for cnf-conformance 2020-12-09 23:30:29,110 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance workload βœ”οΈ PASSED: hostPath volumes not found πŸ–₯️ πŸ’Ύ Statelessness final score: 5 of 5 βœ”οΈ PASSED: No privileged containers πŸ”“πŸ”‘ Security final score: 5 of 5 βœ”οΈ PASSED: Replicas increased to 3 πŸ“¦πŸ“ˆ βœ”οΈ PASSED: Replicas decreased to 1 πŸ“¦πŸ“‰ Scalability final score: 20 of 25 βœ”οΈ PASSED: No IP addresses found βœ”οΈ PASSED: Helm liveness probe found 🧫 βœ”οΈ PASSED: Helm readiness probe found βœ”οΈ PASSED: CNF coredns-coredns Rolling Update Passed βœ”οΈ PASSED: NodePort is not used install.go:172: [debug] Original chart version: "" install.go:189: [debug] CHART PATH: /root/.cache/helm/repository/coredns-1.13.8.tgz βœ”οΈ PASSED: No hard-coded IP addresses found in the runtime K8s configuration Configuration Lifecycle final score: 25 of 25 βœ”οΈ PASSED (by default): No install script provided Successfully created directories for cnf-conformance βœ”οΈ PASSED: Helm Chart cnfs/coredns/helm_chart/coredns Lint Passed βœ”οΈ PASSED: Published Helm Chart Found βœ”οΈ PASSED: Helm deploy successful Installability final score: 20 of 20 βœ”οΈ PASSED: Image size is good 🐜 βš–οΈπŸ‘€ Error from server (AlreadyExists): namespaces "startup-test" already exists Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply βœ”οΈ PASSED: CNF had a reasonable startup time πŸš€ Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply Microservice final score: 10 of 10 Error from server (AlreadyExists): error when creating "https://raw.githubusercontent.com/chaos-mesh/chaos-mesh/v0.8.0/manifests/crd.yaml": customresourcedefinitions.apiextensions.k8s.io "iochaos.pingcap.com" already exists Error from server (AlreadyExists): error when creating "https://raw.githubusercontent.com/chaos-mesh/chaos-mesh/v0.8.0/manifests/crd.yaml": customresourcedefinitions.apiextensions.k8s.io "kernelchaos.pingcap.com" already exists Error from server (AlreadyExists): error when creating "https://raw.githubusercontent.com/chaos-mesh/chaos-mesh/v0.8.0/manifests/crd.yaml": customresourcedefinitions.apiextensions.k8s.io "networkchaos.pingcap.com" already exists Error from server (AlreadyExists): error when creating "https://raw.githubusercontent.com/chaos-mesh/chaos-mesh/v0.8.0/manifests/crd.yaml": customresourcedefinitions.apiextensions.k8s.io "podchaos.pingcap.com" already exists Error from server (AlreadyExists): error when creating "https://raw.githubusercontent.com/chaos-mesh/chaos-mesh/v0.8.0/manifests/crd.yaml": customresourcedefinitions.apiextensions.k8s.io "stresschaos.pingcap.com" already exists Error from server (AlreadyExists): error when creating "https://raw.githubusercontent.com/chaos-mesh/chaos-mesh/v0.8.0/manifests/crd.yaml": customresourcedefinitions.apiextensions.k8s.io "timechaos.pingcap.com" already exists Cloning into '/var/lib/xtesting/results/cnf_conformance/tools/chaos_mesh'... Note: checking out 'tags/v0.8.0'. You are in 'detached HEAD' state. You can look around, make experimental changes and commit them, and you can discard any commits you make in this state without impacting any branches by performing another checkout. If you want to create a new branch to retain commits you create, you may do so (now or later) by using -b with the checkout command again. Example: git checkout -b HEAD is now at 0d10282 Add a new `StressChaos` to generate plenty of stresses (#332) (#454) Error: cannot re-use a name that is still in use error: the path "/var/lib/xtesting/results/cnf_conformance/spec/fixtures/chaos_network_loss.yml" does not exist error: the path "/var/lib/xtesting/results/cnf_conformance/spec/fixtures/chaos_cpu_hog.yml" does not exist error: the path "/var/lib/xtesting/results/cnf_conformance/spec/fixtures/chaos_container_kill.yml" does not exist βœ”οΈ PASSED: Replicas available match desired count after network chaos test πŸ“Άβ˜ οΈ βœ”οΈ PASSED: Application pod is healthy after high CPU consumption πŸ“¦πŸ’»πŸ·πŸ“ˆ βœ”οΈ PASSED: Replicas available match desired count after container kill test πŸ—‘οΈπŸ’€β™»οΈ Resilience final score: 15 of 20 Final workload score: 100 of 105 Results have been saved to results/cnf-conformance-results-20201209-231652-434.yml 2020-12-09 23:30:29,134 - functest_kubernetes.cnf_conformance.conformance - INFO - +-------------------------------------------------------------+----------------+ | NAME | STATUS | +-------------------------------------------------------------+----------------+ | volume_hostpath_not_found | passed | | privileged | passed | | increase_capacity | passed | | decrease_capacity | passed | | ip_addresses | passed | | liveness | passed | | readiness | passed | | rolling_update | passed | | nodeport_not_used | passed | | hardcoded_ip_addresses_in_k8s_runtime_configuration | passed | | install_script_helm | passed | | helm_chart_valid | passed | | helm_chart_published | passed | | helm_deploy | passed | | reasonable_image_size | passed | | reasonable_startup_time | passed | | chaos_network_loss | passed | | chaos_cpu_hog | passed | | chaos_container_kill | passed | +-------------------------------------------------------------+----------------+ 2020-12-09 23:30:29,135 - xtesting.ci.run_tests - INFO - Test result: +-------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------------+------------------+------------------+----------------+ | cnf_conformance | functest | 14:29 | PASS | +-------------------------+------------------+------------------+----------------+ 2020-12-09 23:30:33,073 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance cnf_cleanup cnf-config=cnf-conformance.yml Successfully cleaned up coredns 2020-12-09 23:30:33,398 - xtesting.core.testcase - DEBUG - Publishing /var/lib/xtesting/results/functest-kubernetes.log ('text/plain', None) 2020-12-09 23:30:33,559 - xtesting.core.testcase - DEBUG - Publishing /var/lib/xtesting/results/functest-kubernetes.debug.log ('text/plain', None)