2020-10-22 21:21:07,471 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | k8-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 2JKTQ701XCQV | | NODE_NAME | lf-virtual1-2 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest- | | | kubernetes/2JKTQ701XCQV/functest-kubernetes-pi- | | | ollivier-functest-kubernetes-cnf-iruya- | | | cnf_conformance-run-8 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest- | | | kubernetes/2JKTQ701XCQV/functest-kubernetes-pi- | | | ollivier-functest-kubernetes-cnf-iruya- | | | cnf_conformance-run-8 | +-------------------------+----------------------------------------------------------+ 2020-10-22 21:21:07,486 - xtesting.ci.run_tests - INFO - Loading test case 'cnf_conformance'... 2020-10-22 21:21:07,505 - xtesting.ci.run_tests - INFO - Running test case 'cnf_conformance'... 2020-10-22 21:21:12,846 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance setup % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 658 100 658 0 0 2115 0 --:--:-- --:--:-- --:--:-- 2108 2 9281k 2 220k 0 0 199k 0 0:00:46 0:00:01 0:00:45 199k 100 9281k 100 9281k 0 0 5807k 0 0:00:01 0:00:01 --:--:-- 17.9M --2020-10-22 21:21:09-- https://get.helm.sh/helm-v3.1.1-linux-amd64.tar.gz Resolving get.helm.sh... 152.195.19.97, 2606:2800:11f:1cb7:261b:1f9c:2074:3c Connecting to get.helm.sh|152.195.19.97|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 12270615 (12M) [application/x-tar] Saving to: '/var/lib/xtesting/results/cnf_conformance/tools/helm/helm-v3.1.1-linux-amd64.tar.gz' 0K .......... .......... .......... .......... .......... 0% 2.59M 4s 50K .......... .......... .......... .......... .......... 0% 2.08M 5s 100K .......... .......... .......... .......... .......... 1% 40.6M 3s 150K .......... .......... .......... .......... .......... 1% 83.3M 3s 200K .......... .......... .......... .......... .......... 2% 2.42M 3s 250K .......... .......... .......... .......... .......... 2% 38.4M 3s 300K .......... .......... .......... .......... .......... 2% 33.6M 2s 350K .......... .......... .......... .......... .......... 3% 70.8M 2s 400K .......... .......... .......... .......... .......... 3% 2.37M 2s 450K .......... .......... .......... .......... .......... 4% 62.3M 2s 500K .......... .......... .......... .......... .......... 4% 58.4M 2s 550K .......... .......... .......... .......... .......... 5% 59.0M 2s 600K .......... .......... .......... .......... .......... 5% 54.6M 2s 650K .......... .......... .......... .......... .......... 5% 59.1M 1s 700K .......... .......... .......... .......... .......... 6% 61.6M 1s 750K .......... .......... .......... .......... .......... 6% 73.2M 1s 800K .......... .......... .......... .......... .......... 7% 2.51M 1s 850K .......... .......... .......... .......... .......... 7% 90.7M 1s 900K .......... .......... .......... .......... .......... 7% 84.1M 1s 950K .......... .......... .......... .......... .......... 8% 76.3M 1s 1000K .......... .......... .......... .......... .......... 8% 81.6M 1s 1050K .......... .......... .......... .......... .......... 9% 69.6M 1s 1100K .......... .......... .......... .......... .......... 9% 72.3M 1s 1150K .......... .......... .......... .......... .......... 10% 67.5M 1s 1200K .......... .......... .......... .......... .......... 10% 87.9M 1s 1250K .......... .......... .......... .......... .......... 10% 90.4M 1s 1300K .......... .......... .......... .......... .......... 11% 94.1M 1s 1350K .......... .......... .......... .......... .......... 11% 72.7M 1s 1400K .......... .......... .......... .......... .......... 12% 107M 1s 1450K .......... .......... .......... .......... .......... 12% 108M 1s 1500K .......... .......... .......... .......... .......... 12% 111M 1s 1550K .......... .......... .......... .......... .......... 13% 104M 1s 1600K .......... .......... .......... .......... .......... 13% 3.62M 1s 1650K .......... .......... .......... .......... .......... 14% 49.3M 1s 1700K .......... .......... .......... .......... .......... 14% 122M 1s 1750K .......... .......... .......... .......... .......... 15% 85.9M 1s 1800K .......... .......... .......... .......... .......... 15% 86.0M 1s 1850K .......... .......... .......... .......... .......... 15% 68.8M 1s 1900K .......... .......... .......... .......... .......... 16% 57.0M 1s 1950K .......... .......... .......... .......... .......... 16% 47.0M 1s 2000K .......... .......... .......... .......... .......... 17% 62.7M 1s 2050K .......... .......... .......... .......... .......... 17% 60.1M 1s 2100K .......... .......... .......... .......... .......... 17% 58.0M 1s 2150K .......... .......... .......... .......... .......... 18% 47.4M 1s 2200K .......... .......... .......... .......... .......... 18% 57.5M 1s 2250K .......... .......... .......... .......... .......... 19% 73.4M 1s 2300K .......... .......... .......... .......... .......... 19% 68.0M 1s 2350K .......... .......... .......... .......... .......... 20% 113M 1s 2400K .......... .......... .......... .......... .......... 20% 126M 1s 2450K .......... .......... .......... .......... .......... 20% 4.25M 1s 2500K .......... .......... .......... .......... .......... 21% 72.3M 1s 2550K .......... .......... .......... .......... .......... 21% 50.8M 1s 2600K .......... .......... .......... .......... .......... 22% 81.1M 1s 2650K .......... .......... .......... .......... .......... 22% 64.5M 1s 2700K .......... .......... .......... .......... .......... 22% 58.3M 1s 2750K .......... .......... .......... .......... .......... 23% 62.7M 1s 2800K .......... .......... .......... .......... .......... 23% 86.6M 1s 2850K .......... .......... .......... .......... .......... 24% 62.0M 1s 2900K .......... .......... .......... .......... .......... 24% 122M 1s 2950K .......... .......... .......... .......... .......... 25% 114M 0s 3000K .......... .......... .......... .......... .......... 25% 116M 0s 3050K .......... .......... .......... .......... .......... 25% 108M 0s 3100K .......... .......... .......... .......... .......... 26% 123M 0s 3150K .......... .......... .......... .......... .......... 26% 78.8M 0s 3200K .......... .......... .......... .......... .......... 27% 110M 0s 3250K .......... .......... .......... .......... .......... 27% 114M 0s 3300K .......... .......... .......... .......... .......... 27% 169M 0s 3350K .......... .......... .......... .......... .......... 28% 141M 0s 3400K .......... .......... .......... .......... .......... 28% 143M 0s 3450K .......... .......... .......... .......... .......... 29% 189M 0s 3500K .......... .......... .......... .......... .......... 29% 160M 0s 3550K .......... .......... .......... .......... .......... 30% 142M 0s 3600K .......... .......... .......... .......... .......... 30% 176M 0s 3650K .......... .......... .......... .......... .......... 30% 174M 0s 3700K .......... .......... .......... .......... .......... 31% 109M 0s 3750K .......... .......... .......... .......... .......... 31% 101M 0s 3800K .......... .......... .......... .......... .......... 32% 92.4M 0s 3850K .......... .......... .......... .......... .......... 32% 109M 0s 3900K .......... .......... .......... .......... .......... 32% 112M 0s 3950K .......... .......... .......... .......... .......... 33% 80.7M 0s 4000K .......... .......... .......... .......... .......... 33% 88.9M 0s 4050K .......... .......... .......... .......... .......... 34% 101M 0s 4100K .......... .......... .......... .......... .......... 34% 103M 0s 4150K .......... .......... .......... .......... .......... 35% 101M 0s 4200K .......... .......... .......... .......... .......... 35% 86.7M 0s 4250K .......... .......... .......... .......... .......... 35% 131M 0s 4300K .......... .......... .......... .......... .......... 36% 103M 0s 4350K .......... .......... .......... .......... .......... 36% 81.1M 0s 4400K .......... .......... .......... .......... .......... 37% 107M 0s 4450K .......... .......... .......... .......... .......... 37% 101M 0s 4500K .......... .......... .......... .......... .......... 37% 122M 0s 4550K .......... .......... .......... .......... .......... 38% 104M 0s 4600K .......... .......... .......... .......... .......... 38% 116M 0s 4650K .......... .......... .......... .......... .......... 39% 102M 0s 4700K .......... .......... .......... .......... .......... 39% 114M 0s 4750K .......... .......... .......... .......... .......... 40% 78.9M 0s 4800K .......... .......... .......... .......... .......... 40% 105M 0s 4850K .......... .......... .......... .......... .......... 40% 115M 0s 4900K .......... .......... .......... .......... .......... 41% 105M 0s 4950K .......... .......... .......... .......... .......... 41% 99.2M 0s 5000K .......... .......... .......... .......... .......... 42% 128M 0s 5050K .......... .......... .......... .......... .......... 42% 93.6M 0s 5100K .......... .......... .......... .......... .......... 42% 138M 0s 5150K .......... .......... .......... .......... .......... 43% 98.9M 0s 5200K .......... .......... .......... .......... .......... 43% 82.6M 0s 5250K .......... .......... .......... .......... .......... 44% 108M 0s 5300K .......... .......... .......... .......... .......... 44% 98.4M 0s 5350K .......... .......... .......... .......... .......... 45% 105M 0s 5400K .......... .......... .......... .......... .......... 45% 81.3M 0s 5450K .......... .......... .......... .......... .......... 45% 64.1M 0s 5500K .......... .......... .......... .......... .......... 46% 98.5M 0s 5550K .......... .......... .......... .......... .......... 46% 1005K 0s 5600K .......... .......... .......... .......... .......... 47% 122M 0s 5650K .......... .......... .......... .......... .......... 47% 132M 0s 5700K .......... .......... .......... .......... .......... 47% 194M 0s 5750K .......... .......... .......... .......... .......... 48% 193M 0s 5800K .......... .......... .......... .......... .......... 48% 169M 0s 5850K .......... .......... .......... .......... .......... 49% 183M 0s 5900K .......... .......... .......... .......... .......... 49% 147M 0s 5950K .......... .......... .......... .......... .......... 50% 126M 0s 6000K .......... .......... .......... .......... .......... 50% 177M 0s 6050K .......... .......... .......... .......... .......... 50% 94.0M 0s 6100K .......... .......... .......... .......... .......... 51% 210M 0s 6150K .......... .......... .......... .......... .......... 51% 173M 0s 6200K .......... .......... .......... .......... .......... 52% 196M 0s 6250K .......... .......... .......... .......... .......... 52% 213M 0s 6300K .......... .......... .......... .......... .......... 52% 211M 0s 6350K .......... .......... .......... .......... .......... 53% 183M 0s 6400K .......... .......... .......... .......... .......... 53% 213M 0s 6450K .......... .......... .......... .......... .......... 54% 201M 0s 6500K .......... .......... .......... .......... .......... 54% 149M 0s 6550K .......... .......... .......... .......... .......... 55% 172M 0s 6600K .......... .......... .......... .......... .......... 55% 221M 0s 6650K .......... .......... .......... .......... .......... 55% 211M 0s 6700K .......... .......... .......... .......... .......... 56% 196M 0s 6750K .......... .......... .......... .......... .......... 56% 169M 0s 6800K .......... .......... .......... .......... .......... 57% 210M 0s 6850K .......... .......... .......... .......... .......... 57% 213M 0s 6900K .......... .......... .......... .......... .......... 57% 213M 0s 6950K .......... .......... .......... .......... .......... 58% 182M 0s 7000K .......... .......... .......... .......... .......... 58% 190M 0s 7050K .......... .......... .......... .......... .......... 59% 213M 0s 7100K .......... .......... .......... .......... .......... 59% 223M 0s 7150K .......... .......... .......... .......... .......... 60% 178M 0s 7200K .......... .......... .......... .......... .......... 60% 181M 0s 7250K .......... .......... .......... .......... .......... 60% 211M 0s 7300K .......... .......... .......... .......... .......... 61% 210M 0s 7350K .......... .......... .......... .......... .......... 61% 199M 0s 7400K .......... .......... .......... .......... .......... 62% 201M 0s 7450K .......... .......... .......... .......... .......... 62% 223M 0s 7500K .......... .......... .......... .......... .......... 63% 215M 0s 7550K .......... .......... .......... .......... .......... 63% 185M 0s 7600K .......... .......... .......... .......... .......... 63% 223M 0s 7650K .......... .......... .......... .......... .......... 64% 131M 0s 7700K .......... .......... .......... .......... .......... 64% 167M 0s 7750K .......... .......... .......... .......... .......... 65% 185M 0s 7800K .......... .......... .......... .......... .......... 65% 223M 0s 7850K .......... .......... .......... .......... .......... 65% 215M 0s 7900K .......... .......... .......... .......... .......... 66% 194M 0s 7950K .......... .......... .......... .......... .......... 66% 177M 0s 8000K .......... .......... .......... .......... .......... 67% 149M 0s 8050K .......... .......... .......... .......... .......... 67% 210M 0s 8100K .......... .......... .......... .......... .......... 68% 177M 0s 8150K .......... .......... .......... .......... .......... 68% 166M 0s 8200K .......... .......... .......... .......... .......... 68% 213M 0s 8250K .......... .......... .......... .......... .......... 69% 213M 0s 8300K .......... .......... .......... .......... .......... 69% 248M 0s 8350K .......... .......... .......... .......... .......... 70% 152M 0s 8400K .......... .......... .......... .......... .......... 70% 193M 0s 8450K .......... .......... .......... .......... .......... 70% 218M 0s 8500K .......... .......... .......... .......... .......... 71% 209M 0s 8550K .......... .......... .......... .......... .......... 71% 183M 0s 8600K .......... .......... .......... .......... .......... 72% 5.98M 0s 8650K .......... .......... .......... .......... .......... 72% 111M 0s 8700K .......... .......... .......... .......... .......... 73% 114M 0s 8750K .......... .......... .......... .......... .......... 73% 81.9M 0s 8800K .......... .......... .......... .......... .......... 73% 125M 0s 8850K .......... .......... .......... .......... .......... 74% 114M 0s 8900K .......... .......... .......... .......... .......... 74% 103M 0s 8950K .......... .......... .......... .......... .......... 75% 83.6M 0s 9000K .......... .......... .......... .......... .......... 75% 123M 0s 9050K .......... .......... .......... .......... .......... 75% 132M 0s 9100K .......... .......... .......... .......... .......... 76% 147M 0s 9150K .......... .......... .......... .......... .......... 76% 68.5M 0s 9200K .......... .......... .......... .......... .......... 77% 108M 0s 9250K .......... .......... .......... .......... .......... 77% 136M 0s 9300K .......... .......... .......... .......... .......... 78% 167M 0s 9350K .......... .......... .......... .......... .......... 78% 129M 0s 9400K .......... .......... .......... .......... .......... 78% 101M 0s 9450K .......... .......... .......... .......... .......... 79% 98.2M 0s 9500K .......... .......... .......... .......... .......... 79% 63.7M 0s 9550K .......... .......... .......... .......... .......... 80% 3.96M 0s 9600K .......... .......... .......... .......... .......... 80% 154M 0s 9650K .......... .......... .......... .......... .......... 80% 147M 0s 9700K .......... .......... .......... .......... .......... 81% 193M 0s 9750K .......... .......... .......... .......... .......... 81% 181M 0s 9800K .......... .......... .......... .......... .......... 82% 190M 0s 9850K .......... .......... .......... .......... .......... 82% 197M 0s 9900K .......... .......... .......... .......... .......... 83% 198M 0s 9950K .......... .......... .......... .......... .......... 83% 175M 0s 10000K .......... .......... .......... .......... .......... 83% 208M 0s 10050K .......... .......... .......... .......... .......... 84% 195M 0s 10100K .......... .......... .......... .......... .......... 84% 191M 0s 10150K .......... .......... .......... .......... .......... 85% 180M 0s 10200K .......... .......... .......... .......... .......... 85% 209M 0s 10250K .......... .......... .......... .......... .......... 85% 191M 0s 10300K .......... .......... .......... .......... .......... 86% 202M 0s 10350K .......... .......... .......... .......... .......... 86% 167M 0s 10400K .......... .......... .......... .......... .......... 87% 212M 0s 10450K .......... .......... .......... .......... .......... 87% 191M 0s 10500K .......... .......... .......... .......... .......... 88% 202M 0s 10550K .......... .......... .......... .......... .......... 88% 180M 0s 10600K .......... .......... .......... .......... .......... 88% 213M 0s 10650K .......... .......... .......... .......... .......... 89% 173M 0s 10700K .......... .......... .......... .......... .......... 89% 166M 0s 10750K .......... .......... .......... .......... .......... 90% 174M 0s 10800K .......... .......... .......... .......... .......... 90% 153M 0s 10850K .......... .......... .......... .......... .......... 90% 169M 0s 10900K .......... .......... .......... .......... .......... 91% 176M 0s 10950K .......... .......... .......... .......... .......... 91% 159M 0s 11000K .......... .......... .......... .......... .......... 92% 191M 0s 11050K .......... .......... .......... .......... .......... 92% 193M 0s 11100K .......... .......... .......... .......... .......... 93% 212M 0s 11150K .......... .......... .......... .......... .......... 93% 147M 0s 11200K .......... .......... .......... .......... .......... 93% 198M 0s 11250K .......... .......... .......... .......... .......... 94% 184M 0s 11300K .......... .......... .......... .......... .......... 94% 161M 0s 11350K .......... .......... .......... .......... .......... 95% 195M 0s 11400K .......... .......... .......... .......... .......... 95% 201M 0s 11450K .......... .......... .......... .......... .......... 95% 213M 0s 11500K .......... .......... .......... .......... .......... 96% 159M 0s 11550K .......... .......... .......... .......... .......... 96% 146M 0s 11600K .......... .......... .......... .......... .......... 97% 145M 0s 11650K .......... .......... .......... .......... .......... 97% 183M 0s 11700K .......... .......... .......... .......... .......... 98% 199M 0s 11750K .......... .......... .......... .......... .......... 98% 151M 0s 11800K .......... .......... .......... .......... .......... 98% 209M 0s 11850K .......... .......... .......... .......... .......... 99% 189M 0s 11900K .......... .......... .......... .......... .......... 99% 257M 0s 11950K .......... .......... .......... ... 100% 270M=0.3s 2020-10-22 21:21:10 (39.5 MB/s) - '/var/lib/xtesting/results/cnf_conformance/tools/helm/helm-v3.1.1-linux-amd64.tar.gz' saved [12270615/12270615] Global helm found. Version: v3.3.1 Local helm found. Version:  Global wget found. Version: 1.20.3 No Local wget version found Global curl found. Version: 7.64.0 No Local curl version found Global kubectl found. Version: 1.15+ No Local kubectl version found All prerequisites found. create_results_yml file exists?:false Successfully created directories for cnf-conformance Setup complete 2020-10-22 21:21:33,688 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance cnf_setup cnf-config=cnf-conformance.yml Successfully created directories for cnf-conformance Successfully setup coredns 2020-10-22 21:23:34,914 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance all install.go:158: [debug] Original chart version: "" install.go:175: [debug] CHART PATH: /root/.cache/helm/repository/coredns-1.13.4.tgz Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply create_results_yml file exists?:false ✔️ PASSED: No privileged containers Security final score: 5 of 5 ✔️ PASSED: Replicas increased to 3 📦📈 ✔️ PASSED: Replicas decreased to 1 📦📉 Scalability final score: 20 of 20 ✖️ FAILURE: IP addresses found ✔️ PASSED: Helm liveness probe found ✔️ PASSED: Helm readiness probe found ✔️ PASSED: CNF coredns-coredns Rolling Update Passed ✔️ PASSED: NodePort is not used ✔️ PASSED: No hard-coded IP addresses found in the runtime K8s configuration Configuration lifecycle final score: 24 of 25 PASSED (by default): No install script provided Successfully created directories for cnf-conformance ✔️ PASSED: Helm Chart cnfs/coredns/helm_chart/coredns Lint Passed ✔️ PASSED: Published Helm Chart Found ✔️ PASSED: Helm deploy successful Installability final score: 20 of 20 Hostname lookup for hub.docker.com failed: System error /home/pair/workspace/taylor/qa/jun8/lib/halite/src/halite/client.cr:155:7 in 'perform' /home/pair/workspace/taylor/qa/jun8/lib/halite/src/halite/client.cr:115:9 in 'request' /home/pair/workspace/taylor/qa/jun8/lib/halite/src/halite/chainable.cr:485:7 in '->' /home/pair/workspace/taylor/qa/jun8/src/tasks/utils/utils.cr:255:3 in 'task_runner' /home/pair/workspace/taylor/qa/jun8/src/tasks/microservice.cr:93:3 in '->' /home/pair/workspace/taylor/qa/jun8/lib/sam/src/sam/task.cr:39:29 in 'call' /home/pair/workspace/taylor/qa/jun8/lib/sam/src/sam/task.cr:39:29 in 'call' /home/pair/workspace/taylor/qa/jun8/lib/sam/src/sam.cr:43:5 in '__crystal_main' /usr/local/depot/crystal-0.33.0-1/share/crystal/src/crystal/main.cr:106:5 in 'main' ??? ??? ✔️ PASSED: CNF had a reasonable startup time 🚀 Microservice final score: 5 of 10 Final score: 74 of 80 Results have been saved to cnf-conformance-results-20201022-212334-897.yml 2020-10-22 21:23:34,934 - functest_kubernetes.cnf_conformance.conformance - INFO - +-------------------------------------------------------------+----------------+ | NAME | STATUS | +-------------------------------------------------------------+----------------+ | privileged | passed | | increase_capacity | passed | | decrease_capacity | passed | | ip_addresses | failed | | liveness | passed | | readiness | passed | | rolling_update | passed | | nodeport_not_used | passed | | hardcoded_ip_addresses_in_k8s_runtime_configuration | passed | | install_script_helm | passed | | helm_chart_valid | passed | | helm_chart_published | passed | | helm_deploy | passed | | reasonable_startup_time | passed | +-------------------------------------------------------------+----------------+ 2020-10-22 21:23:34,934 - xtesting.ci.run_tests - INFO - Test result: +-------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------------+------------------+------------------+----------------+ | cnf_conformance | functest | 02:27 | PASS | +-------------------------+------------------+------------------+----------------+ 2020-10-22 21:23:42,064 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance cnf_cleanup cnf-config=cnf-conformance.yml Successfully cleaned up coredns