2020-09-23 20:12:35,706 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------+ | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_DST_URL | s3://artifacts.opnfv.org/functest- | | | kubernetes/0KEJOJF1IWZR/functest-kubernetes-pi- | | | ollivier-functest-kubernetes-cnf-hunter- | | | cnf_conformance-run-3 | | S3_ENDPOINT_URL | https://storage.googleapis.com | | DEPLOY_SCENARIO | k8-nosdn-nofeature-noha | | BUILD_TAG | 0KEJOJF1IWZR | | DEBUG | true | | INSTALLER_TYPE | unknown | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | HTTP_DST_URL | http://artifacts.opnfv.org/functest- | | | kubernetes/0KEJOJF1IWZR/functest-kubernetes-pi- | | | ollivier-functest-kubernetes-cnf-hunter- | | | cnf_conformance-run-3 | | NODE_NAME | lf-virtual1-1 | +-------------------------+----------------------------------------------------------+ 2020-09-23 20:12:35,722 - xtesting.ci.run_tests - INFO - Loading test case 'cnf_conformance'... 2020-09-23 20:12:35,740 - xtesting.ci.run_tests - INFO - Running test case 'cnf_conformance'... 2020-09-23 20:12:41,682 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance setup % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 658 100 658 0 0 2115 0 --:--:-- --:--:-- --:--:-- 2108 2 9281k 2 202k 0 0 168k 0 0:00:55 0:00:01 0:00:54 168k 100 9281k 100 9281k 0 0 5472k 0 0:00:01 0:00:01 --:--:-- 17.9M --2020-09-23 20:12:38-- https://get.helm.sh/helm-v3.1.1-linux-amd64.tar.gz Resolving get.helm.sh... 152.195.19.97, 2606:2800:11f:1cb7:261b:1f9c:2074:3c Connecting to get.helm.sh|152.195.19.97|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 12270615 (12M) [application/x-tar] Saving to: '/var/lib/xtesting/results/cnf_conformance/tools/helm/helm-v3.1.1-linux-amd64.tar.gz' 0K .......... .......... .......... .......... .......... 0% 5.71M 2s 50K .......... .......... .......... .......... .......... 0% 6.40M 2s 100K .......... .......... .......... .......... .......... 1% 46.4M 1s 150K .......... .......... .......... .......... .......... 1% 3.95M 2s 200K .......... .......... .......... .......... .......... 2% 191M 1s 250K .......... .......... .......... .......... .......... 2% 238M 1s 300K .......... .......... .......... .......... .......... 2% 211M 1s 350K .......... .......... .......... .......... .......... 3% 3.97M 1s 400K .......... .......... .......... .......... .......... 3% 26.9M 1s 450K .......... .......... .......... .......... .......... 4% 86.1M 1s 500K .......... .......... .......... .......... .......... 4% 106M 1s 550K .......... .......... .......... .......... .......... 5% 87.1M 1s 600K .......... .......... .......... .......... .......... 5% 9.32M 1s 650K .......... .......... .......... .......... .......... 5% 82.9M 1s 700K .......... .......... .......... .......... .......... 6% 73.3M 1s 750K .......... .......... .......... .......... .......... 6% 59.2M 1s 800K .......... .......... .......... .......... .......... 7% 70.5M 1s 850K .......... .......... .......... .......... .......... 7% 73.2M 1s 900K .......... .......... .......... .......... .......... 7% 69.0M 1s 950K .......... .......... .......... .......... .......... 8% 37.0M 1s 1000K .......... .......... .......... .......... .......... 8% 84.3M 1s 1050K .......... .......... .......... .......... .......... 9% 78.4M 1s 1100K .......... .......... .......... .......... .......... 9% 247M 1s 1150K .......... .......... .......... .......... .......... 10% 187M 1s 1200K .......... .......... .......... .......... .......... 10% 224M 1s 1250K .......... .......... .......... .......... .......... 10% 253M 0s 1300K .......... .......... .......... .......... .......... 11% 7.74M 1s 1350K .......... .......... .......... .......... .......... 11% 78.3M 0s 1400K .......... .......... .......... .......... .......... 12% 69.9M 0s 1450K .......... .......... .......... .......... .......... 12% 61.5M 0s 1500K .......... .......... .......... .......... .......... 12% 59.1M 0s 1550K .......... .......... .......... .......... .......... 13% 45.8M 0s 1600K .......... .......... .......... .......... .......... 13% 65.4M 0s 1650K .......... .......... .......... .......... .......... 14% 55.6M 0s 1700K .......... .......... .......... .......... .......... 14% 66.3M 0s 1750K .......... .......... .......... .......... .......... 15% 54.7M 0s 1800K .......... .......... .......... .......... .......... 15% 57.0M 0s 1850K .......... .......... .......... .......... .......... 15% 63.0M 0s 1900K .......... .......... .......... .......... .......... 16% 60.0M 0s 1950K .......... .......... .......... .......... .......... 16% 49.0M 0s 2000K .......... .......... .......... .......... .......... 17% 59.9M 0s 2050K .......... .......... .......... .......... .......... 17% 54.3M 0s 2100K .......... .......... .......... .......... .......... 17% 59.2M 0s 2150K .......... .......... .......... .......... .......... 18% 57.0M 0s 2200K .......... .......... .......... .......... .......... 18% 76.4M 0s 2250K .......... .......... .......... .......... .......... 19% 77.4M 0s 2300K .......... .......... .......... .......... .......... 19% 85.7M 0s 2350K .......... .......... .......... .......... .......... 20% 71.0M 0s 2400K .......... .......... .......... .......... .......... 20% 49.7M 0s 2450K .......... .......... .......... .......... .......... 20% 36.1M 0s 2500K .......... .......... .......... .......... .......... 21% 46.3M 0s 2550K .......... .......... .......... .......... .......... 21% 39.8M 0s 2600K .......... .......... .......... .......... .......... 22% 47.6M 0s 2650K .......... .......... .......... .......... .......... 22% 73.3M 0s 2700K .......... .......... .......... .......... .......... 22% 50.6M 0s 2750K .......... .......... .......... .......... .......... 23% 30.2M 0s 2800K .......... .......... .......... .......... .......... 23% 26.1M 0s 2850K .......... .......... .......... .......... .......... 24% 25.2M 0s 2900K .......... .......... .......... .......... .......... 24% 29.3M 0s 2950K .......... .......... .......... .......... .......... 25% 27.8M 0s 3000K .......... .......... .......... .......... .......... 25% 141M 0s 3050K .......... .......... .......... .......... .......... 25% 140M 0s 3100K .......... .......... .......... .......... .......... 26% 140M 0s 3150K .......... .......... .......... .......... .......... 26% 114M 0s 3200K .......... .......... .......... .......... .......... 27% 125M 0s 3250K .......... .......... .......... .......... .......... 27% 139M 0s 3300K .......... .......... .......... .......... .......... 27% 133M 0s 3350K .......... .......... .......... .......... .......... 28% 122M 0s 3400K .......... .......... .......... .......... .......... 28% 131M 0s 3450K .......... .......... .......... .......... .......... 29% 122M 0s 3500K .......... .......... .......... .......... .......... 29% 147M 0s 3550K .......... .......... .......... .......... .......... 30% 107M 0s 3600K .......... .......... .......... .......... .......... 30% 126M 0s 3650K .......... .......... .......... .......... .......... 30% 133M 0s 3700K .......... .......... .......... .......... .......... 31% 111M 0s 3750K .......... .......... .......... .......... .......... 31% 123M 0s 3800K .......... .......... .......... .......... .......... 32% 123M 0s 3850K .......... .......... .......... .......... .......... 32% 127M 0s 3900K .......... .......... .......... .......... .......... 32% 125M 0s 3950K .......... .......... .......... .......... .......... 33% 112M 0s 4000K .......... .......... .......... .......... .......... 33% 110M 0s 4050K .......... .......... .......... .......... .......... 34% 130M 0s 4100K .......... .......... .......... .......... .......... 34% 133M 0s 4150K .......... .......... .......... .......... .......... 35% 119M 0s 4200K .......... .......... .......... .......... .......... 35% 126M 0s 4250K .......... .......... .......... .......... .......... 35% 131M 0s 4300K .......... .......... .......... .......... .......... 36% 149M 0s 4350K .......... .......... .......... .......... .......... 36% 119M 0s 4400K .......... .......... .......... .......... .......... 37% 137M 0s 4450K .......... .......... .......... .......... .......... 37% 149M 0s 4500K .......... .......... .......... .......... .......... 37% 123M 0s 4550K .......... .......... .......... .......... .......... 38% 131M 0s 4600K .......... .......... .......... .......... .......... 38% 147M 0s 4650K .......... .......... .......... .......... .......... 39% 146M 0s 4700K .......... .......... .......... .......... .......... 39% 152M 0s 4750K .......... .......... .......... .......... .......... 40% 115M 0s 4800K .......... .......... .......... .......... .......... 40% 139M 0s 4850K .......... .......... .......... .......... .......... 40% 139M 0s 4900K .......... .......... .......... .......... .......... 41% 145M 0s 4950K .......... .......... .......... .......... .......... 41% 138M 0s 5000K .......... .......... .......... .......... .......... 42% 136M 0s 5050K .......... .......... .......... .......... .......... 42% 153M 0s 5100K .......... .......... .......... .......... .......... 42% 151M 0s 5150K .......... .......... .......... .......... .......... 43% 120M 0s 5200K .......... .......... .......... .......... .......... 43% 154M 0s 5250K .......... .......... .......... .......... .......... 44% 131M 0s 5300K .......... .......... .......... .......... .......... 44% 124M 0s 5350K .......... .......... .......... .......... .......... 45% 99.5M 0s 5400K .......... .......... .......... .......... .......... 45% 125M 0s 5450K .......... .......... .......... .......... .......... 45% 139M 0s 5500K .......... .......... .......... .......... .......... 46% 123M 0s 5550K .......... .......... .......... .......... .......... 46% 107M 0s 5600K .......... .......... .......... .......... .......... 47% 122M 0s 5650K .......... .......... .......... .......... .......... 47% 143M 0s 5700K .......... .......... .......... .......... .......... 47% 156M 0s 5750K .......... .......... .......... .......... .......... 48% 121M 0s 5800K .......... .......... .......... .......... .......... 48% 128M 0s 5850K .......... .......... .......... .......... .......... 49% 157M 0s 5900K .......... .......... .......... .......... .......... 49% 167M 0s 5950K .......... .......... .......... .......... .......... 50% 155M 0s 6000K .......... .......... .......... .......... .......... 50% 151M 0s 6050K .......... .......... .......... .......... .......... 50% 165M 0s 6100K .......... .......... .......... .......... .......... 51% 174M 0s 6150K .......... .......... .......... .......... .......... 51% 146M 0s 6200K .......... .......... .......... .......... .......... 52% 124M 0s 6250K .......... .......... .......... .......... .......... 52% 146M 0s 6300K .......... .......... .......... .......... .......... 52% 136M 0s 6350K .......... .......... .......... .......... .......... 53% 122M 0s 6400K .......... .......... .......... .......... .......... 53% 146M 0s 6450K .......... .......... .......... .......... .......... 54% 151M 0s 6500K .......... .......... .......... .......... .......... 54% 140M 0s 6550K .......... .......... .......... .......... .......... 55% 120M 0s 6600K .......... .......... .......... .......... .......... 55% 152M 0s 6650K .......... .......... .......... .......... .......... 55% 145M 0s 6700K .......... .......... .......... .......... .......... 56% 147M 0s 6750K .......... .......... .......... .......... .......... 56% 105M 0s 6800K .......... .......... .......... .......... .......... 57% 133M 0s 6850K .......... .......... .......... .......... .......... 57% 147M 0s 6900K .......... .......... .......... .......... .......... 57% 152M 0s 6950K .......... .......... .......... .......... .......... 58% 140M 0s 7000K .......... .......... .......... .......... .......... 58% 141M 0s 7050K .......... .......... .......... .......... .......... 59% 138M 0s 7100K .......... .......... .......... .......... .......... 59% 148M 0s 7150K .......... .......... .......... .......... .......... 60% 124M 0s 7200K .......... .......... .......... .......... .......... 60% 147M 0s 7250K .......... .......... .......... .......... .......... 60% 161M 0s 7300K .......... .......... .......... .......... .......... 61% 140M 0s 7350K .......... .......... .......... .......... .......... 61% 131M 0s 7400K .......... .......... .......... .......... .......... 62% 158M 0s 7450K .......... .......... .......... .......... .......... 62% 154M 0s 7500K .......... .......... .......... .......... .......... 63% 150M 0s 7550K .......... .......... .......... .......... .......... 63% 119M 0s 7600K .......... .......... .......... .......... .......... 63% 158M 0s 7650K .......... .......... .......... .......... .......... 64% 153M 0s 7700K .......... .......... .......... .......... .......... 64% 144M 0s 7750K .......... .......... .......... .......... .......... 65% 135M 0s 7800K .......... .......... .......... .......... .......... 65% 140M 0s 7850K .......... .......... .......... .......... .......... 65% 157M 0s 7900K .......... .......... .......... .......... .......... 66% 160M 0s 7950K .......... .......... .......... .......... .......... 66% 109M 0s 8000K .......... .......... .......... .......... .......... 67% 150M 0s 8050K .......... .......... .......... .......... .......... 67% 142M 0s 8100K .......... .......... .......... .......... .......... 68% 142M 0s 8150K .......... .......... .......... .......... .......... 68% 137M 0s 8200K .......... .......... .......... .......... .......... 68% 153M 0s 8250K .......... .......... .......... .......... .......... 69% 147M 0s 8300K .......... .......... .......... .......... .......... 69% 154M 0s 8350K .......... .......... .......... .......... .......... 70% 118M 0s 8400K .......... .......... .......... .......... .......... 70% 156M 0s 8450K .......... .......... .......... .......... .......... 70% 167M 0s 8500K .......... .......... .......... .......... .......... 71% 116M 0s 8550K .......... .......... .......... .......... .......... 71% 138M 0s 8600K .......... .......... .......... .......... .......... 72% 146M 0s 8650K .......... .......... .......... .......... .......... 72% 160M 0s 8700K .......... .......... .......... .......... .......... 73% 163M 0s 8750K .......... .......... .......... .......... .......... 73% 132M 0s 8800K .......... .......... .......... .......... .......... 73% 170M 0s 8850K .......... .......... .......... .......... .......... 74% 167M 0s 8900K .......... .......... .......... .......... .......... 74% 163M 0s 8950K .......... .......... .......... .......... .......... 75% 160M 0s 9000K .......... .......... .......... .......... .......... 75% 150M 0s 9050K .......... .......... .......... .......... .......... 75% 166M 0s 9100K .......... .......... .......... .......... .......... 76% 160M 0s 9150K .......... .......... .......... .......... .......... 76% 129M 0s 9200K .......... .......... .......... .......... .......... 77% 166M 0s 9250K .......... .......... .......... .......... .......... 77% 158M 0s 9300K .......... .......... .......... .......... .......... 78% 163M 0s 9350K .......... .......... .......... .......... .......... 78% 84.8M 0s 9400K .......... .......... .......... .......... .......... 78% 113M 0s 9450K .......... .......... .......... .......... .......... 79% 116M 0s 9500K .......... .......... .......... .......... .......... 79% 116M 0s 9550K .......... .......... .......... .......... .......... 80% 96.1M 0s 9600K .......... .......... .......... .......... .......... 80% 91.6M 0s 9650K .......... .......... .......... .......... .......... 80% 81.7M 0s 9700K .......... .......... .......... .......... .......... 81% 2.11M 0s 9750K .......... .......... .......... .......... .......... 81% 189M 0s 9800K .......... .......... .......... .......... .......... 82% 186M 0s 9850K .......... .......... .......... .......... .......... 82% 206M 0s 9900K .......... .......... .......... .......... .......... 83% 270M 0s 9950K .......... .......... .......... .......... .......... 83% 178M 0s 10000K .......... .......... .......... .......... .......... 83% 235M 0s 10050K .......... .......... .......... .......... .......... 84% 227M 0s 10100K .......... .......... .......... .......... .......... 84% 14.0M 0s 10150K .......... .......... .......... .......... .......... 85% 63.2M 0s 10200K .......... .......... .......... .......... .......... 85% 140M 0s 10250K .......... .......... .......... .......... .......... 85% 144M 0s 10300K .......... .......... .......... .......... .......... 86% 105M 0s 10350K .......... .......... .......... .......... .......... 86% 210M 0s 10400K .......... .......... .......... .......... .......... 87% 149M 0s 10450K .......... .......... .......... .......... .......... 87% 74.4M 0s 10500K .......... .......... .......... .......... .......... 88% 106M 0s 10550K .......... .......... .......... .......... .......... 88% 110M 0s 10600K .......... .......... .......... .......... .......... 88% 123M 0s 10650K .......... .......... .......... .......... .......... 89% 78.8M 0s 10700K .......... .......... .......... .......... .......... 89% 149M 0s 10750K .......... .......... .......... .......... .......... 90% 69.5M 0s 10800K .......... .......... .......... .......... .......... 90% 184M 0s 10850K .......... .......... .......... .......... .......... 90% 197M 0s 10900K .......... .......... .......... .......... .......... 91% 97.0M 0s 10950K .......... .......... .......... .......... .......... 91% 73.4M 0s 11000K .......... .......... .......... .......... .......... 92% 56.0M 0s 11050K .......... .......... .......... .......... .......... 92% 83.8M 0s 11100K .......... .......... .......... .......... .......... 93% 137M 0s 11150K .......... .......... .......... .......... .......... 93% 150M 0s 11200K .......... .......... .......... .......... .......... 93% 177M 0s 11250K .......... .......... .......... .......... .......... 94% 178M 0s 11300K .......... .......... .......... .......... .......... 94% 113M 0s 11350K .......... .......... .......... .......... .......... 95% 97.2M 0s 11400K .......... .......... .......... .......... .......... 95% 107M 0s 11450K .......... .......... .......... .......... .......... 95% 107M 0s 11500K .......... .......... .......... .......... .......... 96% 126M 0s 11550K .......... .......... .......... .......... .......... 96% 87.3M 0s 11600K .......... .......... .......... .......... .......... 97% 133M 0s 11650K .......... .......... .......... .......... .......... 97% 117M 0s 11700K .......... .......... .......... .......... .......... 98% 116M 0s 11750K .......... .......... .......... .......... .......... 98% 100M 0s 11800K .......... .......... .......... .......... .......... 98% 117M 0s 11850K .......... .......... .......... .......... .......... 99% 202M 0s 11900K .......... .......... .......... .......... .......... 99% 264M 0s 11950K .......... .......... .......... ... 100% 289M=0.2s 2020-09-23 20:12:39 (61.4 MB/s) - '/var/lib/xtesting/results/cnf_conformance/tools/helm/helm-v3.1.1-linux-amd64.tar.gz' saved [12270615/12270615] Global helm found. Version: v3.3.1 Local helm found. Version:  Global wget found. Version: 1.20.3 No Local wget version found Global curl found. Version: 7.64.0 No Local curl version found Global kubectl found. Version: 1.13 No Local kubectl version found All prerequisites found. create_results_yml file exists?:false Successfully created directories for cnf-conformance Setup complete 2020-09-23 20:13:06,753 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance cnf_setup cnf-config=cnf-conformance.yml Successfully created directories for cnf-conformance Successfully setup coredns 2020-09-23 20:14:59,339 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance all install.go:158: [debug] Original chart version: "" install.go:175: [debug] CHART PATH: /root/.cache/helm/repository/coredns-1.13.3.tgz Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply create_results_yml file exists?:false ✔️ PASSED: No privileged containers Security final score: 5 of 5 ✔️ PASSED: Replicas increased to 3 📦📈 ✔️ PASSED: Replicas decreased to 1 📦📉 Scalability final score: 20 of 20 ✖️ FAILURE: IP addresses found ✔️ PASSED: Helm liveness probe found ✔️ PASSED: Helm readiness probe found ✔️ PASSED: CNF coredns-coredns Rolling Update Passed ✔️ PASSED: NodePort is not used ✔️ PASSED: No hard-coded IP addresses found in the runtime K8s configuration Configuration lifecycle final score: 24 of 25 PASSED (by default): No install script provided Successfully created directories for cnf-conformance ✔️ PASSED: Helm Chart cnfs/coredns/helm_chart/coredns Lint Passed ✔️ PASSED: Published Helm Chart Found ✔️ PASSED: Helm deploy successful Installability final score: 20 of 20 Hostname lookup for hub.docker.com failed: System error /home/pair/workspace/taylor/qa/jun8/lib/halite/src/halite/client.cr:155:7 in 'perform' /home/pair/workspace/taylor/qa/jun8/lib/halite/src/halite/client.cr:115:9 in 'request' /home/pair/workspace/taylor/qa/jun8/lib/halite/src/halite/chainable.cr:485:7 in '->' /home/pair/workspace/taylor/qa/jun8/src/tasks/utils/utils.cr:255:3 in 'task_runner' /home/pair/workspace/taylor/qa/jun8/src/tasks/microservice.cr:93:3 in '->' /home/pair/workspace/taylor/qa/jun8/lib/sam/src/sam/task.cr:39:29 in 'call' /home/pair/workspace/taylor/qa/jun8/lib/sam/src/sam/task.cr:39:29 in 'call' /home/pair/workspace/taylor/qa/jun8/lib/sam/src/sam.cr:43:5 in '__crystal_main' /usr/local/depot/crystal-0.33.0-1/share/crystal/src/crystal/main.cr:106:5 in 'main' ??? ??? ✔️ PASSED: CNF had a reasonable startup time 🚀 Microservice final score: 5 of 10 Final score: 74 of 80 Results have been saved to cnf-conformance-results-20200923-201459-332.yml 2020-09-23 20:14:59,359 - functest_kubernetes.cnf_conformance.conformance - INFO - +-------------------------------------------------------------+----------------+ | NAME | STATUS | +-------------------------------------------------------------+----------------+ | privileged | passed | | increase_capacity | passed | | decrease_capacity | passed | | ip_addresses | failed | | liveness | passed | | readiness | passed | | rolling_update | passed | | nodeport_not_used | passed | | hardcoded_ip_addresses_in_k8s_runtime_configuration | passed | | install_script_helm | passed | | helm_chart_valid | passed | | helm_chart_published | passed | | helm_deploy | passed | | reasonable_startup_time | passed | +-------------------------------------------------------------+----------------+ 2020-09-23 20:14:59,360 - xtesting.ci.run_tests - INFO - Test result: +-------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------------+------------------+------------------+----------------+ | cnf_conformance | functest | 02:23 | PASS | +-------------------------+------------------+------------------+----------------+ 2020-09-23 20:15:03,114 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance cnf_cleanup cnf-config=cnf-conformance.yml Successfully cleaned up coredns