2020-10-07 13:30:10,619 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_DST_URL | s3://artifacts.opnfv.org/functest- | | | kubernetes/02EMRPM3F4YF/functest-kubernetes-opnfv- | | | functest-kubernetes-cnf-hunter-cnf_conformance- | | | run-7 | | S3_ENDPOINT_URL | https://storage.googleapis.com | | DEPLOY_SCENARIO | k8-nosdn-nofeature-noha | | BUILD_TAG | 02EMRPM3F4YF | | DEBUG | true | | INSTALLER_TYPE | unknown | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | HTTP_DST_URL | http://artifacts.opnfv.org/functest- | | | kubernetes/02EMRPM3F4YF/functest-kubernetes-opnfv- | | | functest-kubernetes-cnf-hunter-cnf_conformance- | | | run-7 | | NODE_NAME | lf-virtual1-1 | +-------------------------+------------------------------------------------------------+ 2020-10-07 13:30:10,635 - xtesting.ci.run_tests - INFO - Loading test case 'cnf_conformance'... 2020-10-07 13:30:10,667 - xtesting.ci.run_tests - INFO - Running test case 'cnf_conformance'... 2020-10-07 13:30:16,957 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance setup % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 658 100 658 0 0 1880 0 --:--:-- --:--:-- --:--:-- 1880 0 9281k 0 16360 0 0 17763 0 0:08:55 --:--:-- 0:08:55 17763 56 9281k 56 5225k 0 0 2706k 0 0:00:03 0:00:01 0:00:02 5163k 100 9281k 100 9281k 0 0 3795k 0 0:00:02 0:00:02 --:--:-- 6083k --2020-10-07 13:30:13-- https://get.helm.sh/helm-v3.1.1-linux-amd64.tar.gz Resolving get.helm.sh... 152.195.19.97, 2606:2800:11f:1cb7:261b:1f9c:2074:3c Connecting to get.helm.sh|152.195.19.97|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 12270615 (12M) [application/x-tar] Saving to: '/var/lib/xtesting/results/cnf_conformance/tools/helm/helm-v3.1.1-linux-amd64.tar.gz' 0K .......... .......... .......... .......... .......... 0% 2.97M 4s 50K .......... .......... .......... .......... .......... 0% 2.97M 4s 100K .......... .......... .......... .......... .......... 1% 68.0M 3s 150K .......... .......... .......... .......... .......... 1% 3.02M 3s 200K .......... .......... .......... .......... .......... 2% 90.1M 2s 250K .......... .......... .......... .......... .......... 2% 67.4M 2s 300K .......... .......... .......... .......... .......... 2% 4.09M 2s 350K .......... .......... .......... .......... .......... 3% 19.0M 2s 400K .......... .......... .......... .......... .......... 3% 99.9M 2s 450K .......... .......... .......... .......... .......... 4% 116M 2s 500K .......... .......... .......... .......... .......... 4% 116M 1s 550K .......... .......... .......... .......... .......... 5% 83.1M 1s 600K .......... .......... .......... .......... .......... 5% 60.0M 1s 650K .......... .......... .......... .......... .......... 5% 59.2M 1s 700K .......... .......... .......... .......... .......... 6% 4.15M 1s 750K .......... .......... .......... .......... .......... 6% 32.8M 1s 800K .......... .......... .......... .......... .......... 7% 34.8M 1s 850K .......... .......... .......... .......... .......... 7% 67.6M 1s 900K .......... .......... .......... .......... .......... 7% 58.6M 1s 950K .......... .......... .......... .......... .......... 8% 61.0M 1s 1000K .......... .......... .......... .......... .......... 8% 69.1M 1s 1050K .......... .......... .......... .......... .......... 9% 93.7M 1s 1100K .......... .......... .......... .......... .......... 9% 82.5M 1s 1150K .......... .......... .......... .......... .......... 10% 70.8M 1s 1200K .......... .......... .......... .......... .......... 10% 76.4M 1s 1250K .......... .......... .......... .......... .......... 10% 63.4M 1s 1300K .......... .......... .......... .......... .......... 11% 83.9M 1s 1350K .......... .......... .......... .......... .......... 11% 90.7M 1s 1400K .......... .......... .......... .......... .......... 12% 110M 1s 1450K .......... .......... .......... .......... .......... 12% 7.28M 1s 1500K .......... .......... .......... .......... .......... 12% 82.6M 1s 1550K .......... .......... .......... .......... .......... 13% 83.6M 1s 1600K .......... .......... .......... .......... .......... 13% 90.5M 1s 1650K .......... .......... .......... .......... .......... 14% 110M 1s 1700K .......... .......... .......... .......... .......... 14% 66.6M 1s 1750K .......... .......... .......... .......... .......... 15% 54.3M 1s 1800K .......... .......... .......... .......... .......... 15% 61.0M 1s 1850K .......... .......... .......... .......... .......... 15% 63.1M 1s 1900K .......... .......... .......... .......... .......... 16% 59.7M 1s 1950K .......... .......... .......... .......... .......... 16% 34.7M 1s 2000K .......... .......... .......... .......... .......... 17% 41.0M 1s 2050K .......... .......... .......... .......... .......... 17% 29.8M 1s 2100K .......... .......... .......... .......... .......... 17% 45.7M 1s 2150K .......... .......... .......... .......... .......... 18% 44.6M 0s 2200K .......... .......... .......... .......... .......... 18% 48.4M 0s 2250K .......... .......... .......... .......... .......... 19% 44.5M 0s 2300K .......... .......... .......... .......... .......... 19% 51.4M 0s 2350K .......... .......... .......... .......... .......... 20% 69.5M 0s 2400K .......... .......... .......... .......... .......... 20% 69.9M 0s 2450K .......... .......... .......... .......... .......... 20% 59.4M 0s 2500K .......... .......... .......... .......... .......... 21% 76.8M 0s 2550K .......... .......... .......... .......... .......... 21% 82.7M 0s 2600K .......... .......... .......... .......... .......... 22% 65.8M 0s 2650K .......... .......... .......... .......... .......... 22% 87.4M 0s 2700K .......... .......... .......... .......... .......... 22% 76.3M 0s 2750K .......... .......... .......... .......... .......... 23% 32.9M 0s 2800K .......... .......... .......... .......... .......... 23% 85.9M 0s 2850K .......... .......... .......... .......... .......... 24% 81.5M 0s 2900K .......... .......... .......... .......... .......... 24% 99.0M 0s 2950K .......... .......... .......... .......... .......... 25% 86.1M 0s 3000K .......... .......... .......... .......... .......... 25% 80.4M 0s 3050K .......... .......... .......... .......... .......... 25% 82.1M 0s 3100K .......... .......... .......... .......... .......... 26% 82.0M 0s 3150K .......... .......... .......... .......... .......... 26% 70.5M 0s 3200K .......... .......... .......... .......... .......... 27% 91.9M 0s 3250K .......... .......... .......... .......... .......... 27% 88.1M 0s 3300K .......... .......... .......... .......... .......... 27% 93.5M 0s 3350K .......... .......... .......... .......... .......... 28% 71.7M 0s 3400K .......... .......... .......... .......... .......... 28% 86.2M 0s 3450K .......... .......... .......... .......... .......... 29% 87.4M 0s 3500K .......... .......... .......... .......... .......... 29% 79.1M 0s 3550K .......... .......... .......... .......... .......... 30% 77.5M 0s 3600K .......... .......... .......... .......... .......... 30% 102M 0s 3650K .......... .......... .......... .......... .......... 30% 101M 0s 3700K .......... .......... .......... .......... .......... 31% 89.8M 0s 3750K .......... .......... .......... .......... .......... 31% 86.7M 0s 3800K .......... .......... .......... .......... .......... 32% 93.7M 0s 3850K .......... .......... .......... .......... .......... 32% 96.8M 0s 3900K .......... .......... .......... .......... .......... 32% 80.3M 0s 3950K .......... .......... .......... .......... .......... 33% 79.1M 0s 4000K .......... .......... .......... .......... .......... 33% 101M 0s 4050K .......... .......... .......... .......... .......... 34% 86.4M 0s 4100K .......... .......... .......... .......... .......... 34% 100M 0s 4150K .......... .......... .......... .......... .......... 35% 93.8M 0s 4200K .......... .......... .......... .......... .......... 35% 82.7M 0s 4250K .......... .......... .......... .......... .......... 35% 82.5M 0s 4300K .......... .......... .......... .......... .......... 36% 84.0M 0s 4350K .......... .......... .......... .......... .......... 36% 78.4M 0s 4400K .......... .......... .......... .......... .......... 37% 101M 0s 4450K .......... .......... .......... .......... .......... 37% 108M 0s 4500K .......... .......... .......... .......... .......... 37% 97.8M 0s 4550K .......... .......... .......... .......... .......... 38% 74.3M 0s 4600K .......... .......... .......... .......... .......... 38% 91.7M 0s 4650K .......... .......... .......... .......... .......... 39% 98.5M 0s 4700K .......... .......... .......... .......... .......... 39% 96.6M 0s 4750K .......... .......... .......... .......... .......... 40% 90.9M 0s 4800K .......... .......... .......... .......... .......... 40% 88.1M 0s 4850K .......... .......... .......... .......... .......... 40% 109M 0s 4900K .......... .......... .......... .......... .......... 41% 104M 0s 4950K .......... .......... .......... .......... .......... 41% 91.4M 0s 5000K .......... .......... .......... .......... .......... 42% 90.1M 0s 5050K .......... .......... .......... .......... .......... 42% 43.8M 0s 5100K .......... .......... .......... .......... .......... 42% 67.1M 0s 5150K .......... .......... .......... .......... .......... 43% 70.5M 0s 5200K .......... .......... .......... .......... .......... 43% 107M 0s 5250K .......... .......... .......... .......... .......... 44% 89.2M 0s 5300K .......... .......... .......... .......... .......... 44% 60.8M 0s 5350K .......... .......... .......... .......... .......... 45% 78.9M 0s 5400K .......... .......... .......... .......... .......... 45% 87.9M 0s 5450K .......... .......... .......... .......... .......... 45% 85.9M 0s 5500K .......... .......... .......... .......... .......... 46% 89.4M 0s 5550K .......... .......... .......... .......... .......... 46% 78.0M 0s 5600K .......... .......... .......... .......... .......... 47% 66.8M 0s 5650K .......... .......... .......... .......... .......... 47% 104M 0s 5700K .......... .......... .......... .......... .......... 47% 110M 0s 5750K .......... .......... .......... .......... .......... 48% 94.2M 0s 5800K .......... .......... .......... .......... .......... 48% 81.9M 0s 5850K .......... .......... .......... .......... .......... 49% 77.6M 0s 5900K .......... .......... .......... .......... .......... 49% 87.6M 0s 5950K .......... .......... .......... .......... .......... 50% 83.6M 0s 6000K .......... .......... .......... .......... .......... 50% 104M 0s 6050K .......... .......... .......... .......... .......... 50% 108M 0s 6100K .......... .......... .......... .......... .......... 51% 98.5M 0s 6150K .......... .......... .......... .......... .......... 51% 74.7M 0s 6200K .......... .......... .......... .......... .......... 52% 96.3M 0s 6250K .......... .......... .......... .......... .......... 52% 112M 0s 6300K .......... .......... .......... .......... .......... 52% 109M 0s 6350K .......... .......... .......... .......... .......... 53% 74.4M 0s 6400K .......... .......... .......... .......... .......... 53% 102M 0s 6450K .......... .......... .......... .......... .......... 54% 104M 0s 6500K .......... .......... .......... .......... .......... 54% 101M 0s 6550K .......... .......... .......... .......... .......... 55% 80.8M 0s 6600K .......... .......... .......... .......... .......... 55% 104M 0s 6650K .......... .......... .......... .......... .......... 55% 112M 0s 6700K .......... .......... .......... .......... .......... 56% 107M 0s 6750K .......... .......... .......... .......... .......... 56% 91.2M 0s 6800K .......... .......... .......... .......... .......... 57% 110M 0s 6850K .......... .......... .......... .......... .......... 57% 100M 0s 6900K .......... .......... .......... .......... .......... 57% 108M 0s 6950K .......... .......... .......... .......... .......... 58% 98.6M 0s 7000K .......... .......... .......... .......... .......... 58% 113M 0s 7050K .......... .......... .......... .......... .......... 59% 82.0M 0s 7100K .......... .......... .......... .......... .......... 59% 103M 0s 7150K .......... .......... .......... .......... .......... 60% 87.8M 0s 7200K .......... .......... .......... .......... .......... 60% 101M 0s 7250K .......... .......... .......... .......... .......... 60% 116M 0s 7300K .......... .......... .......... .......... .......... 61% 116M 0s 7350K .......... .......... .......... .......... .......... 61% 96.8M 0s 7400K .......... .......... .......... .......... .......... 62% 96.1M 0s 7450K .......... .......... .......... .......... .......... 62% 105M 0s 7500K .......... .......... .......... .......... .......... 63% 101M 0s 7550K .......... .......... .......... .......... .......... 63% 90.1M 0s 7600K .......... .......... .......... .......... .......... 63% 91.1M 0s 7650K .......... .......... .......... .......... .......... 64% 116M 0s 7700K .......... .......... .......... .......... .......... 64% 117M 0s 7750K .......... .......... .......... .......... .......... 65% 107M 0s 7800K .......... .......... .......... .......... .......... 65% 96.6M 0s 7850K .......... .......... .......... .......... .......... 65% 118M 0s 7900K .......... .......... .......... .......... .......... 66% 111M 0s 7950K .......... .......... .......... .......... .......... 66% 96.4M 0s 8000K .......... .......... .......... .......... .......... 67% 115M 0s 8050K .......... .......... .......... .......... .......... 67% 99.9M 0s 8100K .......... .......... .......... .......... .......... 68% 116M 0s 8150K .......... .......... .......... .......... .......... 68% 93.6M 0s 8200K .......... .......... .......... .......... .......... 68% 120M 0s 8250K .......... .......... .......... .......... .......... 69% 115M 0s 8300K .......... .......... .......... .......... .......... 69% 120M 0s 8350K .......... .......... .......... .......... .......... 70% 99.2M 0s 8400K .......... .......... .......... .......... .......... 70% 96.7M 0s 8450K .......... .......... .......... .......... .......... 70% 93.4M 0s 8500K .......... .......... .......... .......... .......... 71% 107M 0s 8550K .......... .......... .......... .......... .......... 71% 84.4M 0s 8600K .......... .......... .......... .......... .......... 72% 98.7M 0s 8650K .......... .......... .......... .......... .......... 72% 106M 0s 8700K .......... .......... .......... .......... .......... 73% 123M 0s 8750K .......... .......... .......... .......... .......... 73% 121M 0s 8800K .......... .......... .......... .......... .......... 73% 120M 0s 8850K .......... .......... .......... .......... .......... 74% 157M 0s 8900K .......... .......... .......... .......... .......... 74% 98.9M 0s 8950K .......... .......... .......... .......... .......... 75% 98.1M 0s 9000K .......... .......... .......... .......... .......... 75% 119M 0s 9050K .......... .......... .......... .......... .......... 75% 163M 0s 9100K .......... .......... .......... .......... .......... 76% 147M 0s 9150K .......... .......... .......... .......... .......... 76% 106M 0s 9200K .......... .......... .......... .......... .......... 77% 189M 0s 9250K .......... .......... .......... .......... .......... 77% 165M 0s 9300K .......... .......... .......... .......... .......... 78% 158M 0s 9350K .......... .......... .......... .......... .......... 78% 130M 0s 9400K .......... .......... .......... .......... .......... 78% 85.2M 0s 9450K .......... .......... .......... .......... .......... 79% 88.5M 0s 9500K .......... .......... .......... .......... .......... 79% 71.7M 0s 9550K .......... .......... .......... .......... .......... 80% 113M 0s 9600K .......... .......... .......... .......... .......... 80% 138M 0s 9650K .......... .......... .......... .......... .......... 80% 116M 0s 9700K .......... .......... .......... .......... .......... 81% 125M 0s 9750K .......... .......... .......... .......... .......... 81% 117M 0s 9800K .......... .......... .......... .......... .......... 82% 165M 0s 9850K .......... .......... .......... .......... .......... 82% 160M 0s 9900K .......... .......... .......... .......... .......... 83% 111M 0s 9950K .......... .......... .......... .......... .......... 83% 108M 0s 10000K .......... .......... .......... .......... .......... 83% 151M 0s 10050K .......... .......... .......... .......... .......... 84% 182M 0s 10100K .......... .......... .......... .......... .......... 84% 195M 0s 10150K .......... .......... .......... .......... .......... 85% 259M 0s 10200K .......... .......... .......... .......... .......... 85% 169M 0s 10250K .......... .......... .......... .......... .......... 85% 145M 0s 10300K .......... .......... .......... .......... .......... 86% 177M 0s 10350K .......... .......... .......... .......... .......... 86% 104M 0s 10400K .......... .......... .......... .......... .......... 87% 129M 0s 10450K .......... .......... .......... .......... .......... 87% 115M 0s 10500K .......... .......... .......... .......... .......... 88% 106M 0s 10550K .......... .......... .......... .......... .......... 88% 108M 0s 10600K .......... .......... .......... .......... .......... 88% 127M 0s 10650K .......... .......... .......... .......... .......... 89% 102M 0s 10700K .......... .......... .......... .......... .......... 89% 104M 0s 10750K .......... .......... .......... .......... .......... 90% 100M 0s 10800K .......... .......... .......... .......... .......... 90% 173M 0s 10850K .......... .......... .......... .......... .......... 90% 297M 0s 10900K .......... .......... .......... .......... .......... 91% 282M 0s 10950K .......... .......... .......... .......... .......... 91% 252M 0s 11000K .......... .......... .......... .......... .......... 92% 292M 0s 11050K .......... .......... .......... .......... .......... 92% 286M 0s 11100K .......... .......... .......... .......... .......... 93% 300M 0s 11150K .......... .......... .......... .......... .......... 93% 217M 0s 11200K .......... .......... .......... .......... .......... 93% 279M 0s 11250K .......... .......... .......... .......... .......... 94% 299M 0s 11300K .......... .......... .......... .......... .......... 94% 303M 0s 11350K .......... .......... .......... .......... .......... 95% 270M 0s 11400K .......... .......... .......... .......... .......... 95% 292M 0s 11450K .......... .......... .......... .......... .......... 95% 282M 0s 11500K .......... .......... .......... .......... .......... 96% 297M 0s 11550K .......... .......... .......... .......... .......... 96% 248M 0s 11600K .......... .......... .......... .......... .......... 97% 309M 0s 11650K .......... .......... .......... .......... .......... 97% 298M 0s 11700K .......... .......... .......... .......... .......... 98% 283M 0s 11750K .......... .......... .......... .......... .......... 98% 246M 0s 11800K .......... .......... .......... .......... .......... 98% 282M 0s 11850K .......... .......... .......... .......... .......... 99% 304M 0s 11900K .......... .......... .......... .......... .......... 99% 300M 0s 11950K .......... .......... .......... ... 100% 300M=0.2s 2020-10-07 13:30:14 (57.3 MB/s) - '/var/lib/xtesting/results/cnf_conformance/tools/helm/helm-v3.1.1-linux-amd64.tar.gz' saved [12270615/12270615] Global helm found. Version: v3.3.1 Local helm found. Version:  Global wget found. Version: 1.20.3 No Local wget version found Global curl found. Version: 7.64.0 No Local curl version found Global kubectl found. Version: 1.13 No Local kubectl version found All prerequisites found. create_results_yml file exists?:false Successfully created directories for cnf-conformance Setup complete 2020-10-07 13:30:36,372 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance cnf_setup cnf-config=cnf-conformance.yml Successfully created directories for cnf-conformance Successfully setup coredns 2020-10-07 13:32:23,001 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance all install.go:158: [debug] Original chart version: "" install.go:175: [debug] CHART PATH: /root/.cache/helm/repository/coredns-1.13.4.tgz Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply create_results_yml file exists?:false ✔️ PASSED: No privileged containers Security final score: 5 of 5 ✔️ PASSED: Replicas increased to 3 📦📈 ✔️ PASSED: Replicas decreased to 1 📦📉 Scalability final score: 20 of 20 ✖️ FAILURE: IP addresses found ✔️ PASSED: Helm liveness probe found ✔️ PASSED: Helm readiness probe found ✔️ PASSED: CNF coredns-coredns Rolling Update Passed ✔️ PASSED: NodePort is not used ✔️ PASSED: No hard-coded IP addresses found in the runtime K8s configuration Configuration lifecycle final score: 24 of 25 PASSED (by default): No install script provided Successfully created directories for cnf-conformance ✔️ PASSED: Helm Chart cnfs/coredns/helm_chart/coredns Lint Passed ✔️ PASSED: Published Helm Chart Found ✔️ PASSED: Helm deploy successful Installability final score: 20 of 20 Hostname lookup for hub.docker.com failed: System error /home/pair/workspace/taylor/qa/jun8/lib/halite/src/halite/client.cr:155:7 in 'perform' /home/pair/workspace/taylor/qa/jun8/lib/halite/src/halite/client.cr:115:9 in 'request' /home/pair/workspace/taylor/qa/jun8/lib/halite/src/halite/chainable.cr:485:7 in '->' /home/pair/workspace/taylor/qa/jun8/src/tasks/utils/utils.cr:255:3 in 'task_runner' /home/pair/workspace/taylor/qa/jun8/src/tasks/microservice.cr:93:3 in '->' /home/pair/workspace/taylor/qa/jun8/lib/sam/src/sam/task.cr:39:29 in 'call' /home/pair/workspace/taylor/qa/jun8/lib/sam/src/sam/task.cr:39:29 in 'call' /home/pair/workspace/taylor/qa/jun8/lib/sam/src/sam.cr:43:5 in '__crystal_main' /usr/local/depot/crystal-0.33.0-1/share/crystal/src/crystal/main.cr:106:5 in 'main' ??? ??? ✔️ PASSED: CNF had a reasonable startup time 🚀 Microservice final score: 5 of 10 Final score: 74 of 80 Results have been saved to cnf-conformance-results-20201007-133222-994.yml 2020-10-07 13:32:23,025 - functest_kubernetes.cnf_conformance.conformance - INFO - +-------------------------------------------------------------+----------------+ | NAME | STATUS | +-------------------------------------------------------------+----------------+ | privileged | passed | | increase_capacity | passed | | decrease_capacity | passed | | ip_addresses | failed | | liveness | passed | | readiness | passed | | rolling_update | passed | | nodeport_not_used | passed | | hardcoded_ip_addresses_in_k8s_runtime_configuration | passed | | install_script_helm | passed | | helm_chart_valid | passed | | helm_chart_published | passed | | helm_deploy | passed | | reasonable_startup_time | passed | +-------------------------------------------------------------+----------------+ 2020-10-07 13:32:23,026 - xtesting.ci.run_tests - INFO - Test result: +-------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------------+------------------+------------------+----------------+ | cnf_conformance | functest | 02:12 | PASS | +-------------------------+------------------+------------------+----------------+ 2020-10-07 13:32:26,905 - functest_kubernetes.cnf_conformance.conformance - INFO - cnf-conformance cnf_cleanup cnf-config=cnf-conformance.yml Successfully cleaned up coredns