Gap analysis and Development

Introduction

• Describe the purpose of this chapter, which includes, but not limited to:

• Test Case Gaps (analysis)

• Automation Gaps

• OpenStack release Comparisons

Openstack Release Comparisons

• Provide details, preferably in table format, comparing OpenStack releases based on Wallaby baseline for RI-1

Automation Gaps

At the time of writing, the yaml file configuring all RI Jenkins jobs are postprocessed by hand which requires lots of skills especially about Jenkins job builder. The RI Cookbook will be deeply simplified if the deployment scripts are delivered in a new Xtesting-based container as proposed in new RI deployment container. In addition to avoid configuring the jumphost, it will allow generating the Jenkins jobs via a simple yaml file and Xtesting CI.

Test Case Gaps

Anuket has developed many test cases in the different test projects which can quickly improve RC. As listed in NFVI Conformance Requirements, porting all the existing testcases to Xtesting will unify the test case execution and simplify the test integration as required by RC. Here are all the related issues:

• port VinePerf to Xtesting

• port NFVbench testcases to Xtesting

Here are the possible new test cases which could be integrated in the existing Anuket projects to improve RC:

issues	requirements
integrate KloudBuster in Functest	disk benchmarking
add tempest-stress in Functest	stress testing

Framework Gaps

As proposed in port VTP test cases to Xtesting, VTP selected in VNF Testing Framework Requirements requires small adaptations to fully fulfill the current NFVI Conformance Requirements. It seems trivial changes as VTP proposed a REST API but will ensure that both NFVI and VNF testing can be executed in the same CI toolchain very easily.