Gap analysis and Development ============================ Introduction ------------ - Describe the purpose of this chapter, which includes, but not limited to: - Test Case Gaps (analysis) - Automation Gaps - OpenStack release Comparisons Openstack Release Comparisons ----------------------------- - Provide details, preferably in table format, comparing OpenStack releases based on Wallaby baseline for RI-1 Test Case Gaps -------------- Anuket has developed many test cases in the different `test projects `__ which can quickly improve RC. As listed in :doc:`ref_cert/RC1/chapters/chapter02`, porting all the existing testcases to Xtesting will unify the test case execution and simplify the test integration as required by RC. Here are all the related issues: - `port VinePerf to Xtesting `__ - `port NFVbench testcases to Xtesting `__ Here are the possible new test cases which could be integrated in the existing Anuket projects to improve RC: +-------------------------------------------------+-------------------+ | issues | requirements | +=================================================+===================+ | `integrate KloudBuster in | disk benchmarking | | Functest | | | `__ | | +-------------------------------------------------+-------------------+ | `add tempest-stress in | stress testing | | Functest | | | `__ | | +-------------------------------------------------+-------------------+ Framework Gaps -------------- As proposed in `port VTP test cases to Xtesting `__, VTP selected in :doc:`ref_cert/RC1/chapters/chapter05` requires small adaptations to fully fulfill the current :doc:`ref_cert/RC1/chapters/chapter02`. It seems trivial changes as VTP proposed a REST API but will ensure that both NFVI and VNF testing can be executed in the same CI toolchain very easily.