€cdocutils.nodes
document
q)q}q(U nametypesq}q(X version historyqNX featuresqNX characteristicsqNX
referencesq NX" feature testing scope and approachq
NX scope of testingqNX another test areaqNX feature test scopeq
NX
resilienceqNX "pharos specification"qˆX next test areaqNX scaleqNX introductionqNX
test approachqNX test criteria and reportingqNX overviewqNX definitions and termsqNX pre-test validationqNX test planning and preparationqNX cvp test executionqNX test reportsqNX purposeqNX security?qNX6 compliance and verification program test specificationqNX excluded test areasqNX test design and toolsqNX included test areasq NX opnfv glossaryq!ˆX vim nbi testingq"NX refstackq#ˆuUsubstitution_defsq$}q%Uparse_messagesq&]q'cdocutils.nodes
system_message
q()q)}q*(U rawsourceq+U Uparentq,cdocutils.nodes
section
q-)q.}q/(h+U h,h-)q0}q1(h+U h,h-)q2}q3(h+U h,h-)q4}q5(h+U h,hUsourceq6Xk /opt/jenkins-ci/jobs/opnfv-docs-verify-master/workspace/docs_build/_src/testing/user/teststrategy/index.rstq7Utagnameq8Usectionq9U
attributesq:}q;(Udupnamesq<]Uclassesq=]Ubackrefsq>]Uidsq?]q@U6compliance-and-verification-program-test-specificationqAaUnamesqB]qChauUlineqDKUdocumentqEhUchildrenqF]qG(cdocutils.nodes
title
qH)qI}qJ(h+X6 Compliance and Verification program test specificationqKh,h4h6h7h8UtitleqLh:}qM(h<]h=]h>]h?]hB]uhDKhEhhF]qNcdocutils.nodes
Text
qOX6 Compliance and Verification program test specificationqP…qQ}qR(h+hKh,hIubaubcdocutils.nodes
compound
qS)qT}qU(h+U h,h4h6h7h8UcompoundqVh:}qW(h<]h=]qXUtoctree-wrapperqYah>]h?]hB]uhDNhEhhF]qZcsphinx.addnodes
toctree
q[)q\}q](h+U h,hTh6h7h8Utoctreeq^h:}q_(Unumberedq`K U
includehiddenqa‰h,X teststrategy/indexqbUcaptionqcNUglobqd‰h?]h>]U
titlesonlyqe‰h<]h=]hB]Uentriesqf]qgUhiddenqh‰Uincludefilesqi]qjUmaxdepthqkKuhDK hF]ubaubh-)ql}qm(h+U h,h4h6h7h8h9h:}qn(h<]h=]h>]h?]qoUversion-historyqpahB]qqhauhDK
hEhhF]qr(hH)qs}qt(h+X Version historyquh,hlh6h7h8hLh:}qv(h<]h=]h>]h?]hB]uhDK
hEhhF]qwhOX Version historyqx…qy}qz(h+huh,hsubaubcdocutils.nodes
table
q{)q|}q}(h+U h,hlh6h7h8Utableq~h:}q(h<]h=]h>]h?]hB]uhDNhEhhF]q€cdocutils.nodes
tgroup
q)q‚}qƒ(h+U h:}q„(h?]h>]h<]h=]hB]UcolsKuh,h|hF]q…(cdocutils.nodes
colspec
q†)q‡}qˆ(h+U h:}q‰(h?]h>]h<]h=]hB]UcolwidthKuh,h‚hF]h8UcolspecqŠubh†)q‹}qŒ(h+U h:}q(h?]h>]h<]h=]hB]UcolwidthK
uh,h‚hF]h8hŠubh†)qŽ}q(h+U h:}q(h?]h>]h<]h=]hB]UcolwidthKuh,h‚hF]h8hŠubh†)q‘}q’(h+U h:}q“(h?]h>]h<]h=]hB]UcolwidthK"uh,h‚hF]h8hŠubcdocutils.nodes
tbody
q”)q•}q–(h+U h:}q—(h<]h=]h>]h?]hB]uh,h‚hF]q˜(cdocutils.nodes
row
q™)qš}q›(h+U h:}qœ(h<]h=]h>]h?]hB]uh,h•hF]q(cdocutils.nodes
entry
qž)qŸ}q (h+U h:}q¡(h<]h=]h>]h?]hB]uh,hšhF]q¢cdocutils.nodes
paragraph
q£)q¤}q¥(h+X **Date**q¦h,hŸh6h7h8U paragraphq§h:}q¨(h<]h=]h>]h?]hB]uhDKhF]q©cdocutils.nodes
strong
qª)q«}q¬(h+h¦h:}q(h<]h=]h>]h?]hB]uh,h¤hF]q®hOX Dateq¯…q°}q±(h+U h,h«ubah8Ustrongq²ubaubah8Uentryq³ubhž)q´}qµ(h+U h:}q¶(h<]h=]h>]h?]hB]uh,hšhF]q·h£)q¸}q¹(h+X **Ver.**qºh,h´h6h7h8h§h:}q»(h<]h=]h>]h?]hB]uhDKhF]q¼hª)q½}q¾(h+hºh:}q¿(h<]h=]h>]h?]hB]uh,h¸hF]qÀhOX Ver.qÁ…qÂ}qÃ(h+U h,h½ubah8h²ubaubah8h³ubhž)qÄ}qÅ(h+U h:}qÆ(h<]h=]h>]h?]hB]uh,hšhF]qÇh£)qÈ}qÉ(h+X
**Author**qÊh,hÄh6h7h8h§h:}qË(h<]h=]h>]h?]hB]uhDKhF]qÌhª)qÍ}qÎ(h+hÊh:}qÏ(h<]h=]h>]h?]hB]uh,hÈhF]qÐhOX AuthorqÑ…qÒ}qÓ(h+U h,hÍubah8h²ubaubah8h³ubhž)qÔ}qÕ(h+U h:}qÖ(h<]h=]h>]h?]hB]uh,hšhF]q×h£)qØ}qÙ(h+X **Comment**qÚh,hÔh6h7h8h§h:}qÛ(h<]h=]h>]h?]hB]uhDKhF]qÜhª)qÝ}qÞ(h+hÚh:}qß(h<]h=]h>]h?]hB]uh,hØhF]qàhOX Commentqá…qâ}qã(h+U h,hÝubah8h²ubaubah8h³ubeh8Urowqäubh™)qå}qæ(h+U h:}qç(h<]h=]h>]h?]hB]uh,h•hF]qè(hž)qé}qê(h+U h:}që(h<]h=]h>]h?]hB]uh,håhF]qìh£)qí}qî(h+X
2017-03-15qïh,héh6h7h8h§h:}qð(h<]h=]h>]h?]hB]uhDKhF]qñhOX
2017-03-15qò…qó}qô(h+hïh,híubaubah8h³ubhž)qõ}qö(h+U h:}q÷(h<]h=]h>]h?]hB]uh,håhF]qøh£)qù}qú(h+X 0.0.1qûh,hõh6h7h8h§h:}qü(h<]h=]h>]h?]hB]uhDKhF]qýhOX 0.0.1qþ…qÿ}r (h+hûh,hùubaubah8h³ubhž)r }r (h+U h:}r (h<]h=]h>]h?]hB]uh,håhF]r h£)r }r (h+X Chris Pricer h,j h6h7h8h§h:}r (h<]h=]h>]h?]hB]uhDKhF]r hOX Chris Pricer
…r }r (h+j h,j ubaubah8h³ubhž)r
}r (h+U h:}r (h<]h=]h>]h?]hB]uh,håhF]r h£)r }r (h+X
Draft versionr h,j
h6h7h8h§h:}r (h<]h=]h>]h?]hB]uhDKhF]r hOX
Draft versionr …r }r (h+j h,j ubaubah8h³ubeh8häubeh8Utbodyr ubeh8Utgroupr ubaubeubh2h-)r }r (h+U h,h4h6h7h8h9h:}r (h<]h=]h>]h?]r Uoverviewr ahB]r hauhDKhEhhF]r! (hH)r" }r# (h+X Overviewr$ h,j h6h7h8hLh:}r% (h<]h=]h>]h?]hB]uhDKhEhhF]r& hOX Overviewr' …r( }r) (h+j$ h,j" ubaubh£)r* }r+ (h+X† This section of the document will describe in details the processes and procedures required to perform OPNFV CVP
compliance testing. The section is structured to address; planning and preparation, the approach to testing, the
scope of test activities including details of the test areas, methods and tools used in the testing and the result,
reporting & output of the test suites when run.r, h,j h6h7h8h§h:}r- (h<]h=]h>]h?]hB]uhDK‘hEhhF]r. hOX† This section of the document will describe in details the processes and procedures required to perform OPNFV CVP
compliance testing. The section is structured to address; planning and preparation, the approach to testing, the
scope of test activities including details of the test areas, methods and tools used in the testing and the result,
reporting & output of the test suites when run.r/ …r0 }r1 (h+j, h,j* ubaubeubh-)r2 }r3 (h+U h,h4h6h7h8h9h:}r4 (h<]h=]h>]h?]r5 Utest-planning-and-preparationr6 ahB]r7 hauhDK—hEhhF]r8 (hH)r9 }r: (h+X Test planning and preparationr; h,j2 h6h7h8hLh:}r< (h<]h=]h>]h?]hB]uhDK—hEhhF]r= hOX Test planning and preparationr> …r? }r@ (h+j; h,j9 ubaubh£)rA }rB (h+X* https://jira.opnfv.org/browse/DOVETAIL-384rC h,j2 h6h7h8h§h:}rD (h<]h=]h>]h?]hB]uhDK™hEhhF]rE cdocutils.nodes
reference
rF )rG }rH (h+jC h:}rI (UrefurijC h?]h>]h<]h=]hB]uh,jA hF]rJ hOX* https://jira.opnfv.org/browse/DOVETAIL-384rK …rL }rM (h+U h,jG ubah8U referencerN ubaubh£)rO }rP (h+Xd Give an outline of the planning phase, refer to the detailed system prep guide and test guides here.rQ h,j2 h6h7h8h§h:}rR (h<]h=]h>]h?]hB]uhDK›hEhhF]rS hOXd Give an outline of the planning phase, refer to the detailed system prep guide and test guides here.rT …rU }rV (h+jQ h,jO ubaubcdocutils.nodes
block_quote
rW )rX }rY (h+U h,j2 h6h7h8Ublock_quoterZ h:}r[ (h<]h=]h>]h?]hB]uhDNhEhhF]r\ h£)r] }r^ (h+X! ../../systempreparation/index.rstr_ h,jX h6h7h8h§h:}r` (h<]h=]h>]h?]hB]uhDKhF]ra hOX! ../../systempreparation/index.rstrb …rc }rd (h+j_ h,j] ubaubaubeubh-)re }rf (h+U h,h4h6h7h8h9h:}rg (h<]h=]h>]h?]rh U"feature-testing-scope-and-approachri ahB]rj h
auhDK hEhhF]rk (hH)rl }rm (h+X" Feature testing scope and approachrn h,je h6h7h8hLh:}ro (h<]h=]h>]h?]hB]uhDK hEhhF]rp hOX" Feature testing scope and approachrq …rr }rs (h+jn h,jl ubaubh-)rt }ru (h+U h,je h6h7h8h9h:}rv (h<]h=]h>]h?]rw Upre-test-validationrx ahB]ry hauhDK¤hEhhF]rz (hH)r{ }r| (h+X Pre-test validationr} h,jt h6h7h8hLh:}r~ (h<]h=]h>]h?]hB]uhDK¤hEhhF]r hOX Pre-test validationr€ …r }r‚ (h+j} h,j{ ubaubh£)rƒ }r„ (h+XÂ Describe how to evaluate test readiness here.
I suggest this be a process of doing a "dry run" and evaluating the results on the DB. This should not
need to be reproduced later in the document.r… h,jt h6h7h8h§h:}r† (h<]h=]h>]h?]hB]uhDK¦hEhhF]r‡ hOXÂ Describe how to evaluate test readiness here.
I suggest this be a process of doing a "dry run" and evaluating the results on the DB. This should not
need to be reproduced later in the document.rˆ …r‰ }rŠ (h+j… h,jƒ ubaubeubh-)r‹ }rŒ (h+U h,je h6h7h8h9h:}r (h<]h=]h>]h?]rŽ U
test-approachr ahB]r hauhDKhEhhF]r‘ (hH)r’ }r“ (h+X
Test approachr” h,j‹ h6h7h8hLh:}r• (h<]h=]h>]h?]hB]uhDKhEhhF]r– hOX
Test approachr— …r˜ }r™ (h+j” h,j’ ubaubh£)rš }r› (h+X; Here we should describe the way we approach testing different areas. API through RefStack, resilience through
ETSI test implementations, security is done in xyz way. This should serve as an introduction to the following
feature test scope sections and provide common information not to be replicated further down.rœ h,j‹ h6h7h8h§h:}r (h<]h=]h>]h?]hB]uhDK¯hEhhF]rž hOX; Here we should describe the way we approach testing different areas. API through RefStack, resilience through
ETSI test implementations, security is done in xyz way. This should serve as an introduction to the following
feature test scope sections and provide common information not to be replicated further down.rŸ …r }r¡ (h+jœ h,jš ubaubeubh-)r¢ }r£ (h+U h,je h6h7h8h9h:}r¤ (h<]h=]h>]h?]r¥ Ufeature-test-scoper¦ ahB]r§ h
auhDK¶hEhhF]r¨ (hH)r© }rª (h+X Feature test scoper« h,j¢ h6h7h8hLh:}r¬ (h<]h=]h>]h?]hB]uhDK¶hEhhF]r hOX Feature test scoper® …r¯ }r° (h+j« h,j© ubaubh-)r± }r² (h+U h,j¢ h6h7h8h9h:}r³ (h<]h=]h>]h?]r´ Uincluded-test-areasrµ ahB]r¶ h auhDK¹hEhhF]r· (hH)r¸ }r¹ (h+X Included test areasrº h,j± h6h7h8hLh:}r» (h<]h=]h>]h?]hB]uhDK¹hEhhF]r¼ hOX Included test areasr½ …r¾ }r¿ (h+jº h,j¸ ubaubh£)rÀ }rÁ (h+XQ CVP testing for the Danube release focuses on evaluating the ability of a platform to host basic carrier
networking related workloads. The testing focuses on establishing the ability of the SUT to perform
basic NFVi operations such as managing images, instatiating workload & networking these workloads in a
secure and resiliant manner.r h,j± h6h7h8h§h:}rà (h<]h=]h>]h?]hB]uhDK»hEhhF]rÄ hOXQ CVP testing for the Danube release focuses on evaluating the ability of a platform to host basic carrier
networking related workloads. The testing focuses on establishing the ability of the SUT to perform
basic NFVi operations such as managing images, instatiating workload & networking these workloads in a
secure and resiliant manner.rÅ …rÆ }rÇ (h+j h,jÀ ubaubh£)rÈ }rÉ (h+Xê Many OPNFV features are derived from our target upstream communities resulting in the tests focusing
on exposing behaviour present through those development efforts. This approach to OPNFV development
is reflected in our CVP testing where upstream validation procedures are leveraged to validate the
composite platform. The OpenStack `RefStack `_ test suites are
leveraged in OPNFV for performing VIM validation according to expected behaviour in OPNFV.h,j± h6h7h8h§h:}rÊ (h<]h=]h>]h?]hB]uhDKÀhEhhF]rË (hOXP Many OPNFV features are derived from our target upstream communities resulting in the tests focusing
on exposing behaviour present through those development efforts. This approach to OPNFV development
is reflected in our CVP testing where upstream validation procedures are leveraged to validate the
composite platform. The OpenStack rÌ …rÍ }rÎ (h+XP Many OPNFV features are derived from our target upstream communities resulting in the tests focusing
on exposing behaviour present through those development efforts. This approach to OPNFV development
is reflected in our CVP testing where upstream validation procedures are leveraged to validate the
composite platform. The OpenStack h,jÈ ubjF )rÏ }rÐ (h+X/ `RefStack `_h:}rÑ (UnameX RefStackUrefurirÒ X! https://refstack.openstack.org/#/rÓ h?]h>]h<]h=]hB]uh,jÈ hF]rÔ hOX RefStackrÕ …rÖ }r× (h+U h,jÏ ubah8jN ubcdocutils.nodes
target
rØ )rÙ }rÚ (h+X$ U
referencedrÛ Kh,jÈ h8UtargetrÜ h:}rÝ (UrefurijÓ h?]rÞ Urefstackrß ah>]h<]h=]hB]rà h#auhF]ubhOXk test suites are
leveraged in OPNFV for performing VIM validation according to expected behaviour in OPNFV.rá …râ }rã (h+Xk test suites are
leveraged in OPNFV for performing VIM validation according to expected behaviour in OPNFV.h,jÈ ubeubh£)rä }rå (h+XI OPNFV CVP testing has explicit requirements on hardware, control plane and compute topologies which
are assumed to be in place, these are covered in the `Preparing the virtualisation infrastructure`_
section of this document. Tests may fail if the system is not prepared and configured in accordance
the prpeparation guidelines.h,j± h6h7h8h§h:}ræ (h<]h=]h>]h?]hB]uhDKÆhEhhF]rç (hOX™ OPNFV CVP testing has explicit requirements on hardware, control plane and compute topologies which
are assumed to be in place, these are covered in the rè …ré }rê (h+X™ OPNFV CVP testing has explicit requirements on hardware, control plane and compute topologies which
are assumed to be in place, these are covered in the h,jä ubcdocutils.nodes
problematic
rë )rì }rí (h+X. `Preparing the virtualisation infrastructure`_rî h,jä h6Nh8Uproblematicrï h:}rð (h?]rñ Uid2rò ah>]h<]h=]hB]UrefidUid1ró uhDNhEhhF]rô hOX. `Preparing the virtualisation infrastructure`_rõ …rö }r÷ (h+U h,jì ubaubhOX‚
section of this document. Tests may fail if the system is not prepared and configured in accordance
the prpeparation guidelines.rø …rù }rú (h+X‚
section of this document. Tests may fail if the system is not prepared and configured in accordance
the prpeparation guidelines.h,jä ubeubeubh-)rû }rü (h+U h,j¢ h6h7h8h9h:}rý (h<]h=]h>]h?]rþ Uexcluded-test-areasrÿ ahB]r hauhDKÌhEhhF]r (hH)r }r (h+X Excluded test areasr h,jû h6h7h8hLh:}r (h<]h=]h>]h?]hB]uhDKÌhEhhF]r hOX Excluded test areasr …r }r (h+j h,j ubaubh£)r
}r (h+XÝ The CVP testing procedure in Danube do not cover all aspects of the available OPNFV system, nor feature
suites. To ensure the highest quality of evaluation that provides a trustworthy foundation for industry
compliance toward a common OPNFV standard tests and test areas are selected based on three key principals;
maturity of the test area and framework, availability of features and capabilities across OPNFV compositions,
relevance and value to the industry for evaluation.r h,jû h6h7h8h§h:}r
(h<]h=]h>]h?]hB]uhDKÎhEhhF]r hOXÝ The CVP testing procedure in Danube do not cover all aspects of the available OPNFV system, nor feature
suites. To ensure the highest quality of evaluation that provides a trustworthy foundation for industry
compliance toward a common OPNFV standard tests and test areas are selected based on three key principals;
maturity of the test area and framework, availability of features and capabilities across OPNFV compositions,
relevance and value to the industry for evaluation.r …r }r (h+j h,j
ubaubh£)r }r (h+X’ In the Danube release of the CVP we have elected to esbalish an evaluation suite for only the common base
features of the platform. Features areas that are optional or not yet mature in the platform are expluded.
This includes a number of optinal networking features such as BGP VPN networking and Service Chaining which
are intended to be included as optional evaluation areas in future CVP releases.r h,jû h6h7h8h§h:}r (h<]h=]h>]h?]hB]uhDKÔhEhhF]r hOX’ In the Danube release of the CVP we have elected to esbalish an evaluation suite for only the common base
features of the platform. Features areas that are optional or not yet mature in the platform are expluded.
This includes a number of optinal networking features such as BGP VPN networking and Service Chaining which
are intended to be included as optional evaluation areas in future CVP releases.r …r }r (h+j h,j ubaubh£)r }r (h+Xª The Danube release of the OPNFV CVP testing suite in addition dose not attempt to provide an evaluation criteria
for hardware. Any hardware used in the evaluation testing must comply to the pre-resuities outlined in the
`Preparing the virtualisation infrastructure`_ section of this document. Although the hardware is not tested
itself and no qualification metric has been established for the hardware in the Danube release.h,jû h6h7h8h§h:}r (h<]h=]h>]h?]hB]uhDKÙhEhhF]r (hOXÝ The Danube release of the OPNFV CVP testing suite in addition dose not attempt to provide an evaluation criteria
for hardware. Any hardware used in the evaluation testing must comply to the pre-resuities outlined in the
r …r }r (h+XÝ The Danube release of the OPNFV CVP testing suite in addition dose not attempt to provide an evaluation criteria
for hardware. Any hardware used in the evaluation testing must comply to the pre-resuities outlined in the
h,j ubjë )r! }r" (h+X. `Preparing the virtualisation infrastructure`_r# h,j h6Nh8jï h:}r$ (h?]r% Uid4r& ah>]h<]h=]hB]UrefidUid3r' uhDNhEhhF]r( hOX. `Preparing the virtualisation infrastructure`_r) …r* }r+ (h+U h,j! ubaubhOXŸ section of this document. Although the hardware is not tested
itself and no qualification metric has been established for the hardware in the Danube release.r, …r- }r. (h+XŸ section of this document. Although the hardware is not tested
itself and no qualification metric has been established for the hardware in the Danube release.h,j ubeubeubh-)r/ }r0 (h+U h,j¢ h6h7h8h9h:}r1 (h<]h=]h>]h?]r2 Utest-criteria-and-reportingr3 ahB]r4 hauhDKßhEhhF]r5 (hH)r6 }r7 (h+X Test criteria and reportingr8 h,j/ h6h7h8hLh:}r9 (h<]h=]h>]h?]hB]uhDKßhEhhF]r: hOX Test criteria and reportingr; …r< }r= (h+j8 h,j6 ubaubh£)r> }r? (h+X* https://jira.opnfv.org/browse/DOVETAIL-389r@ h,j/ h6h7h8h§h:}rA (h<]h=]h>]h?]hB]uhDKáhEhhF]rB jF )rC }rD (h+j@ h:}rE (Urefurij@ h?]h>]h<]h=]hB]uh,j> hF]rF hOX* https://jira.opnfv.org/browse/DOVETAIL-389rG …rH }rI (h+U h,jC ubah8jN ubaubh£)rJ }rK (h+X This section should specify the criteria to be used to decide whether a test item has passed or failed.
As each area may have differences it is important to ensure the user can react to a failure in accordance
with it's relevance to the overall test suites running.rL h,j/ h6h7h8h§h:}rM (h<]h=]h>]h?]hB]uhDKãhEhhF]rN hOX This section should specify the criteria to be used to decide whether a test item has passed or failed.
As each area may have differences it is important to ensure the user can react to a failure in accordance
with it's relevance to the overall test suites running.rO …rP }rQ (h+jL h,jJ ubaubh£)rR }rS (h+X6 Critical functions that are mandatory should be identified here. If any of these fail the system testing
should be halted. If we can having a grading or sorts described here would be helpful as a "guide" for a
tester to know if they should submit, resolve an item in their stack, or try again at another time.rT h,j/ h6h7h8h§h:}rU (h<]h=]h>]h?]hB]uhDKçhEhhF]rV hOX6 Critical functions that are mandatory should be identified here. If any of these fail the system testing
should be halted. If we can having a grading or sorts described here would be helpful as a "guide" for a
tester to know if they should submit, resolve an item in their stack, or try again at another time.rW …rX }rY (h+jT h,jR ubaubeubeubh-)rZ }r[ (h+U h,je h6h7h8h9h:}r\ (h<]h=]h>]h?]r] Utest-design-and-toolsr^ ahB]r_ hauhDKîhEhhF]r` (hH)ra }rb (h+X Test design and toolsrc h,jZ h6h7h8hLh:}rd (h<]h=]h>]h?]hB]uhDKîhEhhF]re hOX Test design and toolsrf …rg }rh (h+jc h,ja ubaubh£)ri }rj (h+Xr This section needs to be done once we know the tools and areas covered by the CVP testing suites. Parked for now.rk h,jZ h6h7h8h§h:}rl (h<]h=]h>]h?]hB]uhDKðhEhhF]rm hOXr This section needs to be done once we know the tools and areas covered by the CVP testing suites. Parked for now.rn …ro }rp (h+jk h,ji ubaubh-)rq }rr (h+U h,jZ h6h7h8h9h:}rs (h<]h=]h>]h?]rt Uvim-nbi-testingru ahB]rv h"auhDKóhEhhF]rw (hH)rx }ry (h+X VIM NBI testingrz h,jq h6h7h8hLh:}r{ (h<]h=]h>]h?]hB]uhDKóhEhhF]r| hOX VIM NBI testingr} …r~ }r (h+jz h,jx ubaubh£)r€ }r (h+X5 Describe the test areas addressed and how the tools are designed. It is important to understand the behaviour
of the testing framework when running these tests. Here we get into the details of behaviour for each of
the test frameworks we use, what they are testing and how the results are to be interpreted.r‚ h,jq h6h7h8h§h:}rƒ (h<]h=]h>]h?]hB]uhDKõhEhhF]r„ hOX5 Describe the test areas addressed and how the tools are designed. It is important to understand the behaviour
of the testing framework when running these tests. Here we get into the details of behaviour for each of
the test frameworks we use, what they are testing and how the results are to be interpreted.r… …r† }r‡ (h+j‚ h,j€ ubaubh£)rˆ }r‰ (h+X® Outline the tool in detail, in this case RefStack. How does it work, is it run to completion, is reporting
done per test case when do I as a user know I should do something?rŠ h,jq h6h7h8h§h:}r‹ (h<]h=]h>]h?]hB]uhDKùhEhhF]rŒ hOX® Outline the tool in detail, in this case RefStack. How does it work, is it run to completion, is reporting
done per test case when do I as a user know I should do something?r …rŽ }r (h+jŠ h,jˆ ubaubh£)r }r‘ (h+X© Summarise the tests to be executed by this test framework and the purpose of those tests in the evaluation
of the CVP. Are there dependancies between tests, does the tool expect a certain behaviour, do the test
cases have specific dependancies. This provides the overall context of the evaluation performed by this
toolchain / suite and I would not want to be surprised by something when I run the tests after reading this.r’ h,jq h6h7h8h§h:}r“ (h<]h=]h>]h?]hB]uhDKühEhhF]r” hOX© Summarise the tests to be executed by this test framework and the purpose of those tests in the evaluation
of the CVP. Are there dependancies between tests, does the tool expect a certain behaviour, do the test
cases have specific dependancies. This provides the overall context of the evaluation performed by this
toolchain / suite and I would not want to be surprised by something when I run the tests after reading this.r• …r– }r— (h+j’ h,j ubaubeubh-)r˜ }r™ (h+U h,jZ h6h7h8h9h:}rš (h<]h=]h>]h?]r› Unext-test-arearœ ahB]r hauhDMhEhhF]rž (hH)rŸ }r (h+X Next test arear¡ h,j˜ h6h7h8hLh:}r¢ (h<]h=]h>]h?]hB]uhDMhEhhF]r£ hOX Next test arear¤ …r¥ }r¦ (h+j¡ h,jŸ ubaubh£)r§ }r¨ (h+XX What is the test area, what tools, how do they work what does it mean to me as a tester?r© h,j˜ h6h7h8h§h:}rª (h<]h=]h>]h?]hB]uhDMhEhhF]r« hOXX What is the test area, what tools, how do they work what does it mean to me as a tester?r¬ …r }r® (h+j© h,j§ ubaubeubh-)r¯ }r° (h+U h,jZ h6h7h8h9h:}r± (h<]h=]h>]h?]r² Uanother-test-arear³ ahB]r´ hauhDMhEhhF]rµ (hH)r¶ }r· (h+X Another test arear¸ h,j¯ h6h7h8hLh:}r¹ (h<]h=]h>]h?]hB]uhDMhEhhF]rº hOX Another test arear» …r¼ }r½ (h+j¸ h,j¶ ubaubh£)r¾ }r¿ (h+X^ Again what is the test area, what tools, how do they work what does it mean to me as a tester?rÀ h,j¯ h6h7h8h§h:}rÁ (h<]h=]h>]h?]hB]uhDM hEhhF]r hOX^ Again what is the test area, what tools, how do they work what does it mean to me as a tester?rà …rÄ }rÅ (h+jÀ h,j¾ ubaubeubeubeubh-)rÆ }rÇ (h+U h,h4h6h7h8h9h:}rÈ (h<]h=]h>]h?]rÉ Ucvp-test-executionrÊ ahB]rË hauhDM
hEhhF]rÌ (hH)rÍ }rÎ (h+X CVP test executionrÏ h,jÆ h6h7h8hLh:}rÐ (h<]h=]h>]h?]hB]uhDM
hEhhF]rÑ hOX CVP test executionrÒ …rÓ }rÔ (h+jÏ h,jÍ ubaubh£)rÕ }rÖ (h+Xá This section should identify the test procedure being executed. Include all people and
roles involved in the execution of a CVP test. Include procedures, mailing lists, escalation, support
and periods of waiting for results.r× h,jÆ h6h7h8h§h:}rØ (h<]h=]h>]h?]hB]uhDMhEhhF]rÙ hOXá This section should identify the test procedure being executed. Include all people and
roles involved in the execution of a CVP test. Include procedures, mailing lists, escalation, support
and periods of waiting for results.rÚ …rÛ }rÜ (h+j× h,jÕ ubaubh£)rÝ }rÞ (h+X<