1. Introduction¶
1.1. Overview¶
This Reference Architecture is focussed on OpenStack as the Virtualised Infrastructure Manager (VIM) chosen based on the criteria laid out in the Cloud Infrastructure Reference Model [1] (referred to as “Reference Model” or “RM” in the document). OpenStack [2] has the advantage of being a mature and widely accepted open-source technology; a strong ecosystem of vendors that support it, the OpenInfra Foundation for managing the community, and, most importantly, it is widely deployed by the global operator community for both internal infrastructure and external facing products and services. This means that the operators have existing staff with the right skill sets to support a Cloud Infrastructure (or Network Function Virtualisation Infrastructure, NFVI [3]) deployment into development, test and production. Another reason to choose OpenStack is that it has a large active community of vendors and operators, which means that any code or component changes needed to support the Common Telco Cloud Infrastructure requirements can be managed through the existing project communities’ processes to add and validate the required features through well-established mechanisms.
1.1.1. Vision¶
The OpenStack-based Reference Architecture will host NFV workloads, primarily VNFs (Virtual Network Functions), of interest to the Anuket community. The Reference Architecture document can be used by operators to deploy Anuket conformant infrastructure; hereafter, “conformant” denotes that the resource can satisfy tests conducted to verify conformance with this reference architecture.
1.2. Use Cases¶
Several NFV use cases are documented in OpenStack. For more examples and details refer to the OpenStack Use cases [4].
Examples include:
Overlay networks: The overlay functionality design includes OpenStack Networking in Open vSwitch [5] GRE tunnel mode. In this case, the layer-3 external routers pair with VRRP, and switches pair with an implementation of MLAG to ensure that you do not lose connectivity with the upstream routing infrastructure.
Performance tuning: Network level tuning for this workload is minimal. Quality of Service (QoS) applies to these workloads for a middle ground Class Selector depending on existing policies. It is higher than a best effort queue but lower than an Expedited Forwarding or Assured Forwarding queue. Since this type of application generates larger packets with longer-lived connections, you can optimize bandwidth utilization for long duration TCP. Normal bandwidth planning applies here with regards to benchmarking a session’s usage multiplied by the expected number of concurrent sessions with overhead.
Network functions: Network functions is a broad category but encompasses workloads that support the exchange of information (data, voice, multi-media) over a system’s network. Some of these workloads tend to consist of a large number of small-sized packets that are short lived, such as DNS queries or SNMP traps. These messages need to arrive quickly and, thus, do not handle packet loss. Network function workloads have requirements that may affect configurations including at the hypervisor level. For an application that generates 10 TCP sessions per user with an average bandwidth of 512 kilobytes per second per flow and expected user count of ten thousand (10,000) concurrent users, the expected bandwidth plan is approximately 4.88 gigabits per second. The supporting network for this type of configuration needs to have a low latency and evenly distributed load across the topology. These types of workload benefit from having services local to the consumers of the service. Thus, use a multi-site approach, as well as, deploying many copies of the application to handle load as close as possible to consumers. Since these applications function independently, they do not warrant running overlays to interconnect tenant networks. Overlays also have the drawback of performing poorly with rapid flow setup and may incur too much overhead with large quantities of small packets and therefore we do not recommend them. QoS is desirable for some workloads to ensure delivery. DNS has a major impact on the load times of other services and needs to be reliable and provide rapid responses. Configure rules in upstream devices to apply a higher-Class Selector to DNS to ensure faster delivery or a better spot in queuing algorithms.
1.3. OpenStack Reference Release¶
This Reference Architecture document conforms to the OpenStack Wallaby [6] release. While many features and capabilities are conformant with many OpenStack releases, this document will refer to features, capabilities and APIs that are part of the OpenStack Wallaby release. For ease, this Reference Architecture document version can be referred to as “RA-1 OSTK Wallaby.”
1.4. Principles¶
OpenStack Reference Architecture must obey to the following set of principles described in:
1.4.1. OpenStack specific principles¶
OpenStack considers the following Four Opens essential for success:
Open Source
Open Design
Open Development
Open Community
This OpenStack Reference Architecture is organised around the three major Cloud Infrastructure resource types as core services of compute, storage and networking, and a set of shared services of identity management, image management, graphical user interface, orchestration engine, etc.
1.5. Document Organisation¶
Chapter 2 defines the Reference Architecture requirements and, when appropriate, provides references to where these requirements are addressed in this document. The intent of this document is to address all of the mandatory (“must”) requirements and the most useful of the other optional (“should”) requirements. Chapter 3 and 4 cover the Cloud Infrastructure resources and the core OpenStack services, while the APIs are covered in Chapter 5. Chapter 6 covers the implementation and enforcement of security capabilities and controls. Life Cycle Management of the Cloud Infrastructure and VIM are covered in Chapter 7 with stress on Logging, Monitoring and Analytics (LMA), configuration management and some other operational items. Please note that Chapter 7 is not a replacement for the implementation, configuration and operational documentation that accompanies the different OpenStack distributions. Chapter 8 identifies certain Gaps that currently exist and plans on how to address them (for example, resources autoscaling).
1.6. Terminology¶
General terminology definitions can be found in Glossary and specific terms relating to this reference architecture are to be found in OpenStack Related Terminology OpenStack Related Terminology.
1.7. Abbreviations¶
Abbreviation/Acronym |
Definition |
|---|---|
API |
Application Programming Interface |
BGP VPN |
Border gateway Protocol Virtual Private network |
CI/CD |
Continuous Integration/Continuous Deployment |
CNTT |
Cloud iNfrastructure Task Force |
CPU |
Central Processing Unit |
DNS |
Domain Name System |
DPDK |
Data Plane Development Kit |
DHCP |
Dynamic Host Configuration Protocol |
ECMP |
Equal Cost Multi-Path routing |
ETSI |
European Telecommunications Standards Institute |
FPGA |
Field Programmable Gate Array |
MB/GB/TB |
MegaByte/GigaByte/TeraByte |
GPU |
Graphics Processing Unit |
GRE |
Generic Routing Encapsulation |
GSM |
Global System for Mobile Communications (originally Groupe Spécial Mobile) |
GSMA |
GSM Association |
GSLB |
Global Service Load Balancer |
GUI |
Graphical User Interface |
HA |
High Availability |
HDD |
Hard Disk Drive |
HTTP |
HyperText Transfer Protocol |
HW |
Hardware |
IaaC (also IaC) |
Infrastructure as a Code |
IaaS |
Infrastructure as a Service |
ICMP |
Internet Control Message Protocol |
IMS |
IP Multimedia Sub System |
IO |
Input/Output |
IOPS |
Input/Output per Second |
IPMI |
Intelligent Platform Management Interface |
KVM |
Kernel-based Virtual Machine |
LCM |
LifeCycle Management |
LDAP |
Lightweight Directory Access Protocol |
LFN |
Linux Foundation Networking |
LMA |
Logging, Monitoring and Analytics |
LVM |
Logical Volume Management |
MANO |
Management ANd Orchestration |
MLAG |
Multi-chassis Link Aggregation Group |
NAT |
Network Address Translation |
NFS |
Network File System |
NFV |
Network Function Virtualisation |
NFVI |
Network Function Virtualisation Infrastructure |
NIC |
Network Interface Card |
NPU |
Numeric Processing Unit |
NTP |
Network Time Protocol |
NUMA |
Non-Uniform Memory Access |
OAI |
Open Air Interface |
OS |
Operating System |
OSTK |
OpenStack |
OPNFV |
Open Platform for NFV |
OVS |
Open vSwitch |
OWASP |
Open Web Application Security Project |
PCIe |
Peripheral Component Interconnect Express |
PCI-PT |
PCIe PassThrough |
PXE |
Preboot Execution Environment |
QoS |
Quality of Service |
RA |
Reference Architecture |
RA-1 |
Reference Architecture 1 (i.e., Reference Architecture for OpenStack-based Cloud Infrastructure) |
RBAC |
Role-based Access Control |
RBD |
RADOS Block Device |
REST |
Representational state transfer |
RI |
Reference Implementation |
RM |
Reference Model |
SAST |
Static Application Security Testing |
SDN |
Software Defined Networking |
SFC |
Service Function Chaining |
SG |
Security Group |
SLA |
Service Level Agreement |
SMP |
Symmetric MultiProcessing |
SMT |
Simultaneous MultiThreading |
SNAT |
Source Network Address Translation |
SNMP |
Simple Network Management Protocol |
SR-IOV |
Single Root Input Output Virtualisation |
SSD |
Solid State Drive |
SSL |
Secure Sockets Layer |
SUT |
System Under Test |
TCP |
Transmission Control Protocol |
TLS |
Transport Layer Security |
ToR |
Top of Rack |
TPM |
Trusted Platform Module |
UDP |
User Data Protocol |
VIM |
Virtualised Infrastructure Manager |
VLAN |
Virtual LAN |
VM |
Virtual Machine |
VNF |
Virtual Network Function |
VRRP |
Virtual Router Redundancy Protocol |
VTEP |
VXLAN Tunnel End Point |
VXLAN |
Virtual Extensible LAN |
WAN |
Wide Area Network |
ZTA |
Zero Trust Architecture |
1.8. Conventions¶
The key words “must”, “must not”, “required”, “shall”, “shall not”, “should”, “should not”, “recommended”, “may”, and “optional” in this document are to be interpreted as described in RFC 2119 [7].
1.9. References¶
- 1
Cloud Infrastructure Reference Model. GSMA PRD NG.126 v3.0, 2022.
- 2
OpenStack Documentation. URL: https://docs.openstack.org/.
- 3
Network Functions Virtualisation (NFV); Infrastructure Overview. ETSI GS NFV-INF 001 V1.1.1, January 2015. URL: https://www.etsi.org/deliver/etsi_gs/NFV-INF/001_099/001/01.01.01_60/gs_NFV-INF001v010101p.pdf.
- 4
OpenStack Use cases. URL: https://docs.openstack.org/arch-design/use-cases.html.
- 5
Open vSwitch. URL: https://www.openvswitch.org/.
- 6
OpenStack Community. OpenStack Wallaby projects. URL: https://docs.openstack.org/wallaby/projects.html.
- 7
Scott O. Bradner. Key words for use in RFCs to Indicate Requirement Levels. RFC 2119, March 1997. URL: https://www.rfc-editor.org/info/rfc2119, doi:10.17487/RFC2119.
- 8
H. Philip White. Center for Internet Security - Password Policy Guide. 2020. URL: https://www.cisecurity.org/insights/white-papers/cis-password-policy-guide.
- 9
Center for Internet Security - Controls V7.1. URL: https://www.cisecurity.org/controls/cis-controls-list.
- 10
OpenStack - CPU Dedicated Set. URL: https://docs.openstack.org/nova/latest/configuration/config.html#compute.cpu_dedicated_set.
- 11
OpenStack - CPU Topologies. URL: https://docs.openstack.org/nova/latest/admin/cpu-topologies.html.
- 12
OpenStack - Neutron Plugins and Drivers. URL: https://wiki.openstack.org/wiki/Neutron_Plugins_and_Drivers.
- 13
OpenStack - Tags. URL: https://specs.openstack.org/openstack/api-wg/guidelines/tags.html.
- 14
OpenStack - Configuring the stateful services. URL: https://docs.openstack.org/ha-guide/control-plane-stateful.html.
- 15
OpenStack - Senlin documentation. URL: https://docs.openstack.org/senlin/wallaby/.
- 16
OpenStack - Neutron OVS Agent Support for Baremetal with Smart NIC. URL: https://specs.openstack.org/openstack/neutron-specs/specs/stein/neutron-ovs-agent-support-baremetal-with-smart-nic.html.
- 17
National Telecommunications and Information Administration - Software Bill Of Materials. URL: https://www.ntia.gov/SBOM.
- 18
Center for Internet Security. URL: https://www.cisecurity.org/.
- 19
Cloud Security Alliance. URL: https://cloudsecurityalliance.org/.
- 20
Open Web Application Security Project - Cheat Sheet Series. URL: https://github.com/OWASP/CheatSheetSeries.
- 21
Open Web Application Security Project. URL: https://www.owasp.org.
- 22
Open Web Application Security Project - Top Ten Security Risks. URL: https://owasp.org/www-project-top-ten/.
- 23
Open Web Application Security Project - Software Maturity Model (SAMM). URL: https://owaspsamm.org/blog/2019/12/20/version2-community-release/.
- 24
Open Web Application Security Project - Web Security Testing Guide. URL: https://github.com/OWASP/wstg/tree/master/document.
- 25
ISO (International Organization for Standardization) and IEC (International Electrotechnical Commission) ISO/IEC 27001:2013. 2013. URL: https://www.iso.org/obp/ui/#iso:std:iso-iec:27001:ed-2:v1:en.
- 26
ISO (International Organization for Standardization) and IEC (International Electrotechnical Commission) ISO/IEC 27002:2013. 2013. URL: https://www.iso.org/obp/ui/#iso:std:iso-iec:27002:ed-2:v1:en.
- 27
ISO (International Organization for Standardization) and IEC (International Electrotechnical Commission) ISO/IEC 7032:2012. 2012. URL: https://www.iso.org/obp/ui/#iso:std:iso-iec:27032:ed-1:v1:en.
- 28
OpenStack Storage. URL: https://docs.openstack.org/arch-design/design-storage/design-storage-concepts.html#table-openstack-storage.
- 29
OpenStack Cinder Driver Support Matrix. URL: https://docs.openstack.org/cinder/latest/reference/support-matrix.html.
- 30
Tungsten Fabric - Multicloud Multistack SDN. URL: https://tungsten.io.
- 31
OpenStack Glossary. URL: https://docs.openstack.org/doc-contrib-guide/common/glossary.html.
- 32
OpenStack Feature Support Matrix. URL: https://docs.openstack.org/nova/latest/user/support-matrix.html.
- 33
OpenStack Storage Architecture Design. URL: https://docs.openstack.org/arch-design/design-storage.html.
- 34
OpenStack Nova: KVM. URL: https://docs.openstack.org/nova/wallaby/admin/configuration/hypervisor-kvm.html.
- 35
OpenStack - Hardening the virtualization layers. URL: https://docs.openstack.org/security-guide/compute/hardening-the-virtualization-layers.html.
- 36
OpenStack Reference Architecture For 100, 300 and 500 Nodes. URL: https://fuel-ccp.readthedocs.io/en/latest/design/ref_arch_100_nodes.html.
- 37
(DPDK) Release Notes. URL: http://doc.dpdk.org/guides/rel_notes.
- 38
(DPDK) Performance Reports. URL: http://core.dpdk.org/perf-reports/.
- 39
Robert Moskowitz, Daniel Karrenberg, Yakov Rekhter, Eliot Lear, and Geert Jan de Groot. Address Allocation for Private Internets. RFC 1918, February 1996. URL: https://www.rfc-editor.org/info/rfc1918, doi:10.17487/RFC1918.
- 40
OpenStack - Introducing Octavia. URL: https://docs.openstack.org/octavia/latest/reference/introduction.html.
- 41
OpenStack Octavia (Load-balancer service). URL: https://governance.openstack.org/tc/reference/projects/octavia.html.
- 42
openstack/neutron-vpnaas. URL: https://opendev.org/openstack/neutron-vpnaas.
- 43
OpenStack Neutron: Plugins. URL: https://wiki.openstack.org/wiki/Neutron#Plugins.
- 44
OpenStack Neutron: API Extensions. URL: https://docs.openstack.org/neutron/latest/contributor/internals/api_extensions.html.
- 45
OpenStack Networking API v2.0: List extensions. URL: https://docs.openstack.org/api-ref/network/v2/#list-extensions.
- 46
OpenStack Networking API v2.0: Show extension details. URL: https://docs.openstack.org/api-ref/network/v2/#show-extension-details.
- 47
OpenStack Neutron/ML2. URL: https://wiki.openstack.org/wiki/Neutron/ML2.
- 48
OpenStack Cinder Driver Support Matrix. URL: https://docs.openstack.org/cinder/latest/reference/support-matrix.html.
- 49
OpenStack (Cinder) Available Drivers. URL: https://docs.openstack.org/cinder/latest/drivers.html.
- 50
OpenStack Cinder Service Configuration. URL: https://docs.openstack.org/cinder/latest/configuration/index.html.
- 51
OpenStack Cinder Administration. URL: https://docs.openstack.org/cinder/latest/admin/index.html.
- 52
Ceph - The Future of Storage. URL: https://ceph.io/en.
- 53
Keystone, the OpenStack Identity Service. URL: https://docs.openstack.org/keystone/wallaby/.
- 54
OpenStack - Welcome to Glance’s documentation! URL: https://docs.openstack.org/glance/wallaby/.
- 55
OpenStack Block Storage (Cinder) documentation. URL: https://docs.openstack.org/cinder/wallaby/.
- 56
OpenStack - Welcome to Swift’s documentation! URL: https://docs.openstack.org/swift/wallaby/.
- 57
OpenStack - Welcome to Neutron’s documentation! URL: https://docs.openstack.org/neutron/wallaby/.
- 58
OpenStack - Scenario: High Availability using Distributed Virtual Routing (DVR). URL: https://docs.openstack.org/liberty/networking-guide/scenario-dvr-ovs.html.
- 59
OpenStack Neutron: Distributed Virtual Routing with VRRP. URL: https://docs.openstack.org/neutron/wallaby/admin/config-dvr-ha-snat.html.
- 60
OpenStack Compute (nova). URL: https://docs.openstack.org/nova/wallaby/.
- 61
OpenStack - Welcome to Ironic’s documentation! URL: https://docs.openstack.org/ironic/wallaby/.
- 62
OpenStack Ironic API Reference: Bare Metal API. URL: https://docs.openstack.org/api-ref/baremetal/.
- 63
OpenStack - Welcome to the Heat documentation! URL: https://docs.openstack.org/heat/wallaby/.
- 64
Horizon: The OpenStack Dashboard Project. URL: https://docs.openstack.org/horizon/wallaby/.
- 65
OpenStack - Placement. URL: https://docs.openstack.org/placement/wallaby/index.html.
- 66
OpenStack - Placement: Modeling with Provider Trees. URL: https://docs.openstack.org/placement/latest/user/provider-tree.html.
- 67
OpenStack - Placement Usage. URL: https://docs.openstack.org/placement/latest/user/index.html.
- 68
OpenStack Key Manager (barbican). URL: https://docs.openstack.org/barbican/wallaby/.
- 69
OpenStack Accelerator (Cyborg). URL: https://docs.openstack.org/cyborg/wallaby/.
- 70
OpenStack Compute API Guide 2.1.0: Server concepts. URL: https://docs.openstack.org/api-guide/compute/server_concepts.html.
- 71
OpenStack Cyborg Support Matrix (Wallaby). URL: https://docs.openstack.org/cyborg/wallaby/reference/support-matrix.html.
- 72
OpenStack Cyborg Support Matrix. URL: https://docs.openstack.org/cyborg/latest/reference/support-matrix.html.
- 73
OpenStack Cyborg architecture. URL: https://docs.openstack.org/cyborg/latest/user/architecture.html.
- 74
OpenStack Nova: Flavors. URL: https://docs.openstack.org/nova/latest/user/flavors.html.
- 75
Open Glossary of Edge Computing. URL: https://github.com/State-of-the-Edge/glossary/blob/master/edge-glossary.md.
- 76
OpenStack - Edge Computing: Next Steps in Architecture, Design and Testing. URL: https://www.openstack.org/use-cases/edge-computing/edge-computing-next-steps-in-architecture-design-and-testing.
- 77
OpenStack Reference Architecture For 100, 300 and 500 Nodes: Services Placement Summary. URL: https://fuel-ccp.readthedocs.io/en/latest/design/ref_arch_100_nodes.html#services-placement-summary.
- 78
OpenStack Nova: Image pre-caching. URL: https://docs.openstack.org/nova/latest/admin/image-caching.html#image-pre-caching.
- 79
Airship v2. URL: https://www.airshipit.org/.
- 80
StarlingX - Deploy Your Edge Cloud Now. URL: https://www.starlingx.io/.
- 81
OpenStack TripleO. URL: http://opendev.org/openstack/tripleo-common.
- 82
OpenStack - Security Boundaries and Threats. URL: https://docs.openstack.org/security-guide/introduction/security-boundaries-and-threats.html.
- 83
OpenStack Security Guide. URL: https://docs.openstack.org/security-guide/introduction/introduction-to-openstack.html.
- 84
Mitre - Common Vulnerabilities and Exposures. URL: https://cve.mitre.org/.
- 85
National Institute of Standards and Technology Vulnerabilities Metrics. URL: https://nvd.nist.gov/vuln-metrics/cvss.
- 86
OpenStack Security Guide - Identity. URL: https://docs.openstack.org/security-guide/identity.html.
- 87
OpenStack Security Guide - Authentication Methods. URL: https://docs.openstack.org/security-guide/identity/authentication-methods.html.
- 88
OpenStack Security Guide - Policies. URL: https://docs.openstack.org/security-guide/identity/policies.html#policy-section.
- 89
OpenStack KeyStone Default Roles. URL: https://docs.openstack.org/keystone/latest/admin/service-api-protection.html.
- 90
OpenStack - Introduction to TLS and SSL. URL: https://docs.openstack.org/security-guide/secure-communication/introduction-to-ssl-and-tls.html.
- 91
Center for Internet Security CIS-CAT Pro. URL: https://www.cisecurity.org/cybersecurity-tools/cis-cat-pro/.
- 92
Center for Internet Security Benchmarks. URL: https://www.cisecurity.org/cis-benchmarks/.
- 93
OpenStack Image Signature Verification. URL: https://docs.openstack.org/glance/wallaby/user/signature.html.
- 94
OpenStack - SR-IOV Passthrough For Networking. URL: https://wiki.openstack.org/wiki/SR-IOV-Passthrough-For-Networking.
- 95
OpenStack Trusted Images. URL: https://docs.openstack.org/security-guide/instance-management/security-services-for-instances.html#trusted-images.
- 96
Adding Signed Images. URL: https://docs.openstack.org/operations-guide/ops-user-facing-operations.html#adding-signed-images.
- 97
Network Functions Virtualisation (NFV) Release 4; Protocols and Data Models; VNF Package and PNFD Archive specification. ETSI GS NFV-SOL 004 V4.3.1, July 2022. URL: https://www.etsi.org/deliver/etsi_gs/NFV-SOL/001_099/004/04.03.01_60/gs_NFV-SOL004v040301p.pdf.
- 98
Network Functions Virtualisation (NFV) Release 2; Security; VNF Package Security Specification. ETSI GS NFV-SEC 021 V2.6.1, June 2019. URL: https://www.etsi.org/deliver/etsi_gs/NFV-SEC/001_099/021/02.06.01_60/gs_nfv-sec021v020601p.pdf.
- 99
Foreman. URL: https://www.theforeman.org/.
- 100
Ansible Documentation. URL: https://docs.ansible.com/.
- 101
OpenStack TripleO Architecture. URL: https://docs.openstack.org/tripleo-docs/latest/install/introduction/architecture.html#project-architecture.
- 102
OVP. URL: https://www.opnfv.org/verification.
- 103
jenkins. URL: https://build.opnfv.org/.
- 104
Test Dabase. URL: https://docs.opnfv.org/en/stable-hunter/_images/OPNFV_testing_working_group.png.
- 105
S3 compatible storage service. URL: http://artifacts.opnfv.org/.
- 106
functest-wallaby-zip. URL: https://build.opnfv.org/ci/job/functest-wallaby-zip/4/console.
- 107
Xtesting CI. URL: https://galaxy.ansible.com/collivier/xtesting.
- 108
Docker. URL: https://www.docker.com/.
- 109
Xtesting. URL: https://xtesting.readthedocs.io/en/latest/.
- 110
OPNFV Fraser. URL: https://www.sdxcentral.com/articles/news/opnfvs-6th-release-brings-testing-capabilities-that-orange-is-already-using/2018/05/.
- 111
Xtesting Python package. URL: https://pypi.org/project/xtesting/.
- 112
Test case execution description. URL: https://git.opnfv.org/functest-xtesting/tree/docker/core/testcases.yaml.
- 113
CI/CD toolchains in a few commands. URL: https://github.com/collivier/ansible-role-xtesting#readme.
- 114
CI/CD deployment models. URL: https://lists.opnfv.org/g/opnfv-tsc/message/5702.
- 115
Anuket Releng. URL: https://git.opnfv.org/releng/tree/jjb/functest.
- 116
Test Case result dump. URL: http://artifacts.opnfv.org/functest/9ID39XK47PMZ.zip.
- 117
Xtesting Samples. URL: https://git.opnfv.org/functest-xtesting/plain/ansible/site.yml?h=stable/wallaby.
- 118
OpenStack verification. URL: https://git.opnfv.org/functest/plain/ansible/site.yml?h=stable/wallaby.
- 119
Anuket RC1. URL: https://git.opnfv.org/functest/plain/ansible/site.cntt.yml?h=stable/wallaby.
- 120
Kubernetes verification. URL: https://git.opnfv.org/functest-kubernetes/plain/ansible/site.yml?h=stable/v1.22.
- 121
Functest. URL: https://functest.readthedocs.io/en/stable-wallaby/.
- 122
RefStack. URL: https://refstack.openstack.org/.
- 123
Networking BGPVPN. URL: https://docs.openstack.org/networking-bgpvpn/latest/.
- 124
Networking SFC. URL: https://docs.openstack.org/networking-sfc/latest/.
- 125
Kubernetes End-to-end tests. URL: https://kubernetes.io/blog/2019/03/22/kubernetes-end-to-end-testing-for-everyone/.
- 126
k8s-conformance. URL: https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-v1.22-k8s_conformance-run/25/console.
- 127
DevStack Gates. URL: https://docs.opendev.org/opendev/system-config/latest/devstack-gate.html.
- 128
Rally. URL: https://github.com/openstack/rally-openstack.
- 129
Temptest. URL: https://github.com/openstack/tempest.
- 130
Temptest. URL: https://docs.openstack.org/devstack/latest/.
- 131
Raspberry PI. URL: https://www.raspberrypi.org/.
- 132
Functest daily jobs. URL: https://build.opnfv.org/ci/view/functest/job/functest-wallaby-daily/17/.
- 133
OpenStack performance tools. URL: https://docs.openstack.org/developer/performance-docs/methodologies/tools.html.
- 134
Run Alpine Functest containers (Wallaby). URL: https://wiki.anuket.io/display/HOME/Functest+Wallaby.
- 135
Functest gates. URL: https://build.opnfv.org/ci/view/functest.
- 136
New Functest CNTT containers. URL: https://lists.opnfv.org/g/opnfv-tsc/message/5717.
- 137
keystone-tempest-plugin. URL: https://opendev.org/openstack/keystone-tempest-plugin.
- 138
Functest Smoke CNTT. URL: https://git.opnfv.org/functest/tree/docker/smoke-cntt/testcases.yaml?h=stable%2Fwallaby.
- 139
cinder-tempest-plugin. URL: https://opendev.org/openstack/cinder-tempest-plugin.
- 140
Functest review 68881. URL: https://gerrit.opnfv.org/gerrit/68881.
- 141
Functest review 71011. URL: https://gerrit.opnfv.org/gerrit/71011.
- 142
OpenStack bug 1770179. URL: https://launchpad.net/bugs/1770179.
- 143
OpenStack bug 1677525. URL: https://launchpad.net/bugs/1677525.
- 144
OpenStack bug 1317133. URL: https://launchpad.net/bugs/1317133.
- 145
OpenStack bug 1905432. URL: https://launchpad.net/bugs/1905432.
- 146
neutron-tempest-plugin. URL: https://opendev.org/openstack/neutron-tempest-plugin.
- 147
OpenStack bug 1863707. URL: https://launchpad.net/bugs/1863707.
- 148
Functest review 69105. URL: https://gerrit.opnfv.org/gerrit/69105.
- 149
OpenStack bug 1676207. URL: https://launchpad.net/bugs/1676207.
- 150
OpenStack bug 1836595. URL: https://launchpad.net/bugs/1836595.
- 151
OpenStack bug 1186354. URL: https://launchpad.net/bugs/1186354.
- 152
OpenStack bug 1014647. URL: https://launchpad.net/bugs/1014647.
- 153
OpenStack bug 1311500. URL: https://launchpad.net/bugs/1311500.
- 154
OpenStack bug 1161411. URL: https://launchpad.net/bugs/1161411.
- 155
OpenStack bug 1540645. URL: https://launchpad.net/bugs/1540645.
- 156
heat-tempest-plugin. URL: https://opendev.org/openstack/heat-tempest-plugin.
- 157
OpenStack story 2007804. URL: https://storyboard.openstack.org/#!/story/2007804.
- 158
Functest review 69926. URL: https://gerrit.opnfv.org/gerrit/69926.
- 159
Functest review 69931. URL: https://gerrit.opnfv.org/gerrit/69931.
- 160
Functest review 70004. URL: https://gerrit.opnfv.org/gerrit/70004.
- 161
tempest-horizon. URL: https://github.com/openstack/tempest-horizon.
- 162
Functest Healthcheck. URL: https://git.opnfv.org/functest/tree/docker/healthcheck/testcases.yaml?h=stable%2Fwallaby.
- 163
Functest Benchmarking CNTT. URL: https://git.opnfv.org/functest/tree/docker/benchmarking-cntt/testcases.yaml?h=stable%2Fwallaby.
- 164
rally_full_cntt. URL: http://artifacts.opnfv.org/functest/KDBNITEN317M/functest-opnfv-functest-benchmarking-cntt-wallaby-rally_full_cntt-run-5/rally_full_cntt/rally_full_cntt.html.
- 165
rally_jobs_cntt. URL: http://artifacts.opnfv.org/functest/KDBNITEN317M/functest-opnfv-functest-benchmarking-cntt-wallaby-rally_jobs_cntt-run-5/rally_jobs_cntt/rally_jobs_cntt.html.
- 166
VMTP. URL: http://vmtp.readthedocs.io/en/latest.
- 167
Shaker. URL: https://pyshaker.readthedocs.io/en/latest/.
- 168
VMTP scenarios. URL: http://artifacts.opnfv.org/functest/KDBNITEN317M/functest-opnfv-functest-benchmarking-wallaby-vmtp-run-8/vmtp/vmtp.json.
- 169
Functest VMTP. URL: http://artifacts.opnfv.org/functest/KDBNITEN317M/functest-opnfv-functest-benchmarking-wallaby-vmtp-run-8/vmtp/vmtp.html.
- 170
Shaker scenarios. URL: http://artifacts.opnfv.org/functest/KDBNITEN317M/functest-opnfv-functest-benchmarking-wallaby-shaker-run-8/shaker/report.json.
- 171
Functest VNF. URL: https://git.opnfv.org/functest/tree/docker/vnf/testcases.yaml?h=stable%2Fwallaby.
- 172
Clearwater IMS. URL: https://clearwater.readthedocs.io/en/stable/.
- 173
VyOS vRouter. URL: https://www.vyos.io/.
- 174
OpenAirInterface vEPC. URL: https://www.openairinterface.org/.
- 175
Cloudify. URL: https://cloudify.co.
- 176
Juju. URL: https://jaas.ai/.
- 177
clearwater-live-test. URL: https://github.com/Metaswitch/clearwater-live-test.
- 178
Docker HTTP/HTTPS proxy. URL: https://docs.docker.com/config/daemon/systemd/#httphttps-proxy.
- 179
OpenStack Autoscaling with Heat. URL: https://docs.openstack.org/senlin/latest/scenarios/autoscaling_heat.html.
