VSPERF Results¶
1. VSPERF Test Scenarios¶
Predefined Tests suitable for automated execution with CI:
| Test | Definition |
|---|---|
| phy2phy_tput | PacketLossRatio for Phy2Phy |
| back2back | BackToBackFrames for Phy2Phy |
| phy2phy_tput_mod_vlan | PacketLossRatioFrameModification for Phy2Phy |
| phy2phy_cont | Phy2Phy blast vswitch at x% TX rate and measure throughput |
| pvp_cont | PVP blast vswitch at x% TX rate and measure throughput |
| pvvp_cont | PVVP blast vswitch at x% TX rate and measure throughput |
| phy2phy_scalability | Scalability0PacketLoss for Phy2Phy |
| pvp_tput | PacketLossRatio for PVP |
| pvp_back2back | BackToBackFrames for PVP |
| pvvp_tput | PacketLossRatio for PVVP |
| pvvp_back2back | BackToBackFrames for PVVP |
| phy2phy_cpu_load | CPU0PacketLoss for Phy2Phy |
| phy2phy_mem_load | Same as CPU0PacketLoss but using a memory intensive app |
Deployment topologies:
- Phy2Phy: Physical port -> vSwitch -> Physical port.
- PVP: Physical port -> vSwitch -> VNF -> vSwitch -> Physical port.
- PVVP: Physical port -> vSwitch -> VNF -> vSwitch -> VNF -> vSwitch -> Physical port.
Loopback applications in the Guest:
- DPDK testpmd.
- Linux Bridge.
- l2fwd-module
Supported traffic generators:
- Spirent Testcenter
- Ixia: IxOS and IxNet.
- Xena
- MoonGen
- Dummy
- T-Rex
2. OPNFV Test Results¶
VSPERF CI jobs are run daily and sample results can be found at https://wiki.opnfv.org/display/vsperf/Vsperf+Results
Testcase names shown in the dashboard are combination of orignal testcase name from VSPERF framework and indication of used vswitch.
Example:
Testcase
phy2phy_tputis executed for three vSwitch types:OvsDpdkVhost,OvsVanillaandVppDpdkVhost. In this case, following testcase names will be used in the dashboard:phy2phy_tput_ovsdpdkvhost,phy2phy_tput_ovsvanillaandphy2phy_tput_vppdpdkvhost.
In case of RFC2544 Throughput test, the recorded metric is FPS (frames per second) without packet loss. For RFC2544 Back2Back test, the recorded metric is back-to-back value (number of frames) without packet loss.
The loopback application in the VNF used for PVP and PVVP scenarios was DPDK testpmd.
Guest interface types are vhost-user for OvsDpdkVhost and VppDpdkVhost
and virtio-net for OvsVanilla.
3. Performance report for OvsDpdkVhost¶
3.1. Introduction¶
The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).
This document is currently in draft form.
3.1.1. Document identifier¶
The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.
3.1.2. Scope¶
The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.
3.1.3. References¶
3.2. Details of the Level Test Report¶
This section provides a test-results-overview. Also included are the rationale and the conclusions.
3.2.1. Test ID: BACK2BACK¶
3.2.1.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
Below are test details:
- Test ID: back2back
- Description: LTD.Throughput.RFC2544.BackToBackFrames
- Deployment: p2p
- Traffic type: rfc2544_back2back
- Bidirectional : True
3.2.1.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
3.2.1.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 25970 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 64 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:30:08 |
| start_time | 2018-09-21 15:22:52 |
| stop_time | 2018-09-21 15:53:00 |
3.2.1.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 9048 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 5056816 |
| RSS | 43083 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 9030 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50708 |
| RSS | 6732 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.1.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
3.2.1.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 253378378 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 128 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:30:08 |
| start_time | 2018-09-21 15:22:52 |
| stop_time | 2018-09-21 15:53:00 |
3.2.1.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 9048 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 5056816 |
| RSS | 43083 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 9030 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50708 |
| RSS | 6732 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.1.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
3.2.1.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 70488721 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 512 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:30:08 |
| start_time | 2018-09-21 15:22:52 |
| stop_time | 2018-09-21 15:53:00 |
3.2.1.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 9048 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 5056816 |
| RSS | 43083 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 9030 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50708 |
| RSS | 6732 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.1.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
3.2.1.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 35919540 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 1024 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:30:08 |
| start_time | 2018-09-21 15:22:52 |
| stop_time | 2018-09-21 15:53:00 |
3.2.1.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 9048 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 5056816 |
| RSS | 43083 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 9030 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50708 |
| RSS | 6732 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.1.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
3.2.1.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 24382314 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 1518 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:30:08 |
| start_time | 2018-09-21 15:22:52 |
| stop_time | 2018-09-21 15:53:00 |
3.2.1.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 9048 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 5056816 |
| RSS | 43083 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 9030 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50708 |
| RSS | 6732 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.1.7. Anomalies¶
No anomalies were detected during the course of this test.
3.2.1.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
3.2.2. Test ID: PHY2PHY_SCALABILITY¶
3.2.2.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
Below are test details:
- Test ID: phy2phy_scalability
- Description: LTD.Scalability.Flows.RFC2544.0PacketLoss
- Deployment: p2p
- Traffic type: rfc2544_throughput
- Bidirectional : True
3.2.2.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
3.2.2.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 18022327.192 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 9227.432 |
| tx_rate_percent | 60.555 |
| throughput_rx_percent | 60.555 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 4640.000 |
| max_latency_ns | 22080.000 |
| avg_latency_ns | 11943.000 |
| type | rfc2544_throughput |
| packet_size | 64 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:16:18 |
| start_time | 2018-09-21 16:20:42 |
| stop_time | 2018-09-21 16:37:00 |
| stream_count | 8000 |
| match_type | L4 |
| pre-installed_flows | No |
3.2.2.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 13077 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.04 |
| majflt/s | 0.00 |
| VSZ | 5056816 |
| RSS | 43070 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 13059 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6732 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.2.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
3.2.2.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 16761271.156 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 17163.542 |
| tx_rate_percent | 99.227 |
| throughput_rx_percent | 99.227 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 4980.000 |
| max_latency_ns | 25220.000 |
| avg_latency_ns | 13733.000 |
| type | rfc2544_throughput |
| packet_size | 128 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:16:18 |
| start_time | 2018-09-21 16:20:42 |
| stop_time | 2018-09-21 16:37:00 |
| stream_count | 8000 |
| match_type | L4 |
| pre-installed_flows | No |
3.2.2.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 13077 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.04 |
| majflt/s | 0.00 |
| VSZ | 5056816 |
| RSS | 43070 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 13059 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6732 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.2.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
3.2.2.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 4699201.955 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19247.931 |
| tx_rate_percent | 100 |
| throughput_rx_percent | 100 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 13700.000 |
| max_latency_ns | 43680.000 |
| avg_latency_ns | 32909.500 |
| type | rfc2544_throughput |
| packet_size | 512 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:16:18 |
| start_time | 2018-09-21 16:20:42 |
| stop_time | 2018-09-21 16:37:00 |
| stream_count | 8000 |
| match_type | L4 |
| pre-installed_flows | No |
3.2.2.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 13077 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.04 |
| majflt/s | 0.00 |
| VSZ | 5056816 |
| RSS | 43070 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 13059 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6732 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.2.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
3.2.2.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 2394615.458 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19616.690 |
| tx_rate_percent | 100 |
| throughput_rx_percent | 100 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 13080.000 |
| max_latency_ns | 40420.000 |
| avg_latency_ns | 29010.000 |
| type | rfc2544_throughput |
| packet_size | 1024 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:16:18 |
| start_time | 2018-09-21 16:20:42 |
| stop_time | 2018-09-21 16:37:00 |
| stream_count | 8000 |
| match_type | L4 |
| pre-installed_flows | No |
3.2.2.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 13077 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.04 |
| majflt/s | 0.00 |
| VSZ | 5056816 |
| RSS | 43070 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 13059 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6732 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.2.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
3.2.2.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 1625474.449 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19739.762 |
| tx_rate_percent | 100 |
| throughput_rx_percent | 100 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 14100.000 |
| max_latency_ns | 38680.000 |
| avg_latency_ns | 28247.000 |
| type | rfc2544_throughput |
| packet_size | 1518 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:16:18 |
| start_time | 2018-09-21 16:20:42 |
| stop_time | 2018-09-21 16:37:00 |
| stream_count | 8000 |
| match_type | L4 |
| pre-installed_flows | No |
3.2.2.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 13077 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.04 |
| majflt/s | 0.00 |
| VSZ | 5056816 |
| RSS | 43070 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 13059 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6732 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.2.7. Anomalies¶
No anomalies were detected during the course of this test.
3.2.2.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
3.2.3. Test ID: PHY2PHY_TPUT_MOD_VLAN¶
3.2.3.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
Below are test details:
- Test ID: phy2phy_tput_mod_vlan
- Description: LTD.Throughput.RFC2544.PacketLossRatioFrameModification
- Deployment: p2p
- Traffic type: rfc2544_throughput
- Bidirectional : True
3.2.3.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
3.2.3.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 16641095.564 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 9052.756 |
| tx_rate_percent | 55.914 |
| throughput_rx_percent | 58.577 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 5120.000 |
| max_latency_ns | 28580.000 |
| avg_latency_ns | 11164.000 |
| type | rfc2544_throughput |
| packet_size | 64 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:27:40 |
| start_time | 2018-09-21 15:53:01 |
| stop_time | 2018-09-21 16:20:41 |
3.2.3.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 11098 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 5056816 |
| RSS | 43143 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 11079 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6708 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.3.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
3.2.3.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 16369327.705 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 17286.010 |
| tx_rate_percent | 96.906 |
| throughput_rx_percent | 99.526 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 5440.000 |
| max_latency_ns | 33660.000 |
| avg_latency_ns | 15790.500 |
| type | rfc2544_throughput |
| packet_size | 128 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:27:40 |
| start_time | 2018-09-21 15:53:01 |
| stop_time | 2018-09-21 16:20:41 |
3.2.3.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 11098 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 5056816 |
| RSS | 43143 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 11079 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6708 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.3.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
3.2.3.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 4662904.615 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19248.470 |
| tx_rate_percent | 99.227 |
| throughput_rx_percent | 99.973 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 5460.000 |
| max_latency_ns | 19500.000 |
| avg_latency_ns | 6958.000 |
| type | rfc2544_throughput |
| packet_size | 512 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:27:40 |
| start_time | 2018-09-21 15:53:01 |
| stop_time | 2018-09-21 16:20:41 |
3.2.3.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 11098 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 5056816 |
| RSS | 43143 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 11079 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6708 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.3.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
3.2.3.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 2376116.944 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19541.186 |
| tx_rate_percent | 99.227 |
| throughput_rx_percent | 99.607 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 6060.000 |
| max_latency_ns | 23680.000 |
| avg_latency_ns | 7400.000 |
| type | rfc2544_throughput |
| packet_size | 1024 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:27:40 |
| start_time | 2018-09-21 15:53:01 |
| stop_time | 2018-09-21 16:20:41 |
3.2.3.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 11098 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 5056816 |
| RSS | 43143 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 11079 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6708 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.3.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
3.2.3.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 1612916.334 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19638.869 |
| tx_rate_percent | 99.227 |
| throughput_rx_percent | 99.485 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 6280.000 |
| max_latency_ns | 24920.000 |
| avg_latency_ns | 8555.000 |
| type | rfc2544_throughput |
| packet_size | 1518 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:27:40 |
| start_time | 2018-09-21 15:53:01 |
| stop_time | 2018-09-21 16:20:41 |
3.2.3.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 11098 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 5056816 |
| RSS | 43143 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 11079 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6708 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.3.7. Anomalies¶
No anomalies were detected during the course of this test.
3.2.3.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
3.2.4. Test ID: PVP_BACK2BACK¶
3.2.4.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
- VM images:
- /home/jenkins/vloop-vnf-ubuntu-16.04_trex_20180209.qcow2
- VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
Below are test details:
- Test ID: pvp_back2back
- Description: LTD.Throughput.RFC2544.BackToBackFrames
- Deployment: pvp
- Traffic type: rfc2544_back2back
- Bidirectional : True
3.2.4.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
3.2.4.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 2128 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 64 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:52:40 |
| start_time | 2018-09-21 16:54:24 |
| stop_time | 2018-09-21 17:47:05 |
| guest_loopback_app | testpmd |
3.2.4.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 15875 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 11422004 |
| RSS | 43020 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 15845 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6680 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 16022 |
| %usr | 0.08 |
| %system | 0.04 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.01 |
| majflt/s | 0.00 |
| VSZ | 2802865 |
| RSS | 69091 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 7.08 |
| kB_ccwr/s | 0.00 |
3.2.4.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
3.2.4.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 1449 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 128 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:52:40 |
| start_time | 2018-09-21 16:54:24 |
| stop_time | 2018-09-21 17:47:05 |
| guest_loopback_app | testpmd |
3.2.4.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 15875 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 11422004 |
| RSS | 43020 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 15845 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6680 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 16022 |
| %usr | 0.08 |
| %system | 0.04 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.01 |
| majflt/s | 0.00 |
| VSZ | 2802865 |
| RSS | 69091 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 7.08 |
| kB_ccwr/s | 0.00 |
3.2.4.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
3.2.4.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 70488721 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 512 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:52:40 |
| start_time | 2018-09-21 16:54:24 |
| stop_time | 2018-09-21 17:47:05 |
| guest_loopback_app | testpmd |
3.2.4.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 15875 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 11422004 |
| RSS | 43020 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 15845 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6680 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 16022 |
| %usr | 0.08 |
| %system | 0.04 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.01 |
| majflt/s | 0.00 |
| VSZ | 2802865 |
| RSS | 69091 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 7.08 |
| kB_ccwr/s | 0.00 |
3.2.4.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
3.2.4.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 35919540 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 1024 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:52:40 |
| start_time | 2018-09-21 16:54:24 |
| stop_time | 2018-09-21 17:47:05 |
| guest_loopback_app | testpmd |
3.2.4.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 15875 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 11422004 |
| RSS | 43020 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 15845 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6680 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 16022 |
| %usr | 0.08 |
| %system | 0.04 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.01 |
| majflt/s | 0.00 |
| VSZ | 2802865 |
| RSS | 69091 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 7.08 |
| kB_ccwr/s | 0.00 |
3.2.4.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
3.2.4.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 24382314 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 1518 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:52:40 |
| start_time | 2018-09-21 16:54:24 |
| stop_time | 2018-09-21 17:47:05 |
| guest_loopback_app | testpmd |
3.2.4.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 15875 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 11422004 |
| RSS | 43020 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 15845 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6680 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 16022 |
| %usr | 0.08 |
| %system | 0.04 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.01 |
| majflt/s | 0.00 |
| VSZ | 2802865 |
| RSS | 69091 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 7.08 |
| kB_ccwr/s | 0.00 |
3.2.4.7. Anomalies¶
No anomalies were detected during the course of this test.
3.2.4.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
3.2.5. Test ID: PHY2PHY_TPUT¶
3.2.5.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
Below are test details:
- Test ID: phy2phy_tput
- Description: LTD.Throughput.RFC2544.PacketLossRatio
- Deployment: p2p
- Traffic type: rfc2544_throughput
- Bidirectional : True
3.2.5.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
3.2.5.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 23316600.135 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 11938.099 |
| tx_rate_percent | 78.344 |
| throughput_rx_percent | 78.344 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 4700.000 |
| max_latency_ns | 29000.000 |
| avg_latency_ns | 11860.500 |
| type | rfc2544_throughput |
| packet_size | 64 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:13:21 |
| start_time | 2018-09-21 15:09:30 |
| stop_time | 2018-09-21 15:22:51 |
3.2.5.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 7808 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.05 |
| majflt/s | 0.00 |
| VSZ | 5056808 |
| RSS | 42732 |
| %MEM | 0.06 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 7790 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50700 |
| RSS | 6660 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.5.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
3.2.5.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 16891670.672 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 17297.071 |
| tx_rate_percent | 100 |
| throughput_rx_percent | 100 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 12680.000 |
| max_latency_ns | 61660.000 |
| avg_latency_ns | 42604.500 |
| type | rfc2544_throughput |
| packet_size | 128 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:13:21 |
| start_time | 2018-09-21 15:09:30 |
| stop_time | 2018-09-21 15:22:51 |
3.2.5.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 7808 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.05 |
| majflt/s | 0.00 |
| VSZ | 5056808 |
| RSS | 42732 |
| %MEM | 0.06 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 7790 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50700 |
| RSS | 6660 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.5.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
3.2.5.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 4699200.623 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19247.926 |
| tx_rate_percent | 100 |
| throughput_rx_percent | 100 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 15380.000 |
| max_latency_ns | 47280.000 |
| avg_latency_ns | 35997.000 |
| type | rfc2544_throughput |
| packet_size | 512 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:13:21 |
| start_time | 2018-09-21 15:09:30 |
| stop_time | 2018-09-21 15:22:51 |
3.2.5.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 7808 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.05 |
| majflt/s | 0.00 |
| VSZ | 5056808 |
| RSS | 42732 |
| %MEM | 0.06 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 7790 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50700 |
| RSS | 6660 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.5.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
3.2.5.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 2394615.522 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19616.690 |
| tx_rate_percent | 100 |
| throughput_rx_percent | 100 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 13340.000 |
| max_latency_ns | 40040.000 |
| avg_latency_ns | 29207.000 |
| type | rfc2544_throughput |
| packet_size | 1024 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:13:21 |
| start_time | 2018-09-21 15:09:30 |
| stop_time | 2018-09-21 15:22:51 |
3.2.5.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 7808 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.05 |
| majflt/s | 0.00 |
| VSZ | 5056808 |
| RSS | 42732 |
| %MEM | 0.06 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 7790 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50700 |
| RSS | 6660 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.5.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
3.2.5.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 1625474.573 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19739.763 |
| tx_rate_percent | 100 |
| throughput_rx_percent | 100 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 16160.000 |
| max_latency_ns | 42060.000 |
| avg_latency_ns | 30538.500 |
| type | rfc2544_throughput |
| packet_size | 1518 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:13:21 |
| start_time | 2018-09-21 15:09:30 |
| stop_time | 2018-09-21 15:22:51 |
3.2.5.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 7808 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.05 |
| majflt/s | 0.00 |
| VSZ | 5056808 |
| RSS | 42732 |
| %MEM | 0.06 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 7790 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50700 |
| RSS | 6660 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
3.2.5.7. Anomalies¶
No anomalies were detected during the course of this test.
3.2.5.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
3.2.6. Test ID: PVP_TPUT¶
3.2.6.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
- VM images:
- /home/jenkins/vloop-vnf-ubuntu-16.04_trex_20180209.qcow2
- VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
Below are test details:
- Test ID: pvp_tput
- Description: LTD.Throughput.RFC2544.PacketLossRatio
- Deployment: pvp
- Traffic type: rfc2544_throughput
- Bidirectional : True
3.2.6.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
3.2.6.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 7663722.954 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 3923.826 |
| tx_rate_percent | 25.750 |
| throughput_rx_percent | 25.750 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 5800.000 |
| max_latency_ns | 40400.000 |
| avg_latency_ns | 7544.000 |
| type | rfc2544_throughput |
| packet_size | 64 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:17:22 |
| start_time | 2018-09-21 16:37:01 |
| stop_time | 2018-09-21 16:54:24 |
| guest_loopback_app | testpmd |
3.2.6.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 14389 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.06 |
| majflt/s | 0.00 |
| VSZ | 11421996 |
| RSS | 43140 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 14370 |
| %usr | 0.01 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6632 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 14536 |
| %usr | 0.10 |
| %system | 0.05 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.05 |
| majflt/s | 0.00 |
| VSZ | 2890730 |
| RSS | 67142 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 22.74 |
| kB_ccwr/s | 0.00 |
3.2.6.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
3.2.6.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 8530441.632 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 8735.172 |
| tx_rate_percent | 50.500 |
| throughput_rx_percent | 50.500 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 7580.000 |
| max_latency_ns | 40860.000 |
| avg_latency_ns | 9737.500 |
| type | rfc2544_throughput |
| packet_size | 128 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:17:22 |
| start_time | 2018-09-21 16:37:01 |
| stop_time | 2018-09-21 16:54:24 |
| guest_loopback_app | testpmd |
3.2.6.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 14389 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.06 |
| majflt/s | 0.00 |
| VSZ | 11421996 |
| RSS | 43140 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 14370 |
| %usr | 0.01 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6632 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 14536 |
| %usr | 0.10 |
| %system | 0.05 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.05 |
| majflt/s | 0.00 |
| VSZ | 2890730 |
| RSS | 67142 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 22.74 |
| kB_ccwr/s | 0.00 |
3.2.6.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
3.2.6.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 4699168.685 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19247.795 |
| tx_rate_percent | 100 |
| throughput_rx_percent | 100 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 22840.000 |
| max_latency_ns | 75480.000 |
| avg_latency_ns | 64362.000 |
| type | rfc2544_throughput |
| packet_size | 512 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:17:22 |
| start_time | 2018-09-21 16:37:01 |
| stop_time | 2018-09-21 16:54:24 |
| guest_loopback_app | testpmd |
3.2.6.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 14389 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.06 |
| majflt/s | 0.00 |
| VSZ | 11421996 |
| RSS | 43140 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 14370 |
| %usr | 0.01 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6632 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 14536 |
| %usr | 0.10 |
| %system | 0.05 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.05 |
| majflt/s | 0.00 |
| VSZ | 2890730 |
| RSS | 67142 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 22.74 |
| kB_ccwr/s | 0.00 |
3.2.6.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
3.2.6.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 2394605.201 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19616.606 |
| tx_rate_percent | 100 |
| throughput_rx_percent | 100 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 21560.000 |
| max_latency_ns | 64720.000 |
| avg_latency_ns | 49341.000 |
| type | rfc2544_throughput |
| packet_size | 1024 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:17:22 |
| start_time | 2018-09-21 16:37:01 |
| stop_time | 2018-09-21 16:54:24 |
| guest_loopback_app | testpmd |
3.2.6.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 14389 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.06 |
| majflt/s | 0.00 |
| VSZ | 11421996 |
| RSS | 43140 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 14370 |
| %usr | 0.01 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6632 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 14536 |
| %usr | 0.10 |
| %system | 0.05 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.05 |
| majflt/s | 0.00 |
| VSZ | 2890730 |
| RSS | 67142 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 22.74 |
| kB_ccwr/s | 0.00 |
3.2.6.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
3.2.6.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 1625471.035 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19739.720 |
| tx_rate_percent | 100 |
| throughput_rx_percent | 100 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 22960.000 |
| max_latency_ns | 55660.000 |
| avg_latency_ns | 43539.500 |
| type | rfc2544_throughput |
| packet_size | 1518 |
| vswitch | OvsDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:17:22 |
| start_time | 2018-09-21 16:37:01 |
| stop_time | 2018-09-21 16:54:24 |
| guest_loopback_app | testpmd |
3.2.6.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 14389 |
| %usr | 100.00 |
| %system | 0.05 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.06 |
| majflt/s | 0.00 |
| VSZ | 11421996 |
| RSS | 43140 |
| %MEM | 0.07 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 14370 |
| %usr | 0.01 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 50696 |
| RSS | 6632 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 14536 |
| %usr | 0.10 |
| %system | 0.05 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.05 |
| majflt/s | 0.00 |
| VSZ | 2890730 |
| RSS | 67142 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 22.74 |
| kB_ccwr/s | 0.00 |
3.2.6.7. Anomalies¶
No anomalies were detected during the course of this test.
3.2.6.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
3.3. Rationale for decisions¶
The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.
3.4. Conclusions and recommendations¶
The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/fraser/2018-09-21_22-09-22/vswitchperf_logs_2018-09-21_22-09-22.tar.gz.
3.5. General¶
3.5.1. Glossary¶
- NFV - Network Function Virtualization
- Mbps - 1,000,000bps
3.5.2. Document change procedures and history¶
| Document ID | Author | Date Modified |
|---|---|---|
| OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT | Christopher Nolan | 23/01/2015 |
| OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT | Christopher Nolan | 28/01/2015 |
4. Performance report for OvsVanilla¶
4.1. Introduction¶
The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).
This document is currently in draft form.
4.1.1. Document identifier¶
The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.
4.1.2. Scope¶
The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.
4.1.3. References¶
4.2. Details of the Level Test Report¶
This section provides a test-results-overview. Also included are the rationale and the conclusions.
4.2.1. Test ID: BACK2BACK¶
4.2.1.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
Below are test details:
- Test ID: back2back
- Description: LTD.Throughput.RFC2544.BackToBackFrames
- Deployment: p2p
- Traffic type: rfc2544_back2back
- Bidirectional : True
4.2.1.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
4.2.1.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 5108 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 64 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:42:20 |
| start_time | 2018-09-21 18:30:17 |
| stop_time | 2018-09-21 19:12:37 |
4.2.1.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 23028 |
| %usr | 0.21 |
| %system | 1.22 |
| %guest | 0.00 |
| %CPU | 1.43 |
| CPU | |
| minflt/s | 0.09 |
| majflt/s | 0.00 |
| VSZ | 3364108 |
| RSS | 7723 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 23023 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.00 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5620 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.1.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
4.2.1.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 3382 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 128 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:42:20 |
| start_time | 2018-09-21 18:30:17 |
| stop_time | 2018-09-21 19:12:37 |
4.2.1.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 23028 |
| %usr | 0.21 |
| %system | 1.22 |
| %guest | 0.00 |
| %CPU | 1.43 |
| CPU | |
| minflt/s | 0.09 |
| majflt/s | 0.00 |
| VSZ | 3364108 |
| RSS | 7723 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 23023 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.00 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5620 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.1.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
4.2.1.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 1613 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 512 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:42:20 |
| start_time | 2018-09-21 18:30:17 |
| stop_time | 2018-09-21 19:12:37 |
4.2.1.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 23028 |
| %usr | 0.21 |
| %system | 1.22 |
| %guest | 0.00 |
| %CPU | 1.43 |
| CPU | |
| minflt/s | 0.09 |
| majflt/s | 0.00 |
| VSZ | 3364108 |
| RSS | 7723 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 23023 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.00 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5620 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.1.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
4.2.1.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 1370 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 1024 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:42:20 |
| start_time | 2018-09-21 18:30:17 |
| stop_time | 2018-09-21 19:12:37 |
4.2.1.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 23028 |
| %usr | 0.21 |
| %system | 1.22 |
| %guest | 0.00 |
| %CPU | 1.43 |
| CPU | |
| minflt/s | 0.09 |
| majflt/s | 0.00 |
| VSZ | 3364108 |
| RSS | 7723 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 23023 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.00 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5620 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.1.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
4.2.1.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 1488 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 1518 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:42:20 |
| start_time | 2018-09-21 18:30:17 |
| stop_time | 2018-09-21 19:12:37 |
4.2.1.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 23028 |
| %usr | 0.21 |
| %system | 1.22 |
| %guest | 0.00 |
| %CPU | 1.43 |
| CPU | |
| minflt/s | 0.09 |
| majflt/s | 0.00 |
| VSZ | 3364108 |
| RSS | 7723 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 23023 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.00 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5620 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.1.7. Anomalies¶
No anomalies were detected during the course of this test.
4.2.1.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
4.2.2. Test ID: PHY2PHY_SCALABILITY¶
4.2.2.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
Below are test details:
- Test ID: phy2phy_scalability
- Description: LTD.Scalability.Flows.RFC2544.0PacketLoss
- Deployment: p2p
- Traffic type: rfc2544_throughput
- Bidirectional : True
4.2.2.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
4.2.2.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 757999.099 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 388.096 |
| tx_rate_percent | 2.547 |
| throughput_rx_percent | 2.547 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 4060.000 |
| max_latency_ns | 205400.000 |
| avg_latency_ns | 29742.000 |
| type | rfc2544_throughput |
| packet_size | 64 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:27:39 |
| start_time | 2018-09-21 19:40:11 |
| stop_time | 2018-09-21 20:07:51 |
| stream_count | 8000 |
| match_type | L4 |
| pre-installed_flows | No |
4.2.2.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 27276 |
| %usr | 0.22 |
| %system | 1.31 |
| %guest | 0.00 |
| %CPU | 1.53 |
| CPU | |
| minflt/s | 0.76 |
| majflt/s | 0.00 |
| VSZ | 3364104 |
| RSS | 7473 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 27271 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5872 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.2.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
4.2.2.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 952808.366 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 975.676 |
| tx_rate_percent | 5.641 |
| throughput_rx_percent | 5.641 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 4200.000 |
| max_latency_ns | 266180.000 |
| avg_latency_ns | 30472.000 |
| type | rfc2544_throughput |
| packet_size | 128 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:27:39 |
| start_time | 2018-09-21 19:40:11 |
| stop_time | 2018-09-21 20:07:51 |
| stream_count | 8000 |
| match_type | L4 |
| pre-installed_flows | No |
4.2.2.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 27276 |
| %usr | 0.22 |
| %system | 1.31 |
| %guest | 0.00 |
| %CPU | 1.53 |
| CPU | |
| minflt/s | 0.76 |
| majflt/s | 0.00 |
| VSZ | 3364104 |
| RSS | 7473 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 27271 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5872 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.2.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
4.2.2.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 810253.897 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 3318.800 |
| tx_rate_percent | 17.242 |
| throughput_rx_percent | 17.242 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 5040.000 |
| max_latency_ns | 458000.000 |
| avg_latency_ns | 29397.500 |
| type | rfc2544_throughput |
| packet_size | 512 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:27:39 |
| start_time | 2018-09-21 19:40:11 |
| stop_time | 2018-09-21 20:07:51 |
| stream_count | 8000 |
| match_type | L4 |
| pre-installed_flows | No |
4.2.2.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 27276 |
| %usr | 0.22 |
| %system | 1.31 |
| %guest | 0.00 |
| %CPU | 1.53 |
| CPU | |
| minflt/s | 0.76 |
| majflt/s | 0.00 |
| VSZ | 3364104 |
| RSS | 7473 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 27271 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5872 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.2.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
4.2.2.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 838872.219 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 6872.041 |
| tx_rate_percent | 35.031 |
| throughput_rx_percent | 35.031 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 5780.000 |
| max_latency_ns | 425660.000 |
| avg_latency_ns | 37026.500 |
| type | rfc2544_throughput |
| packet_size | 1024 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:27:39 |
| start_time | 2018-09-21 19:40:11 |
| stop_time | 2018-09-21 20:07:51 |
| stream_count | 8000 |
| match_type | L4 |
| pre-installed_flows | No |
4.2.2.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 27276 |
| %usr | 0.22 |
| %system | 1.31 |
| %guest | 0.00 |
| %CPU | 1.53 |
| CPU | |
| minflt/s | 0.76 |
| majflt/s | 0.00 |
| VSZ | 3364104 |
| RSS | 7473 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 27271 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5872 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.2.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
4.2.2.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 846015.960 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 10274.018 |
| tx_rate_percent | 52.047 |
| throughput_rx_percent | 52.047 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 7300.000 |
| max_latency_ns | 977820.000 |
| avg_latency_ns | 65728.500 |
| type | rfc2544_throughput |
| packet_size | 1518 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:27:39 |
| start_time | 2018-09-21 19:40:11 |
| stop_time | 2018-09-21 20:07:51 |
| stream_count | 8000 |
| match_type | L4 |
| pre-installed_flows | No |
4.2.2.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 27276 |
| %usr | 0.22 |
| %system | 1.31 |
| %guest | 0.00 |
| %CPU | 1.53 |
| CPU | |
| minflt/s | 0.76 |
| majflt/s | 0.00 |
| VSZ | 3364104 |
| RSS | 7473 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 27271 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5872 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.2.7. Anomalies¶
No anomalies were detected during the course of this test.
4.2.2.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
4.2.3. Test ID: PVVP_TPUT¶
4.2.3.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: pvvp
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
- VM images:
- /home/jenkins/vloop-vnf-ubuntu-16.04_trex_20180209.qcow2
- /home/jenkins/vloop-vnf-ubuntu-16.04_trex_20180209.qcow2
- VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
Below are test details:
- Test ID: pvvp_tput
- Description: LTD.Throughput.RFC2544.PacketLossRatio
- Deployment: pvvp
- Traffic type: rfc2544_throughput
- Bidirectional : True
4.2.3.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
4.2.3.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 249545.987 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 127.768 |
| tx_rate_percent | 1.773 |
| throughput_rx_percent | 0.838 |
| frame_loss_percent | 52.718 |
| min_latency_ns | 26680.000 |
| max_latency_ns | 71126020.000 |
| avg_latency_ns | 4657391.500 |
| type | rfc2544_throughput |
| packet_size | 64 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:29:44 |
| start_time | 2018-09-21 21:20:02 |
| stop_time | 2018-09-21 21:49:46 |
| guest_loopback_app | testpmd testpmd |
4.2.3.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 33785 |
| %usr | 0.20 |
| %system | 1.10 |
| %guest | 0.00 |
| %CPU | 1.30 |
| CPU | |
| minflt/s | 0.14 |
| majflt/s | 0.00 |
| VSZ | 3364224 |
| RSS | 8114 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 33779 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5884 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 34110 |
| %usr | 0.11 |
| %system | 1.77 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 2818382 |
| RSS | 67764 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 13.32 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 34021 |
| %usr | 0.03 |
| %system | 1.72 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 2863728 |
| RSS | 60956 |
| %MEM | 0.09 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.3.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
4.2.3.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 299568.642 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 306.758 |
| tx_rate_percent | 1.773 |
| throughput_rx_percent | 1.773 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 20580.000 |
| max_latency_ns | 1218760.000 |
| avg_latency_ns | 59677.500 |
| type | rfc2544_throughput |
| packet_size | 128 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:29:44 |
| start_time | 2018-09-21 21:20:02 |
| stop_time | 2018-09-21 21:49:46 |
| guest_loopback_app | testpmd testpmd |
4.2.3.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 33785 |
| %usr | 0.20 |
| %system | 1.10 |
| %guest | 0.00 |
| %CPU | 1.30 |
| CPU | |
| minflt/s | 0.14 |
| majflt/s | 0.00 |
| VSZ | 3364224 |
| RSS | 8114 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 33779 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5884 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 34110 |
| %usr | 0.11 |
| %system | 1.77 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 2818382 |
| RSS | 67764 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 13.32 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 34021 |
| %usr | 0.03 |
| %system | 1.72 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 2863728 |
| RSS | 60956 |
| %MEM | 0.09 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.3.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
4.2.3.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 156030.390 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 639.100 |
| tx_rate_percent | 3.320 |
| throughput_rx_percent | 3.320 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 22320.000 |
| max_latency_ns | 1239640.000 |
| avg_latency_ns | 76724.000 |
| type | rfc2544_throughput |
| packet_size | 512 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:29:44 |
| start_time | 2018-09-21 21:20:02 |
| stop_time | 2018-09-21 21:49:46 |
| guest_loopback_app | testpmd testpmd |
4.2.3.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 33785 |
| %usr | 0.20 |
| %system | 1.10 |
| %guest | 0.00 |
| %CPU | 1.30 |
| CPU | |
| minflt/s | 0.14 |
| majflt/s | 0.00 |
| VSZ | 3364224 |
| RSS | 8114 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 33779 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5884 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 34110 |
| %usr | 0.11 |
| %system | 1.77 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 2818382 |
| RSS | 67764 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 13.32 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 34021 |
| %usr | 0.03 |
| %system | 1.72 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 2863728 |
| RSS | 60956 |
| %MEM | 0.09 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.3.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
4.2.3.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 227678.633 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 1865.143 |
| tx_rate_percent | 9.508 |
| throughput_rx_percent | 9.508 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 27980.000 |
| max_latency_ns | 2575440.000 |
| avg_latency_ns | 80396.000 |
| type | rfc2544_throughput |
| packet_size | 1024 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:29:44 |
| start_time | 2018-09-21 21:20:02 |
| stop_time | 2018-09-21 21:49:46 |
| guest_loopback_app | testpmd testpmd |
4.2.3.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 33785 |
| %usr | 0.20 |
| %system | 1.10 |
| %guest | 0.00 |
| %CPU | 1.30 |
| CPU | |
| minflt/s | 0.14 |
| majflt/s | 0.00 |
| VSZ | 3364224 |
| RSS | 8114 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 33779 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5884 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 34110 |
| %usr | 0.11 |
| %system | 1.77 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 2818382 |
| RSS | 67764 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 13.32 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 34021 |
| %usr | 0.03 |
| %system | 1.72 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 2863728 |
| RSS | 60956 |
| %MEM | 0.09 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.3.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
4.2.3.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 242554.504 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 2945.582 |
| tx_rate_percent | 14.922 |
| throughput_rx_percent | 14.922 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 29220.000 |
| max_latency_ns | 1230000.000 |
| avg_latency_ns | 89771.500 |
| type | rfc2544_throughput |
| packet_size | 1518 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:29:44 |
| start_time | 2018-09-21 21:20:02 |
| stop_time | 2018-09-21 21:49:46 |
| guest_loopback_app | testpmd testpmd |
4.2.3.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 33785 |
| %usr | 0.20 |
| %system | 1.10 |
| %guest | 0.00 |
| %CPU | 1.30 |
| CPU | |
| minflt/s | 0.14 |
| majflt/s | 0.00 |
| VSZ | 3364224 |
| RSS | 8114 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 33779 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5884 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 34110 |
| %usr | 0.11 |
| %system | 1.77 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 2818382 |
| RSS | 67764 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 13.32 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 34021 |
| %usr | 0.03 |
| %system | 1.72 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 2863728 |
| RSS | 60956 |
| %MEM | 0.09 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.3.7. Anomalies¶
No anomalies were detected during the course of this test.
4.2.3.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
4.2.4. Test ID: PHY2PHY_TPUT_MOD_VLAN¶
4.2.4.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
Below are test details:
- Test ID: phy2phy_tput_mod_vlan
- Description: LTD.Throughput.RFC2544.PacketLossRatioFrameModification
- Deployment: p2p
- Traffic type: rfc2544_throughput
- Bidirectional : True
4.2.4.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
4.2.4.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 757998.695 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 412.351 |
| tx_rate_percent | 2.547 |
| throughput_rx_percent | 2.668 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 4120.000 |
| max_latency_ns | 220360.000 |
| avg_latency_ns | 28650.000 |
| type | rfc2544_throughput |
| packet_size | 64 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:27:33 |
| start_time | 2018-09-21 19:12:38 |
| stop_time | 2018-09-21 19:40:11 |
4.2.4.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 25564 |
| %usr | 0.22 |
| %system | 1.26 |
| %guest | 0.00 |
| %CPU | 1.48 |
| CPU | |
| minflt/s | 0.14 |
| majflt/s | 0.00 |
| VSZ | 3364112 |
| RSS | 7741 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 25559 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5872 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.4.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
4.2.4.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 822160.889 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 868.202 |
| tx_rate_percent | 4.867 |
| throughput_rx_percent | 4.999 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 4260.000 |
| max_latency_ns | 199440.000 |
| avg_latency_ns | 29431.500 |
| type | rfc2544_throughput |
| packet_size | 128 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:27:33 |
| start_time | 2018-09-21 19:12:38 |
| stop_time | 2018-09-21 19:40:11 |
4.2.4.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 25564 |
| %usr | 0.22 |
| %system | 1.26 |
| %guest | 0.00 |
| %CPU | 1.48 |
| CPU | |
| minflt/s | 0.14 |
| majflt/s | 0.00 |
| VSZ | 3364112 |
| RSS | 7741 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 25559 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5872 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.4.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
4.2.4.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 810254.321 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 3344.730 |
| tx_rate_percent | 17.242 |
| throughput_rx_percent | 17.372 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 5260.000 |
| max_latency_ns | 475880.000 |
| avg_latency_ns | 32323.500 |
| type | rfc2544_throughput |
| packet_size | 512 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:27:33 |
| start_time | 2018-09-21 19:12:38 |
| stop_time | 2018-09-21 19:40:11 |
4.2.4.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 25564 |
| %usr | 0.22 |
| %system | 1.26 |
| %guest | 0.00 |
| %CPU | 1.48 |
| CPU | |
| minflt/s | 0.14 |
| majflt/s | 0.00 |
| VSZ | 3364112 |
| RSS | 7741 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 25559 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5872 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.4.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
4.2.4.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 820350.181 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 6746.560 |
| tx_rate_percent | 34.258 |
| throughput_rx_percent | 34.389 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 5820.000 |
| max_latency_ns | 481780.000 |
| avg_latency_ns | 39995.500 |
| type | rfc2544_throughput |
| packet_size | 1024 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:27:33 |
| start_time | 2018-09-21 19:12:38 |
| stop_time | 2018-09-21 19:40:11 |
4.2.4.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 25564 |
| %usr | 0.22 |
| %system | 1.26 |
| %guest | 0.00 |
| %CPU | 1.48 |
| CPU | |
| minflt/s | 0.14 |
| majflt/s | 0.00 |
| VSZ | 3364112 |
| RSS | 7741 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 25559 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5872 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.4.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
4.2.4.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 820876.331 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 9994.990 |
| tx_rate_percent | 50.500 |
| throughput_rx_percent | 50.632 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 7920.000 |
| max_latency_ns | 605360.000 |
| avg_latency_ns | 49250.500 |
| type | rfc2544_throughput |
| packet_size | 1518 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:27:33 |
| start_time | 2018-09-21 19:12:38 |
| stop_time | 2018-09-21 19:40:11 |
4.2.4.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 25564 |
| %usr | 0.22 |
| %system | 1.26 |
| %guest | 0.00 |
| %CPU | 1.48 |
| CPU | |
| minflt/s | 0.14 |
| majflt/s | 0.00 |
| VSZ | 3364112 |
| RSS | 7741 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 25559 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5872 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.4.7. Anomalies¶
No anomalies were detected during the course of this test.
4.2.4.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
4.2.5. Test ID: PVVP_BACK2BACK¶
4.2.5.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: pvvp
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
- VM images:
- /home/jenkins/vloop-vnf-ubuntu-16.04_trex_20180209.qcow2
- /home/jenkins/vloop-vnf-ubuntu-16.04_trex_20180209.qcow2
- VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
Below are test details:
- Test ID: pvvp_back2back
- Description: LTD.Throughput.RFC2544.BackToBackFrames
- Deployment: pvvp
- Traffic type: rfc2544_back2back
- Bidirectional : True
4.2.5.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
4.2.5.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 851 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 64 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:44:23 |
| start_time | 2018-09-21 21:49:47 |
| stop_time | 2018-09-21 22:34:10 |
| guest_loopback_app | testpmd testpmd |
4.2.5.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 35929 |
| %usr | 0.21 |
| %system | 1.16 |
| %guest | 0.00 |
| %CPU | 1.37 |
| CPU | |
| minflt/s | 0.08 |
| majflt/s | 0.00 |
| VSZ | 3364232 |
| RSS | 8035 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 35923 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44316 |
| RSS | 5932 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 36254 |
| %usr | 0.10 |
| %system | 0.18 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 2845156 |
| RSS | 68103 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 8.71 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 36160 |
| %usr | 0.06 |
| %system | 0.15 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 2817468 |
| RSS | 62552 |
| %MEM | 0.09 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.5.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
4.2.5.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 483 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 128 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:44:23 |
| start_time | 2018-09-21 21:49:47 |
| stop_time | 2018-09-21 22:34:10 |
| guest_loopback_app | testpmd testpmd |
4.2.5.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 35929 |
| %usr | 0.21 |
| %system | 1.16 |
| %guest | 0.00 |
| %CPU | 1.37 |
| CPU | |
| minflt/s | 0.08 |
| majflt/s | 0.00 |
| VSZ | 3364232 |
| RSS | 8035 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 35923 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44316 |
| RSS | 5932 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 36254 |
| %usr | 0.10 |
| %system | 0.18 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 2845156 |
| RSS | 68103 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 8.71 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 36160 |
| %usr | 0.06 |
| %system | 0.15 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 2817468 |
| RSS | 62552 |
| %MEM | 0.09 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.5.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
4.2.5.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 537 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 512 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:44:23 |
| start_time | 2018-09-21 21:49:47 |
| stop_time | 2018-09-21 22:34:10 |
| guest_loopback_app | testpmd testpmd |
4.2.5.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 35929 |
| %usr | 0.21 |
| %system | 1.16 |
| %guest | 0.00 |
| %CPU | 1.37 |
| CPU | |
| minflt/s | 0.08 |
| majflt/s | 0.00 |
| VSZ | 3364232 |
| RSS | 8035 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 35923 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44316 |
| RSS | 5932 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 36254 |
| %usr | 0.10 |
| %system | 0.18 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 2845156 |
| RSS | 68103 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 8.71 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 36160 |
| %usr | 0.06 |
| %system | 0.15 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 2817468 |
| RSS | 62552 |
| %MEM | 0.09 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.5.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
4.2.5.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 1096 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 1024 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:44:23 |
| start_time | 2018-09-21 21:49:47 |
| stop_time | 2018-09-21 22:34:10 |
| guest_loopback_app | testpmd testpmd |
4.2.5.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 35929 |
| %usr | 0.21 |
| %system | 1.16 |
| %guest | 0.00 |
| %CPU | 1.37 |
| CPU | |
| minflt/s | 0.08 |
| majflt/s | 0.00 |
| VSZ | 3364232 |
| RSS | 8035 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 35923 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44316 |
| RSS | 5932 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 36254 |
| %usr | 0.10 |
| %system | 0.18 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 2845156 |
| RSS | 68103 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 8.71 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 36160 |
| %usr | 0.06 |
| %system | 0.15 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 2817468 |
| RSS | 62552 |
| %MEM | 0.09 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.5.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
4.2.5.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 744 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 1518 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:44:23 |
| start_time | 2018-09-21 21:49:47 |
| stop_time | 2018-09-21 22:34:10 |
| guest_loopback_app | testpmd testpmd |
4.2.5.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 35929 |
| %usr | 0.21 |
| %system | 1.16 |
| %guest | 0.00 |
| %CPU | 1.37 |
| CPU | |
| minflt/s | 0.08 |
| majflt/s | 0.00 |
| VSZ | 3364232 |
| RSS | 8035 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 35923 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44316 |
| RSS | 5932 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 36254 |
| %usr | 0.10 |
| %system | 0.18 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 2845156 |
| RSS | 68103 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 8.71 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 36160 |
| %usr | 0.06 |
| %system | 0.15 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 2817468 |
| RSS | 62552 |
| %MEM | 0.09 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.5.7. Anomalies¶
No anomalies were detected during the course of this test.
4.2.5.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
4.2.6. Test ID: PVP_BACK2BACK¶
4.2.6.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
- VM images:
- /home/jenkins/vloop-vnf-ubuntu-16.04_trex_20180209.qcow2
- VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
Below are test details:
- Test ID: pvp_back2back
- Description: LTD.Throughput.RFC2544.BackToBackFrames
- Deployment: pvp
- Traffic type: rfc2544_back2back
- Bidirectional : True
4.2.6.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
4.2.6.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 1702 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 64 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:43:28 |
| start_time | 2018-09-21 20:36:33 |
| stop_time | 2018-09-21 21:20:01 |
| guest_loopback_app | testpmd |
4.2.6.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 30992 |
| %usr | 0.21 |
| %system | 1.20 |
| %guest | 0.00 |
| %CPU | 1.41 |
| CPU | |
| minflt/s | 0.11 |
| majflt/s | 0.00 |
| VSZ | 3364104 |
| RSS | 7724 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.01 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 30987 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5836 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 31178 |
| %usr | 0.07 |
| %system | 0.12 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.01 |
| majflt/s | 0.00 |
| VSZ | 2835972 |
| RSS | 68544 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 8.69 |
| kB_ccwr/s | 0.00 |
4.2.6.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
4.2.6.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 0 |
| b2b_frame_loss_percent | 100 |
| type | rfc2544_back2back |
| packet_size | 128 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:43:28 |
| start_time | 2018-09-21 20:36:33 |
| stop_time | 2018-09-21 21:20:01 |
| guest_loopback_app | testpmd |
4.2.6.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 30992 |
| %usr | 0.21 |
| %system | 1.20 |
| %guest | 0.00 |
| %CPU | 1.41 |
| CPU | |
| minflt/s | 0.11 |
| majflt/s | 0.00 |
| VSZ | 3364104 |
| RSS | 7724 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.01 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 30987 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5836 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 31178 |
| %usr | 0.07 |
| %system | 0.12 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.01 |
| majflt/s | 0.00 |
| VSZ | 2835972 |
| RSS | 68544 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 8.69 |
| kB_ccwr/s | 0.00 |
4.2.6.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
4.2.6.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 537 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 512 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:43:28 |
| start_time | 2018-09-21 20:36:33 |
| stop_time | 2018-09-21 21:20:01 |
| guest_loopback_app | testpmd |
4.2.6.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 30992 |
| %usr | 0.21 |
| %system | 1.20 |
| %guest | 0.00 |
| %CPU | 1.41 |
| CPU | |
| minflt/s | 0.11 |
| majflt/s | 0.00 |
| VSZ | 3364104 |
| RSS | 7724 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.01 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 30987 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5836 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 31178 |
| %usr | 0.07 |
| %system | 0.12 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.01 |
| majflt/s | 0.00 |
| VSZ | 2835972 |
| RSS | 68544 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 8.69 |
| kB_ccwr/s | 0.00 |
4.2.6.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
4.2.6.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 548 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 1024 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:43:28 |
| start_time | 2018-09-21 20:36:33 |
| stop_time | 2018-09-21 21:20:01 |
| guest_loopback_app | testpmd |
4.2.6.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 30992 |
| %usr | 0.21 |
| %system | 1.20 |
| %guest | 0.00 |
| %CPU | 1.41 |
| CPU | |
| minflt/s | 0.11 |
| majflt/s | 0.00 |
| VSZ | 3364104 |
| RSS | 7724 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.01 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 30987 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5836 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 31178 |
| %usr | 0.07 |
| %system | 0.12 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.01 |
| majflt/s | 0.00 |
| VSZ | 2835972 |
| RSS | 68544 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 8.69 |
| kB_ccwr/s | 0.00 |
4.2.6.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
4.2.6.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 744 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 1518 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:43:28 |
| start_time | 2018-09-21 20:36:33 |
| stop_time | 2018-09-21 21:20:01 |
| guest_loopback_app | testpmd |
4.2.6.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 30992 |
| %usr | 0.21 |
| %system | 1.20 |
| %guest | 0.00 |
| %CPU | 1.41 |
| CPU | |
| minflt/s | 0.11 |
| majflt/s | 0.00 |
| VSZ | 3364104 |
| RSS | 7724 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.01 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 30987 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5836 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 31178 |
| %usr | 0.07 |
| %system | 0.12 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.01 |
| majflt/s | 0.00 |
| VSZ | 2835972 |
| RSS | 68544 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 8.69 |
| kB_ccwr/s | 0.00 |
4.2.6.7. Anomalies¶
No anomalies were detected during the course of this test.
4.2.6.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
4.2.7. Test ID: PHY2PHY_TPUT¶
4.2.7.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
Below are test details:
- Test ID: phy2phy_tput
- Description: LTD.Throughput.RFC2544.PacketLossRatio
- Deployment: p2p
- Traffic type: rfc2544_throughput
- Bidirectional : True
4.2.7.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
4.2.7.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 758000.485 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 388.096 |
| tx_rate_percent | 2.547 |
| throughput_rx_percent | 2.547 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 4040.000 |
| max_latency_ns | 308380.000 |
| avg_latency_ns | 31677.500 |
| type | rfc2544_throughput |
| packet_size | 64 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:27:38 |
| start_time | 2018-09-21 18:02:37 |
| stop_time | 2018-09-21 18:30:16 |
4.2.7.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 21239 |
| %usr | 0.23 |
| %system | 1.26 |
| %guest | 0.00 |
| %CPU | 1.49 |
| CPU | |
| minflt/s | 0.18 |
| majflt/s | 0.00 |
| VSZ | 3364108 |
| RSS | 7728 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.01 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 21233 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5808 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.7.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
4.2.7.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 952811.345 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 975.679 |
| tx_rate_percent | 5.641 |
| throughput_rx_percent | 5.641 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 4180.000 |
| max_latency_ns | 3014840.000 |
| avg_latency_ns | 42144.500 |
| type | rfc2544_throughput |
| packet_size | 128 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:27:38 |
| start_time | 2018-09-21 18:02:37 |
| stop_time | 2018-09-21 18:30:16 |
4.2.7.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 21239 |
| %usr | 0.23 |
| %system | 1.26 |
| %guest | 0.00 |
| %CPU | 1.49 |
| CPU | |
| minflt/s | 0.18 |
| majflt/s | 0.00 |
| VSZ | 3364108 |
| RSS | 7728 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.01 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 21233 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5808 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.7.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
4.2.7.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 810255.903 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 3318.808 |
| tx_rate_percent | 17.242 |
| throughput_rx_percent | 17.242 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 5020.000 |
| max_latency_ns | 666780.000 |
| avg_latency_ns | 31141.000 |
| type | rfc2544_throughput |
| packet_size | 512 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:27:38 |
| start_time | 2018-09-21 18:02:37 |
| stop_time | 2018-09-21 18:30:16 |
4.2.7.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 21239 |
| %usr | 0.23 |
| %system | 1.26 |
| %guest | 0.00 |
| %CPU | 1.49 |
| CPU | |
| minflt/s | 0.18 |
| majflt/s | 0.00 |
| VSZ | 3364108 |
| RSS | 7728 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.01 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 21233 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5808 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.7.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
4.2.7.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 838873.921 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 6872.055 |
| tx_rate_percent | 35.031 |
| throughput_rx_percent | 35.031 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 5780.000 |
| max_latency_ns | 487980.000 |
| avg_latency_ns | 31815.000 |
| type | rfc2544_throughput |
| packet_size | 1024 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:27:38 |
| start_time | 2018-09-21 18:02:37 |
| stop_time | 2018-09-21 18:30:16 |
4.2.7.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 21239 |
| %usr | 0.23 |
| %system | 1.26 |
| %guest | 0.00 |
| %CPU | 1.49 |
| CPU | |
| minflt/s | 0.18 |
| majflt/s | 0.00 |
| VSZ | 3364108 |
| RSS | 7728 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.01 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 21233 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5808 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.7.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
4.2.7.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 846017.964 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 10274.042 |
| tx_rate_percent | 52.047 |
| throughput_rx_percent | 52.047 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 9620.000 |
| max_latency_ns | 520240.000 |
| avg_latency_ns | 40098.500 |
| type | rfc2544_throughput |
| packet_size | 1518 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:27:38 |
| start_time | 2018-09-21 18:02:37 |
| stop_time | 2018-09-21 18:30:16 |
4.2.7.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 21239 |
| %usr | 0.23 |
| %system | 1.26 |
| %guest | 0.00 |
| %CPU | 1.49 |
| CPU | |
| minflt/s | 0.18 |
| majflt/s | 0.00 |
| VSZ | 3364108 |
| RSS | 7728 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.01 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 21233 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44320 |
| RSS | 5808 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
4.2.7.7. Anomalies¶
No anomalies were detected during the course of this test.
4.2.7.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
4.2.8. Test ID: PVP_TPUT¶
4.2.8.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
- VM images:
- /home/jenkins/vloop-vnf-ubuntu-16.04_trex_20180209.qcow2
- VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
Below are test details:
- Test ID: pvp_tput
- Description: LTD.Throughput.RFC2544.PacketLossRatio
- Deployment: pvp
- Traffic type: rfc2544_throughput
- Bidirectional : True
4.2.8.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
4.2.8.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 226318.414 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 115.875 |
| tx_rate_percent | 1.773 |
| throughput_rx_percent | 0.760 |
| frame_loss_percent | 57.119 |
| min_latency_ns | 17160.000 |
| max_latency_ns | 81334680.000 |
| avg_latency_ns | 5445300.000 |
| type | rfc2544_throughput |
| packet_size | 64 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:28:40 |
| start_time | 2018-09-21 20:07:52 |
| stop_time | 2018-09-21 20:36:32 |
| guest_loopback_app | testpmd |
4.2.8.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 29021 |
| %usr | 0.22 |
| %system | 1.16 |
| %guest | 0.00 |
| %CPU | 1.37 |
| CPU | |
| minflt/s | 0.20 |
| majflt/s | 0.00 |
| VSZ | 3364108 |
| RSS | 7714 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.01 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 29016 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44316 |
| RSS | 5976 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 29209 |
| %usr | 0.05 |
| %system | 1.14 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.03 |
| majflt/s | 0.00 |
| VSZ | 2942690 |
| RSS | 65964 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 13.25 |
| kB_ccwr/s | 0.00 |
4.2.8.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
4.2.8.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 299567.736 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 306.757 |
| tx_rate_percent | 1.773 |
| throughput_rx_percent | 1.773 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 12100.000 |
| max_latency_ns | 274580.000 |
| avg_latency_ns | 39267.000 |
| type | rfc2544_throughput |
| packet_size | 128 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:28:40 |
| start_time | 2018-09-21 20:07:52 |
| stop_time | 2018-09-21 20:36:32 |
| guest_loopback_app | testpmd |
4.2.8.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 29021 |
| %usr | 0.22 |
| %system | 1.16 |
| %guest | 0.00 |
| %CPU | 1.37 |
| CPU | |
| minflt/s | 0.20 |
| majflt/s | 0.00 |
| VSZ | 3364108 |
| RSS | 7714 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.01 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 29016 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44316 |
| RSS | 5976 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 29209 |
| %usr | 0.05 |
| %system | 1.14 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.03 |
| majflt/s | 0.00 |
| VSZ | 2942690 |
| RSS | 65964 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 13.25 |
| kB_ccwr/s | 0.00 |
4.2.8.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
4.2.8.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 228721.748 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 936.844 |
| tx_rate_percent | 4.867 |
| throughput_rx_percent | 4.867 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 12620.000 |
| max_latency_ns | 297480.000 |
| avg_latency_ns | 58249.500 |
| type | rfc2544_throughput |
| packet_size | 512 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:28:40 |
| start_time | 2018-09-21 20:07:52 |
| stop_time | 2018-09-21 20:36:32 |
| guest_loopback_app | testpmd |
4.2.8.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 29021 |
| %usr | 0.22 |
| %system | 1.16 |
| %guest | 0.00 |
| %CPU | 1.37 |
| CPU | |
| minflt/s | 0.20 |
| majflt/s | 0.00 |
| VSZ | 3364108 |
| RSS | 7714 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.01 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 29016 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44316 |
| RSS | 5976 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 29209 |
| %usr | 0.05 |
| %system | 1.14 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.03 |
| majflt/s | 0.00 |
| VSZ | 2942690 |
| RSS | 65964 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 13.25 |
| kB_ccwr/s | 0.00 |
4.2.8.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
4.2.8.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 320289.062 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 2623.808 |
| tx_rate_percent | 13.375 |
| throughput_rx_percent | 13.375 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 18220.000 |
| max_latency_ns | 276160.000 |
| avg_latency_ns | 64597.500 |
| type | rfc2544_throughput |
| packet_size | 1024 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:28:40 |
| start_time | 2018-09-21 20:07:52 |
| stop_time | 2018-09-21 20:36:32 |
| guest_loopback_app | testpmd |
4.2.8.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 29021 |
| %usr | 0.22 |
| %system | 1.16 |
| %guest | 0.00 |
| %CPU | 1.37 |
| CPU | |
| minflt/s | 0.20 |
| majflt/s | 0.00 |
| VSZ | 3364108 |
| RSS | 7714 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.01 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 29016 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44316 |
| RSS | 5976 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 29209 |
| %usr | 0.05 |
| %system | 1.14 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.03 |
| majflt/s | 0.00 |
| VSZ | 2942690 |
| RSS | 65964 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 13.25 |
| kB_ccwr/s | 0.00 |
4.2.8.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
4.2.8.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 242553.401 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 2945.569 |
| tx_rate_percent | 14.922 |
| throughput_rx_percent | 14.922 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 15040.000 |
| max_latency_ns | 485780.000 |
| avg_latency_ns | 68509.500 |
| type | rfc2544_throughput |
| packet_size | 1518 |
| vswitch | OvsVanilla |
| traffic_type | udp |
| test_execution_time | 00:28:40 |
| start_time | 2018-09-21 20:07:52 |
| stop_time | 2018-09-21 20:36:32 |
| guest_loopback_app | testpmd |
4.2.8.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: ovs-vswitchd | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 29021 |
| %usr | 0.22 |
| %system | 1.16 |
| %guest | 0.00 |
| %CPU | 1.37 |
| CPU | |
| minflt/s | 0.20 |
| majflt/s | 0.00 |
| VSZ | 3364108 |
| RSS | 7714 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.01 |
| kB_ccwr/s | 0.00 |
| Process: ovsdb-server | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 29016 |
| %usr | 0.00 |
| %system | 0.00 |
| %guest | 0.00 |
| %CPU | 0.01 |
| CPU | |
| minflt/s | 0.00 |
| majflt/s | 0.00 |
| VSZ | 44316 |
| RSS | 5976 |
| %MEM | 0.01 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 29209 |
| %usr | 0.05 |
| %system | 1.14 |
| %guest | 100.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.03 |
| majflt/s | 0.00 |
| VSZ | 2942690 |
| RSS | 65964 |
| %MEM | 0.10 |
| kB_rd/s | 0.00 |
| kB_wr/s | 13.25 |
| kB_ccwr/s | 0.00 |
4.2.8.7. Anomalies¶
No anomalies were detected during the course of this test.
4.2.8.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
4.3. Rationale for decisions¶
The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.
4.4. Conclusions and recommendations¶
The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/fraser/2018-09-21_22-09-22/vswitchperf_logs_2018-09-21_22-09-22.tar.gz.
4.5. General¶
4.5.1. Glossary¶
- NFV - Network Function Virtualization
- Mbps - 1,000,000bps
4.5.2. Document change procedures and history¶
| Document ID | Author | Date Modified |
|---|---|---|
| OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT | Christopher Nolan | 23/01/2015 |
| OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT | Christopher Nolan | 28/01/2015 |
5. Performance report for VppDpdkVhost¶
5.1. Introduction¶
The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).
This document is currently in draft form.
5.1.1. Document identifier¶
The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.
5.1.2. Scope¶
The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.
5.1.3. References¶
5.2. Details of the Level Test Report¶
This section provides a test-results-overview. Also included are the rationale and the conclusions.
5.2.1. Test ID: PVP_TPUT_VPP¶
5.2.1.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
Below are test details:
- Test ID: pvp_tput_vpp
- Description: VPP: LTD.Throughput.RFC2544.PacketLossRatio
- Deployment: clean
- Traffic type: rfc2544_throughput
- Bidirectional : True
5.2.1.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
5.2.1.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 3980659.931 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 2038.098 |
| tx_rate_percent | 13.375 |
| throughput_rx_percent | 13.375 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 7660.000 |
| max_latency_ns | 44780.000 |
| avg_latency_ns | 12935.000 |
| type | rfc2544_throughput |
| packet_size | 64 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:23:42 |
| start_time | 2018-09-21 23:36:16 |
| stop_time | 2018-09-21 23:59:59 |
5.2.1.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 43194 |
| %usr | 100.00 |
| %system | 0.13 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.10 |
| majflt/s | 0.00 |
| VSZ | 9743020 |
| RSS | 50779 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.1.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
5.2.1.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 4349669.772 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 4454.062 |
| tx_rate_percent | 25.750 |
| throughput_rx_percent | 25.750 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 9580.000 |
| max_latency_ns | 47740.000 |
| avg_latency_ns | 15972.000 |
| type | rfc2544_throughput |
| packet_size | 128 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:23:42 |
| start_time | 2018-09-21 23:36:16 |
| stop_time | 2018-09-21 23:59:59 |
5.2.1.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 43194 |
| %usr | 100.00 |
| %system | 0.13 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.10 |
| majflt/s | 0.00 |
| VSZ | 9743020 |
| RSS | 50779 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.1.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
5.2.1.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 3645221.669 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 14930.828 |
| tx_rate_percent | 77.570 |
| throughput_rx_percent | 77.570 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 10600.000 |
| max_latency_ns | 61640.000 |
| avg_latency_ns | 25807.000 |
| type | rfc2544_throughput |
| packet_size | 512 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:23:42 |
| start_time | 2018-09-21 23:36:16 |
| stop_time | 2018-09-21 23:59:59 |
5.2.1.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 43194 |
| %usr | 100.00 |
| %system | 0.13 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.10 |
| majflt/s | 0.00 |
| VSZ | 9743020 |
| RSS | 50779 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.1.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
5.2.1.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 2394564.335 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19616.271 |
| tx_rate_percent | 100 |
| throughput_rx_percent | 100 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 11420.000 |
| max_latency_ns | 107300.000 |
| avg_latency_ns | 91460.500 |
| type | rfc2544_throughput |
| packet_size | 1024 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:23:42 |
| start_time | 2018-09-21 23:36:16 |
| stop_time | 2018-09-21 23:59:59 |
5.2.1.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 43194 |
| %usr | 100.00 |
| %system | 0.13 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.10 |
| majflt/s | 0.00 |
| VSZ | 9743020 |
| RSS | 50779 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.1.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
5.2.1.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 1625436.690 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19739.303 |
| tx_rate_percent | 100 |
| throughput_rx_percent | 100 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 11720.000 |
| max_latency_ns | 107600.000 |
| avg_latency_ns | 95561.500 |
| type | rfc2544_throughput |
| packet_size | 1518 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:23:42 |
| start_time | 2018-09-21 23:36:16 |
| stop_time | 2018-09-21 23:59:59 |
5.2.1.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 43194 |
| %usr | 100.00 |
| %system | 0.13 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.10 |
| majflt/s | 0.00 |
| VSZ | 9743020 |
| RSS | 50779 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.1.7. Anomalies¶
No anomalies were detected during the course of this test.
5.2.1.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
5.2.2. Test ID: PVP_BACK2BACK_VPP¶
5.2.2.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
Below are test details:
- Test ID: pvp_back2back_vpp
- Description: VPP: LTD.Throughput.RFC2544.BackToBackFrames
- Deployment: clean
- Traffic type: rfc2544_back2back
- Bidirectional : True
5.2.2.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
5.2.2.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 0 |
| b2b_frame_loss_percent | 100 |
| type | rfc2544_back2back |
| packet_size | 64 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:47:55 |
| start_time | 2018-09-21 23:59:59 |
| stop_time | 2018-09-22 00:47:55 |
5.2.2.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 44906 |
| %usr | 100.00 |
| %system | 0.13 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.06 |
| majflt/s | 0.00 |
| VSZ | 9982915 |
| RSS | 51446 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.2.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
5.2.2.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 966 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 128 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:47:55 |
| start_time | 2018-09-21 23:59:59 |
| stop_time | 2018-09-22 00:47:55 |
5.2.2.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 44906 |
| %usr | 100.00 |
| %system | 0.13 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.06 |
| majflt/s | 0.00 |
| VSZ | 9982915 |
| RSS | 51446 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.2.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
5.2.2.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 70488721 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 512 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:47:55 |
| start_time | 2018-09-21 23:59:59 |
| stop_time | 2018-09-22 00:47:55 |
5.2.2.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 44906 |
| %usr | 100.00 |
| %system | 0.13 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.06 |
| majflt/s | 0.00 |
| VSZ | 9982915 |
| RSS | 51446 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.2.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
5.2.2.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 35919540 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 1024 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:47:55 |
| start_time | 2018-09-21 23:59:59 |
| stop_time | 2018-09-22 00:47:55 |
5.2.2.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 44906 |
| %usr | 100.00 |
| %system | 0.13 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.06 |
| majflt/s | 0.00 |
| VSZ | 9982915 |
| RSS | 51446 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.2.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
5.2.2.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 24382314 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 1518 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:47:55 |
| start_time | 2018-09-21 23:59:59 |
| stop_time | 2018-09-22 00:47:55 |
5.2.2.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 44906 |
| %usr | 100.00 |
| %system | 0.13 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.06 |
| majflt/s | 0.00 |
| VSZ | 9982915 |
| RSS | 51446 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.2.7. Anomalies¶
No anomalies were detected during the course of this test.
5.2.2.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
5.2.3. Test ID: PHY2PHY_BACK2BACK_VPP¶
5.2.3.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
Below are test details:
- Test ID: phy2phy_back2back_vpp
- Description: VPP: LTD.Throughput.RFC2544.BackToBackFrames
- Deployment: clean
- Traffic type: rfc2544_back2back
- Bidirectional : True
5.2.3.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
5.2.3.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 20435 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 64 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:43:30 |
| start_time | 2018-09-21 22:52:45 |
| stop_time | 2018-09-21 23:36:15 |
5.2.3.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 40561 |
| %usr | 100.00 |
| %system | 0.40 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 3937580 |
| RSS | 50196 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.3.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
5.2.3.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 42528 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 128 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:43:30 |
| start_time | 2018-09-21 22:52:45 |
| stop_time | 2018-09-21 23:36:15 |
5.2.3.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 40561 |
| %usr | 100.00 |
| %system | 0.40 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 3937580 |
| RSS | 50196 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.3.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
5.2.3.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 4302 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 512 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:43:30 |
| start_time | 2018-09-21 22:52:45 |
| stop_time | 2018-09-21 23:36:15 |
5.2.3.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 40561 |
| %usr | 100.00 |
| %system | 0.40 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 3937580 |
| RSS | 50196 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.3.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
5.2.3.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 1644 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 1024 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:43:30 |
| start_time | 2018-09-21 22:52:45 |
| stop_time | 2018-09-21 23:36:15 |
5.2.3.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 40561 |
| %usr | 100.00 |
| %system | 0.40 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 3937580 |
| RSS | 50196 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.3.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
5.2.3.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| b2b_frames | 1116 |
| b2b_frame_loss_percent | 0.0 |
| type | rfc2544_back2back |
| packet_size | 1518 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:43:30 |
| start_time | 2018-09-21 22:52:45 |
| stop_time | 2018-09-21 23:36:15 |
5.2.3.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 40561 |
| %usr | 100.00 |
| %system | 0.40 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.02 |
| majflt/s | 0.00 |
| VSZ | 3937580 |
| RSS | 50196 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.3.7. Anomalies¶
No anomalies were detected during the course of this test.
5.2.3.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
5.2.4. Test ID: PVVP_TPUT_VPP¶
5.2.4.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
Below are test details:
- Test ID: pvvp_tput_vpp
- Description: VPP: LTD.Throughput.RFC2544.PacketLossRatio
- Deployment: clean
- Traffic type: rfc2544_throughput
- Bidirectional : True
5.2.4.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
5.2.4.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 3980658.193 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 2038.097 |
| tx_rate_percent | 13.375 |
| throughput_rx_percent | 13.375 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 10180.000 |
| max_latency_ns | 75560.000 |
| avg_latency_ns | 18128.500 |
| type | rfc2544_throughput |
| packet_size | 64 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:25:57 |
| start_time | 2018-09-22 00:47:55 |
| stop_time | 2018-09-22 01:13:53 |
5.2.4.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 47901 |
| %usr | 100.00 |
| %system | 0.13 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.13 |
| majflt/s | 0.00 |
| VSZ | 14986288 |
| RSS | 51158 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.4.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
5.2.4.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 4349663.291 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 4454.055 |
| tx_rate_percent | 25.750 |
| throughput_rx_percent | 25.750 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 13460.000 |
| max_latency_ns | 87100.000 |
| avg_latency_ns | 23672.000 |
| type | rfc2544_throughput |
| packet_size | 128 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:25:57 |
| start_time | 2018-09-22 00:47:55 |
| stop_time | 2018-09-22 01:13:53 |
5.2.4.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 47901 |
| %usr | 100.00 |
| %system | 0.13 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.13 |
| majflt/s | 0.00 |
| VSZ | 14986288 |
| RSS | 51158 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.4.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
5.2.4.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 3100034.923 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 12697.743 |
| tx_rate_percent | 65.969 |
| throughput_rx_percent | 65.969 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 14020.000 |
| max_latency_ns | 112980.000 |
| avg_latency_ns | 29699.000 |
| type | rfc2544_throughput |
| packet_size | 512 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:25:57 |
| start_time | 2018-09-22 00:47:55 |
| stop_time | 2018-09-22 01:13:53 |
5.2.4.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 47901 |
| %usr | 100.00 |
| %system | 0.13 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.13 |
| majflt/s | 0.00 |
| VSZ | 14986288 |
| RSS | 51158 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.4.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
5.2.4.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 2394455.206 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19615.377 |
| tx_rate_percent | 100 |
| throughput_rx_percent | 100 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 12260.000 |
| max_latency_ns | 245540.000 |
| avg_latency_ns | 228728.000 |
| type | rfc2544_throughput |
| packet_size | 1024 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:25:57 |
| start_time | 2018-09-22 00:47:55 |
| stop_time | 2018-09-22 01:13:53 |
5.2.4.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 47901 |
| %usr | 100.00 |
| %system | 0.13 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.13 |
| majflt/s | 0.00 |
| VSZ | 14986288 |
| RSS | 51158 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.4.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
5.2.4.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 1625420.117 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19739.102 |
| tx_rate_percent | 100 |
| throughput_rx_percent | 100 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 12320.000 |
| max_latency_ns | 148480.000 |
| avg_latency_ns | 128711.000 |
| type | rfc2544_throughput |
| packet_size | 1518 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:25:57 |
| start_time | 2018-09-22 00:47:55 |
| stop_time | 2018-09-22 01:13:53 |
5.2.4.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 47901 |
| %usr | 100.00 |
| %system | 0.13 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.13 |
| majflt/s | 0.00 |
| VSZ | 14986288 |
| RSS | 51158 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.4.7. Anomalies¶
No anomalies were detected during the course of this test.
5.2.4.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
5.2.5. Test ID: PHY2PHY_TPUT_VPP¶
5.2.5.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
Below are test details:
- Test ID: phy2phy_tput_vpp
- Description: VPP: LTD.Throughput.RFC2544.PacketLossRatio
- Deployment: clean
- Traffic type: rfc2544_throughput
- Bidirectional : True
5.2.5.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
5.2.5.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 22856311.739 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 11702.432 |
| tx_rate_percent | 76.797 |
| throughput_rx_percent | 76.797 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 5240.000 |
| max_latency_ns | 54040.000 |
| avg_latency_ns | 27140.000 |
| type | rfc2544_throughput |
| packet_size | 64 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:18:23 |
| start_time | 2018-09-21 22:34:21 |
| stop_time | 2018-09-21 22:52:45 |
5.2.5.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 39207 |
| %usr | 100.00 |
| %system | 0.12 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.06 |
| majflt/s | 0.00 |
| VSZ | 3937580 |
| RSS | 50821 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.5.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
5.2.5.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 16630607.064 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 17029.742 |
| tx_rate_percent | 98.453 |
| throughput_rx_percent | 98.453 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 5300.000 |
| max_latency_ns | 36380.000 |
| avg_latency_ns | 14354.500 |
| type | rfc2544_throughput |
| packet_size | 128 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:18:23 |
| start_time | 2018-09-21 22:34:21 |
| stop_time | 2018-09-21 22:52:45 |
5.2.5.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 39207 |
| %usr | 100.00 |
| %system | 0.12 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.06 |
| majflt/s | 0.00 |
| VSZ | 3937580 |
| RSS | 50821 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.5.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
5.2.5.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 4699202.111 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19247.932 |
| tx_rate_percent | 100 |
| throughput_rx_percent | 100 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 5560.000 |
| max_latency_ns | 35360.000 |
| avg_latency_ns | 23433.000 |
| type | rfc2544_throughput |
| packet_size | 512 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:18:23 |
| start_time | 2018-09-21 22:34:21 |
| stop_time | 2018-09-21 22:52:45 |
5.2.5.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 39207 |
| %usr | 100.00 |
| %system | 0.12 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.06 |
| majflt/s | 0.00 |
| VSZ | 3937580 |
| RSS | 50821 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.5.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
5.2.5.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 2394616.576 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19616.699 |
| tx_rate_percent | 100 |
| throughput_rx_percent | 100 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 5980.000 |
| max_latency_ns | 31720.000 |
| avg_latency_ns | 20142.500 |
| type | rfc2544_throughput |
| packet_size | 1024 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:18:23 |
| start_time | 2018-09-21 22:34:21 |
| stop_time | 2018-09-21 22:52:45 |
5.2.5.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 39207 |
| %usr | 100.00 |
| %system | 0.12 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.06 |
| majflt/s | 0.00 |
| VSZ | 3937580 |
| RSS | 50821 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.5.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
5.2.5.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 1625474.167 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 19739.758 |
| tx_rate_percent | 100 |
| throughput_rx_percent | 100 |
| frame_loss_percent | 0.000 |
| min_latency_ns | 6320.000 |
| max_latency_ns | 33120.000 |
| avg_latency_ns | 20926.500 |
| type | rfc2544_throughput |
| packet_size | 1518 |
| vswitch | VppDpdkVhost |
| traffic_type | udp |
| test_execution_time | 00:18:23 |
| start_time | 2018-09-21 22:34:21 |
| stop_time | 2018-09-21 22:52:45 |
5.2.5.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: vpp_main | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 39207 |
| %usr | 100.00 |
| %system | 0.12 |
| %guest | 0.00 |
| %CPU | 100.00 |
| CPU | |
| minflt/s | 0.06 |
| majflt/s | 0.00 |
| VSZ | 3937580 |
| RSS | 50821 |
| %MEM | 0.08 |
| kB_rd/s | 0.00 |
| kB_wr/s | 0.00 |
| kB_ccwr/s | 0.00 |
5.2.5.7. Anomalies¶
No anomalies were detected during the course of this test.
5.2.5.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
5.3. Rationale for decisions¶
The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.
5.4. Conclusions and recommendations¶
The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/fraser/2018-09-21_22-09-22/vswitchperf_logs_2018-09-21_22-09-22.tar.gz.
5.5. General¶
5.5.1. Glossary¶
- NFV - Network Function Virtualization
- Mbps - 1,000,000bps
5.5.2. Document change procedures and history¶
| Document ID | Author | Date Modified |
|---|---|---|
| OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT | Christopher Nolan | 23/01/2015 |
| OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT | Christopher Nolan | 28/01/2015 |
6. Performance report for none¶
6.1. Introduction¶
The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).
This document is currently in draft form.
6.1.1. Document identifier¶
The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.
6.1.2. Scope¶
The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.
6.1.3. References¶
6.2. Details of the Level Test Report¶
This section provides a test-results-overview. Also included are the rationale and the conclusions.
6.2.1. Test ID: PVP_TPUT¶
6.2.1.1. Test Environment¶
Below is the environment that the test was performed in:
OS: CentOS Linux 7 Core
Kernel Version: 4.4.116-1.el7.elrepo.x86_64
- NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 44
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 998842df061caf3f90adf756c78667262525a6e0
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: none, Version: None, GIT tag: None
VNF: QemuPciPassthrough, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
- VM images:
- /home/jenkins/vloop-vnf-ubuntu-16.04_trex_20180209.qcow2
- VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
Below are test details:
- Test ID: pvp_tput
- Description: LTD.Throughput.RFC2544.PacketLossRatio
- Deployment: pvp
- Traffic type: rfc2544_throughput
- Bidirectional : True
6.2.1.2. Test results for packet size: 64¶
A detailed summary of the main results is outlined below.
6.2.1.2.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 0 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 0 |
| tx_rate_percent | 1.773 |
| throughput_rx_percent | 0.000 |
| frame_loss_percent | 100.000 |
| min_latency_ns | 0 |
| max_latency_ns | 0 |
| avg_latency_ns | 0 |
| type | rfc2544_throughput |
| packet_size | 64 |
| vswitch | none |
| traffic_type | udp |
| test_execution_time | 00:28:39 |
| start_time | 2018-09-22 01:20:38 |
| stop_time | 2018-09-22 01:49:17 |
| guest_loopback_app | testpmd |
6.2.1.2.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 50926 |
| %usr | 0.05 |
| %system | 0.06 |
| %guest | 0.06 |
| %CPU | 0.17 |
| CPU | |
| minflt/s | 0.05 |
| majflt/s | 0.00 |
| VSZ | 2848360 |
| RSS | 76486 |
| %MEM | 0.12 |
| kB_rd/s | 0.00 |
| kB_wr/s | 13.20 |
| kB_ccwr/s | 0.00 |
6.2.1.3. Test results for packet size: 128¶
A detailed summary of the main results is outlined below.
6.2.1.3.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 0 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 0 |
| tx_rate_percent | 1.773 |
| throughput_rx_percent | 0.000 |
| frame_loss_percent | 100.000 |
| min_latency_ns | 0 |
| max_latency_ns | 0 |
| avg_latency_ns | 0 |
| type | rfc2544_throughput |
| packet_size | 128 |
| vswitch | none |
| traffic_type | udp |
| test_execution_time | 00:28:39 |
| start_time | 2018-09-22 01:20:38 |
| stop_time | 2018-09-22 01:49:17 |
| guest_loopback_app | testpmd |
6.2.1.3.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 50926 |
| %usr | 0.05 |
| %system | 0.06 |
| %guest | 0.06 |
| %CPU | 0.17 |
| CPU | |
| minflt/s | 0.05 |
| majflt/s | 0.00 |
| VSZ | 2848360 |
| RSS | 76486 |
| %MEM | 0.12 |
| kB_rd/s | 0.00 |
| kB_wr/s | 13.20 |
| kB_ccwr/s | 0.00 |
6.2.1.4. Test results for packet size: 512¶
A detailed summary of the main results is outlined below.
6.2.1.4.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 0 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 0 |
| tx_rate_percent | 1.773 |
| throughput_rx_percent | 0.000 |
| frame_loss_percent | 100.000 |
| min_latency_ns | 0 |
| max_latency_ns | 0 |
| avg_latency_ns | 0 |
| type | rfc2544_throughput |
| packet_size | 512 |
| vswitch | none |
| traffic_type | udp |
| test_execution_time | 00:28:39 |
| start_time | 2018-09-22 01:20:38 |
| stop_time | 2018-09-22 01:49:17 |
| guest_loopback_app | testpmd |
6.2.1.4.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 50926 |
| %usr | 0.05 |
| %system | 0.06 |
| %guest | 0.06 |
| %CPU | 0.17 |
| CPU | |
| minflt/s | 0.05 |
| majflt/s | 0.00 |
| VSZ | 2848360 |
| RSS | 76486 |
| %MEM | 0.12 |
| kB_rd/s | 0.00 |
| kB_wr/s | 13.20 |
| kB_ccwr/s | 0.00 |
6.2.1.5. Test results for packet size: 1024¶
A detailed summary of the main results is outlined below.
6.2.1.5.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 0 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 0 |
| tx_rate_percent | 1.773 |
| throughput_rx_percent | 0.000 |
| frame_loss_percent | 100.000 |
| min_latency_ns | 0 |
| max_latency_ns | 0 |
| avg_latency_ns | 0 |
| type | rfc2544_throughput |
| packet_size | 1024 |
| vswitch | none |
| traffic_type | udp |
| test_execution_time | 00:28:39 |
| start_time | 2018-09-22 01:20:38 |
| stop_time | 2018-09-22 01:49:17 |
| guest_loopback_app | testpmd |
6.2.1.5.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 50926 |
| %usr | 0.05 |
| %system | 0.06 |
| %guest | 0.06 |
| %CPU | 0.17 |
| CPU | |
| minflt/s | 0.05 |
| majflt/s | 0.00 |
| VSZ | 2848360 |
| RSS | 76486 |
| %MEM | 0.12 |
| kB_rd/s | 0.00 |
| kB_wr/s | 13.20 |
| kB_ccwr/s | 0.00 |
6.2.1.6. Test results for packet size: 1518¶
A detailed summary of the main results is outlined below.
6.2.1.6.1. Results/Metrics Collected¶
The following are the metrics obtained during this test:
| Metric | Result |
|---|---|
| tx_rate_fps | Unknown |
| throughput_rx_fps | 0 |
| tx_rate_mbps | Unknown |
| throughput_rx_mbps | 0 |
| tx_rate_percent | 1.773 |
| throughput_rx_percent | 0.000 |
| frame_loss_percent | 100.000 |
| min_latency_ns | 0 |
| max_latency_ns | 0 |
| avg_latency_ns | 0 |
| type | rfc2544_throughput |
| packet_size | 1518 |
| vswitch | none |
| traffic_type | udp |
| test_execution_time | 00:28:39 |
| start_time | 2018-09-22 01:20:38 |
| stop_time | 2018-09-22 01:49:17 |
| guest_loopback_app | testpmd |
6.2.1.6.2. Statistics collected¶
The following system statistics were collected during testcase execution:
| Process: qemu-system-x86 | |
|---|---|
| Statistic | Value |
| UID | 0 |
| PID | 50926 |
| %usr | 0.05 |
| %system | 0.06 |
| %guest | 0.06 |
| %CPU | 0.17 |
| CPU | |
| minflt/s | 0.05 |
| majflt/s | 0.00 |
| VSZ | 2848360 |
| RSS | 76486 |
| %MEM | 0.12 |
| kB_rd/s | 0.00 |
| kB_wr/s | 13.20 |
| kB_ccwr/s | 0.00 |
6.2.1.7. Anomalies¶
No anomalies were detected during the course of this test.
6.2.1.8. Testing Activities/Events¶
pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.
Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.
6.3. Rationale for decisions¶
The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.
6.4. Conclusions and recommendations¶
The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/fraser/2018-09-21_22-09-22/vswitchperf_logs_2018-09-21_22-09-22.tar.gz.
6.5. General¶
6.5.1. Glossary¶
- NFV - Network Function Virtualization
- Mbps - 1,000,000bps
6.5.2. Document change procedures and history¶
| Document ID | Author | Date Modified |
|---|---|---|
| OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT | Christopher Nolan | 23/01/2015 |
| OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT | Christopher Nolan | 28/01/2015 |
