VSPERF Results

1. VSPERF Test Scenarios

Predefined Tests suitable for automated execution with CI:

Test	Definition
phy2phy_tput	PacketLossRatio for Phy2Phy
back2back	BackToBackFrames for Phy2Phy
phy2phy_tput_mod_vlan	PacketLossRatioFrameModification for Phy2Phy
phy2phy_cont	Phy2Phy blast vswitch at x% TX rate and measure throughput
pvp_cont	PVP blast vswitch at x% TX rate and measure throughput
pvvp_cont	PVVP blast vswitch at x% TX rate and measure throughput
phy2phy_scalability	Scalability0PacketLoss for Phy2Phy
pvp_tput	PacketLossRatio for PVP
pvp_back2back	BackToBackFrames for PVP
pvvp_tput	PacketLossRatio for PVVP
pvvp_back2back	BackToBackFrames for PVVP
phy2phy_cpu_load	CPU0PacketLoss for Phy2Phy
phy2phy_mem_load	Same as CPU0PacketLoss but using a memory intensive app

Deployment topologies:

• Phy2Phy: Physical port -> vSwitch -> Physical port.
• PVP: Physical port -> vSwitch -> VNF -> vSwitch -> Physical port.
• PVVP: Physical port -> vSwitch -> VNF -> vSwitch -> VNF -> vSwitch -> Physical port.

Loopback applications in the Guest:

• DPDK testpmd.
• Linux Bridge.
• l2fwd-module

Supported traffic generators:

• Spirent Testcenter
• Ixia: IxOS and IxNet.
• Xena
• MoonGen
• Dummy
• T-Rex

2. OPNFV Test Results

VSPERF CI jobs are run daily and sample results can be found at https://wiki.opnfv.org/display/vsperf/Vsperf+Results

Testcase names shown in the dashboard are combination of orignal testcase name from VSPERF framework and indication of used vswitch.

Example:

Testcase phy2phy_tput is executed for three vSwitch types: OvsDpdkVhost, OvsVanilla and VppDpdkVhost. In this case, following testcase names will be used in the dashboard: phy2phy_tput_ovsdpdkvhost, phy2phy_tput_ovsvanilla and phy2phy_tput_vppdpdkvhost.

In case of RFC2544 Throughput test, the recorded metric is FPS (frames per second) without packet loss. For RFC2544 Back2Back test, the recorded metric is back-to-back value (number of frames) without packet loss.

The loopback application in the VNF used for PVP and PVVP scenarios was DPDK testpmd.

Guest interface types are vhost-user for OvsDpdkVhost and VppDpdkVhost and virtio-net for OvsVanilla.

3. Performance report for OvsDpdkVhost

3.1. Introduction

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

3.1.1. Document identifier

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

3.1.2. Scope

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

3.1.3. References

OPNFV_vswitchperf_LTD_Brahmaputra_REVIEWED

3.2. Details of the Level Test Report

This section provides a test-results-overview. Also included are the rationale and the conclusions.

3.2.1. Test ID: BACK2BACK

3.2.1.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: p2p

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

• DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

• Test ID: back2back
• Description: LTD.Throughput.RFC2544.BackToBackFrames
• Deployment: p2p
• Traffic type: rfc2544_back2back
• Bidirectional : True

3.2.1.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.1.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	21287
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:08:18
start_time	2018-05-09 21:06:00
stop_time	2018-05-09 22:14:19

3.2.1.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056808
RSS	42700
%MEM	0.06
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6744
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.1.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	253378378
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:08:18
start_time	2018-05-09 21:06:00
stop_time	2018-05-09 22:14:19

3.2.1.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056808
RSS	42700
%MEM	0.06
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6744
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.1.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488721
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:08:18
start_time	2018-05-09 21:06:00
stop_time	2018-05-09 22:14:19

3.2.1.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056808
RSS	42700
%MEM	0.06
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6744
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.1.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:08:18
start_time	2018-05-09 21:06:00
stop_time	2018-05-09 22:14:19

3.2.1.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056808
RSS	42700
%MEM	0.06
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6744
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.1.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:08:18
start_time	2018-05-09 21:06:00
stop_time	2018-05-09 22:14:19

3.2.1.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056808
RSS	42700
%MEM	0.06
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6744
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.7. Anomalies

No anomalies were detected during the course of this test.

3.2.1.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.2. Test ID: PHY2PHY_SCALABILITY

3.2.2.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: p2p

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

• DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

• Test ID: phy2phy_scalability
• Description: LTD.Scalability.Flows.RFC2544.0PacketLoss
• Deployment: p2p
• Traffic type: rfc2544_throughput
• Bidirectional : True

3.2.2.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.2.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	15720370.598
tx_rate_mbps	Unknown
throughput_rx_mbps	8048.830
tx_rate_percent	52.820
throughput_rx_percent	52.820
frame_loss_percent	0.000
min_latency_ns	5500.000
max_latency_ns	85260.000
avg_latency_ns	13544.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:02:57
start_time	2018-05-09 23:24:18
stop_time	2018-05-10 00:27:15
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.2.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.17
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056816
RSS	43003
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6760
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.2.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.2.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	15846776.196
tx_rate_mbps	Unknown
throughput_rx_mbps	16227.099
tx_rate_percent	93.813
throughput_rx_percent	93.813
frame_loss_percent	0.000
min_latency_ns	5400.000
max_latency_ns	87800.000
avg_latency_ns	17219.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:02:57
start_time	2018-05-09 23:24:18
stop_time	2018-05-10 00:27:15
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.2.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.17
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056816
RSS	43003
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6760
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.2.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.2.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699195.705
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.906
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	22900.000
max_latency_ns	58960.000
avg_latency_ns	46106.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:02:57
start_time	2018-05-09 23:24:18
stop_time	2018-05-10 00:27:15
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.2.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.17
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056816
RSS	43003
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6760
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.2.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.2.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394614.692
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.684
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	17540.000
max_latency_ns	47740.000
avg_latency_ns	33992.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:02:57
start_time	2018-05-09 23:24:18
stop_time	2018-05-10 00:27:15
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.2.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.17
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056816
RSS	43003
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6760
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.2.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.2.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625473.457
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.750
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	16620.000
max_latency_ns	46020.000
avg_latency_ns	32690.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:02:57
start_time	2018-05-09 23:24:18
stop_time	2018-05-10 00:27:15
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.2.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.17
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056816
RSS	43003
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6760
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.2.7. Anomalies

No anomalies were detected during the course of this test.

3.2.2.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.3. Test ID: PVVP_TPUT

3.2.3.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: pvvp

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

• DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

• VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

• VM images:

  • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2

• VM loopback apps:

  • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
  • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

• Test ID: pvvp_tput
• Description: LTD.Throughput.RFC2544.PacketLossRatio
• Deployment: pvvp
• Traffic type: rfc2544_throughput
• Bidirectional : True

3.2.3.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.3.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4441036.018
tx_rate_mbps	Unknown
throughput_rx_mbps	2273.810
tx_rate_percent	14.922
throughput_rx_percent	14.922
frame_loss_percent	0.000
min_latency_ns	12000.000
max_latency_ns	97300.000
avg_latency_ns	19528.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:47
start_time	2018-05-10 02:46:04
stop_time	2018-05-10 03:57:51
guest_loopback_app	testpmd testpmd

3.2.3.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	600.15
%system	0.02
%guest	0.00
%CPU	600.19
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	17713456
RSS	43112
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6824
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.08
%system	0.09
%guest	200.05
%CPU	200.22
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2774176
RSS	67252
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.46
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.12
%system	0.17
%guest	200.06
%CPU	200.35
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2850220
RSS	67216
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.3.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	5133551.959
tx_rate_mbps	Unknown
throughput_rx_mbps	5256.757
tx_rate_percent	30.391
throughput_rx_percent	30.391
frame_loss_percent	0.000
min_latency_ns	12280.000
max_latency_ns	78220.000
avg_latency_ns	21171.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:47
start_time	2018-05-10 02:46:04
stop_time	2018-05-10 03:57:51
guest_loopback_app	testpmd testpmd

3.2.3.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	600.15
%system	0.02
%guest	0.00
%CPU	600.19
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	17713456
RSS	43112
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6824
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.08
%system	0.09
%guest	200.05
%CPU	200.22
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2774176
RSS	67252
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.46
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.12
%system	0.17
%guest	200.06
%CPU	200.35
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2850220
RSS	67216
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.3.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699137.703
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.668
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	40520.000
max_latency_ns	123860.000
avg_latency_ns	109200.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:47
start_time	2018-05-10 02:46:04
stop_time	2018-05-10 03:57:51
guest_loopback_app	testpmd testpmd

3.2.3.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	600.15
%system	0.02
%guest	0.00
%CPU	600.19
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	17713456
RSS	43112
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6824
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.08
%system	0.09
%guest	200.05
%CPU	200.22
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2774176
RSS	67252
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.46
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.12
%system	0.17
%guest	200.06
%CPU	200.35
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2850220
RSS	67216
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.3.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394590.930
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.489
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	39300.000
max_latency_ns	99180.000
avg_latency_ns	83246.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:47
start_time	2018-05-10 02:46:04
stop_time	2018-05-10 03:57:51
guest_loopback_app	testpmd testpmd

3.2.3.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	600.15
%system	0.02
%guest	0.00
%CPU	600.19
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	17713456
RSS	43112
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6824
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.08
%system	0.09
%guest	200.05
%CPU	200.22
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2774176
RSS	67252
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.46
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.12
%system	0.17
%guest	200.06
%CPU	200.35
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2850220
RSS	67216
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.3.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625452.099
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.490
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	57940.000
max_latency_ns	126780.000
avg_latency_ns	113536.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:47
start_time	2018-05-10 02:46:04
stop_time	2018-05-10 03:57:51
guest_loopback_app	testpmd testpmd

3.2.3.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	600.15
%system	0.02
%guest	0.00
%CPU	600.19
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	17713456
RSS	43112
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6824
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.08
%system	0.09
%guest	200.05
%CPU	200.22
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2774176
RSS	67252
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.46
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.12
%system	0.17
%guest	200.06
%CPU	200.35
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2850220
RSS	67216
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.7. Anomalies

No anomalies were detected during the course of this test.

3.2.3.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.4. Test ID: PHY2PHY_TPUT_MOD_VLAN

3.2.4.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: p2p

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

• DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

• Test ID: phy2phy_tput_mod_vlan
• Description: LTD.Throughput.RFC2544.PacketLossRatioFrameModification
• Deployment: p2p
• Traffic type: rfc2544_throughput
• Bidirectional : True

3.2.4.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.4.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	14569458.559
tx_rate_mbps	Unknown
throughput_rx_mbps	7925.785
tx_rate_percent	48.953
throughput_rx_percent	51.284
frame_loss_percent	0.000
min_latency_ns	5440.000
max_latency_ns	65940.000
avg_latency_ns	12140.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:57
start_time	2018-05-09 22:14:19
stop_time	2018-05-09 23:24:17

3.2.4.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056816
RSS	43216
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6844
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.4.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.4.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	14670903.205
tx_rate_mbps	Unknown
throughput_rx_mbps	15492.474
tx_rate_percent	86.852
throughput_rx_percent	89.199
frame_loss_percent	0.000
min_latency_ns	5580.000
max_latency_ns	46160.000
avg_latency_ns	15418.000
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:57
start_time	2018-05-09 22:14:19
stop_time	2018-05-09 23:24:17

3.2.4.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056816
RSS	43216
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6844
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.4.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.4.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4662904.144
tx_rate_mbps	Unknown
throughput_rx_mbps	19248.468
tx_rate_percent	99.227
throughput_rx_percent	99.973
frame_loss_percent	0.000
min_latency_ns	6180.000
max_latency_ns	26460.000
avg_latency_ns	11117.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:57
start_time	2018-05-09 22:14:19
stop_time	2018-05-09 23:24:17

3.2.4.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056816
RSS	43216
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6844
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.4.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.4.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2376116.820
tx_rate_mbps	Unknown
throughput_rx_mbps	19541.185
tx_rate_percent	99.227
throughput_rx_percent	99.607
frame_loss_percent	0.000
min_latency_ns	6760.000
max_latency_ns	24960.000
avg_latency_ns	9502.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:57
start_time	2018-05-09 22:14:19
stop_time	2018-05-09 23:24:17

3.2.4.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056816
RSS	43216
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6844
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.4.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.4.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1612916.376
tx_rate_mbps	Unknown
throughput_rx_mbps	19638.870
tx_rate_percent	99.227
throughput_rx_percent	99.485
frame_loss_percent	0.000
min_latency_ns	7120.000
max_latency_ns	24380.000
avg_latency_ns	9627.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:57
start_time	2018-05-09 22:14:19
stop_time	2018-05-09 23:24:17

3.2.4.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056816
RSS	43216
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6844
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.4.7. Anomalies

No anomalies were detected during the course of this test.

3.2.4.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.5. Test ID: PVVP_BACK2BACK

3.2.5.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: pvvp

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

• DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

• VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

• VM images:

  • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2

• VM loopback apps:

  • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
  • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

• Test ID: pvvp_back2back
• Description: LTD.Throughput.RFC2544.BackToBackFrames
• Deployment: pvvp
• Traffic type: rfc2544_back2back
• Bidirectional : True

3.2.5.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.5.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	851
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:16
start_time	2018-05-10 03:57:52
stop_time	2018-05-10 05:07:09
guest_loopback_app	testpmd testpmd

3.2.5.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	600.15
%system	0.02
%guest	0.00
%CPU	600.18
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	17713456
RSS	43164
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6736
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.09
%system	0.14
%guest	200.06
%CPU	200.30
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2775204
RSS	67148
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.38
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.06
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2775204
RSS	60464
%MEM	0.09
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.5.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.5.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	483
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:16
start_time	2018-05-10 03:57:52
stop_time	2018-05-10 05:07:09
guest_loopback_app	testpmd testpmd

3.2.5.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	600.15
%system	0.02
%guest	0.00
%CPU	600.18
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	17713456
RSS	43164
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6736
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.09
%system	0.14
%guest	200.06
%CPU	200.30
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2775204
RSS	67148
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.38
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.06
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2775204
RSS	60464
%MEM	0.09
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.5.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.5.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488721
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:16
start_time	2018-05-10 03:57:52
stop_time	2018-05-10 05:07:09
guest_loopback_app	testpmd testpmd

3.2.5.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	600.15
%system	0.02
%guest	0.00
%CPU	600.18
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	17713456
RSS	43164
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6736
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.09
%system	0.14
%guest	200.06
%CPU	200.30
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2775204
RSS	67148
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.38
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.06
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2775204
RSS	60464
%MEM	0.09
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.5.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.5.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:16
start_time	2018-05-10 03:57:52
stop_time	2018-05-10 05:07:09
guest_loopback_app	testpmd testpmd

3.2.5.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	600.15
%system	0.02
%guest	0.00
%CPU	600.18
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	17713456
RSS	43164
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6736
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.09
%system	0.14
%guest	200.06
%CPU	200.30
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2775204
RSS	67148
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.38
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.06
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2775204
RSS	60464
%MEM	0.09
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.5.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.5.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:16
start_time	2018-05-10 03:57:52
stop_time	2018-05-10 05:07:09
guest_loopback_app	testpmd testpmd

3.2.5.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	600.15
%system	0.02
%guest	0.00
%CPU	600.18
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	17713456
RSS	43164
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6736
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.09
%system	0.14
%guest	200.06
%CPU	200.30
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2775204
RSS	67148
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.38
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.06
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2775204
RSS	60464
%MEM	0.09
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.5.7. Anomalies

No anomalies were detected during the course of this test.

3.2.5.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.6. Test ID: PVP_BACK2BACK

3.2.6.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: pvp

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

• DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

• VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

• VM images:

  • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2

• VM loopback apps:

  • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

• Test ID: pvp_back2back
• Description: LTD.Throughput.RFC2544.BackToBackFrames
• Deployment: pvp
• Traffic type: rfc2544_back2back
• Bidirectional : True

3.2.6.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.6.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	3405
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:39
start_time	2018-05-10 01:34:24
stop_time	2018-05-10 02:46:03
guest_loopback_app	testpmd

3.2.6.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	400.15
%system	0.02
%guest	0.00
%CPU	400.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	11422004
RSS	43320
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6648
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.06
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2779288
RSS	65548
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.54
kB_ccwr/s	0.00

3.2.6.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.6.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	1449
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:39
start_time	2018-05-10 01:34:24
stop_time	2018-05-10 02:46:03
guest_loopback_app	testpmd

3.2.6.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	400.15
%system	0.02
%guest	0.00
%CPU	400.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	11422004
RSS	43320
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6648
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.06
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2779288
RSS	65548
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.54
kB_ccwr/s	0.00

3.2.6.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.6.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488721
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:39
start_time	2018-05-10 01:34:24
stop_time	2018-05-10 02:46:03
guest_loopback_app	testpmd

3.2.6.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	400.15
%system	0.02
%guest	0.00
%CPU	400.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	11422004
RSS	43320
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6648
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.06
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2779288
RSS	65548
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.54
kB_ccwr/s	0.00

3.2.6.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.6.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:39
start_time	2018-05-10 01:34:24
stop_time	2018-05-10 02:46:03
guest_loopback_app	testpmd

3.2.6.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	400.15
%system	0.02
%guest	0.00
%CPU	400.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	11422004
RSS	43320
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6648
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.06
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2779288
RSS	65548
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.54
kB_ccwr/s	0.00

3.2.6.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.6.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:39
start_time	2018-05-10 01:34:24
stop_time	2018-05-10 02:46:03
guest_loopback_app	testpmd

3.2.6.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	400.15
%system	0.02
%guest	0.00
%CPU	400.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	11422004
RSS	43320
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6648
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.06
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2779288
RSS	65548
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.54
kB_ccwr/s	0.00

3.2.6.7. Anomalies

No anomalies were detected during the course of this test.

3.2.6.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.7. Test ID: PHY2PHY_TPUT

3.2.7.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: p2p

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

• DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

• Test ID: phy2phy_tput
• Description: LTD.Throughput.RFC2544.PacketLossRatio
• Deployment: p2p
• Traffic type: rfc2544_throughput
• Bidirectional : True

3.2.7.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.7.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	19633554.948
tx_rate_mbps	Unknown
throughput_rx_mbps	10052.380
tx_rate_percent	65.969
throughput_rx_percent	65.969
frame_loss_percent	0.000
min_latency_ns	5360.000
max_latency_ns	59880.000
avg_latency_ns	11385.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:54:04
start_time	2018-05-09 20:11:55
stop_time	2018-05-09 21:05:59

3.2.7.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.17
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056816
RSS	43143
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6724
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.7.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.7.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	16891642.519
tx_rate_mbps	Unknown
throughput_rx_mbps	17297.042
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	15540.000
max_latency_ns	66060.000
avg_latency_ns	49807.000
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:54:04
start_time	2018-05-09 20:11:55
stop_time	2018-05-09 21:05:59

3.2.7.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.17
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056816
RSS	43143
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6724
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.7.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.7.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699201.203
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.928
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	17160.000
max_latency_ns	47780.000
avg_latency_ns	36709.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:54:04
start_time	2018-05-09 20:11:55
stop_time	2018-05-09 21:05:59

3.2.7.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.17
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056816
RSS	43143
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6724
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.7.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.7.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394609.575
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.642
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	26420.000
max_latency_ns	60340.000
avg_latency_ns	49188.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:54:04
start_time	2018-05-09 20:11:55
stop_time	2018-05-09 21:05:59

3.2.7.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.17
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056816
RSS	43143
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6724
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.7.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.7.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625474.004
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.756
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	17160.000
max_latency_ns	43300.000
avg_latency_ns	32113.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:54:04
start_time	2018-05-09 20:11:55
stop_time	2018-05-09 21:05:59

3.2.7.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	200.15
%system	0.02
%guest	0.00
%CPU	200.17
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	5056816
RSS	43143
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6724
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.7.7. Anomalies

No anomalies were detected during the course of this test.

3.2.7.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.8. Test ID: PVP_TPUT

3.2.8.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: pvp

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

• DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

• VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

• VM images:

  • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2

• VM loopback apps:

  • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

• Test ID: pvp_tput
• Description: LTD.Throughput.RFC2544.PacketLossRatio
• Deployment: pvp
• Traffic type: rfc2544_throughput
• Bidirectional : True

3.2.8.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.8.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	5361795.372
tx_rate_mbps	Unknown
throughput_rx_mbps	2745.239
tx_rate_percent	18.016
throughput_rx_percent	18.016
frame_loss_percent	0.000
min_latency_ns	7800.000
max_latency_ns	63440.000
avg_latency_ns	10682.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:07:08
start_time	2018-05-10 00:27:15
stop_time	2018-05-10 01:34:23
guest_loopback_app	testpmd

3.2.8.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	400.15
%system	0.02
%guest	0.00
%CPU	400.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	11421996
RSS	43248
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6784
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.07
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2791471
RSS	68356
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.75
kB_ccwr/s	0.00

3.2.8.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.8.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	5264207.324
tx_rate_mbps	Unknown
throughput_rx_mbps	5390.548
tx_rate_percent	31.164
throughput_rx_percent	31.164
frame_loss_percent	0.000
min_latency_ns	8360.000
max_latency_ns	62980.000
avg_latency_ns	11273.000
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:07:08
start_time	2018-05-10 00:27:15
stop_time	2018-05-10 01:34:23
guest_loopback_app	testpmd

3.2.8.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	400.15
%system	0.02
%guest	0.00
%CPU	400.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	11421996
RSS	43248
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6784
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.07
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2791471
RSS	68356
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.75
kB_ccwr/s	0.00

3.2.8.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.8.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699182.704
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.852
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	30720.000
max_latency_ns	74400.000
avg_latency_ns	62617.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:07:08
start_time	2018-05-10 00:27:15
stop_time	2018-05-10 01:34:23
guest_loopback_app	testpmd

3.2.8.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	400.15
%system	0.02
%guest	0.00
%CPU	400.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	11421996
RSS	43248
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6784
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.07
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2791471
RSS	68356
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.75
kB_ccwr/s	0.00

3.2.8.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.8.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394599.295
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.557
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	29080.000
max_latency_ns	75380.000
avg_latency_ns	62520.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:07:08
start_time	2018-05-10 00:27:15
stop_time	2018-05-10 01:34:23
guest_loopback_app	testpmd

3.2.8.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	400.15
%system	0.02
%guest	0.00
%CPU	400.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	11421996
RSS	43248
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6784
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.07
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2791471
RSS	68356
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.75
kB_ccwr/s	0.00

3.2.8.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.8.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625462.333
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.615
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	29900.000
max_latency_ns	81660.000
avg_latency_ns	66012.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:07:08
start_time	2018-05-10 00:27:15
stop_time	2018-05-10 01:34:23
guest_loopback_app	testpmd

3.2.8.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	400.15
%system	0.02
%guest	0.00
%CPU	400.18
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	11421996
RSS	43248
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50700
RSS	6784
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.07
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2791471
RSS	68356
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.75
kB_ccwr/s	0.00

3.2.8.7. Anomalies

No anomalies were detected during the course of this test.

3.2.8.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.3. Rationale for decisions

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

3.4. Conclusions and recommendations

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-05-10_03-11-47/vswitchperf_logs_2018-05-10_03-11-47.tar.gz.

3.5. General

3.5.1. Glossary

• NFV - Network Function Virtualization
• Mbps - 1,000,000bps

3.5.2. Document change procedures and history

Document ID	Author	Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT	Christopher Nolan	23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT	Christopher Nolan	28/01/2015

4. Performance report for OvsVanilla

4.1. Introduction

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

4.1.1. Document identifier

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

4.1.2. Scope

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

4.1.3. References

OPNFV_vswitchperf_LTD_Brahmaputra_REVIEWED

4.2. Details of the Level Test Report

This section provides a test-results-overview. Also included are the rationale and the conclusions.

4.2.1. Test ID: BACK2BACK

4.2.1.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: p2p

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

• Test ID: back2back
• Description: LTD.Throughput.RFC2544.BackToBackFrames
• Deployment: p2p
• Traffic type: rfc2544_back2back
• Bidirectional : True

4.2.1.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.1.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	5108
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:14:48
start_time	2018-05-10 06:20:40
stop_time	2018-05-10 07:35:28

4.2.1.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.52
%system	1.08
%guest	0.00
%CPU	1.59
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	3364104
RSS	7789
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44316
RSS	5896
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.1.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	3382
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:14:48
start_time	2018-05-10 06:20:40
stop_time	2018-05-10 07:35:28

4.2.1.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.52
%system	1.08
%guest	0.00
%CPU	1.59
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	3364104
RSS	7789
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44316
RSS	5896
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.1.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	1613
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:14:48
start_time	2018-05-10 06:20:40
stop_time	2018-05-10 07:35:28

4.2.1.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.52
%system	1.08
%guest	0.00
%CPU	1.59
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	3364104
RSS	7789
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44316
RSS	5896
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.1.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	1370
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:14:48
start_time	2018-05-10 06:20:40
stop_time	2018-05-10 07:35:28

4.2.1.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.52
%system	1.08
%guest	0.00
%CPU	1.59
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	3364104
RSS	7789
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44316
RSS	5896
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.1.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	1488
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:14:48
start_time	2018-05-10 06:20:40
stop_time	2018-05-10 07:35:28

4.2.1.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.52
%system	1.08
%guest	0.00
%CPU	1.59
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	3364104
RSS	7789
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44316
RSS	5896
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.7. Anomalies

No anomalies were detected during the course of this test.

4.2.1.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.2. Test ID: PHY2PHY_SCALABILITY

4.2.2.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: p2p

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

• Test ID: phy2phy_scalability
• Description: LTD.Scalability.Flows.RFC2544.0PacketLoss
• Deployment: p2p
• Traffic type: rfc2544_throughput
• Bidirectional : True

4.2.2.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.2.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	988189.673
tx_rate_mbps	Unknown
throughput_rx_mbps	505.953
tx_rate_percent	3.320
throughput_rx_percent	3.320
frame_loss_percent	0.000
min_latency_ns	4020.000
max_latency_ns	1179100.000
avg_latency_ns	31522.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:45
start_time	2018-05-10 08:44:56
stop_time	2018-05-10 09:56:41
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.2.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.53
%system	1.11
%guest	0.00
%CPU	1.66
CPU
minflt/s	0.52
majflt/s	0.00
VSZ	3364108
RSS	7683
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5980
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.2.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.2.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	952807.962
tx_rate_mbps	Unknown
throughput_rx_mbps	975.675
tx_rate_percent	5.641
throughput_rx_percent	5.641
frame_loss_percent	0.000
min_latency_ns	4160.000
max_latency_ns	359880.000
avg_latency_ns	28132.000
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:45
start_time	2018-05-10 08:44:56
stop_time	2018-05-10 09:56:41
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.2.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.53
%system	1.11
%guest	0.00
%CPU	1.66
CPU
minflt/s	0.52
majflt/s	0.00
VSZ	3364108
RSS	7683
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5980
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.2.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.2.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	846600.119
tx_rate_mbps	Unknown
throughput_rx_mbps	3467.674
tx_rate_percent	18.016
throughput_rx_percent	18.016
frame_loss_percent	0.000
min_latency_ns	5260.000
max_latency_ns	527640.000
avg_latency_ns	30319.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:45
start_time	2018-05-10 08:44:56
stop_time	2018-05-10 09:56:41
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.2.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.53
%system	1.11
%guest	0.00
%CPU	1.66
CPU
minflt/s	0.52
majflt/s	0.00
VSZ	3364108
RSS	7683
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5980
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.2.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.2.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	875912.740
tx_rate_mbps	Unknown
throughput_rx_mbps	7175.477
tx_rate_percent	36.578
throughput_rx_percent	36.578
frame_loss_percent	0.000
min_latency_ns	5780.000
max_latency_ns	641120.000
avg_latency_ns	72607.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:45
start_time	2018-05-10 08:44:56
stop_time	2018-05-10 09:56:41
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.2.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.53
%system	1.11
%guest	0.00
%CPU	1.66
CPU
minflt/s	0.52
majflt/s	0.00
VSZ	3364108
RSS	7683
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5980
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.2.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.2.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	871160.795
tx_rate_mbps	Unknown
throughput_rx_mbps	10579.377
tx_rate_percent	53.594
throughput_rx_percent	53.594
frame_loss_percent	0.000
min_latency_ns	8760.000
max_latency_ns	488940.000
avg_latency_ns	54805.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:45
start_time	2018-05-10 08:44:56
stop_time	2018-05-10 09:56:41
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.2.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.53
%system	1.11
%guest	0.00
%CPU	1.66
CPU
minflt/s	0.52
majflt/s	0.00
VSZ	3364108
RSS	7683
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5980
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.2.7. Anomalies

No anomalies were detected during the course of this test.

4.2.2.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.3. Test ID: PVVP_TPUT

4.2.3.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: pvvp

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

• VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

• VM images:

  • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2

• VM loopback apps:

  • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
  • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

• Test ID: pvvp_tput
• Description: LTD.Throughput.RFC2544.PacketLossRatio
• Deployment: pvvp
• Traffic type: rfc2544_throughput
• Bidirectional : True

4.2.3.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.3.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	257857.418
tx_rate_mbps	Unknown
throughput_rx_mbps	132.023
tx_rate_percent	1.773
throughput_rx_percent	0.866
frame_loss_percent	51.143
min_latency_ns	31440.000
max_latency_ns	64889220.000
avg_latency_ns	4552005.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:31
start_time	2018-05-10 12:26:02
stop_time	2018-05-10 13:37:34
guest_loopback_app	testpmd testpmd

4.2.3.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.05
%guest	0.00
%CPU	1.55
CPU
minflt/s	0.10
majflt/s	0.00
VSZ	3364236
RSS	8083
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5896
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.01
%system	0.68
%guest	199.35
%CPU	200.04
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2780484
RSS	66880
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.72
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.06
%system	0.68
%guest	199.41
%CPU	200.15
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2813380
RSS	67340
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.3.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.3.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	299568.551
tx_rate_mbps	Unknown
throughput_rx_mbps	306.758
tx_rate_percent	1.773
throughput_rx_percent	1.773
frame_loss_percent	0.000
min_latency_ns	21340.000
max_latency_ns	686660.000
avg_latency_ns	71735.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:31
start_time	2018-05-10 12:26:02
stop_time	2018-05-10 13:37:34
guest_loopback_app	testpmd testpmd

4.2.3.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.05
%guest	0.00
%CPU	1.55
CPU
minflt/s	0.10
majflt/s	0.00
VSZ	3364236
RSS	8083
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5896
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.01
%system	0.68
%guest	199.35
%CPU	200.04
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2780484
RSS	66880
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.72
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.06
%system	0.68
%guest	199.41
%CPU	200.15
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2813380
RSS	67340
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.3.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.3.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	265067.788
tx_rate_mbps	Unknown
throughput_rx_mbps	1085.718
tx_rate_percent	5.641
throughput_rx_percent	5.641
frame_loss_percent	0.000
min_latency_ns	29180.000
max_latency_ns	865840.000
avg_latency_ns	92070.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:31
start_time	2018-05-10 12:26:02
stop_time	2018-05-10 13:37:34
guest_loopback_app	testpmd testpmd

4.2.3.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.05
%guest	0.00
%CPU	1.55
CPU
minflt/s	0.10
majflt/s	0.00
VSZ	3364236
RSS	8083
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5896
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.01
%system	0.68
%guest	199.35
%CPU	200.04
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2780484
RSS	66880
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.72
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.06
%system	0.68
%guest	199.41
%CPU	200.15
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2813380
RSS	67340
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.3.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.3.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	320302.315
tx_rate_mbps	Unknown
throughput_rx_mbps	2623.917
tx_rate_percent	13.375
throughput_rx_percent	13.375
frame_loss_percent	0.000
min_latency_ns	33380.000
max_latency_ns	1488460.000
avg_latency_ns	118932.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:31
start_time	2018-05-10 12:26:02
stop_time	2018-05-10 13:37:34
guest_loopback_app	testpmd testpmd

4.2.3.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.05
%guest	0.00
%CPU	1.55
CPU
minflt/s	0.10
majflt/s	0.00
VSZ	3364236
RSS	8083
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5896
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.01
%system	0.68
%guest	199.35
%CPU	200.04
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2780484
RSS	66880
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.72
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.06
%system	0.68
%guest	199.41
%CPU	200.15
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2813380
RSS	67340
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.3.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.3.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	280271.177
tx_rate_mbps	Unknown
throughput_rx_mbps	3403.613
tx_rate_percent	17.242
throughput_rx_percent	17.242
frame_loss_percent	0.000
min_latency_ns	34720.000
max_latency_ns	1120180.000
avg_latency_ns	95861.000
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:31
start_time	2018-05-10 12:26:02
stop_time	2018-05-10 13:37:34
guest_loopback_app	testpmd testpmd

4.2.3.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.05
%guest	0.00
%CPU	1.55
CPU
minflt/s	0.10
majflt/s	0.00
VSZ	3364236
RSS	8083
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5896
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.01
%system	0.68
%guest	199.35
%CPU	200.04
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2780484
RSS	66880
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.72
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.06
%system	0.68
%guest	199.41
%CPU	200.15
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2813380
RSS	67340
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.3.7. Anomalies

No anomalies were detected during the course of this test.

4.2.3.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.4. Test ID: PHY2PHY_TPUT_MOD_VLAN

4.2.4.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: p2p

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

• Test ID: phy2phy_tput_mod_vlan
• Description: LTD.Throughput.RFC2544.PacketLossRatioFrameModification
• Deployment: p2p
• Traffic type: rfc2544_throughput
• Bidirectional : True

4.2.4.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.4.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	757999.353
tx_rate_mbps	Unknown
throughput_rx_mbps	412.352
tx_rate_percent	2.547
throughput_rx_percent	2.668
frame_loss_percent	0.000
min_latency_ns	4040.000
max_latency_ns	196140.000
avg_latency_ns	29627.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:09:27
start_time	2018-05-10 07:35:28
stop_time	2018-05-10 08:44:56

4.2.4.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.07
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	3364104
RSS	7792
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44313
RSS	5903
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.4.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.4.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	952808.053
tx_rate_mbps	Unknown
throughput_rx_mbps	1006.165
tx_rate_percent	5.641
throughput_rx_percent	5.793
frame_loss_percent	0.000
min_latency_ns	4180.000
max_latency_ns	429360.000
avg_latency_ns	28242.000
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:09:27
start_time	2018-05-10 07:35:28
stop_time	2018-05-10 08:44:56

4.2.4.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.07
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	3364104
RSS	7792
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44313
RSS	5903
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.4.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.4.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	846598.720
tx_rate_mbps	Unknown
throughput_rx_mbps	3494.760
tx_rate_percent	18.016
throughput_rx_percent	18.151
frame_loss_percent	0.000
min_latency_ns	5280.000
max_latency_ns	477840.000
avg_latency_ns	29908.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:09:27
start_time	2018-05-10 07:35:28
stop_time	2018-05-10 08:44:56

4.2.4.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.07
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	3364104
RSS	7792
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44313
RSS	5903
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.4.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.4.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	857393.000
tx_rate_mbps	Unknown
throughput_rx_mbps	7051.200
tx_rate_percent	35.805
throughput_rx_percent	35.942
frame_loss_percent	0.000
min_latency_ns	5780.000
max_latency_ns	694020.000
avg_latency_ns	38794.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:09:27
start_time	2018-05-10 07:35:28
stop_time	2018-05-10 08:44:56

4.2.4.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.07
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	3364104
RSS	7792
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44313
RSS	5903
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.4.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.4.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	871157.264
tx_rate_mbps	Unknown
throughput_rx_mbps	10607.211
tx_rate_percent	53.594
throughput_rx_percent	53.733
frame_loss_percent	0.000
min_latency_ns	7780.000
max_latency_ns	796940.000
avg_latency_ns	70326.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:09:27
start_time	2018-05-10 07:35:28
stop_time	2018-05-10 08:44:56

4.2.4.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.07
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	3364104
RSS	7792
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44313
RSS	5903
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.4.7. Anomalies

No anomalies were detected during the course of this test.

4.2.4.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.5. Test ID: PVVP_BACK2BACK

4.2.5.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: pvvp

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

• VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

• VM images:

  • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2

• VM loopback apps:

  • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
  • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

• Test ID: pvvp_back2back
• Description: LTD.Throughput.RFC2544.BackToBackFrames
• Deployment: pvvp
• Traffic type: rfc2544_back2back
• Bidirectional : True

4.2.5.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.5.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	851
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:18:11
start_time	2018-05-10 13:37:35
stop_time	2018-05-10 14:55:46
guest_loopback_app	testpmd testpmd

4.2.5.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.04
%guest	0.00
%CPU	1.56
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	3364240
RSS	7981
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5940
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.07
%system	0.14
%guest	199.99
%CPU	200.20
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2869806
RSS	67232
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.25
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.01
%system	0.08
%guest	199.95
%CPU	200.05
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2793848
RSS	65180
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.5.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.5.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	966
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:18:11
start_time	2018-05-10 13:37:35
stop_time	2018-05-10 14:55:46
guest_loopback_app	testpmd testpmd

4.2.5.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.04
%guest	0.00
%CPU	1.56
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	3364240
RSS	7981
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5940
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.07
%system	0.14
%guest	199.99
%CPU	200.20
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2869806
RSS	67232
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.25
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.01
%system	0.08
%guest	199.95
%CPU	200.05
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2793848
RSS	65180
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.5.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.5.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	806
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:18:11
start_time	2018-05-10 13:37:35
stop_time	2018-05-10 14:55:46
guest_loopback_app	testpmd testpmd

4.2.5.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.04
%guest	0.00
%CPU	1.56
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	3364240
RSS	7981
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5940
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.07
%system	0.14
%guest	199.99
%CPU	200.20
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2869806
RSS	67232
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.25
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.01
%system	0.08
%guest	199.95
%CPU	200.05
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2793848
RSS	65180
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.5.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.5.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	1096
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:18:11
start_time	2018-05-10 13:37:35
stop_time	2018-05-10 14:55:46
guest_loopback_app	testpmd testpmd

4.2.5.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.04
%guest	0.00
%CPU	1.56
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	3364240
RSS	7981
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5940
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.07
%system	0.14
%guest	199.99
%CPU	200.20
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2869806
RSS	67232
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.25
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.01
%system	0.08
%guest	199.95
%CPU	200.05
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2793848
RSS	65180
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.5.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.5.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	744
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:18:11
start_time	2018-05-10 13:37:35
stop_time	2018-05-10 14:55:46
guest_loopback_app	testpmd testpmd

4.2.5.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.04
%guest	0.00
%CPU	1.56
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	3364240
RSS	7981
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5940
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.07
%system	0.14
%guest	199.99
%CPU	200.20
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2869806
RSS	67232
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.25
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.01
%system	0.08
%guest	199.95
%CPU	200.05
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2793848
RSS	65180
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.5.7. Anomalies

No anomalies were detected during the course of this test.

4.2.5.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.6. Test ID: PVP_BACK2BACK

4.2.6.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: pvp

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

• VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

• VM images:

  • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2

• VM loopback apps:

  • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

• Test ID: pvp_back2back
• Description: LTD.Throughput.RFC2544.BackToBackFrames
• Deployment: pvp
• Traffic type: rfc2544_back2back
• Bidirectional : True

4.2.6.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.6.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	851
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:17:12
start_time	2018-05-10 11:08:50
stop_time	2018-05-10 12:26:02
guest_loopback_app	testpmd

4.2.6.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.51
%system	1.05
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	3364104
RSS	7664
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5804
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.07
%guest	199.96
%CPU	200.05
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2840080
RSS	66560
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.31
kB_ccwr/s	0.00

4.2.6.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.6.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	483
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:17:12
start_time	2018-05-10 11:08:50
stop_time	2018-05-10 12:26:02
guest_loopback_app	testpmd

4.2.6.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.51
%system	1.05
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	3364104
RSS	7664
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5804
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.07
%guest	199.96
%CPU	200.05
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2840080
RSS	66560
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.31
kB_ccwr/s	0.00

4.2.6.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.6.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	537
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:17:12
start_time	2018-05-10 11:08:50
stop_time	2018-05-10 12:26:02
guest_loopback_app	testpmd

4.2.6.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.51
%system	1.05
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	3364104
RSS	7664
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5804
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.07
%guest	199.96
%CPU	200.05
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2840080
RSS	66560
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.31
kB_ccwr/s	0.00

4.2.6.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.6.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	548
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:17:12
start_time	2018-05-10 11:08:50
stop_time	2018-05-10 12:26:02
guest_loopback_app	testpmd

4.2.6.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.51
%system	1.05
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	3364104
RSS	7664
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5804
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.07
%guest	199.96
%CPU	200.05
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2840080
RSS	66560
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.31
kB_ccwr/s	0.00

4.2.6.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.6.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	744
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:17:12
start_time	2018-05-10 11:08:50
stop_time	2018-05-10 12:26:02
guest_loopback_app	testpmd

4.2.6.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.51
%system	1.05
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	3364104
RSS	7664
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5804
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.07
%guest	199.96
%CPU	200.05
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2840080
RSS	66560
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.31
kB_ccwr/s	0.00

4.2.6.7. Anomalies

No anomalies were detected during the course of this test.

4.2.6.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.7. Test ID: PHY2PHY_TPUT

4.2.7.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: p2p

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

• Test ID: phy2phy_tput
• Description: LTD.Throughput.RFC2544.PacketLossRatio
• Deployment: p2p
• Traffic type: rfc2544_throughput
• Bidirectional : True

4.2.7.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.7.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	988189.860
tx_rate_mbps	Unknown
throughput_rx_mbps	505.953
tx_rate_percent	3.320
throughput_rx_percent	3.320
frame_loss_percent	0.000
min_latency_ns	3980.000
max_latency_ns	338040.000
avg_latency_ns	28353.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:13:20
start_time	2018-05-10 05:07:18
stop_time	2018-05-10 06:20:39

4.2.7.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.08
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	3364104
RSS	7767
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5892
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.7.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.7.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	952809.460
tx_rate_mbps	Unknown
throughput_rx_mbps	975.677
tx_rate_percent	5.641
throughput_rx_percent	5.641
frame_loss_percent	0.000
min_latency_ns	4140.000
max_latency_ns	4146640.000
avg_latency_ns	34500.000
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:13:20
start_time	2018-05-10 05:07:18
stop_time	2018-05-10 06:20:39

4.2.7.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.08
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	3364104
RSS	7767
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5892
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.7.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.7.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	846600.545
tx_rate_mbps	Unknown
throughput_rx_mbps	3467.676
tx_rate_percent	18.016
throughput_rx_percent	18.016
frame_loss_percent	0.000
min_latency_ns	5040.000
max_latency_ns	364500.000
avg_latency_ns	29513.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:13:20
start_time	2018-05-10 05:07:18
stop_time	2018-05-10 06:20:39

4.2.7.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.08
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	3364104
RSS	7767
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5892
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.7.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.7.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	875914.496
tx_rate_mbps	Unknown
throughput_rx_mbps	7175.492
tx_rate_percent	36.578
throughput_rx_percent	36.578
frame_loss_percent	0.000
min_latency_ns	5720.000
max_latency_ns	1820520.000
avg_latency_ns	40270.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:13:20
start_time	2018-05-10 05:07:18
stop_time	2018-05-10 06:20:39

4.2.7.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.08
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	3364104
RSS	7767
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5892
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.7.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.7.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	871160.958
tx_rate_mbps	Unknown
throughput_rx_mbps	10579.379
tx_rate_percent	53.594
throughput_rx_percent	53.594
frame_loss_percent	0.000
min_latency_ns	8900.000
max_latency_ns	629100.000
avg_latency_ns	48126.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:13:20
start_time	2018-05-10 05:07:18
stop_time	2018-05-10 06:20:39

4.2.7.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.08
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	3364104
RSS	7767
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	5892
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.7.7. Anomalies

No anomalies were detected during the course of this test.

4.2.7.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.8. Test ID: PVP_TPUT

4.2.8.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: pvp

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

• VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

• VM images:

  • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2

• VM loopback apps:

  • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

• Test ID: pvp_tput
• Description: LTD.Throughput.RFC2544.PacketLossRatio
• Deployment: pvp
• Traffic type: rfc2544_throughput
• Bidirectional : True

4.2.8.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.8.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	243027.195
tx_rate_mbps	Unknown
throughput_rx_mbps	124.430
tx_rate_percent	1.773
throughput_rx_percent	0.817
frame_loss_percent	53.953
min_latency_ns	19140.000
max_latency_ns	69499580.000
avg_latency_ns	4996218.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:12:07
start_time	2018-05-10 09:56:42
stop_time	2018-05-10 11:08:49
guest_loopback_app	testpmd

4.2.8.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.05
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.08
majflt/s	0.00
VSZ	3364108
RSS	7587
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	6056
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.62
%guest	199.44
%CPU	200.07
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2790690
RSS	65868
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.25
kB_ccwr/s	0.00

4.2.8.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.8.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	299567.559
tx_rate_mbps	Unknown
throughput_rx_mbps	306.757
tx_rate_percent	1.773
throughput_rx_percent	1.773
frame_loss_percent	0.000
min_latency_ns	11900.000
max_latency_ns	739560.000
avg_latency_ns	47150.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:12:07
start_time	2018-05-10 09:56:42
stop_time	2018-05-10 11:08:49
guest_loopback_app	testpmd

4.2.8.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.05
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.08
majflt/s	0.00
VSZ	3364108
RSS	7587
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	6056
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.62
%guest	199.44
%CPU	200.07
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2790690
RSS	65868
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.25
kB_ccwr/s	0.00

4.2.8.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.8.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	192375.648
tx_rate_mbps	Unknown
throughput_rx_mbps	787.971
tx_rate_percent	4.094
throughput_rx_percent	4.094
frame_loss_percent	0.000
min_latency_ns	14540.000
max_latency_ns	374460.000
avg_latency_ns	60813.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:12:07
start_time	2018-05-10 09:56:42
stop_time	2018-05-10 11:08:49
guest_loopback_app	testpmd

4.2.8.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.05
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.08
majflt/s	0.00
VSZ	3364108
RSS	7587
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	6056
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.62
%guest	199.44
%CPU	200.07
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2790690
RSS	65868
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.25
kB_ccwr/s	0.00

4.2.8.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.8.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	264719.993
tx_rate_mbps	Unknown
throughput_rx_mbps	2168.586
tx_rate_percent	11.055
throughput_rx_percent	11.055
frame_loss_percent	0.000
min_latency_ns	15260.000
max_latency_ns	910800.000
avg_latency_ns	72472.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:12:07
start_time	2018-05-10 09:56:42
stop_time	2018-05-10 11:08:49
guest_loopback_app	testpmd

4.2.8.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.05
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.08
majflt/s	0.00
VSZ	3364108
RSS	7587
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	6056
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.62
%guest	199.44
%CPU	200.07
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2790690
RSS	65868
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.25
kB_ccwr/s	0.00

4.2.8.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.8.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	267697.839
tx_rate_mbps	Unknown
throughput_rx_mbps	3250.923
tx_rate_percent	16.469
throughput_rx_percent	16.469
frame_loss_percent	0.000
min_latency_ns	18580.000
max_latency_ns	1106440.000
avg_latency_ns	72845.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:12:07
start_time	2018-05-10 09:56:42
stop_time	2018-05-10 11:08:49
guest_loopback_app	testpmd

4.2.8.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
%usr	0.50
%system	1.05
%guest	0.00
%CPU	1.58
CPU
minflt/s	0.08
majflt/s	0.00
VSZ	3364108
RSS	7587
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44312
RSS	6056
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.62
%guest	199.44
%CPU	200.07
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2790690
RSS	65868
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.25
kB_ccwr/s	0.00

4.2.8.7. Anomalies

No anomalies were detected during the course of this test.

4.2.8.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.3. Rationale for decisions

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

4.4. Conclusions and recommendations

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-05-10_03-11-47/vswitchperf_logs_2018-05-10_03-11-47.tar.gz.

4.5. General

4.5.1. Glossary

• NFV - Network Function Virtualization
• Mbps - 1,000,000bps

4.5.2. Document change procedures and history

Document ID	Author	Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT	Christopher Nolan	23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT	Christopher Nolan	28/01/2015

5. Performance report for VppDpdkVhost

5.1. Introduction

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

5.1.1. Document identifier

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

5.1.2. Scope

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

5.1.3. References

OPNFV_vswitchperf_LTD_Brahmaputra_REVIEWED

5.2. Details of the Level Test Report

This section provides a test-results-overview. Also included are the rationale and the conclusions.

5.2.1. Test ID: PVP_TPUT_VPP

5.2.1.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: clean

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA

• DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

• Test ID: pvp_tput_vpp
• Description: VPP: LTD.Throughput.RFC2544.PacketLossRatio
• Deployment: clean
• Traffic type: rfc2544_throughput
• Bidirectional : True

5.2.1.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

5.2.1.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4210845.067
tx_rate_mbps	Unknown
throughput_rx_mbps	2155.953
tx_rate_percent	14.148
throughput_rx_percent	14.148
frame_loss_percent	0.000
min_latency_ns	14260.000
max_latency_ns	117700.000
avg_latency_ns	30979.000
type	rfc2544_throughput
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:15:56
start_time	2018-05-10 17:22:29
stop_time	2018-05-10 18:38:25

5.2.1.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.80
%system	0.73
%guest	0.00
%CPU	601.52
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10071169
RSS	51506
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

5.2.1.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4349649.821
tx_rate_mbps	Unknown
throughput_rx_mbps	4454.041
tx_rate_percent	25.750
throughput_rx_percent	25.750
frame_loss_percent	0.000
min_latency_ns	17580.000
max_latency_ns	101460.000
avg_latency_ns	35813.500
type	rfc2544_throughput
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:15:56
start_time	2018-05-10 17:22:29
stop_time	2018-05-10 18:38:25

5.2.1.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.80
%system	0.73
%guest	0.00
%CPU	601.52
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10071169
RSS	51506
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

5.2.1.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	3536144.389
tx_rate_mbps	Unknown
throughput_rx_mbps	14484.047
tx_rate_percent	75.250
throughput_rx_percent	75.250
frame_loss_percent	0.000
min_latency_ns	17140.000
max_latency_ns	118020.000
avg_latency_ns	51794.000
type	rfc2544_throughput
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:15:56
start_time	2018-05-10 17:22:29
stop_time	2018-05-10 18:38:25

5.2.1.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.80
%system	0.73
%guest	0.00
%CPU	601.52
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10071169
RSS	51506
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

5.2.1.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394464.664
tx_rate_mbps	Unknown
throughput_rx_mbps	19615.455
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	19460.000
max_latency_ns	247180.000
avg_latency_ns	223503.000
type	rfc2544_throughput
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:15:56
start_time	2018-05-10 17:22:29
stop_time	2018-05-10 18:38:25

5.2.1.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.80
%system	0.73
%guest	0.00
%CPU	601.52
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10071169
RSS	51506
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

5.2.1.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625413.090
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.017
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	19940.000
max_latency_ns	161980.000
avg_latency_ns	147514.500
type	rfc2544_throughput
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:15:56
start_time	2018-05-10 17:22:29
stop_time	2018-05-10 18:38:25

5.2.1.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.80
%system	0.73
%guest	0.00
%CPU	601.52
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10071169
RSS	51506
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.7. Anomalies

No anomalies were detected during the course of this test.

5.2.1.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.2. Test ID: PVP_BACK2BACK_VPP

5.2.2.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: clean

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA

• DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

• Test ID: pvp_back2back_vpp
• Description: VPP: LTD.Throughput.RFC2544.BackToBackFrames
• Deployment: clean
• Traffic type: rfc2544_back2back
• Bidirectional : True

5.2.2.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

5.2.2.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:18:36
start_time	2018-05-10 18:38:25
stop_time	2018-05-10 19:57:02

5.2.2.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.44
%system	0.30
%guest	0.00
%CPU	600.74
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10085935
RSS	51064
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

5.2.2.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:18:36
start_time	2018-05-10 18:38:25
stop_time	2018-05-10 19:57:02

5.2.2.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.44
%system	0.30
%guest	0.00
%CPU	600.74
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10085935
RSS	51064
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

5.2.2.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488635
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:18:36
start_time	2018-05-10 18:38:25
stop_time	2018-05-10 19:57:02

5.2.2.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.44
%system	0.30
%guest	0.00
%CPU	600.74
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10085935
RSS	51064
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

5.2.2.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:18:36
start_time	2018-05-10 18:38:25
stop_time	2018-05-10 19:57:02

5.2.2.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.44
%system	0.30
%guest	0.00
%CPU	600.74
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10085935
RSS	51064
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

5.2.2.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:18:36
start_time	2018-05-10 18:38:25
stop_time	2018-05-10 19:57:02

5.2.2.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.44
%system	0.30
%guest	0.00
%CPU	600.74
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10085935
RSS	51064
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.7. Anomalies

No anomalies were detected during the course of this test.

5.2.2.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.3. Test ID: PVVP_BACK2BACK_VPP

5.2.3.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: clean

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA

• DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

• Test ID: pvvp_back2back_vpp
• Description: VPP: LTD.Throughput.RFC2544.BackToBackFrames
• Deployment: clean
• Traffic type: rfc2544_back2back
• Bidirectional : True

5.2.3.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

5.2.3.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:12:37
start_time	2018-05-10 20:04:05
stop_time	2018-05-10 21:16:43

5.2.3.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.58
%system	0.30
%guest	0.00
%CPU	600.88
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	16009364
RSS	51312
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

5.2.3.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	483
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:12:37
start_time	2018-05-10 20:04:05
stop_time	2018-05-10 21:16:43

5.2.3.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.58
%system	0.30
%guest	0.00
%CPU	600.88
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	16009364
RSS	51312
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

5.2.3.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488721
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:12:37
start_time	2018-05-10 20:04:05
stop_time	2018-05-10 21:16:43

5.2.3.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.58
%system	0.30
%guest	0.00
%CPU	600.88
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	16009364
RSS	51312
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

5.2.3.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:12:37
start_time	2018-05-10 20:04:05
stop_time	2018-05-10 21:16:43

5.2.3.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.58
%system	0.30
%guest	0.00
%CPU	600.88
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	16009364
RSS	51312
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

5.2.3.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:12:37
start_time	2018-05-10 20:04:05
stop_time	2018-05-10 21:16:43

5.2.3.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.58
%system	0.30
%guest	0.00
%CPU	600.88
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	16009364
RSS	51312
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.7. Anomalies

No anomalies were detected during the course of this test.

5.2.3.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.4. Test ID: PHY2PHY_BACK2BACK_VPP

5.2.4.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: clean

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA

• DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

• Test ID: phy2phy_back2back_vpp
• Description: VPP: LTD.Throughput.RFC2544.BackToBackFrames
• Deployment: clean
• Traffic type: rfc2544_back2back
• Bidirectional : True

5.2.4.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

5.2.4.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	23841
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:17:36
start_time	2018-05-10 16:04:52
stop_time	2018-05-10 17:22:28

5.2.4.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.37
%system	0.29
%guest	0.00
%CPU	600.66
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	3937588
RSS	50404
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

5.2.4.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	247439
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:17:36
start_time	2018-05-10 16:04:52
stop_time	2018-05-10 17:22:28

5.2.4.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.37
%system	0.29
%guest	0.00
%CPU	600.66
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	3937588
RSS	50404
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

5.2.4.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488721
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:17:36
start_time	2018-05-10 16:04:52
stop_time	2018-05-10 17:22:28

5.2.4.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.37
%system	0.29
%guest	0.00
%CPU	600.66
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	3937588
RSS	50404
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

5.2.4.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:17:36
start_time	2018-05-10 16:04:52
stop_time	2018-05-10 17:22:28

5.2.4.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.37
%system	0.29
%guest	0.00
%CPU	600.66
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	3937588
RSS	50404
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

5.2.4.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:17:36
start_time	2018-05-10 16:04:52
stop_time	2018-05-10 17:22:28

5.2.4.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.37
%system	0.29
%guest	0.00
%CPU	600.66
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	3937588
RSS	50404
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.7. Anomalies

No anomalies were detected during the course of this test.

5.2.4.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.5. Test ID: PHY2PHY_TPUT_VPP

5.2.5.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: clean

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA

• DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

• Test ID: phy2phy_tput_vpp
• Description: VPP: LTD.Throughput.RFC2544.PacketLossRatio
• Deployment: clean
• Traffic type: rfc2544_throughput
• Bidirectional : True

5.2.5.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

5.2.5.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	22856314.505
tx_rate_mbps	Unknown
throughput_rx_mbps	11702.433
tx_rate_percent	76.797
throughput_rx_percent	76.797
frame_loss_percent	0.000
min_latency_ns	5300.000
max_latency_ns	50820.000
avg_latency_ns	22284.500
type	rfc2544_throughput
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:08:54
start_time	2018-05-10 14:55:57
stop_time	2018-05-10 16:04:52

5.2.5.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.34
%system	0.29
%guest	0.00
%CPU	600.63
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	3937588
RSS	50910
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.5.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

5.2.5.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	16630607.740
tx_rate_mbps	Unknown
throughput_rx_mbps	17029.742
tx_rate_percent	98.453
throughput_rx_percent	98.453
frame_loss_percent	0.000
min_latency_ns	5320.000
max_latency_ns	33820.000
avg_latency_ns	12950.500
type	rfc2544_throughput
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:08:54
start_time	2018-05-10 14:55:57
stop_time	2018-05-10 16:04:52

5.2.5.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.34
%system	0.29
%guest	0.00
%CPU	600.63
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	3937588
RSS	50910
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.5.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

5.2.5.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699208.142
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.957
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	5720.000
max_latency_ns	31700.000
avg_latency_ns	20220.500
type	rfc2544_throughput
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:08:54
start_time	2018-05-10 14:55:57
stop_time	2018-05-10 16:04:52

5.2.5.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.34
%system	0.29
%guest	0.00
%CPU	600.63
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	3937588
RSS	50910
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.5.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

5.2.5.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394612.784
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.668
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	6260.000
max_latency_ns	36000.000
avg_latency_ns	24783.500
type	rfc2544_throughput
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:08:54
start_time	2018-05-10 14:55:57
stop_time	2018-05-10 16:04:52

5.2.5.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.34
%system	0.29
%guest	0.00
%CPU	600.63
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	3937588
RSS	50910
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.5.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

5.2.5.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625473.495
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.750
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	8400.000
max_latency_ns	34820.000
avg_latency_ns	23842.500
type	rfc2544_throughput
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:08:54
start_time	2018-05-10 14:55:57
stop_time	2018-05-10 16:04:52

5.2.5.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
%usr	600.34
%system	0.29
%guest	0.00
%CPU	600.63
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	3937588
RSS	50910
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.5.7. Anomalies

No anomalies were detected during the course of this test.

5.2.5.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.3. Rationale for decisions

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

5.4. Conclusions and recommendations

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-05-10_03-11-47/vswitchperf_logs_2018-05-10_03-11-47.tar.gz.

5.5. General

5.5.1. Glossary

• NFV - Network Function Virtualization
• Mbps - 1,000,000bps

5.5.2. Document change procedures and history

Document ID	Author	Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT	Christopher Nolan	23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT	Christopher Nolan	28/01/2015

6. Performance report for none

6.1. Introduction

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

6.1.1. Document identifier

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

6.1.2. Scope

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

6.1.3. References

OPNFV_vswitchperf_LTD_Brahmaputra_REVIEWED

6.2. Details of the Level Test Report

This section provides a test-results-overview. Also included are the rationale and the conclusions.

6.2.1. Test ID: PVP_TPUT

6.2.1.1. Test Environment

Below is the environment that the test was performed in:

• OS: CentOS Linux 7 Core

• Kernel Version: 4.4.112-1.el7.elrepo.x86_64

• NIC(s):

  • Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
  • Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)

• Board: Intel Corporation S2600WT2R [2 sockets]

• CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

• CPU cores: 44

• Memory: 65917716 kB

• Virtual Switch Set-up: pvp

• vswitchperf: GIT tag: ba989f41bd53f80dbdbade9334661bf5ff1b88e4

• Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

• vSwitch: none, Version: None, GIT tag: None

• VNF: QemuPciPassthrough, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

• VM images:

  • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2

• VM loopback apps:

  • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

• Test ID: pvp_tput
• Description: LTD.Throughput.RFC2544.PacketLossRatio
• Deployment: pvp
• Traffic type: rfc2544_throughput
• Bidirectional : True

6.2.1.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

6.2.1.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	6052367.215
tx_rate_mbps	Unknown
throughput_rx_mbps	3098.812
tx_rate_percent	20.336
throughput_rx_percent	20.336
frame_loss_percent	0.000
min_latency_ns	3560.000
max_latency_ns	33380.000
avg_latency_ns	3846.000
type	rfc2544_throughput
packet_size	64
vswitch	none
traffic_type	udp
test_execution_time	01:15:28
start_time	2018-05-10 21:16:54
stop_time	2018-05-10 22:32:23
guest_loopback_app	testpmd

6.2.1.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.07
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2879474
RSS	76632
%MEM	0.12
kB_rd/s	0.00
kB_wr/s	4.75
kB_ccwr/s	0.00

6.2.1.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

6.2.1.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	5133552.586
tx_rate_mbps	Unknown
throughput_rx_mbps	5256.758
tx_rate_percent	30.391
throughput_rx_percent	30.391
frame_loss_percent	0.000
min_latency_ns	3640.000
max_latency_ns	34520.000
avg_latency_ns	4082.000
type	rfc2544_throughput
packet_size	128
vswitch	none
traffic_type	udp
test_execution_time	01:15:28
start_time	2018-05-10 21:16:54
stop_time	2018-05-10 22:32:23
guest_loopback_app	testpmd

6.2.1.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.07
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2879474
RSS	76632
%MEM	0.12
kB_rd/s	0.00
kB_wr/s	4.75
kB_ccwr/s	0.00

6.2.1.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

6.2.1.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699180.981
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.845
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	4900.000
max_latency_ns	49680.000
avg_latency_ns	34963.000
type	rfc2544_throughput
packet_size	512
vswitch	none
traffic_type	udp
test_execution_time	01:15:28
start_time	2018-05-10 21:16:54
stop_time	2018-05-10 22:32:23
guest_loopback_app	testpmd

6.2.1.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.07
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2879474
RSS	76632
%MEM	0.12
kB_rd/s	0.00
kB_wr/s	4.75
kB_ccwr/s	0.00

6.2.1.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

6.2.1.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394607.085
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.621
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	5460.000
max_latency_ns	47060.000
avg_latency_ns	28108.500
type	rfc2544_throughput
packet_size	1024
vswitch	none
traffic_type	udp
test_execution_time	01:15:28
start_time	2018-05-10 21:16:54
stop_time	2018-05-10 22:32:23
guest_loopback_app	testpmd

6.2.1.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.07
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2879474
RSS	76632
%MEM	0.12
kB_rd/s	0.00
kB_wr/s	4.75
kB_ccwr/s	0.00

6.2.1.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

6.2.1.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625465.308
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.651
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	5940.000
max_latency_ns	47760.000
avg_latency_ns	33116.500
type	rfc2544_throughput
packet_size	1518
vswitch	none
traffic_type	udp
test_execution_time	01:15:28
start_time	2018-05-10 21:16:54
stop_time	2018-05-10 22:32:23
guest_loopback_app	testpmd

6.2.1.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic	Value
%usr	0.02
%system	0.03
%guest	200.02
%CPU	200.07
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2879474
RSS	76632
%MEM	0.12
kB_rd/s	0.00
kB_wr/s	4.75
kB_ccwr/s	0.00

6.2.1.7. Anomalies

No anomalies were detected during the course of this test.

6.2.1.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat. Please note that vsperf recalculates the CPU consumption of a process by aggregating the CPU usage of each thread.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

6.3. Rationale for decisions

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

6.4. Conclusions and recommendations

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-05-10_03-11-47/vswitchperf_logs_2018-05-10_03-11-47.tar.gz.

6.5. General

6.5.1. Glossary

• NFV - Network Function Virtualization
• Mbps - 1,000,000bps

6.5.2. Document change procedures and history

Document ID	Author	Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT	Christopher Nolan	23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT	Christopher Nolan	28/01/2015