VSPERF Results¶

1. VSPERF Test Scenarios¶

Predefined Tests suitable for automated execution with CI:

Test	Definition
phy2phy_tput	PacketLossRatio for Phy2Phy
back2back	BackToBackFrames for Phy2Phy
phy2phy_tput_mod_vlan	PacketLossRatioFrameModification for Phy2Phy
phy2phy_cont	Phy2Phy blast vswitch at x% TX rate and measure throughput
pvp_cont	PVP blast vswitch at x% TX rate and measure throughput
pvvp_cont	PVVP blast vswitch at x% TX rate and measure throughput
phy2phy_scalability	Scalability0PacketLoss for Phy2Phy
pvp_tput	PacketLossRatio for PVP
pvp_back2back	BackToBackFrames for PVP
pvvp_tput	PacketLossRatio for PVVP
pvvp_back2back	BackToBackFrames for PVVP
phy2phy_cpu_load	CPU0PacketLoss for Phy2Phy
phy2phy_mem_load	Same as CPU0PacketLoss but using a memory intensive app

Deployment topologies:

Phy2Phy: Physical port -> vSwitch -> Physical port.
PVP: Physical port -> vSwitch -> VNF -> vSwitch -> Physical port.
PVVP: Physical port -> vSwitch -> VNF -> vSwitch -> VNF -> vSwitch -> Physical port.

Loopback applications in the Guest:

DPDK testpmd.
Linux Bridge.
l2fwd-module

Supported traffic generators:

Spirent Testcenter
Ixia: IxOS and IxNet.
Xena
MoonGen
Dummy
T-Rex

2. OPNFV Test Results¶

VSPERF CI jobs are run daily and sample results can be found at https://wiki.opnfv.org/display/vsperf/Vsperf+Results

Testcase names shown in the dashboard are combination of orignal testcase name from VSPERF framework and indication of used vswitch.

Example:

Testcase phy2phy_tput is executed for three vSwitch types: OvsDpdkVhost, OvsVanilla and VppDpdkVhost. In this case, following testcase names will be used in the dashboard: phy2phy_tput_ovsdpdkvhost, phy2phy_tput_ovsvanilla and phy2phy_tput_vppdpdkvhost.

In case of RFC2544 Throughput test, the recorded metric is FPS (frames per second) without packet loss. For RFC2544 Back2Back test, the recorded metric is back-to-back value (number of frames) without packet loss.

The loopback application in the VNF used for PVP and PVVP scenarios was DPDK testpmd.

Guest interface types are vhost-user for OvsDpdkVhost and VppDpdkVhost and virtio-net for OvsVanilla.

3. Performance report for OvsDpdkVhost¶

3.1. Introduction¶

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

3.1.1. Document identifier¶

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

3.1.2. Scope¶

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

3.1.3. References¶

OPNFV_vswitchperf_LTD_Brahmaputra_REVIEWED

3.2. Details of the Level Test Report¶

This section provides a test-results-overview. Also included are the rationale and the conclusions.

3.2.1. Test ID: BACK2BACK¶

3.2.1.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: back2back
Description: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: p2p
Traffic type: rfc2544_back2back
Bidirectional : True

3.2.1.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.1.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	26396
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:34:46
start_time	2018-01-22 05:48:53
stop_time	2018-01-22 06:23:39

3.2.1.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	134524
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	8300988
RSS	43331
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	134508
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6544
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.1.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	253378378
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:34:46
start_time	2018-01-22 05:48:53
stop_time	2018-01-22 06:23:39

3.2.1.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	134524
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	8300988
RSS	43331
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	134508
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6544
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.1.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488721
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:34:46
start_time	2018-01-22 05:48:53
stop_time	2018-01-22 06:23:39

3.2.1.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	134524
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	8300988
RSS	43331
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	134508
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6544
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.1.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:34:46
start_time	2018-01-22 05:48:53
stop_time	2018-01-22 06:23:39

3.2.1.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	134524
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	8300988
RSS	43331
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	134508
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6544
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.1.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:34:46
start_time	2018-01-22 05:48:53
stop_time	2018-01-22 06:23:39

3.2.1.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	134524
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	8300988
RSS	43331
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	134508
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6544
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.1.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.2. Test ID: PVP_TPUT¶

3.2.2.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: pvp
Traffic type: rfc2544_throughput
Bidirectional : True

3.2.2.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.2.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	7663730.107
tx_rate_mbps	Unknown
throughput_rx_mbps	3923.830
tx_rate_percent	25.750
throughput_rx_percent	25.750
frame_loss_percent	0.000
min_latency_ns	5800.000
max_latency_ns	38360.000
avg_latency_ns	7445.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:21:52
start_time	2018-01-22 07:12:47
stop_time	2018-01-22 07:34:39
guest_loopback_app	testpmd

3.2.2.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	152755
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	14666176
RSS	43316
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	152738
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6496
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	153000
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	2840813
RSS	62671
%MEM	0.10
kB_rd/s	0.04
kB_wr/s	15.77
kB_ccwr/s	0.00

3.2.2.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.2.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	8530451.357
tx_rate_mbps	Unknown
throughput_rx_mbps	8735.182
tx_rate_percent	50.500
throughput_rx_percent	50.500
frame_loss_percent	0.000
min_latency_ns	7600.000
max_latency_ns	39460.000
avg_latency_ns	9679.000
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:21:52
start_time	2018-01-22 07:12:47
stop_time	2018-01-22 07:34:39
guest_loopback_app	testpmd

3.2.2.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	152755
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	14666176
RSS	43316
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	152738
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6496
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	153000
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	2840813
RSS	62671
%MEM	0.10
kB_rd/s	0.04
kB_wr/s	15.77
kB_ccwr/s	0.00

3.2.2.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.2.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699160.916
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.763
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	26920.000
max_latency_ns	87780.000
avg_latency_ns	74255.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:21:52
start_time	2018-01-22 07:12:47
stop_time	2018-01-22 07:34:39
guest_loopback_app	testpmd

3.2.2.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	152755
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	14666176
RSS	43316
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	152738
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6496
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	153000
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	2840813
RSS	62671
%MEM	0.10
kB_rd/s	0.04
kB_wr/s	15.77
kB_ccwr/s	0.00

3.2.2.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.2.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394605.345
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.607
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	33420.000
max_latency_ns	73680.000
avg_latency_ns	62622.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:21:52
start_time	2018-01-22 07:12:47
stop_time	2018-01-22 07:34:39
guest_loopback_app	testpmd

3.2.2.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	152755
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	14666176
RSS	43316
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	152738
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6496
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	153000
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	2840813
RSS	62671
%MEM	0.10
kB_rd/s	0.04
kB_wr/s	15.77
kB_ccwr/s	0.00

3.2.2.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.2.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625466.451
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.665
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	34700.000
max_latency_ns	78120.000
avg_latency_ns	64524.000
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:21:52
start_time	2018-01-22 07:12:47
stop_time	2018-01-22 07:34:39
guest_loopback_app	testpmd

3.2.2.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	152755
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	14666176
RSS	43316
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	152738
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6496
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	153000
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	2840813
RSS	62671
%MEM	0.10
kB_rd/s	0.04
kB_wr/s	15.77
kB_ccwr/s	0.00

3.2.2.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.2.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.3. Test ID: PHY2PHY_TPUT_MOD_VLAN¶

3.2.3.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: phy2phy_tput_mod_vlan
Description: LTD.Throughput.RFC2544.PacketLossRatioFrameModification
Deployment: p2p
Traffic type: rfc2544_throughput
Bidirectional : True

3.2.3.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.3.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	16410990.734
tx_rate_mbps	Unknown
throughput_rx_mbps	8927.579
tx_rate_percent	55.141
throughput_rx_percent	57.767
frame_loss_percent	0.000
min_latency_ns	5100.000
max_latency_ns	31680.000
avg_latency_ns	11294.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:29:04
start_time	2018-01-22 06:23:39
stop_time	2018-01-22 06:52:44

3.2.3.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	141954
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	8301016
RSS	43547
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	141938
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6584
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.3.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	16369327.629
tx_rate_mbps	Unknown
throughput_rx_mbps	17286.010
tx_rate_percent	96.906
throughput_rx_percent	99.526
frame_loss_percent	0.000
min_latency_ns	5720.000
max_latency_ns	68920.000
avg_latency_ns	15939.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:29:04
start_time	2018-01-22 06:23:39
stop_time	2018-01-22 06:52:44

3.2.3.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	141954
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	8301016
RSS	43547
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	141938
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6584
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.3.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4662904.624
tx_rate_mbps	Unknown
throughput_rx_mbps	19248.470
tx_rate_percent	99.227
throughput_rx_percent	99.973
frame_loss_percent	0.000
min_latency_ns	6100.000
max_latency_ns	22900.000
avg_latency_ns	7548.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:29:04
start_time	2018-01-22 06:23:39
stop_time	2018-01-22 06:52:44

3.2.3.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	141954
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	8301016
RSS	43547
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	141938
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6584
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.3.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2376116.999
tx_rate_mbps	Unknown
throughput_rx_mbps	19541.186
tx_rate_percent	99.227
throughput_rx_percent	99.607
frame_loss_percent	0.000
min_latency_ns	6780.000
max_latency_ns	30680.000
avg_latency_ns	7842.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:29:04
start_time	2018-01-22 06:23:39
stop_time	2018-01-22 06:52:44

3.2.3.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	141954
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	8301016
RSS	43547
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	141938
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6584
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.3.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1612916.345
tx_rate_mbps	Unknown
throughput_rx_mbps	19638.869
tx_rate_percent	99.227
throughput_rx_percent	99.485
frame_loss_percent	0.000
min_latency_ns	6960.000
max_latency_ns	25260.000
avg_latency_ns	8864.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:29:04
start_time	2018-01-22 06:23:39
stop_time	2018-01-22 06:52:44

3.2.3.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	141954
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	8301016
RSS	43547
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	141938
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6584
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.3.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.4. Test ID: PVVP_BACK2BACK¶

3.2.4.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvvp_back2back
Description: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: pvvp
Traffic type: rfc2544_back2back
Bidirectional : True

3.2.4.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.4.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	851
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:31:06
start_time	2018-01-22 08:27:31
stop_time	2018-01-22 08:58:37
guest_loopback_app	testpmd testpmd

3.2.4.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	169502
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	20957744
RSS	43747
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	169486
%usr	0.01
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6516
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	169972
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2840780
RSS	65475
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	11.43
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	169744
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2807877
RSS	67796
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.03
kB_ccwr/s	0.00

3.2.4.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.4.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	483
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:31:06
start_time	2018-01-22 08:27:31
stop_time	2018-01-22 08:58:37
guest_loopback_app	testpmd testpmd

3.2.4.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	169502
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	20957744
RSS	43747
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	169486
%usr	0.01
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6516
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	169972
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2840780
RSS	65475
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	11.43
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	169744
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2807877
RSS	67796
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.03
kB_ccwr/s	0.00

3.2.4.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.4.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488721
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:31:06
start_time	2018-01-22 08:27:31
stop_time	2018-01-22 08:58:37
guest_loopback_app	testpmd testpmd

3.2.4.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	169502
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	20957744
RSS	43747
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	169486
%usr	0.01
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6516
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	169972
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2840780
RSS	65475
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	11.43
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	169744
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2807877
RSS	67796
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.03
kB_ccwr/s	0.00

3.2.4.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.4.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:31:06
start_time	2018-01-22 08:27:31
stop_time	2018-01-22 08:58:37
guest_loopback_app	testpmd testpmd

3.2.4.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	169502
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	20957744
RSS	43747
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	169486
%usr	0.01
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6516
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	169972
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2840780
RSS	65475
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	11.43
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	169744
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2807877
RSS	67796
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.03
kB_ccwr/s	0.00

3.2.4.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.4.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:31:06
start_time	2018-01-22 08:27:31
stop_time	2018-01-22 08:58:37
guest_loopback_app	testpmd testpmd

3.2.4.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	169502
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	20957744
RSS	43747
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	169486
%usr	0.01
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6516
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	169972
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2840780
RSS	65475
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	11.43
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	169744
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2807877
RSS	67796
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.03
kB_ccwr/s	0.00

3.2.4.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.4.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.5. Test ID: PHY2PHY_TPUT¶

3.2.5.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: phy2phy_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: p2p
Traffic type: rfc2544_throughput
Bidirectional : True

3.2.5.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.5.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	23546937.531
tx_rate_mbps	Unknown
throughput_rx_mbps	12056.032
tx_rate_percent	79.117
throughput_rx_percent	79.117
frame_loss_percent	0.000
min_latency_ns	5260.000
max_latency_ns	83460.000
avg_latency_ns	12223.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	15:19:59
start_time	2018-01-22 14:28:54
stop_time	2018-01-22 05:48:52

3.2.5.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	130045
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	8301016
RSS	43562
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	130027
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6496
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.5.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.5.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	16761273.798
tx_rate_mbps	Unknown
throughput_rx_mbps	17163.544
tx_rate_percent	99.227
throughput_rx_percent	99.227
frame_loss_percent	0.000
min_latency_ns	5840.000
max_latency_ns	25200.000
avg_latency_ns	10139.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	15:19:59
start_time	2018-01-22 14:28:54
stop_time	2018-01-22 05:48:52

3.2.5.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	130045
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	8301016
RSS	43562
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	130027
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6496
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.5.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.5.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699190.082
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.883
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	16160.000
max_latency_ns	53560.000
avg_latency_ns	42944.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	15:19:59
start_time	2018-01-22 14:28:54
stop_time	2018-01-22 05:48:52

3.2.5.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	130045
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	8301016
RSS	43562
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	130027
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6496
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.5.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.5.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394611.882
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.661
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	21940.000
max_latency_ns	52420.000
avg_latency_ns	41889.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	15:19:59
start_time	2018-01-22 14:28:54
stop_time	2018-01-22 05:48:52

3.2.5.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	130045
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	8301016
RSS	43562
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	130027
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6496
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.5.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.5.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625471.458
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.725
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	27020.000
max_latency_ns	58200.000
avg_latency_ns	46772.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	15:19:59
start_time	2018-01-22 14:28:54
stop_time	2018-01-22 05:48:52

3.2.5.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	130045
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	8301016
RSS	43562
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	130027
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6496
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.5.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.5.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.6. Test ID: PHY2PHY_SCALABILITY¶

3.2.6.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: phy2phy_scalability
Description: LTD.Scalability.Flows.RFC2544.0PacketLoss
Deployment: p2p
Traffic type: rfc2544_throughput
Bidirectional : True

3.2.6.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.6.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	15720372.600
tx_rate_mbps	Unknown
throughput_rx_mbps	8048.831
tx_rate_percent	52.820
throughput_rx_percent	52.820
frame_loss_percent	0.000
min_latency_ns	5160.000
max_latency_ns	44360.000
avg_latency_ns	8399.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:20:01
start_time	2018-01-22 06:52:45
stop_time	2018-01-22 07:12:46
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.6.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	148262
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	8300988
RSS	43314
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	148245
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6496
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.6.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.6.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	15324200.706
tx_rate_mbps	Unknown
throughput_rx_mbps	15691.982
tx_rate_percent	90.719
throughput_rx_percent	90.719
frame_loss_percent	0.000
min_latency_ns	5600.000
max_latency_ns	25800.000
avg_latency_ns	9846.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:20:01
start_time	2018-01-22 06:52:45
stop_time	2018-01-22 07:12:46
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.6.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	148262
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	8300988
RSS	43314
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	148245
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6496
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.6.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.6.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699191.444
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.888
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	16120.000
max_latency_ns	55540.000
avg_latency_ns	43326.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:20:01
start_time	2018-01-22 06:52:45
stop_time	2018-01-22 07:12:46
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.6.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	148262
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	8300988
RSS	43314
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	148245
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6496
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.6.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.6.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394608.777
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.635
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	25440.000
max_latency_ns	62660.000
avg_latency_ns	49797.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:20:01
start_time	2018-01-22 06:52:45
stop_time	2018-01-22 07:12:46
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.6.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	148262
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	8300988
RSS	43314
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	148245
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6496
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.6.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.6.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625471.550
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.727
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	25220.000
max_latency_ns	56200.000
avg_latency_ns	45062.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:20:01
start_time	2018-01-22 06:52:45
stop_time	2018-01-22 07:12:46
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.6.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	148262
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	8300988
RSS	43314
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	148245
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6496
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.6.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.6.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.7. Test ID: PVP_BACK2BACK¶

3.2.7.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_back2back
Description: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: pvp
Traffic type: rfc2544_back2back
Bidirectional : True

3.2.7.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.7.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	2128
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:30:22
start_time	2018-01-22 07:34:40
stop_time	2018-01-22 08:05:02
guest_loopback_app	testpmd

3.2.7.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	157764
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	14666176
RSS	43360
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	157660
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6596
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	158004
%usr	0.07
%system	0.04
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2880872
RSS	65459
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	12.48
kB_ccwr/s	0.00

3.2.7.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.7.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	1449
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:30:22
start_time	2018-01-22 07:34:40
stop_time	2018-01-22 08:05:02
guest_loopback_app	testpmd

3.2.7.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	157764
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	14666176
RSS	43360
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	157660
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6596
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	158004
%usr	0.07
%system	0.04
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2880872
RSS	65459
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	12.48
kB_ccwr/s	0.00

3.2.7.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.7.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488721
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:30:22
start_time	2018-01-22 07:34:40
stop_time	2018-01-22 08:05:02
guest_loopback_app	testpmd

3.2.7.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	157764
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	14666176
RSS	43360
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	157660
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6596
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	158004
%usr	0.07
%system	0.04
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2880872
RSS	65459
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	12.48
kB_ccwr/s	0.00

3.2.7.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.7.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:30:22
start_time	2018-01-22 07:34:40
stop_time	2018-01-22 08:05:02
guest_loopback_app	testpmd

3.2.7.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	157764
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	14666176
RSS	43360
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	157660
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6596
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	158004
%usr	0.07
%system	0.04
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2880872
RSS	65459
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	12.48
kB_ccwr/s	0.00

3.2.7.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.7.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:30:22
start_time	2018-01-22 07:34:40
stop_time	2018-01-22 08:05:02
guest_loopback_app	testpmd

3.2.7.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	157764
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	14666176
RSS	43360
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	157660
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6596
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	158004
%usr	0.07
%system	0.04
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2880872
RSS	65459
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	12.48
kB_ccwr/s	0.00

3.2.7.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.7.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.8. Test ID: PVVP_TPUT¶

3.2.8.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvvp_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: pvvp
Traffic type: rfc2544_throughput
Bidirectional : True

3.2.8.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.8.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	7663720.221
tx_rate_mbps	Unknown
throughput_rx_mbps	3923.825
tx_rate_percent	25.750
throughput_rx_percent	25.750
frame_loss_percent	0.000
min_latency_ns	9820.000
max_latency_ns	48440.000
avg_latency_ns	13104.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:22:27
start_time	2018-01-22 08:05:03
stop_time	2018-01-22 08:27:30
guest_loopback_app	testpmd testpmd

3.2.8.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	164407
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	20957648
RSS	43308
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	164301
%usr	0.01
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6760
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	164789
%usr	0.07
%system	0.04
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2801716
RSS	62171
%MEM	0.09
kB_rd/s	0.00
kB_wr/s	17.56
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	164656
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2799660
RSS	65836
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.04
kB_ccwr/s	0.00

3.2.8.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.8.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	6440042.800
tx_rate_mbps	Unknown
throughput_rx_mbps	6594.604
tx_rate_percent	38.125
throughput_rx_percent	38.125
frame_loss_percent	0.000
min_latency_ns	9460.000
max_latency_ns	55100.000
avg_latency_ns	12380.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:22:27
start_time	2018-01-22 08:05:03
stop_time	2018-01-22 08:27:30
guest_loopback_app	testpmd testpmd

3.2.8.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	164407
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	20957648
RSS	43308
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	164301
%usr	0.01
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6760
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	164789
%usr	0.07
%system	0.04
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2801716
RSS	62171
%MEM	0.09
kB_rd/s	0.00
kB_wr/s	17.56
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	164656
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2799660
RSS	65836
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.04
kB_ccwr/s	0.00

3.2.8.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.8.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699147.617
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.709
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	38760.000
max_latency_ns	115860.000
avg_latency_ns	102803.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:22:27
start_time	2018-01-22 08:05:03
stop_time	2018-01-22 08:27:30
guest_loopback_app	testpmd testpmd

3.2.8.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	164407
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	20957648
RSS	43308
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	164301
%usr	0.01
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6760
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	164789
%usr	0.07
%system	0.04
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2801716
RSS	62171
%MEM	0.09
kB_rd/s	0.00
kB_wr/s	17.56
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	164656
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2799660
RSS	65836
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.04
kB_ccwr/s	0.00

3.2.8.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.8.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394583.802
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.431
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	50800.000
max_latency_ns	123540.000
avg_latency_ns	107151.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:22:27
start_time	2018-01-22 08:05:03
stop_time	2018-01-22 08:27:30
guest_loopback_app	testpmd testpmd

3.2.8.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	164407
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	20957648
RSS	43308
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	164301
%usr	0.01
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6760
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	164789
%usr	0.07
%system	0.04
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2801716
RSS	62171
%MEM	0.09
kB_rd/s	0.00
kB_wr/s	17.56
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	164656
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2799660
RSS	65836
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.04
kB_ccwr/s	0.00

3.2.8.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.8.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625458.097
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.563
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	54920.000
max_latency_ns	118240.000
avg_latency_ns	103056.000
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:22:27
start_time	2018-01-22 08:05:03
stop_time	2018-01-22 08:27:30
guest_loopback_app	testpmd testpmd

3.2.8.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	164407
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	20957648
RSS	43308
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	164301
%usr	0.01
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50660
RSS	6760
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	164789
%usr	0.07
%system	0.04
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2801716
RSS	62171
%MEM	0.09
kB_rd/s	0.00
kB_wr/s	17.56
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	164656
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2799660
RSS	65836
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.04
kB_ccwr/s	0.00

3.2.8.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.8.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.3. Rationale for decisions¶

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

3.4. Conclusions and recommendations¶

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-22_22-28-47/vswitchperf_logs_2018-01-22_22-28-47.tar.gz.

3.5. General¶

3.5.1. Glossary¶

NFV - Network Function Virtualization
Mbps - 1,000,000bps

3.5.2. Document change procedures and history¶

Document ID	Author	Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT	Christopher Nolan	23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT	Christopher Nolan	28/01/2015

4. Performance report for OvsVanilla¶

4.1. Introduction¶

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

4.1.1. Document identifier¶

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

4.1.2. Scope¶

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

4.1.3. References¶

OPNFV_vswitchperf_LTD_Brahmaputra_REVIEWED

4.2. Details of the Level Test Report¶

This section provides a test-results-overview. Also included are the rationale and the conclusions.

4.2.1. Test ID: BACK2BACK¶

4.2.1.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

Test ID: back2back
Description: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: p2p
Traffic type: rfc2544_back2back
Bidirectional : True

4.2.1.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.1.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	5108
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:42:14
start_time	2018-01-22 09:28:21
stop_time	2018-01-22 10:10:36

4.2.1.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	182726
%usr	0.42
%system	2.92
%guest	0.00
%CPU	3.35
CPU
minflt/s	0.13
majflt/s	0.00
VSZ	6608356
RSS	9219
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	182723
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5968
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.1.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	3382
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:42:14
start_time	2018-01-22 09:28:21
stop_time	2018-01-22 10:10:36

4.2.1.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	182726
%usr	0.42
%system	2.92
%guest	0.00
%CPU	3.35
CPU
minflt/s	0.13
majflt/s	0.00
VSZ	6608356
RSS	9219
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	182723
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5968
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.1.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	1344
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:42:14
start_time	2018-01-22 09:28:21
stop_time	2018-01-22 10:10:36

4.2.1.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	182726
%usr	0.42
%system	2.92
%guest	0.00
%CPU	3.35
CPU
minflt/s	0.13
majflt/s	0.00
VSZ	6608356
RSS	9219
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	182723
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5968
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.1.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	1096
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:42:14
start_time	2018-01-22 09:28:21
stop_time	2018-01-22 10:10:36

4.2.1.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	182726
%usr	0.42
%system	2.92
%guest	0.00
%CPU	3.35
CPU
minflt/s	0.13
majflt/s	0.00
VSZ	6608356
RSS	9219
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	182723
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5968
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.1.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	1116
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:42:14
start_time	2018-01-22 09:28:21
stop_time	2018-01-22 10:10:36

4.2.1.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	182726
%usr	0.42
%system	2.92
%guest	0.00
%CPU	3.35
CPU
minflt/s	0.13
majflt/s	0.00
VSZ	6608356
RSS	9219
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	182723
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5968
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.1.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.2. Test ID: PVP_TPUT¶

4.2.2.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: pvp
Traffic type: rfc2544_throughput
Bidirectional : True

4.2.2.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.2.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	334376.528
tx_rate_mbps	Unknown
throughput_rx_mbps	171.201
tx_rate_percent	1.773
throughput_rx_percent	1.124
frame_loss_percent	36.647
min_latency_ns	11340.000
max_latency_ns	83403480.000
avg_latency_ns	2732294.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:28:27
start_time	2018-01-22 11:06:00
stop_time	2018-01-22 11:34:28
guest_loopback_app	testpmd

4.2.2.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	7054
%usr	0.39
%system	2.83
%guest	0.00
%CPU	3.21
CPU
minflt/s	0.16
majflt/s	0.00
VSZ	6608352
RSS	9261
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	7045
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5808
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	7328
%usr	0.02
%system	1.37
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2843867
RSS	65099
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	12.02
kB_ccwr/s	0.00

4.2.2.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.2.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	299567.798
tx_rate_mbps	Unknown
throughput_rx_mbps	306.757
tx_rate_percent	1.773
throughput_rx_percent	1.773
frame_loss_percent	0.000
min_latency_ns	9760.000
max_latency_ns	431920.000
avg_latency_ns	45269.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:28:27
start_time	2018-01-22 11:06:00
stop_time	2018-01-22 11:34:28
guest_loopback_app	testpmd

4.2.2.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	7054
%usr	0.39
%system	2.83
%guest	0.00
%CPU	3.21
CPU
minflt/s	0.16
majflt/s	0.00
VSZ	6608352
RSS	9261
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	7045
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5808
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	7328
%usr	0.02
%system	1.37
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2843867
RSS	65099
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	12.02
kB_ccwr/s	0.00

4.2.2.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.2.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	265067.048
tx_rate_mbps	Unknown
throughput_rx_mbps	1085.715
tx_rate_percent	5.641
throughput_rx_percent	5.641
frame_loss_percent	0.000
min_latency_ns	11640.000
max_latency_ns	632120.000
avg_latency_ns	67107.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:28:27
start_time	2018-01-22 11:06:00
stop_time	2018-01-22 11:34:28
guest_loopback_app	testpmd

4.2.2.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	7054
%usr	0.39
%system	2.83
%guest	0.00
%CPU	3.21
CPU
minflt/s	0.16
majflt/s	0.00
VSZ	6608352
RSS	9261
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	7045
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5808
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	7328
%usr	0.02
%system	1.37
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2843867
RSS	65099
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	12.02
kB_ccwr/s	0.00

4.2.2.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.2.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	283240.381
tx_rate_mbps	Unknown
throughput_rx_mbps	2320.305
tx_rate_percent	11.828
throughput_rx_percent	11.828
frame_loss_percent	0.000
min_latency_ns	11780.000
max_latency_ns	1600420.000
avg_latency_ns	72288.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:28:27
start_time	2018-01-22 11:06:00
stop_time	2018-01-22 11:34:28
guest_loopback_app	testpmd

4.2.2.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	7054
%usr	0.39
%system	2.83
%guest	0.00
%CPU	3.21
CPU
minflt/s	0.16
majflt/s	0.00
VSZ	6608352
RSS	9261
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	7045
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5808
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	7328
%usr	0.02
%system	1.37
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2843867
RSS	65099
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	12.02
kB_ccwr/s	0.00

4.2.2.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.2.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	280270.074
tx_rate_mbps	Unknown
throughput_rx_mbps	3403.600
tx_rate_percent	17.242
throughput_rx_percent	17.242
frame_loss_percent	0.000
min_latency_ns	13680.000
max_latency_ns	902820.000
avg_latency_ns	71476.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:28:27
start_time	2018-01-22 11:06:00
stop_time	2018-01-22 11:34:28
guest_loopback_app	testpmd

4.2.2.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	7054
%usr	0.39
%system	2.83
%guest	0.00
%CPU	3.21
CPU
minflt/s	0.16
majflt/s	0.00
VSZ	6608352
RSS	9261
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	7045
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5808
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	7328
%usr	0.02
%system	1.37
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2843867
RSS	65099
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	12.02
kB_ccwr/s	0.00

4.2.2.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.2.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.3. Test ID: PHY2PHY_TPUT_MOD_VLAN¶

4.2.3.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

Test ID: phy2phy_tput_mod_vlan
Description: LTD.Throughput.RFC2544.PacketLossRatioFrameModification
Deployment: p2p
Traffic type: rfc2544_throughput
Bidirectional : True

4.2.3.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.3.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	988192.682
tx_rate_mbps	Unknown
throughput_rx_mbps	537.577
tx_rate_percent	3.320
throughput_rx_percent	3.478
frame_loss_percent	0.000
min_latency_ns	4020.000
max_latency_ns	5945340.000
avg_latency_ns	110947.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:27:44
start_time	2018-01-22 10:10:37
stop_time	2018-01-22 10:38:21

4.2.3.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	191291
%usr	0.44
%system	3.08
%guest	0.00
%CPU	3.52
CPU
minflt/s	0.16
majflt/s	0.00
VSZ	6608356
RSS	9168
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	191288
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5796
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.3.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.3.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	952811.138
tx_rate_mbps	Unknown
throughput_rx_mbps	1006.169
tx_rate_percent	5.641
throughput_rx_percent	5.793
frame_loss_percent	0.000
min_latency_ns	4180.000
max_latency_ns	4436620.000
avg_latency_ns	43363.000
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:27:44
start_time	2018-01-22 10:10:37
stop_time	2018-01-22 10:38:21

4.2.3.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	191291
%usr	0.44
%system	3.08
%guest	0.00
%CPU	3.52
CPU
minflt/s	0.16
majflt/s	0.00
VSZ	6608356
RSS	9168
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	191288
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5796
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.3.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.3.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	846600.918
tx_rate_mbps	Unknown
throughput_rx_mbps	3494.769
tx_rate_percent	18.016
throughput_rx_percent	18.151
frame_loss_percent	0.000
min_latency_ns	5280.000
max_latency_ns	514160.000
avg_latency_ns	30306.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:27:44
start_time	2018-01-22 10:10:37
stop_time	2018-01-22 10:38:21

4.2.3.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	191291
%usr	0.44
%system	3.08
%guest	0.00
%CPU	3.52
CPU
minflt/s	0.16
majflt/s	0.00
VSZ	6608356
RSS	9168
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	191288
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5796
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.3.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.3.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	746268.313
tx_rate_mbps	Unknown
throughput_rx_mbps	6137.311
tx_rate_percent	31.164
throughput_rx_percent	31.284
frame_loss_percent	0.000
min_latency_ns	5800.000
max_latency_ns	2312080.000
avg_latency_ns	34655.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:27:44
start_time	2018-01-22 10:10:37
stop_time	2018-01-22 10:38:21

4.2.3.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	191291
%usr	0.44
%system	3.08
%guest	0.00
%CPU	3.52
CPU
minflt/s	0.16
majflt/s	0.00
VSZ	6608356
RSS	9168
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	191288
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5796
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.3.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.3.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	858589.479
tx_rate_mbps	Unknown
throughput_rx_mbps	10454.185
tx_rate_percent	52.820
throughput_rx_percent	52.958
frame_loss_percent	0.000
min_latency_ns	6900.000
max_latency_ns	1050220.000
avg_latency_ns	43922.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:27:44
start_time	2018-01-22 10:10:37
stop_time	2018-01-22 10:38:21

4.2.3.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	191291
%usr	0.44
%system	3.08
%guest	0.00
%CPU	3.52
CPU
minflt/s	0.16
majflt/s	0.00
VSZ	6608356
RSS	9168
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	191288
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5796
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.3.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.3.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.4. Test ID: PVVP_BACK2BACK¶

4.2.4.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvvp_back2back
Description: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: pvvp
Traffic type: rfc2544_back2back
Bidirectional : True

4.2.4.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.4.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:43:56
start_time	2018-01-22 12:46:35
stop_time	2018-01-22 13:30:32
guest_loopback_app	testpmd testpmd

4.2.4.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	28287
%usr	0.39
%system	2.76
%guest	0.00
%CPU	3.15
CPU
minflt/s	0.14
majflt/s	0.00
VSZ	6608356
RSS	9174
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	28284
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5828
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	28843
%usr	0.15
%system	0.19
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2798772
RSS	67107
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	8.70
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	28612
%usr	0.02
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2804912
RSS	65448
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.02
kB_ccwr/s	0.00

4.2.4.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.4.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:43:56
start_time	2018-01-22 12:46:35
stop_time	2018-01-22 13:30:32
guest_loopback_app	testpmd testpmd

4.2.4.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	28287
%usr	0.39
%system	2.76
%guest	0.00
%CPU	3.15
CPU
minflt/s	0.14
majflt/s	0.00
VSZ	6608356
RSS	9174
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	28284
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5828
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	28843
%usr	0.15
%system	0.19
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2798772
RSS	67107
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	8.70
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	28612
%usr	0.02
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2804912
RSS	65448
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.02
kB_ccwr/s	0.00

4.2.4.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.4.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	537
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:43:56
start_time	2018-01-22 12:46:35
stop_time	2018-01-22 13:30:32
guest_loopback_app	testpmd testpmd

4.2.4.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	28287
%usr	0.39
%system	2.76
%guest	0.00
%CPU	3.15
CPU
minflt/s	0.14
majflt/s	0.00
VSZ	6608356
RSS	9174
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	28284
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5828
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	28843
%usr	0.15
%system	0.19
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2798772
RSS	67107
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	8.70
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	28612
%usr	0.02
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2804912
RSS	65448
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.02
kB_ccwr/s	0.00

4.2.4.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.4.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	548
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:43:56
start_time	2018-01-22 12:46:35
stop_time	2018-01-22 13:30:32
guest_loopback_app	testpmd testpmd

4.2.4.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	28287
%usr	0.39
%system	2.76
%guest	0.00
%CPU	3.15
CPU
minflt/s	0.14
majflt/s	0.00
VSZ	6608356
RSS	9174
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	28284
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5828
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	28843
%usr	0.15
%system	0.19
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2798772
RSS	67107
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	8.70
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	28612
%usr	0.02
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2804912
RSS	65448
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.02
kB_ccwr/s	0.00

4.2.4.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.4.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	372
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:43:56
start_time	2018-01-22 12:46:35
stop_time	2018-01-22 13:30:32
guest_loopback_app	testpmd testpmd

4.2.4.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	28287
%usr	0.39
%system	2.76
%guest	0.00
%CPU	3.15
CPU
minflt/s	0.14
majflt/s	0.00
VSZ	6608356
RSS	9174
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	28284
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5828
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	28843
%usr	0.15
%system	0.19
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2798772
RSS	67107
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	8.70
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	28612
%usr	0.02
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2804912
RSS	65448
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.02
kB_ccwr/s	0.00

4.2.4.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.4.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.5. Test ID: PHY2PHY_TPUT¶

4.2.5.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

Test ID: phy2phy_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: p2p
Traffic type: rfc2544_throughput
Bidirectional : True

4.2.5.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.5.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	757998.731
tx_rate_mbps	Unknown
throughput_rx_mbps	388.095
tx_rate_percent	2.547
throughput_rx_percent	2.547
frame_loss_percent	0.000
min_latency_ns	3980.000
max_latency_ns	13487060.000
avg_latency_ns	61969.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:29:34
start_time	2018-01-22 08:58:47
stop_time	2018-01-22 09:28:21

4.2.5.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	176631
%usr	0.42
%system	2.89
%guest	0.00
%CPU	3.30
CPU
minflt/s	0.17
majflt/s	0.00
VSZ	6608356
RSS	8882
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	176619
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5828
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.5.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.5.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	952811.199
tx_rate_mbps	Unknown
throughput_rx_mbps	975.679
tx_rate_percent	5.641
throughput_rx_percent	5.641
frame_loss_percent	0.000
min_latency_ns	4140.000
max_latency_ns	3692120.000
avg_latency_ns	40631.000
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:29:34
start_time	2018-01-22 08:58:47
stop_time	2018-01-22 09:28:21

4.2.5.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	176631
%usr	0.42
%system	2.89
%guest	0.00
%CPU	3.30
CPU
minflt/s	0.17
majflt/s	0.00
VSZ	6608356
RSS	8882
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	176619
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5828
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.5.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.5.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	773909.900
tx_rate_mbps	Unknown
throughput_rx_mbps	3169.935
tx_rate_percent	16.469
throughput_rx_percent	16.469
frame_loss_percent	0.000
min_latency_ns	5000.000
max_latency_ns	869640.000
avg_latency_ns	32573.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:29:34
start_time	2018-01-22 08:58:47
stop_time	2018-01-22 09:28:21

4.2.5.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	176631
%usr	0.42
%system	2.89
%guest	0.00
%CPU	3.30
CPU
minflt/s	0.17
majflt/s	0.00
VSZ	6608356
RSS	8882
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	176619
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5828
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.5.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.5.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	801831.490
tx_rate_mbps	Unknown
throughput_rx_mbps	6568.604
tx_rate_percent	33.484
throughput_rx_percent	33.484
frame_loss_percent	0.000
min_latency_ns	5720.000
max_latency_ns	1263880.000
avg_latency_ns	32937.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:29:34
start_time	2018-01-22 08:58:47
stop_time	2018-01-22 09:28:21

4.2.5.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	176631
%usr	0.42
%system	2.89
%guest	0.00
%CPU	3.30
CPU
minflt/s	0.17
majflt/s	0.00
VSZ	6608356
RSS	8882
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	176619
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5828
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.5.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.5.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	871162.063
tx_rate_mbps	Unknown
throughput_rx_mbps	10579.392
tx_rate_percent	53.594
throughput_rx_percent	53.594
frame_loss_percent	0.000
min_latency_ns	6740.000
max_latency_ns	720700.000
avg_latency_ns	37852.000
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:29:34
start_time	2018-01-22 08:58:47
stop_time	2018-01-22 09:28:21

4.2.5.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	176631
%usr	0.42
%system	2.89
%guest	0.00
%CPU	3.30
CPU
minflt/s	0.17
majflt/s	0.00
VSZ	6608356
RSS	8882
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	176619
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5828
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.5.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.5.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.6. Test ID: PHY2PHY_SCALABILITY¶

4.2.6.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

Test ID: phy2phy_scalability
Description: LTD.Scalability.Flows.RFC2544.0PacketLoss
Deployment: p2p
Traffic type: rfc2544_throughput
Bidirectional : True

4.2.6.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.6.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	758000.558
tx_rate_mbps	Unknown
throughput_rx_mbps	388.096
tx_rate_percent	2.547
throughput_rx_percent	2.547
frame_loss_percent	0.000
min_latency_ns	4000.000
max_latency_ns	3526660.000
avg_latency_ns	34101.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:27:38
start_time	2018-01-22 10:38:21
stop_time	2018-01-22 11:06:00
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.6.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	1089
%usr	0.41
%system	3.17
%guest	0.00
%CPU	3.58
CPU
minflt/s	0.32
majflt/s	0.00
VSZ	6608356
RSS	8782
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	1086
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5964
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.6.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.6.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	952810.708
tx_rate_mbps	Unknown
throughput_rx_mbps	975.678
tx_rate_percent	5.641
throughput_rx_percent	5.641
frame_loss_percent	0.000
min_latency_ns	4140.000
max_latency_ns	2331900.000
avg_latency_ns	39672.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:27:38
start_time	2018-01-22 10:38:21
stop_time	2018-01-22 11:06:00
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.6.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	1089
%usr	0.41
%system	3.17
%guest	0.00
%CPU	3.58
CPU
minflt/s	0.32
majflt/s	0.00
VSZ	6608356
RSS	8782
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	1086
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5964
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.6.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.6.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	810255.669
tx_rate_mbps	Unknown
throughput_rx_mbps	3318.807
tx_rate_percent	17.242
throughput_rx_percent	17.242
frame_loss_percent	0.000
min_latency_ns	5000.000
max_latency_ns	768900.000
avg_latency_ns	31889.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:27:38
start_time	2018-01-22 10:38:21
stop_time	2018-01-22 11:06:00
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.6.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	1089
%usr	0.41
%system	3.17
%guest	0.00
%CPU	3.58
CPU
minflt/s	0.32
majflt/s	0.00
VSZ	6608356
RSS	8782
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	1086
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5964
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.6.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.6.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	857394.697
tx_rate_mbps	Unknown
throughput_rx_mbps	7023.777
tx_rate_percent	35.805
throughput_rx_percent	35.805
frame_loss_percent	0.000
min_latency_ns	5760.000
max_latency_ns	889920.000
avg_latency_ns	33508.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:27:38
start_time	2018-01-22 10:38:21
stop_time	2018-01-22 11:06:00
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.6.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	1089
%usr	0.41
%system	3.17
%guest	0.00
%CPU	3.58
CPU
minflt/s	0.32
majflt/s	0.00
VSZ	6608356
RSS	8782
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	1086
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5964
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.6.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.6.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	871162.204
tx_rate_mbps	Unknown
throughput_rx_mbps	10579.394
tx_rate_percent	53.594
throughput_rx_percent	53.594
frame_loss_percent	0.000
min_latency_ns	7100.000
max_latency_ns	1099420.000
avg_latency_ns	48685.000
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:27:38
start_time	2018-01-22 10:38:21
stop_time	2018-01-22 11:06:00
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.6.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	1089
%usr	0.41
%system	3.17
%guest	0.00
%CPU	3.58
CPU
minflt/s	0.32
majflt/s	0.00
VSZ	6608356
RSS	8782
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	1086
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5964
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.6.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.6.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.7. Test ID: PVP_BACK2BACK¶

4.2.7.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_back2back
Description: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: pvp
Traffic type: rfc2544_back2back
Bidirectional : True

4.2.7.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.7.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	425
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:42:55
start_time	2018-01-22 11:34:28
stop_time	2018-01-22 12:17:23
guest_loopback_app	testpmd

4.2.7.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	13086
%usr	0.41
%system	3.00
%guest	0.00
%CPU	3.41
CPU
minflt/s	0.12
majflt/s	0.00
VSZ	6608356
RSS	9261
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	13083
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5684
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	13365
%usr	0.04
%system	0.10
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2804912
RSS	65284
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	8.68
kB_ccwr/s	0.00

4.2.7.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.7.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	483
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:42:55
start_time	2018-01-22 11:34:28
stop_time	2018-01-22 12:17:23
guest_loopback_app	testpmd

4.2.7.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	13086
%usr	0.41
%system	3.00
%guest	0.00
%CPU	3.41
CPU
minflt/s	0.12
majflt/s	0.00
VSZ	6608356
RSS	9261
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	13083
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5684
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	13365
%usr	0.04
%system	0.10
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2804912
RSS	65284
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	8.68
kB_ccwr/s	0.00

4.2.7.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.7.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	537
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:42:55
start_time	2018-01-22 11:34:28
stop_time	2018-01-22 12:17:23
guest_loopback_app	testpmd

4.2.7.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	13086
%usr	0.41
%system	3.00
%guest	0.00
%CPU	3.41
CPU
minflt/s	0.12
majflt/s	0.00
VSZ	6608356
RSS	9261
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	13083
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5684
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	13365
%usr	0.04
%system	0.10
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2804912
RSS	65284
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	8.68
kB_ccwr/s	0.00

4.2.7.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.7.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	548
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:42:55
start_time	2018-01-22 11:34:28
stop_time	2018-01-22 12:17:23
guest_loopback_app	testpmd

4.2.7.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	13086
%usr	0.41
%system	3.00
%guest	0.00
%CPU	3.41
CPU
minflt/s	0.12
majflt/s	0.00
VSZ	6608356
RSS	9261
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	13083
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5684
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	13365
%usr	0.04
%system	0.10
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2804912
RSS	65284
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	8.68
kB_ccwr/s	0.00

4.2.7.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.7.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	744
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:42:55
start_time	2018-01-22 11:34:28
stop_time	2018-01-22 12:17:23
guest_loopback_app	testpmd

4.2.7.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	13086
%usr	0.41
%system	3.00
%guest	0.00
%CPU	3.41
CPU
minflt/s	0.12
majflt/s	0.00
VSZ	6608356
RSS	9261
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	13083
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5684
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	13365
%usr	0.04
%system	0.10
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2804912
RSS	65284
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	8.68
kB_ccwr/s	0.00

4.2.7.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.7.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.8. Test ID: PVVP_TPUT¶

4.2.8.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvvp_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: pvvp
Traffic type: rfc2544_throughput
Bidirectional : True

4.2.8.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.8.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	293640.078
tx_rate_mbps	Unknown
throughput_rx_mbps	150.344
tx_rate_percent	1.773
throughput_rx_percent	0.987
frame_loss_percent	44.365
min_latency_ns	33140.000
max_latency_ns	70536960.000
avg_latency_ns	3868273.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:29:10
start_time	2018-01-22 12:17:24
stop_time	2018-01-22 12:46:34
guest_loopback_app	testpmd testpmd

4.2.8.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	22019
%usr	0.38
%system	2.75
%guest	0.00
%CPU	3.13
CPU
minflt/s	0.18
majflt/s	0.00
VSZ	6608356
RSS	9256
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	22016
%usr	0.01
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5792
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	22478
%usr	0.02
%system	1.28
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2800828
RSS	64927
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	13.06
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	22343
%usr	0.04
%system	1.32
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2856340
RSS	66608
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.03
kB_ccwr/s	0.00

4.2.8.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.8.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	297177.474
tx_rate_mbps	Unknown
throughput_rx_mbps	304.310
tx_rate_percent	1.773
throughput_rx_percent	1.759
frame_loss_percent	0.798
min_latency_ns	17740.000
max_latency_ns	7870880.000
avg_latency_ns	193412.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:29:10
start_time	2018-01-22 12:17:24
stop_time	2018-01-22 12:46:34
guest_loopback_app	testpmd testpmd

4.2.8.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	22019
%usr	0.38
%system	2.75
%guest	0.00
%CPU	3.13
CPU
minflt/s	0.18
majflt/s	0.00
VSZ	6608356
RSS	9256
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	22016
%usr	0.01
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5792
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	22478
%usr	0.02
%system	1.28
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2800828
RSS	64927
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	13.06
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	22343
%usr	0.04
%system	1.32
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2856340
RSS	66608
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.03
kB_ccwr/s	0.00

4.2.8.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.8.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	265067.713
tx_rate_mbps	Unknown
throughput_rx_mbps	1085.717
tx_rate_percent	5.641
throughput_rx_percent	5.641
frame_loss_percent	0.000
min_latency_ns	24660.000
max_latency_ns	652120.000
avg_latency_ns	87692.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:29:10
start_time	2018-01-22 12:17:24
stop_time	2018-01-22 12:46:34
guest_loopback_app	testpmd testpmd

4.2.8.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	22019
%usr	0.38
%system	2.75
%guest	0.00
%CPU	3.13
CPU
minflt/s	0.18
majflt/s	0.00
VSZ	6608356
RSS	9256
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	22016
%usr	0.01
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5792
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	22478
%usr	0.02
%system	1.28
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2800828
RSS	64927
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	13.06
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	22343
%usr	0.04
%system	1.32
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2856340
RSS	66608
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.03
kB_ccwr/s	0.00

4.2.8.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.8.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	320293.855
tx_rate_mbps	Unknown
throughput_rx_mbps	2623.847
tx_rate_percent	13.375
throughput_rx_percent	13.375
frame_loss_percent	0.000
min_latency_ns	30380.000
max_latency_ns	801480.000
avg_latency_ns	96019.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:29:10
start_time	2018-01-22 12:17:24
stop_time	2018-01-22 12:46:34
guest_loopback_app	testpmd testpmd

4.2.8.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	22019
%usr	0.38
%system	2.75
%guest	0.00
%CPU	3.13
CPU
minflt/s	0.18
majflt/s	0.00
VSZ	6608356
RSS	9256
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	22016
%usr	0.01
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5792
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	22478
%usr	0.02
%system	1.28
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2800828
RSS	64927
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	13.06
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	22343
%usr	0.04
%system	1.32
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2856340
RSS	66608
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.03
kB_ccwr/s	0.00

4.2.8.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.8.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	267698.684
tx_rate_mbps	Unknown
throughput_rx_mbps	3250.933
tx_rate_percent	16.469
throughput_rx_percent	16.469
frame_loss_percent	0.000
min_latency_ns	30020.000
max_latency_ns	1491080.000
avg_latency_ns	104320.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:29:10
start_time	2018-01-22 12:17:24
stop_time	2018-01-22 12:46:34
guest_loopback_app	testpmd testpmd

4.2.8.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	22019
%usr	0.38
%system	2.75
%guest	0.00
%CPU	3.13
CPU
minflt/s	0.18
majflt/s	0.00
VSZ	6608356
RSS	9256
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	22016
%usr	0.01
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5792
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	22478
%usr	0.02
%system	1.28
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2800828
RSS	64927
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	13.06
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	22343
%usr	0.04
%system	1.32
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2856340
RSS	66608
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.03
kB_ccwr/s	0.00

4.2.8.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.8.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.3. Rationale for decisions¶

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

4.4. Conclusions and recommendations¶

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-22_22-28-47/vswitchperf_logs_2018-01-22_22-28-47.tar.gz.

4.5. General¶

4.5.1. Glossary¶

NFV - Network Function Virtualization
Mbps - 1,000,000bps

4.5.2. Document change procedures and history¶

Document ID	Author	Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT	Christopher Nolan	23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT	Christopher Nolan	28/01/2015

5. Performance report for VppDpdkVhost¶

5.1. Introduction¶

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

5.1.1. Document identifier¶

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

5.1.2. Scope¶

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

5.1.3. References¶

OPNFV_vswitchperf_LTD_Brahmaputra_REVIEWED

5.2. Details of the Level Test Report¶

This section provides a test-results-overview. Also included are the rationale and the conclusions.

5.2.1. Test ID: PVP_TPUT_VPP¶

5.2.1.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_tput_vpp
Description: VPP: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: clean
Traffic type: rfc2544_throughput
Bidirectional : True

5.2.1.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

5.2.1.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4671225.850
tx_rate_mbps	Unknown
throughput_rx_mbps	2391.668
tx_rate_percent	15.695
throughput_rx_percent	15.695
frame_loss_percent	0.000
min_latency_ns	8520.000
max_latency_ns	83540.000
avg_latency_ns	15353.500
type	rfc2544_throughput
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:27:06
start_time	2018-01-22 14:28:38
stop_time	2018-01-22 14:55:45

5.2.1.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	50087
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.10
majflt/s	0.00
VSZ	9808010
RSS	50739
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

5.2.1.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	6440015.366
tx_rate_mbps	Unknown
throughput_rx_mbps	6594.576
tx_rate_percent	38.125
throughput_rx_percent	38.125
frame_loss_percent	0.000
min_latency_ns	9640.000
max_latency_ns	78920.000
avg_latency_ns	35979.000
type	rfc2544_throughput
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:27:06
start_time	2018-01-22 14:28:38
stop_time	2018-01-22 14:55:45

5.2.1.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	50087
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.10
majflt/s	0.00
VSZ	9808010
RSS	50739
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

5.2.1.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4117694.704
tx_rate_mbps	Unknown
throughput_rx_mbps	16866.078
tx_rate_percent	87.625
throughput_rx_percent	87.625
frame_loss_percent	0.000
min_latency_ns	10460.000
max_latency_ns	68940.000
avg_latency_ns	35358.500
type	rfc2544_throughput
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:27:06
start_time	2018-01-22 14:28:38
stop_time	2018-01-22 14:55:45

5.2.1.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	50087
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.10
majflt/s	0.00
VSZ	9808010
RSS	50739
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

5.2.1.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394547.797
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.136
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	15780.000
max_latency_ns	129060.000
avg_latency_ns	117397.000
type	rfc2544_throughput
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:27:06
start_time	2018-01-22 14:28:38
stop_time	2018-01-22 14:55:45

5.2.1.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	50087
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.10
majflt/s	0.00
VSZ	9808010
RSS	50739
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

5.2.1.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625439.063
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.332
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	20800.000
max_latency_ns	115820.000
avg_latency_ns	101033.500
type	rfc2544_throughput
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:27:06
start_time	2018-01-22 14:28:38
stop_time	2018-01-22 14:55:45

5.2.1.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	50087
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.10
majflt/s	0.00
VSZ	9808010
RSS	50739
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.7. Anomalies¶

No anomalies were detected during the course of this test.

5.2.1.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.2. Test ID: PVP_BACK2BACK_VPP¶

5.2.2.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_back2back_vpp
Description: VPP: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: clean
Traffic type: rfc2544_back2back
Bidirectional : True

5.2.2.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

5.2.2.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:38:37
start_time	2018-01-22 14:55:45
stop_time	2018-01-22 15:34:23

5.2.2.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	55802
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	9939675
RSS	50994
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

5.2.2.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:38:37
start_time	2018-01-22 14:55:45
stop_time	2018-01-22 15:34:23

5.2.2.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	55802
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	9939675
RSS	50994
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

5.2.2.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	13216618
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:38:37
start_time	2018-01-22 14:55:45
stop_time	2018-01-22 15:34:23

5.2.2.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	55802
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	9939675
RSS	50994
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

5.2.2.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:38:37
start_time	2018-01-22 14:55:45
stop_time	2018-01-22 15:34:23

5.2.2.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	55802
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	9939675
RSS	50994
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

5.2.2.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:38:37
start_time	2018-01-22 14:55:45
stop_time	2018-01-22 15:34:23

5.2.2.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	55802
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	9939675
RSS	50994
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.7. Anomalies¶

No anomalies were detected during the course of this test.

5.2.2.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.3. Test ID: PHY2PHY_BACK2BACK_VPP¶

5.2.3.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: phy2phy_back2back_vpp
Description: VPP: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: clean
Traffic type: rfc2544_back2back
Bidirectional : True

5.2.3.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

5.2.3.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	23841
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:34:08
start_time	2018-01-22 13:54:29
stop_time	2018-01-22 14:28:38

5.2.3.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	42985
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	3937544
RSS	50560
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

5.2.3.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	251306
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:34:08
start_time	2018-01-22 13:54:29
stop_time	2018-01-22 14:28:38

5.2.3.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	42985
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	3937544
RSS	50560
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

5.2.3.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488721
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:34:08
start_time	2018-01-22 13:54:29
stop_time	2018-01-22 14:28:38

5.2.3.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	42985
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	3937544
RSS	50560
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

5.2.3.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:34:08
start_time	2018-01-22 13:54:29
stop_time	2018-01-22 14:28:38

5.2.3.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	42985
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	3937544
RSS	50560
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

5.2.3.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:34:08
start_time	2018-01-22 13:54:29
stop_time	2018-01-22 14:28:38

5.2.3.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	42985
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	3937544
RSS	50560
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.7. Anomalies¶

No anomalies were detected during the course of this test.

5.2.3.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.4. Test ID: PVVP_BACK2BACK_VPP¶

5.2.4.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvvp_back2back_vpp
Description: VPP: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: clean
Traffic type: rfc2544_back2back
Bidirectional : True

5.2.4.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

5.2.4.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:36:23
start_time	2018-01-22 16:02:17
stop_time	2018-01-22 16:38:41

5.2.4.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	69816
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.09
majflt/s	0.00
VSZ	15497950
RSS	51229
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

5.2.4.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:36:23
start_time	2018-01-22 16:02:17
stop_time	2018-01-22 16:38:41

5.2.4.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	69816
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.09
majflt/s	0.00
VSZ	15497950
RSS	51229
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

5.2.4.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488721
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:36:23
start_time	2018-01-22 16:02:17
stop_time	2018-01-22 16:38:41

5.2.4.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	69816
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.09
majflt/s	0.00
VSZ	15497950
RSS	51229
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

5.2.4.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:36:23
start_time	2018-01-22 16:02:17
stop_time	2018-01-22 16:38:41

5.2.4.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	69816
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.09
majflt/s	0.00
VSZ	15497950
RSS	51229
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

5.2.4.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:36:23
start_time	2018-01-22 16:02:17
stop_time	2018-01-22 16:38:41

5.2.4.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	69816
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.09
majflt/s	0.00
VSZ	15497950
RSS	51229
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.7. Anomalies¶

No anomalies were detected during the course of this test.

5.2.4.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.5. Test ID: PVVP_TPUT_VPP¶

5.2.5.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvvp_tput_vpp
Description: VPP: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: clean
Traffic type: rfc2544_throughput
Bidirectional : True

5.2.5.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

5.2.5.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1908948.137
tx_rate_mbps	Unknown
throughput_rx_mbps	977.381
tx_rate_percent	6.414
throughput_rx_percent	6.414
frame_loss_percent	0.000
min_latency_ns	6120.000
max_latency_ns	55220.000
avg_latency_ns	6965.500
type	rfc2544_throughput
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:27:53
start_time	2018-01-22 15:34:23
stop_time	2018-01-22 16:02:17

5.2.5.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	63804
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.12
majflt/s	0.00
VSZ	15179592
RSS	51139
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.5.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

5.2.5.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	6701342.003
tx_rate_mbps	Unknown
throughput_rx_mbps	6862.174
tx_rate_percent	39.672
throughput_rx_percent	39.672
frame_loss_percent	0.000
min_latency_ns	9160.000
max_latency_ns	66520.000
avg_latency_ns	15424.500
type	rfc2544_throughput
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:27:53
start_time	2018-01-22 15:34:23
stop_time	2018-01-22 16:02:17

5.2.5.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	63804
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.12
majflt/s	0.00
VSZ	15179592
RSS	51139
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.5.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

5.2.5.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699006.807
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.132
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	15320.000
max_latency_ns	174340.000
avg_latency_ns	159206.500
type	rfc2544_throughput
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:27:53
start_time	2018-01-22 15:34:23
stop_time	2018-01-22 16:02:17

5.2.5.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	63804
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.12
majflt/s	0.00
VSZ	15179592
RSS	51139
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.5.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

5.2.5.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394546.200
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.122
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	20420.000
max_latency_ns	135360.000
avg_latency_ns	123288.500
type	rfc2544_throughput
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:27:53
start_time	2018-01-22 15:34:23
stop_time	2018-01-22 16:02:17

5.2.5.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	63804
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.12
majflt/s	0.00
VSZ	15179592
RSS	51139
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.5.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

5.2.5.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625444.329
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.396
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	20500.000
max_latency_ns	101720.000
avg_latency_ns	90626.000
type	rfc2544_throughput
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:27:53
start_time	2018-01-22 15:34:23
stop_time	2018-01-22 16:02:17

5.2.5.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	63804
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.12
majflt/s	0.00
VSZ	15179592
RSS	51139
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.5.7. Anomalies¶

No anomalies were detected during the course of this test.

5.2.5.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.6. Test ID: PHY2PHY_TPUT_VPP¶

5.2.6.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: phy2phy_tput_vpp
Description: VPP: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: clean
Traffic type: rfc2544_throughput
Bidirectional : True

5.2.6.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

5.2.6.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	22395929.193
tx_rate_mbps	Unknown
throughput_rx_mbps	11466.716
tx_rate_percent	75.250
throughput_rx_percent	75.250
frame_loss_percent	0.000
min_latency_ns	5540.000
max_latency_ns	58700.000
avg_latency_ns	20065.000
type	rfc2544_throughput
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:23:46
start_time	2018-01-22 13:30:43
stop_time	2018-01-22 13:54:29

5.2.6.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	37978
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	3937544
RSS	50878
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.6.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

5.2.6.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	15324200.956
tx_rate_mbps	Unknown
throughput_rx_mbps	15691.982
tx_rate_percent	90.719
throughput_rx_percent	90.719
frame_loss_percent	0.000
min_latency_ns	7160.000
max_latency_ns	489200.000
avg_latency_ns	11299.000
type	rfc2544_throughput
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:23:46
start_time	2018-01-22 13:30:43
stop_time	2018-01-22 13:54:29

5.2.6.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	37978
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	3937544
RSS	50878
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.6.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

5.2.6.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699201.579
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.930
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	10680.000
max_latency_ns	40660.000
avg_latency_ns	29661.500
type	rfc2544_throughput
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:23:46
start_time	2018-01-22 13:30:43
stop_time	2018-01-22 13:54:29

5.2.6.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	37978
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	3937544
RSS	50878
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.6.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

5.2.6.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394616.536
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.699
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	12380.000
max_latency_ns	37000.000
avg_latency_ns	26380.500
type	rfc2544_throughput
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:23:46
start_time	2018-01-22 13:30:43
stop_time	2018-01-22 13:54:29

5.2.6.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	37978
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	3937544
RSS	50878
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.6.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

5.2.6.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625475.082
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.769
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	14260.000
max_latency_ns	40880.000
avg_latency_ns	28190.500
type	rfc2544_throughput
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:23:46
start_time	2018-01-22 13:30:43
stop_time	2018-01-22 13:54:29

5.2.6.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	37978
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	3937544
RSS	50878
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.6.7. Anomalies¶

No anomalies were detected during the course of this test.

5.2.6.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.3. Rationale for decisions¶

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

5.4. Conclusions and recommendations¶

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-22_22-28-47/vswitchperf_logs_2018-01-22_22-28-47.tar.gz.

5.5. General¶

5.5.1. Glossary¶

NFV - Network Function Virtualization
Mbps - 1,000,000bps

5.5.2. Document change procedures and history¶

Document ID	Author	Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT	Christopher Nolan	23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT	Christopher Nolan	28/01/2015

6. Performance report for none¶

6.1. Introduction¶

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

6.1.1. Document identifier¶

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

6.1.2. Scope¶

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

6.1.3. References¶

OPNFV_vswitchperf_LTD_Brahmaputra_REVIEWED

6.2. Details of the Level Test Report¶

This section provides a test-results-overview. Also included are the rationale and the conclusions.

6.2.1. Test ID: PVP_TPUT¶

6.2.1.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
- Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: none, Version: None, GIT tag: None
VNF: QemuPciPassthrough, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: pvp
Traffic type: rfc2544_throughput
Bidirectional : True

6.2.1.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

6.2.1.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	263904.415
tx_rate_mbps	Unknown
throughput_rx_mbps	135.119
tx_rate_percent	1.773
throughput_rx_percent	0.887
frame_loss_percent	50.000
min_latency_ns	3440.000
max_latency_ns	22980.000
avg_latency_ns	3539.000
type	rfc2544_throughput
packet_size	64
vswitch	none
traffic_type	udp
test_execution_time	00:29:43
start_time	2018-01-22 16:38:53
stop_time	2018-01-22 17:08:36
guest_loopback_app	testpmd

6.2.1.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic	Value
UID	0
PID	77947
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2842864
RSS	78027
%MEM	0.12
kB_rd/s	0.00
kB_wr/s	12.67
kB_ccwr/s	0.00

6.2.1.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

6.2.1.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	149783.582
tx_rate_mbps	Unknown
throughput_rx_mbps	153.378
tx_rate_percent	1.773
throughput_rx_percent	0.887
frame_loss_percent	50.000
min_latency_ns	3560.000
max_latency_ns	23960.000
avg_latency_ns	3657.000
type	rfc2544_throughput
packet_size	128
vswitch	none
traffic_type	udp
test_execution_time	00:29:43
start_time	2018-01-22 16:38:53
stop_time	2018-01-22 17:08:36
guest_loopback_app	testpmd

6.2.1.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic	Value
UID	0
PID	77947
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2842864
RSS	78027
%MEM	0.12
kB_rd/s	0.00
kB_wr/s	12.67
kB_ccwr/s	0.00

6.2.1.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

6.2.1.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	41669.115
tx_rate_mbps	Unknown
throughput_rx_mbps	170.677
tx_rate_percent	1.773
throughput_rx_percent	0.887
frame_loss_percent	50.000
min_latency_ns	4240.000
max_latency_ns	32780.000
avg_latency_ns	4375.000
type	rfc2544_throughput
packet_size	512
vswitch	none
traffic_type	udp
test_execution_time	00:29:43
start_time	2018-01-22 16:38:53
stop_time	2018-01-22 17:08:36
guest_loopback_app	testpmd

6.2.1.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic	Value
UID	0
PID	77947
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2842864
RSS	78027
%MEM	0.12
kB_rd/s	0.00
kB_wr/s	12.67
kB_ccwr/s	0.00

6.2.1.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

6.2.1.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	21233.687
tx_rate_mbps	Unknown
throughput_rx_mbps	173.946
tx_rate_percent	1.773
throughput_rx_percent	0.887
frame_loss_percent	50.000
min_latency_ns	4700.000
max_latency_ns	18460.000
avg_latency_ns	4838.000
type	rfc2544_throughput
packet_size	1024
vswitch	none
traffic_type	udp
test_execution_time	00:29:43
start_time	2018-01-22 16:38:53
stop_time	2018-01-22 17:08:36
guest_loopback_app	testpmd

6.2.1.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic	Value
UID	0
PID	77947
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2842864
RSS	78027
%MEM	0.12
kB_rd/s	0.00
kB_wr/s	12.67
kB_ccwr/s	0.00

6.2.1.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

6.2.1.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	14413.504
tx_rate_mbps	Unknown
throughput_rx_mbps	175.038
tx_rate_percent	1.773
throughput_rx_percent	0.887
frame_loss_percent	50.000
min_latency_ns	5160.000
max_latency_ns	19580.000
avg_latency_ns	5291.000
type	rfc2544_throughput
packet_size	1518
vswitch	none
traffic_type	udp
test_execution_time	00:29:43
start_time	2018-01-22 16:38:53
stop_time	2018-01-22 17:08:36
guest_loopback_app	testpmd

6.2.1.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic	Value
UID	0
PID	77947
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2842864
RSS	78027
%MEM	0.12
kB_rd/s	0.00
kB_wr/s	12.67
kB_ccwr/s	0.00

6.2.1.7. Anomalies¶

No anomalies were detected during the course of this test.

6.2.1.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

6.3. Rationale for decisions¶

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

6.4. Conclusions and recommendations¶

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-22_22-28-47/vswitchperf_logs_2018-01-22_22-28-47.tar.gz.

6.5. General¶

6.5.1. Glossary¶

NFV - Network Function Virtualization
Mbps - 1,000,000bps

6.5.2. Document change procedures and history¶

Document ID	Author	Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT	Christopher Nolan	23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT	Christopher Nolan	28/01/2015