VSPERF Results¶

1. VSPERF Test Scenarios¶

Predefined Tests suitable for automated execution with CI:

Test	Definition
phy2phy_tput	PacketLossRatio for Phy2Phy
back2back	BackToBackFrames for Phy2Phy
phy2phy_tput_mod_vlan	PacketLossRatioFrameModification for Phy2Phy
phy2phy_cont	Phy2Phy blast vswitch at x% TX rate and measure throughput
pvp_cont	PVP blast vswitch at x% TX rate and measure throughput
pvvp_cont	PVVP blast vswitch at x% TX rate and measure throughput
phy2phy_scalability	Scalability0PacketLoss for Phy2Phy
pvp_tput	PacketLossRatio for PVP
pvp_back2back	BackToBackFrames for PVP
pvvp_tput	PacketLossRatio for PVVP
pvvp_back2back	BackToBackFrames for PVVP
phy2phy_cpu_load	CPU0PacketLoss for Phy2Phy
phy2phy_mem_load	Same as CPU0PacketLoss but using a memory intensive app

Deployment topologies:

Phy2Phy: Physical port -> vSwitch -> Physical port.
PVP: Physical port -> vSwitch -> VNF -> vSwitch -> Physical port.
PVVP: Physical port -> vSwitch -> VNF -> vSwitch -> VNF -> vSwitch -> Physical port.

Loopback applications in the Guest:

DPDK testpmd.
Linux Bridge.
l2fwd-module

Supported traffic generators:

Spirent Testcenter
Ixia: IxOS and IxNet.
Xena
MoonGen
Dummy
T-Rex

2. OPNFV Test Results¶

VSPERF CI jobs are run daily and sample results can be found at https://wiki.opnfv.org/display/vsperf/Vsperf+Results

Testcase names shown in the dashboard are combination of orignal testcase name from VSPERF framework and indication of used vswitch.

Example:

Testcase phy2phy_tput is executed for three vSwitch types: OvsDpdkVhost, OvsVanilla and VppDpdkVhost. In this case, following testcase names will be used in the dashboard: phy2phy_tput_ovsdpdkvhost, phy2phy_tput_ovsvanilla and phy2phy_tput_vppdpdkvhost.

In case of RFC2544 Throughput test, the recorded metric is FPS (frames per second) without packet loss. For RFC2544 Back2Back test, the recorded metric is back-to-back value (number of frames) without packet loss.

The loopback application in the VNF used for PVP and PVVP scenarios was DPDK testpmd.

Guest interface types are vhost-user for OvsDpdkVhost and VppDpdkVhost and virtio-net for OvsVanilla.

3. Performance report for OvsDpdkVhost¶

3.1. Introduction¶

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

3.1.1. Document identifier¶

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

3.1.2. Scope¶

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

3.1.3. References¶

OPNFV_vswitchperf_LTD_Brahmaputra_REVIEWED

3.2. Details of the Level Test Report¶

This section provides a test-results-overview. Also included are the rationale and the conclusions.

3.2.1. Test ID: BACK2BACK¶

3.2.1.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: back2back
Description: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: p2p
Traffic type: rfc2544_back2back
Bidirectional : True

3.2.1.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.1.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	25970
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:45
start_time	2018-01-28 11:50:01
stop_time	2018-01-28 12:59:47

3.2.1.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	97157
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43316
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	97053
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50666
RSS	6554
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.1.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	253378378
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:45
start_time	2018-01-28 11:50:01
stop_time	2018-01-28 12:59:47

3.2.1.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	97157
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43316
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	97053
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50666
RSS	6554
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.1.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488721
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:45
start_time	2018-01-28 11:50:01
stop_time	2018-01-28 12:59:47

3.2.1.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	97157
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43316
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	97053
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50666
RSS	6554
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.1.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:45
start_time	2018-01-28 11:50:01
stop_time	2018-01-28 12:59:47

3.2.1.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	97157
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43316
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	97053
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50666
RSS	6554
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.1.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:45
start_time	2018-01-28 11:50:01
stop_time	2018-01-28 12:59:47

3.2.1.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	97157
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43316
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	97053
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50666
RSS	6554
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.1.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.2. Test ID: PVP_TPUT¶

3.2.2.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: pvp
Traffic type: rfc2544_throughput
Bidirectional : True

3.2.2.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.2.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	7893901.768
tx_rate_mbps	Unknown
throughput_rx_mbps	4041.678
tx_rate_percent	26.523
throughput_rx_percent	26.523
frame_loss_percent	0.000
min_latency_ns	5880.000
max_latency_ns	42680.000
avg_latency_ns	7523.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:08:39
start_time	2018-01-28 15:15:53
stop_time	2018-01-28 16:24:32
guest_loopback_app	testpmd

3.2.2.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	138925
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666204
RSS	43596
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	138909
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6652
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	139156
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2783173
RSS	62628
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.22
kB_ccwr/s	0.00

3.2.2.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.2.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	8661055.277
tx_rate_mbps	Unknown
throughput_rx_mbps	8868.921
tx_rate_percent	51.273
throughput_rx_percent	51.273
frame_loss_percent	0.000
min_latency_ns	7640.000
max_latency_ns	68380.000
avg_latency_ns	9754.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:08:39
start_time	2018-01-28 15:15:53
stop_time	2018-01-28 16:24:32
guest_loopback_app	testpmd

3.2.2.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	138925
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666204
RSS	43596
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	138909
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6652
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	139156
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2783173
RSS	62628
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.22
kB_ccwr/s	0.00

3.2.2.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.2.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699139.488
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.675
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	46220.000
max_latency_ns	118760.000
avg_latency_ns	105897.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:08:39
start_time	2018-01-28 15:15:53
stop_time	2018-01-28 16:24:32
guest_loopback_app	testpmd

3.2.2.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	138925
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666204
RSS	43596
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	138909
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6652
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	139156
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2783173
RSS	62628
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.22
kB_ccwr/s	0.00

3.2.2.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.2.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394586.572
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.453
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	49200.000
max_latency_ns	112300.000
avg_latency_ns	101104.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:08:39
start_time	2018-01-28 15:15:53
stop_time	2018-01-28 16:24:32
guest_loopback_app	testpmd

3.2.2.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	138925
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666204
RSS	43596
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	138909
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6652
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	139156
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2783173
RSS	62628
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.22
kB_ccwr/s	0.00

3.2.2.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.2.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625463.525
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.629
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	42460.000
max_latency_ns	93440.000
avg_latency_ns	76747.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:08:39
start_time	2018-01-28 15:15:53
stop_time	2018-01-28 16:24:32
guest_loopback_app	testpmd

3.2.2.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	138925
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666204
RSS	43596
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	138909
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6652
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	139156
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2783173
RSS	62628
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.22
kB_ccwr/s	0.00

3.2.2.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.2.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.3. Test ID: PHY2PHY_TPUT_MOD_VLAN¶

3.2.3.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: phy2phy_tput_mod_vlan
Description: LTD.Throughput.RFC2544.PacketLossRatioFrameModification
Deployment: p2p
Traffic type: rfc2544_throughput
Bidirectional : True

3.2.3.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.3.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	15259986.413
tx_rate_mbps	Unknown
throughput_rx_mbps	8301.433
tx_rate_percent	51.273
throughput_rx_percent	53.715
frame_loss_percent	0.000
min_latency_ns	6640.000
max_latency_ns	506880.000
avg_latency_ns	8336.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:34
start_time	2018-01-28 12:59:47
stop_time	2018-01-28 14:11:21

3.2.3.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	111239
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43372
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	111223
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6636
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.3.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	16369328.507
tx_rate_mbps	Unknown
throughput_rx_mbps	17286.011
tx_rate_percent	96.906
throughput_rx_percent	99.526
frame_loss_percent	0.000
min_latency_ns	6480.000
max_latency_ns	318180.000
avg_latency_ns	15997.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:34
start_time	2018-01-28 12:59:47
stop_time	2018-01-28 14:11:21

3.2.3.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	111239
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43372
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	111223
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6636
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.3.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4662904.769
tx_rate_mbps	Unknown
throughput_rx_mbps	19248.471
tx_rate_percent	99.227
throughput_rx_percent	99.973
frame_loss_percent	0.000
min_latency_ns	6040.000
max_latency_ns	30780.000
avg_latency_ns	7690.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:34
start_time	2018-01-28 12:59:47
stop_time	2018-01-28 14:11:21

3.2.3.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	111239
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43372
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	111223
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6636
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.3.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2376117.044
tx_rate_mbps	Unknown
throughput_rx_mbps	19541.187
tx_rate_percent	99.227
throughput_rx_percent	99.607
frame_loss_percent	0.000
min_latency_ns	6520.000
max_latency_ns	31420.000
avg_latency_ns	7759.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:34
start_time	2018-01-28 12:59:47
stop_time	2018-01-28 14:11:21

3.2.3.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	111239
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43372
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	111223
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6636
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.3.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1612916.479
tx_rate_mbps	Unknown
throughput_rx_mbps	19638.871
tx_rate_percent	99.227
throughput_rx_percent	99.485
frame_loss_percent	0.000
min_latency_ns	7740.000
max_latency_ns	24400.000
avg_latency_ns	8866.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:34
start_time	2018-01-28 12:59:47
stop_time	2018-01-28 14:11:21

3.2.3.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	111239
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43372
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	111223
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6636
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.3.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.4. Test ID: PVVP_BACK2BACK¶

3.2.4.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvvp_back2back
Description: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: pvvp
Traffic type: rfc2544_back2back
Bidirectional : True

3.2.4.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.4.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	1277
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:12:21
start_time	2018-01-28 18:45:57
stop_time	2018-01-28 19:58:18
guest_loopback_app	testpmd testpmd

3.2.4.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	181828
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957725
RSS	43659
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	181812
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6648
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	182302
%usr	0.19
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2871592
RSS	66772
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.16
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	182167
%usr	0.33
%system	0.19
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2781156
RSS	66640
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.4.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.4.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	966
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:12:21
start_time	2018-01-28 18:45:57
stop_time	2018-01-28 19:58:18
guest_loopback_app	testpmd testpmd

3.2.4.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	181828
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957725
RSS	43659
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	181812
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6648
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	182302
%usr	0.19
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2871592
RSS	66772
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.16
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	182167
%usr	0.33
%system	0.19
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2781156
RSS	66640
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.4.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.4.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488721
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:12:21
start_time	2018-01-28 18:45:57
stop_time	2018-01-28 19:58:18
guest_loopback_app	testpmd testpmd

3.2.4.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	181828
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957725
RSS	43659
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	181812
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6648
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	182302
%usr	0.19
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2871592
RSS	66772
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.16
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	182167
%usr	0.33
%system	0.19
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2781156
RSS	66640
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.4.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.4.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:12:21
start_time	2018-01-28 18:45:57
stop_time	2018-01-28 19:58:18
guest_loopback_app	testpmd testpmd

3.2.4.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	181828
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957725
RSS	43659
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	181812
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6648
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	182302
%usr	0.19
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2871592
RSS	66772
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.16
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	182167
%usr	0.33
%system	0.19
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2781156
RSS	66640
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.4.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.4.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:12:21
start_time	2018-01-28 18:45:57
stop_time	2018-01-28 19:58:18
guest_loopback_app	testpmd testpmd

3.2.4.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	181828
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957725
RSS	43659
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	181812
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6648
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	182302
%usr	0.19
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2871592
RSS	66772
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.16
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	182167
%usr	0.33
%system	0.19
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2781156
RSS	66640
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.4.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.4.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.5. Test ID: PHY2PHY_TPUT¶

3.2.5.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: phy2phy_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: p2p
Traffic type: rfc2544_throughput
Bidirectional : True

3.2.5.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.5.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	19173300.527
tx_rate_mbps	Unknown
throughput_rx_mbps	9816.730
tx_rate_percent	64.422
throughput_rx_percent	64.422
frame_loss_percent	0.000
min_latency_ns	5340.000
max_latency_ns	547440.000
avg_latency_ns	7160.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:55:28
start_time	2018-01-28 10:54:32
stop_time	2018-01-28 11:50:00

3.2.5.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	85821
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300996
RSS	43311
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	85805
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6628
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.5.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.5.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	15193508.168
tx_rate_mbps	Unknown
throughput_rx_mbps	15558.152
tx_rate_percent	89.945
throughput_rx_percent	89.945
frame_loss_percent	0.000
min_latency_ns	5300.000
max_latency_ns	283680.000
avg_latency_ns	8642.000
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:55:28
start_time	2018-01-28 10:54:32
stop_time	2018-01-28 11:50:00

3.2.5.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	85821
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300996
RSS	43311
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	85805
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6628
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.5.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.5.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699195.266
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.904
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	29040.000
max_latency_ns	66000.000
avg_latency_ns	52586.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:55:28
start_time	2018-01-28 10:54:32
stop_time	2018-01-28 11:50:00

3.2.5.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	85821
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300996
RSS	43311
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	85805
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6628
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.5.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.5.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394605.792
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.611
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	35640.000
max_latency_ns	74140.000
avg_latency_ns	63623.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:55:28
start_time	2018-01-28 10:54:32
stop_time	2018-01-28 11:50:00

3.2.5.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	85821
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300996
RSS	43311
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	85805
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6628
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.5.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.5.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625469.832
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.706
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	34060.000
max_latency_ns	67940.000
avg_latency_ns	56670.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:55:28
start_time	2018-01-28 10:54:32
stop_time	2018-01-28 11:50:00

3.2.5.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	85821
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300996
RSS	43311
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	85805
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6628
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.5.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.5.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.6. Test ID: PHY2PHY_SCALABILITY¶

3.2.6.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: phy2phy_scalability
Description: LTD.Scalability.Flows.RFC2544.0PacketLoss
Deployment: p2p
Traffic type: rfc2544_throughput
Bidirectional : True

3.2.6.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.6.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	18482684.731
tx_rate_mbps	Unknown
throughput_rx_mbps	9463.135
tx_rate_percent	62.102
throughput_rx_percent	62.102
frame_loss_percent	0.000
min_latency_ns	5820.000
max_latency_ns	70100.000
avg_latency_ns	10831.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:04:30
start_time	2018-01-28 14:11:22
stop_time	2018-01-28 15:15:52
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.6.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	125732
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8301016
RSS	43579
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	125716
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6604
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.6.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.6.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	14801530.138
tx_rate_mbps	Unknown
throughput_rx_mbps	15156.767
tx_rate_percent	87.625
throughput_rx_percent	87.625
frame_loss_percent	0.000
min_latency_ns	7080.000
max_latency_ns	19900.000
avg_latency_ns	9226.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:04:30
start_time	2018-01-28 14:11:22
stop_time	2018-01-28 15:15:52
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.6.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	125732
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8301016
RSS	43579
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	125716
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6604
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.6.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.6.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699190.959
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.886
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	36100.000
max_latency_ns	73000.000
avg_latency_ns	62375.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:04:30
start_time	2018-01-28 14:11:22
stop_time	2018-01-28 15:15:52
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.6.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	125732
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8301016
RSS	43579
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	125716
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6604
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.6.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.6.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394606.766
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.619
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	40900.000
max_latency_ns	78220.000
avg_latency_ns	67411.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:04:30
start_time	2018-01-28 14:11:22
stop_time	2018-01-28 15:15:52
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.6.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	125732
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8301016
RSS	43579
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	125716
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6604
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.6.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.6.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625468.250
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.686
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	37800.000
max_latency_ns	74640.000
avg_latency_ns	63553.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:04:30
start_time	2018-01-28 14:11:22
stop_time	2018-01-28 15:15:52
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.6.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	125732
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8301016
RSS	43579
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	125716
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6604
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.6.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.6.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.7. Test ID: PVP_BACK2BACK¶

3.2.7.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_back2back
Description: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: pvp
Traffic type: rfc2544_back2back
Bidirectional : True

3.2.7.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.7.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	2128
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:56
start_time	2018-01-28 16:24:33
stop_time	2018-01-28 17:36:29
guest_loopback_app	testpmd

3.2.7.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	152904
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666176
RSS	43344
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	152888
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6652
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	153234
%usr	0.18
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2868536
RSS	67612
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.04
kB_ccwr/s	0.00

3.2.7.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.7.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	1449
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:56
start_time	2018-01-28 16:24:33
stop_time	2018-01-28 17:36:29
guest_loopback_app	testpmd

3.2.7.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	152904
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666176
RSS	43344
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	152888
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6652
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	153234
%usr	0.18
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2868536
RSS	67612
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.04
kB_ccwr/s	0.00

3.2.7.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.7.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488721
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:56
start_time	2018-01-28 16:24:33
stop_time	2018-01-28 17:36:29
guest_loopback_app	testpmd

3.2.7.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	152904
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666176
RSS	43344
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	152888
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6652
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	153234
%usr	0.18
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2868536
RSS	67612
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.04
kB_ccwr/s	0.00

3.2.7.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.7.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:56
start_time	2018-01-28 16:24:33
stop_time	2018-01-28 17:36:29
guest_loopback_app	testpmd

3.2.7.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	152904
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666176
RSS	43344
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	152888
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6652
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	153234
%usr	0.18
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2868536
RSS	67612
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.04
kB_ccwr/s	0.00

3.2.7.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.7.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:11:56
start_time	2018-01-28 16:24:33
stop_time	2018-01-28 17:36:29
guest_loopback_app	testpmd

3.2.7.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	152904
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666176
RSS	43344
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	152888
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6652
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	153234
%usr	0.18
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2868536
RSS	67612
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.04
kB_ccwr/s	0.00

3.2.7.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.7.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.8. Test ID: PVVP_TPUT¶

3.2.8.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvvp_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: pvvp
Traffic type: rfc2544_throughput
Bidirectional : True

3.2.8.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.8.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	7663757.390
tx_rate_mbps	Unknown
throughput_rx_mbps	3923.844
tx_rate_percent	25.750
throughput_rx_percent	25.750
frame_loss_percent	0.000
min_latency_ns	10060.000
max_latency_ns	50960.000
avg_latency_ns	13301.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:26
start_time	2018-01-28 17:36:30
stop_time	2018-01-28 18:45:57
guest_loopback_app	testpmd testpmd

3.2.8.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	167564
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957652
RSS	43404
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	167548
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50676
RSS	6504
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	168035
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2830368
RSS	67344
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.45
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	167899
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2785268
RSS	67136
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.8.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.8.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	6440046.900
tx_rate_mbps	Unknown
throughput_rx_mbps	6594.608
tx_rate_percent	38.125
throughput_rx_percent	38.125
frame_loss_percent	0.000
min_latency_ns	9640.000
max_latency_ns	54860.000
avg_latency_ns	12435.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:26
start_time	2018-01-28 17:36:30
stop_time	2018-01-28 18:45:57
guest_loopback_app	testpmd testpmd

3.2.8.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	167564
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957652
RSS	43404
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	167548
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50676
RSS	6504
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	168035
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2830368
RSS	67344
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.45
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	167899
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2785268
RSS	67136
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.8.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.8.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699113.127
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.567
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	68620.000
max_latency_ns	159460.000
avg_latency_ns	145782.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:26
start_time	2018-01-28 17:36:30
stop_time	2018-01-28 18:45:57
guest_loopback_app	testpmd testpmd

3.2.8.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	167564
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957652
RSS	43404
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	167548
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50676
RSS	6504
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	168035
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2830368
RSS	67344
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.45
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	167899
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2785268
RSS	67136
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.8.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.8.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394580.330
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.402
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	69420.000
max_latency_ns	151340.000
avg_latency_ns	135259.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:26
start_time	2018-01-28 17:36:30
stop_time	2018-01-28 18:45:57
guest_loopback_app	testpmd testpmd

3.2.8.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	167564
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957652
RSS	43404
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	167548
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50676
RSS	6504
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	168035
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2830368
RSS	67344
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.45
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	167899
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2785268
RSS	67136
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.8.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.8.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625451.080
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.478
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	70220.000
max_latency_ns	140640.000
avg_latency_ns	129620.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:09:26
start_time	2018-01-28 17:36:30
stop_time	2018-01-28 18:45:57
guest_loopback_app	testpmd testpmd

3.2.8.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	167564
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957652
RSS	43404
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	167548
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50676
RSS	6504
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	168035
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2830368
RSS	67344
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.45
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	167899
%usr	0.05
%system	0.03
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2785268
RSS	67136
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.8.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.8.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.3. Rationale for decisions¶

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

3.4. Conclusions and recommendations¶

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-28_18-54-25/vswitchperf_logs_2018-01-28_18-54-25.tar.gz.

3.5. General¶

3.5.1. Glossary¶

NFV - Network Function Virtualization
Mbps - 1,000,000bps

3.5.2. Document change procedures and history¶

Document ID	Author	Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT	Christopher Nolan	23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT	Christopher Nolan	28/01/2015

4. Performance report for OvsVanilla¶

4.1. Introduction¶

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

4.1.1. Document identifier¶

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

4.1.2. Scope¶

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

4.1.3. References¶

OPNFV_vswitchperf_LTD_Brahmaputra_REVIEWED

4.2. Details of the Level Test Report¶

This section provides a test-results-overview. Also included are the rationale and the conclusions.

4.2.1. Test ID: BACK2BACK¶

4.2.1.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

Test ID: back2back
Description: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: p2p
Traffic type: rfc2544_back2back
Bidirectional : True

4.2.1.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.1.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	5108
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:14:59
start_time	2018-01-28 21:12:13
stop_time	2018-01-28 22:27:12

4.2.1.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	15810
%usr	0.44
%system	3.01
%guest	0.00
%CPU	3.45
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608352
RSS	9135
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	15807
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5972
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.1.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	3382
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:14:59
start_time	2018-01-28 21:12:13
stop_time	2018-01-28 22:27:12

4.2.1.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	15810
%usr	0.44
%system	3.01
%guest	0.00
%CPU	3.45
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608352
RSS	9135
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	15807
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5972
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.1.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	1344
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:14:59
start_time	2018-01-28 21:12:13
stop_time	2018-01-28 22:27:12

4.2.1.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	15810
%usr	0.44
%system	3.01
%guest	0.00
%CPU	3.45
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608352
RSS	9135
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	15807
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5972
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.1.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	1096
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:14:59
start_time	2018-01-28 21:12:13
stop_time	2018-01-28 22:27:12

4.2.1.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	15810
%usr	0.44
%system	3.01
%guest	0.00
%CPU	3.45
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608352
RSS	9135
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	15807
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5972
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.1.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	1116
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:14:59
start_time	2018-01-28 21:12:13
stop_time	2018-01-28 22:27:12

4.2.1.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	15810
%usr	0.44
%system	3.01
%guest	0.00
%CPU	3.45
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608352
RSS	9135
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	15807
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5972
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.1.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.2. Test ID: PVP_TPUT¶

4.2.2.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: pvp
Traffic type: rfc2544_throughput
Bidirectional : True

4.2.2.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.2.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	500520.332
tx_rate_mbps	Unknown
throughput_rx_mbps	256.266
tx_rate_percent	1.773
throughput_rx_percent	1.682
frame_loss_percent	5.170
min_latency_ns	13700.000
max_latency_ns	5163480.000
avg_latency_ns	871007.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:12:17
start_time	2018-01-29 00:48:19
stop_time	2018-01-29 02:00:36
guest_loopback_app	testpmd

4.2.2.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	58771
%usr	0.42
%system	3.03
%guest	0.00
%CPU	3.45
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	6608352
RSS	9213
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	58768
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5764
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	59045
%usr	0.06
%system	0.55
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2799919
RSS	67200
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.18
kB_ccwr/s	0.00

4.2.2.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.2.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	299567.454
tx_rate_mbps	Unknown
throughput_rx_mbps	306.757
tx_rate_percent	1.773
throughput_rx_percent	1.773
frame_loss_percent	0.000
min_latency_ns	11040.000
max_latency_ns	321800.000
avg_latency_ns	59539.000
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:12:17
start_time	2018-01-29 00:48:19
stop_time	2018-01-29 02:00:36
guest_loopback_app	testpmd

4.2.2.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	58771
%usr	0.42
%system	3.03
%guest	0.00
%CPU	3.45
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	6608352
RSS	9213
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	58768
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5764
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	59045
%usr	0.06
%system	0.55
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2799919
RSS	67200
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.18
kB_ccwr/s	0.00

4.2.2.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.2.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	337758.532
tx_rate_mbps	Unknown
throughput_rx_mbps	1383.459
tx_rate_percent	7.188
throughput_rx_percent	7.188
frame_loss_percent	0.000
min_latency_ns	14140.000
max_latency_ns	744360.000
avg_latency_ns	81339.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:12:17
start_time	2018-01-29 00:48:19
stop_time	2018-01-29 02:00:36
guest_loopback_app	testpmd

4.2.2.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	58771
%usr	0.42
%system	3.03
%guest	0.00
%CPU	3.45
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	6608352
RSS	9213
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	58768
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5764
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	59045
%usr	0.06
%system	0.55
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2799919
RSS	67200
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.18
kB_ccwr/s	0.00

4.2.2.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.2.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	338803.541
tx_rate_mbps	Unknown
throughput_rx_mbps	2775.479
tx_rate_percent	14.148
throughput_rx_percent	14.148
frame_loss_percent	0.000
min_latency_ns	15420.000
max_latency_ns	671860.000
avg_latency_ns	83794.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:12:17
start_time	2018-01-29 00:48:19
stop_time	2018-01-29 02:00:36
guest_loopback_app	testpmd

4.2.2.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	58771
%usr	0.42
%system	3.03
%guest	0.00
%CPU	3.45
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	6608352
RSS	9213
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	58768
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5764
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	59045
%usr	0.06
%system	0.55
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2799919
RSS	67200
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.18
kB_ccwr/s	0.00

4.2.2.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.2.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	330558.084
tx_rate_mbps	Unknown
throughput_rx_mbps	4014.297
tx_rate_percent	20.336
throughput_rx_percent	20.336
frame_loss_percent	0.000
min_latency_ns	12220.000
max_latency_ns	1023220.000
avg_latency_ns	82020.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:12:17
start_time	2018-01-29 00:48:19
stop_time	2018-01-29 02:00:36
guest_loopback_app	testpmd

4.2.2.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	58771
%usr	0.42
%system	3.03
%guest	0.00
%CPU	3.45
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	6608352
RSS	9213
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	58768
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5764
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	59045
%usr	0.06
%system	0.55
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2799919
RSS	67200
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.18
kB_ccwr/s	0.00

4.2.2.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.2.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.3. Test ID: PHY2PHY_TPUT_MOD_VLAN¶

4.2.3.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

Test ID: phy2phy_tput_mod_vlan
Description: LTD.Throughput.RFC2544.PacketLossRatioFrameModification
Deployment: p2p
Traffic type: rfc2544_throughput
Bidirectional : True

4.2.3.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.3.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	988191.008
tx_rate_mbps	Unknown
throughput_rx_mbps	537.576
tx_rate_percent	3.320
throughput_rx_percent	3.478
frame_loss_percent	0.000
min_latency_ns	4020.000
max_latency_ns	5759540.000
avg_latency_ns	97811.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:09:25
start_time	2018-01-28 22:27:13
stop_time	2018-01-28 23:36:38

4.2.3.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	30692
%usr	0.42
%system	3.16
%guest	0.00
%CPU	3.58
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608356
RSS	9079
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	30689
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5968
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.3.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.3.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	952810.836
tx_rate_mbps	Unknown
throughput_rx_mbps	1006.168
tx_rate_percent	5.641
throughput_rx_percent	5.793
frame_loss_percent	0.000
min_latency_ns	4160.000
max_latency_ns	4221660.000
avg_latency_ns	45137.000
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:09:25
start_time	2018-01-28 22:27:13
stop_time	2018-01-28 23:36:38

4.2.3.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	30692
%usr	0.42
%system	3.16
%guest	0.00
%CPU	3.58
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608356
RSS	9079
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	30689
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5968
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.3.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.3.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	846601.334
tx_rate_mbps	Unknown
throughput_rx_mbps	3494.770
tx_rate_percent	18.016
throughput_rx_percent	18.151
frame_loss_percent	0.000
min_latency_ns	5100.000
max_latency_ns	2772300.000
avg_latency_ns	33629.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:09:25
start_time	2018-01-28 22:27:13
stop_time	2018-01-28 23:36:38

4.2.3.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	30692
%usr	0.42
%system	3.16
%guest	0.00
%CPU	3.58
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608356
RSS	9079
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	30689
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5968
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.3.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.3.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	801830.576
tx_rate_mbps	Unknown
throughput_rx_mbps	6594.255
tx_rate_percent	33.484
throughput_rx_percent	33.613
frame_loss_percent	0.000
min_latency_ns	5780.000
max_latency_ns	669600.000
avg_latency_ns	31603.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:09:25
start_time	2018-01-28 22:27:13
stop_time	2018-01-28 23:36:38

4.2.3.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	30692
%usr	0.42
%system	3.16
%guest	0.00
%CPU	3.58
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608356
RSS	9079
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	30689
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5968
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.3.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.3.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	858589.230
tx_rate_mbps	Unknown
throughput_rx_mbps	10454.182
tx_rate_percent	52.820
throughput_rx_percent	52.958
frame_loss_percent	0.000
min_latency_ns	7060.000
max_latency_ns	1015960.000
avg_latency_ns	44151.000
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:09:25
start_time	2018-01-28 22:27:13
stop_time	2018-01-28 23:36:38

4.2.3.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	30692
%usr	0.42
%system	3.16
%guest	0.00
%CPU	3.58
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608356
RSS	9079
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	30689
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5968
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.3.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.3.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.4. Test ID: PVVP_BACK2BACK¶

4.2.4.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvvp_back2back
Description: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: pvvp
Traffic type: rfc2544_back2back
Bidirectional : True

4.2.4.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.4.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:18:26
start_time	2018-01-29 04:29:23
stop_time	2018-01-29 05:47:50
guest_loopback_app	testpmd testpmd

4.2.4.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	108175
%usr	0.41
%system	3.12
%guest	0.00
%CPU	3.53
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	6608356
RSS	9074
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	108172
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5944
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	108739
%usr	0.05
%system	0.09
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2794508
RSS	66376
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.27
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	108501
%usr	0.02
%system	0.05
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2822416
RSS	64260
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.4.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.4.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:18:26
start_time	2018-01-29 04:29:23
stop_time	2018-01-29 05:47:50
guest_loopback_app	testpmd testpmd

4.2.4.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	108175
%usr	0.41
%system	3.12
%guest	0.00
%CPU	3.53
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	6608356
RSS	9074
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	108172
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5944
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	108739
%usr	0.05
%system	0.09
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2794508
RSS	66376
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.27
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	108501
%usr	0.02
%system	0.05
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2822416
RSS	64260
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.4.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.4.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	537
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:18:26
start_time	2018-01-29 04:29:23
stop_time	2018-01-29 05:47:50
guest_loopback_app	testpmd testpmd

4.2.4.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	108175
%usr	0.41
%system	3.12
%guest	0.00
%CPU	3.53
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	6608356
RSS	9074
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	108172
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5944
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	108739
%usr	0.05
%system	0.09
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2794508
RSS	66376
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.27
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	108501
%usr	0.02
%system	0.05
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2822416
RSS	64260
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.4.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.4.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	274
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:18:26
start_time	2018-01-29 04:29:23
stop_time	2018-01-29 05:47:50
guest_loopback_app	testpmd testpmd

4.2.4.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	108175
%usr	0.41
%system	3.12
%guest	0.00
%CPU	3.53
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	6608356
RSS	9074
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	108172
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5944
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	108739
%usr	0.05
%system	0.09
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2794508
RSS	66376
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.27
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	108501
%usr	0.02
%system	0.05
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2822416
RSS	64260
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.4.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.4.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	372
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:18:26
start_time	2018-01-29 04:29:23
stop_time	2018-01-29 05:47:50
guest_loopback_app	testpmd testpmd

4.2.4.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	108175
%usr	0.41
%system	3.12
%guest	0.00
%CPU	3.53
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	6608356
RSS	9074
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	108172
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5944
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	108739
%usr	0.05
%system	0.09
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2794508
RSS	66376
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.27
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	108501
%usr	0.02
%system	0.05
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2822416
RSS	64260
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.4.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.4.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.5. Test ID: PHY2PHY_TPUT¶

4.2.5.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

Test ID: phy2phy_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: p2p
Traffic type: rfc2544_throughput
Bidirectional : True

4.2.5.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.5.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	988192.581
tx_rate_mbps	Unknown
throughput_rx_mbps	505.955
tx_rate_percent	3.320
throughput_rx_percent	3.320
frame_loss_percent	0.000
min_latency_ns	3980.000
max_latency_ns	2978580.000
avg_latency_ns	41935.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:13:45
start_time	2018-01-28 19:58:27
stop_time	2018-01-28 21:12:13

4.2.5.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	1041
%usr	0.41
%system	3.12
%guest	0.00
%CPU	3.53
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	6608352
RSS	8874
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	1027
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5972
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.5.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.5.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	952811.864
tx_rate_mbps	Unknown
throughput_rx_mbps	975.679
tx_rate_percent	5.641
throughput_rx_percent	5.641
frame_loss_percent	0.000
min_latency_ns	4120.000
max_latency_ns	3694880.000
avg_latency_ns	42357.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:13:45
start_time	2018-01-28 19:58:27
stop_time	2018-01-28 21:12:13

4.2.5.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	1041
%usr	0.41
%system	3.12
%guest	0.00
%CPU	3.53
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	6608352
RSS	8874
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	1027
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5972
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.5.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.5.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	773909.598
tx_rate_mbps	Unknown
throughput_rx_mbps	3169.934
tx_rate_percent	16.469
throughput_rx_percent	16.469
frame_loss_percent	0.000
min_latency_ns	5000.000
max_latency_ns	357160.000
avg_latency_ns	32469.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:13:45
start_time	2018-01-28 19:58:27
stop_time	2018-01-28 21:12:13

4.2.5.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	1041
%usr	0.41
%system	3.12
%guest	0.00
%CPU	3.53
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	6608352
RSS	8874
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	1027
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5972
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.5.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.5.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	820353.126
tx_rate_mbps	Unknown
throughput_rx_mbps	6720.333
tx_rate_percent	34.258
throughput_rx_percent	34.258
frame_loss_percent	0.000
min_latency_ns	5780.000
max_latency_ns	1991800.000
avg_latency_ns	32446.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:13:45
start_time	2018-01-28 19:58:27
stop_time	2018-01-28 21:12:13

4.2.5.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	1041
%usr	0.41
%system	3.12
%guest	0.00
%CPU	3.53
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	6608352
RSS	8874
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	1027
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5972
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.5.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.5.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	883732.955
tx_rate_mbps	Unknown
throughput_rx_mbps	10732.053
tx_rate_percent	54.367
throughput_rx_percent	54.367
frame_loss_percent	0.000
min_latency_ns	9020.000
max_latency_ns	1030160.000
avg_latency_ns	53343.000
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:13:45
start_time	2018-01-28 19:58:27
stop_time	2018-01-28 21:12:13

4.2.5.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	1041
%usr	0.41
%system	3.12
%guest	0.00
%CPU	3.53
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	6608352
RSS	8874
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	1027
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5972
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.5.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.5.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.6. Test ID: PHY2PHY_SCALABILITY¶

4.2.6.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

Test ID: phy2phy_scalability
Description: LTD.Scalability.Flows.RFC2544.0PacketLoss
Deployment: p2p
Traffic type: rfc2544_throughput
Bidirectional : True

4.2.6.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.6.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	988191.598
tx_rate_mbps	Unknown
throughput_rx_mbps	505.954
tx_rate_percent	3.320
throughput_rx_percent	3.320
frame_loss_percent	0.000
min_latency_ns	3980.000
max_latency_ns	3380500.000
avg_latency_ns	46328.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:40
start_time	2018-01-28 23:36:39
stop_time	2018-01-29 00:48:19
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.6.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	44495
%usr	0.42
%system	3.18
%guest	0.00
%CPU	3.60
CPU
minflt/s	0.14
majflt/s	0.00
VSZ	6608352
RSS	8791
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	44492
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5800
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.6.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.6.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	952811.234
tx_rate_mbps	Unknown
throughput_rx_mbps	975.679
tx_rate_percent	5.641
throughput_rx_percent	5.641
frame_loss_percent	0.000
min_latency_ns	4160.000
max_latency_ns	2841080.000
avg_latency_ns	38813.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:40
start_time	2018-01-28 23:36:39
stop_time	2018-01-29 00:48:19
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.6.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	44495
%usr	0.42
%system	3.18
%guest	0.00
%CPU	3.60
CPU
minflt/s	0.14
majflt/s	0.00
VSZ	6608352
RSS	8791
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	44492
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5800
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.6.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.6.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	810256.501
tx_rate_mbps	Unknown
throughput_rx_mbps	3318.811
tx_rate_percent	17.242
throughput_rx_percent	17.242
frame_loss_percent	0.000
min_latency_ns	5000.000
max_latency_ns	790520.000
avg_latency_ns	31518.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:40
start_time	2018-01-28 23:36:39
stop_time	2018-01-29 00:48:19
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.6.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	44495
%usr	0.42
%system	3.18
%guest	0.00
%CPU	3.60
CPU
minflt/s	0.14
majflt/s	0.00
VSZ	6608352
RSS	8791
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	44492
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5800
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.6.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.6.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	857394.826
tx_rate_mbps	Unknown
throughput_rx_mbps	7023.778
tx_rate_percent	35.805
throughput_rx_percent	35.805
frame_loss_percent	0.000
min_latency_ns	5780.000
max_latency_ns	874700.000
avg_latency_ns	32750.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:40
start_time	2018-01-28 23:36:39
stop_time	2018-01-29 00:48:19
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.6.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	44495
%usr	0.42
%system	3.18
%guest	0.00
%CPU	3.60
CPU
minflt/s	0.14
majflt/s	0.00
VSZ	6608352
RSS	8791
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	44492
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5800
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.6.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.6.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	820878.585
tx_rate_mbps	Unknown
throughput_rx_mbps	9968.750
tx_rate_percent	50.500
throughput_rx_percent	50.500
frame_loss_percent	0.000
min_latency_ns	7160.000
max_latency_ns	317060.000
avg_latency_ns	36017.000
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:40
start_time	2018-01-28 23:36:39
stop_time	2018-01-29 00:48:19
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.6.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	44495
%usr	0.42
%system	3.18
%guest	0.00
%CPU	3.60
CPU
minflt/s	0.14
majflt/s	0.00
VSZ	6608352
RSS	8791
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	44492
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5800
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.6.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.6.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.7. Test ID: PVP_BACK2BACK¶

4.2.7.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_back2back
Description: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: pvp
Traffic type: rfc2544_back2back
Bidirectional : True

4.2.7.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.7.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	425
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:17:15
start_time	2018-01-29 02:00:37
stop_time	2018-01-29 03:17:52
guest_loopback_app	testpmd

4.2.7.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	73359
%usr	0.41
%system	3.05
%guest	0.00
%CPU	3.46
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	6608356
RSS	9179
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	73356
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5836
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	73634
%usr	0.16
%system	0.12
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2837836
RSS	66148
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.80
kB_ccwr/s	0.00

4.2.7.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.7.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:17:15
start_time	2018-01-29 02:00:37
stop_time	2018-01-29 03:17:52
guest_loopback_app	testpmd

4.2.7.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	73359
%usr	0.41
%system	3.05
%guest	0.00
%CPU	3.46
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	6608356
RSS	9179
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	73356
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5836
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	73634
%usr	0.16
%system	0.12
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2837836
RSS	66148
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.80
kB_ccwr/s	0.00

4.2.7.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.7.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	268
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:17:15
start_time	2018-01-29 02:00:37
stop_time	2018-01-29 03:17:52
guest_loopback_app	testpmd

4.2.7.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	73359
%usr	0.41
%system	3.05
%guest	0.00
%CPU	3.46
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	6608356
RSS	9179
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	73356
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5836
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	73634
%usr	0.16
%system	0.12
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2837836
RSS	66148
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.80
kB_ccwr/s	0.00

4.2.7.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.7.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:17:15
start_time	2018-01-29 02:00:37
stop_time	2018-01-29 03:17:52
guest_loopback_app	testpmd

4.2.7.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	73359
%usr	0.41
%system	3.05
%guest	0.00
%CPU	3.46
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	6608356
RSS	9179
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	73356
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5836
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	73634
%usr	0.16
%system	0.12
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2837836
RSS	66148
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.80
kB_ccwr/s	0.00

4.2.7.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.7.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:17:15
start_time	2018-01-29 02:00:37
stop_time	2018-01-29 03:17:52
guest_loopback_app	testpmd

4.2.7.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	73359
%usr	0.41
%system	3.05
%guest	0.00
%CPU	3.46
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	6608356
RSS	9179
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	73356
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5836
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	73634
%usr	0.16
%system	0.12
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2837836
RSS	66148
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	4.80
kB_ccwr/s	0.00

4.2.7.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.7.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.8. Test ID: PVVP_TPUT¶

4.2.8.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvvp_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: pvvp
Traffic type: rfc2544_throughput
Bidirectional : True

4.2.8.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.8.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	495596.876
tx_rate_mbps	Unknown
throughput_rx_mbps	253.746
tx_rate_percent	1.773
throughput_rx_percent	1.665
frame_loss_percent	6.104
min_latency_ns	29340.000
max_latency_ns	4006360.000
avg_latency_ns	1302835.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:29
start_time	2018-01-29 03:17:53
stop_time	2018-01-29 04:29:23
guest_loopback_app	testpmd testpmd

4.2.8.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	88842
%usr	0.41
%system	2.96
%guest	0.00
%CPU	3.37
CPU
minflt/s	0.09
majflt/s	0.00
VSZ	6608356
RSS	9126
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	88839
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5664
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	94195
%usr	0.26
%system	0.62
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2843896
RSS	67036
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.09
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	89169
%usr	0.02
%system	0.53
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2843967
RSS	64700
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.8.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.8.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	430218.170
tx_rate_mbps	Unknown
throughput_rx_mbps	440.543
tx_rate_percent	2.547
throughput_rx_percent	2.547
frame_loss_percent	0.000
min_latency_ns	28960.000
max_latency_ns	1017380.000
avg_latency_ns	134213.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:29
start_time	2018-01-29 03:17:53
stop_time	2018-01-29 04:29:23
guest_loopback_app	testpmd testpmd

4.2.8.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	88842
%usr	0.41
%system	2.96
%guest	0.00
%CPU	3.37
CPU
minflt/s	0.09
majflt/s	0.00
VSZ	6608356
RSS	9126
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	88839
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5664
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	94195
%usr	0.26
%system	0.62
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2843896
RSS	67036
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.09
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	89169
%usr	0.02
%system	0.53
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2843967
RSS	64700
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.8.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.8.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	337760.062
tx_rate_mbps	Unknown
throughput_rx_mbps	1383.465
tx_rate_percent	7.188
throughput_rx_percent	7.188
frame_loss_percent	0.000
min_latency_ns	31620.000
max_latency_ns	543580.000
avg_latency_ns	100123.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:29
start_time	2018-01-29 03:17:53
stop_time	2018-01-29 04:29:23
guest_loopback_app	testpmd testpmd

4.2.8.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	88842
%usr	0.41
%system	2.96
%guest	0.00
%CPU	3.37
CPU
minflt/s	0.09
majflt/s	0.00
VSZ	6608356
RSS	9126
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	88839
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5664
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	94195
%usr	0.26
%system	0.62
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2843896
RSS	67036
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.09
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	89169
%usr	0.02
%system	0.53
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2843967
RSS	64700
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.8.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.8.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	338805.199
tx_rate_mbps	Unknown
throughput_rx_mbps	2775.492
tx_rate_percent	14.148
throughput_rx_percent	14.148
frame_loss_percent	0.000
min_latency_ns	34360.000
max_latency_ns	667120.000
avg_latency_ns	105707.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:29
start_time	2018-01-29 03:17:53
stop_time	2018-01-29 04:29:23
guest_loopback_app	testpmd testpmd

4.2.8.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	88842
%usr	0.41
%system	2.96
%guest	0.00
%CPU	3.37
CPU
minflt/s	0.09
majflt/s	0.00
VSZ	6608356
RSS	9126
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	88839
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5664
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	94195
%usr	0.26
%system	0.62
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2843896
RSS	67036
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.09
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	89169
%usr	0.02
%system	0.53
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2843967
RSS	64700
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.8.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.8.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	343132.060
tx_rate_mbps	Unknown
throughput_rx_mbps	4166.996
tx_rate_percent	21.109
throughput_rx_percent	21.109
frame_loss_percent	0.000
min_latency_ns	34320.000
max_latency_ns	787420.000
avg_latency_ns	119353.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:11:29
start_time	2018-01-29 03:17:53
stop_time	2018-01-29 04:29:23
guest_loopback_app	testpmd testpmd

4.2.8.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	88842
%usr	0.41
%system	2.96
%guest	0.00
%CPU	3.37
CPU
minflt/s	0.09
majflt/s	0.00
VSZ	6608356
RSS	9126
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	88839
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5664
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	94195
%usr	0.26
%system	0.62
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2843896
RSS	67036
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.09
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	89169
%usr	0.02
%system	0.53
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2843967
RSS	64700
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.8.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.8.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.3. Rationale for decisions¶

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

4.4. Conclusions and recommendations¶

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-28_18-54-25/vswitchperf_logs_2018-01-28_18-54-25.tar.gz.

4.5. General¶

4.5.1. Glossary¶

NFV - Network Function Virtualization
Mbps - 1,000,000bps

4.5.2. Document change procedures and history¶

Document ID	Author	Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT	Christopher Nolan	23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT	Christopher Nolan	28/01/2015

5. Performance report for VppDpdkVhost¶

5.1. Introduction¶

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

5.1.1. Document identifier¶

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

5.1.2. Scope¶

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

5.1.3. References¶

OPNFV_vswitchperf_LTD_Brahmaputra_REVIEWED

5.2. Details of the Level Test Report¶

This section provides a test-results-overview. Also included are the rationale and the conclusions.

5.2.1. Test ID: PVP_TPUT_VPP¶

5.2.1.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_tput_vpp
Description: VPP: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: clean
Traffic type: rfc2544_throughput
Bidirectional : True

5.2.1.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

5.2.1.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4671227.172
tx_rate_mbps	Unknown
throughput_rx_mbps	2391.668
tx_rate_percent	15.695
throughput_rx_percent	15.695
frame_loss_percent	0.000
min_latency_ns	8520.000
max_latency_ns	71820.000
avg_latency_ns	15296.000
type	rfc2544_throughput
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:15:26
start_time	2018-01-29 06:59:44
stop_time	2018-01-29 08:15:11

5.2.1.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	139212
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10079867
RSS	50971
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

5.2.1.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	6439994.543
tx_rate_mbps	Unknown
throughput_rx_mbps	6594.554
tx_rate_percent	38.125
throughput_rx_percent	38.125
frame_loss_percent	0.000
min_latency_ns	10240.000
max_latency_ns	78500.000
avg_latency_ns	36112.500
type	rfc2544_throughput
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:15:26
start_time	2018-01-29 06:59:44
stop_time	2018-01-29 08:15:11

5.2.1.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	139212
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10079867
RSS	50971
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

5.2.1.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4263097.710
tx_rate_mbps	Unknown
throughput_rx_mbps	17461.648
tx_rate_percent	90.719
throughput_rx_percent	90.719
frame_loss_percent	0.000
min_latency_ns	13920.000
max_latency_ns	84440.000
avg_latency_ns	40095.000
type	rfc2544_throughput
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:15:26
start_time	2018-01-29 06:59:44
stop_time	2018-01-29 08:15:11

5.2.1.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	139212
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10079867
RSS	50971
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

5.2.1.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394462.302
tx_rate_mbps	Unknown
throughput_rx_mbps	19615.435
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	28700.000
max_latency_ns	261340.000
avg_latency_ns	236139.000
type	rfc2544_throughput
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:15:26
start_time	2018-01-29 06:59:44
stop_time	2018-01-29 08:15:11

5.2.1.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	139212
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10079867
RSS	50971
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

5.2.1.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625437.345
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.311
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	25780.000
max_latency_ns	127080.000
avg_latency_ns	109218.500
type	rfc2544_throughput
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:15:26
start_time	2018-01-29 06:59:44
stop_time	2018-01-29 08:15:11

5.2.1.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	139212
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10079867
RSS	50971
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.7. Anomalies¶

No anomalies were detected during the course of this test.

5.2.1.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.2. Test ID: PVP_BACK2BACK_VPP¶

5.2.2.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_back2back_vpp
Description: VPP: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: clean
Traffic type: rfc2544_back2back
Bidirectional : True

5.2.2.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

5.2.2.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:18:17
start_time	2018-01-29 08:15:11
stop_time	2018-01-29 09:33:29

5.2.2.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	153982
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10085310
RSS	50743
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

5.2.2.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:18:17
start_time	2018-01-29 08:15:11
stop_time	2018-01-29 09:33:29

5.2.2.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	153982
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10085310
RSS	50743
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

5.2.2.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35244288
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:18:17
start_time	2018-01-29 08:15:11
stop_time	2018-01-29 09:33:29

5.2.2.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	153982
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10085310
RSS	50743
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

5.2.2.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:18:17
start_time	2018-01-29 08:15:11
stop_time	2018-01-29 09:33:29

5.2.2.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	153982
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10085310
RSS	50743
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

5.2.2.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:18:17
start_time	2018-01-29 08:15:11
stop_time	2018-01-29 09:33:29

5.2.2.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	153982
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10085310
RSS	50743
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.7. Anomalies¶

No anomalies were detected during the course of this test.

5.2.2.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.3. Test ID: PHY2PHY_BACK2BACK_VPP¶

5.2.3.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: phy2phy_back2back_vpp
Description: VPP: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: clean
Traffic type: rfc2544_back2back
Bidirectional : True

5.2.3.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

5.2.3.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24267
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:11:21
start_time	2018-01-29 05:48:23
stop_time	2018-01-29 06:59:44

5.2.3.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	124942
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	3937544
RSS	50556
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

5.2.3.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	247439
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:11:21
start_time	2018-01-29 05:48:23
stop_time	2018-01-29 06:59:44

5.2.3.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	124942
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	3937544
RSS	50556
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

5.2.3.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488721
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:11:21
start_time	2018-01-29 05:48:23
stop_time	2018-01-29 06:59:44

5.2.3.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	124942
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	3937544
RSS	50556
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

5.2.3.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:11:21
start_time	2018-01-29 05:48:23
stop_time	2018-01-29 06:59:44

5.2.3.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	124942
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	3937544
RSS	50556
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

5.2.3.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:11:21
start_time	2018-01-29 05:48:23
stop_time	2018-01-29 06:59:44

5.2.3.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	124942
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	3937544
RSS	50556
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.7. Anomalies¶

No anomalies were detected during the course of this test.

5.2.3.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.4. Test ID: PVVP_TPUT_VPP¶

5.2.4.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvvp_tput_vpp
Description: VPP: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: clean
Traffic type: rfc2544_throughput
Bidirectional : True

5.2.4.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

5.2.4.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	6052367.565
tx_rate_mbps	Unknown
throughput_rx_mbps	3098.812
tx_rate_percent	20.336
throughput_rx_percent	20.336
frame_loss_percent	0.000
min_latency_ns	8040.000
max_latency_ns	66520.000
avg_latency_ns	12481.500
type	rfc2544_throughput
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:16:39
start_time	2018-01-29 09:33:29
stop_time	2018-01-29 10:50:09

5.2.4.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	169716
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	16034915
RSS	51052
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

5.2.4.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	8530459.631
tx_rate_mbps	Unknown
throughput_rx_mbps	8735.191
tx_rate_percent	50.500
throughput_rx_percent	50.500
frame_loss_percent	0.000
min_latency_ns	11060.000
max_latency_ns	67880.000
avg_latency_ns	21094.000
type	rfc2544_throughput
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:16:39
start_time	2018-01-29 09:33:29
stop_time	2018-01-29 10:50:09

5.2.4.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	169716
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	16034915
RSS	51052
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

5.2.4.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699003.721
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.119
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	28660.000
max_latency_ns	194280.000
avg_latency_ns	177865.000
type	rfc2544_throughput
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:16:39
start_time	2018-01-29 09:33:29
stop_time	2018-01-29 10:50:09

5.2.4.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	169716
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	16034915
RSS	51052
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

5.2.4.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394547.956
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.137
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	27420.000
max_latency_ns	148820.000
avg_latency_ns	130106.000
type	rfc2544_throughput
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:16:39
start_time	2018-01-29 09:33:29
stop_time	2018-01-29 10:50:09

5.2.4.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	169716
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	16034915
RSS	51052
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

5.2.4.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625449.921
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.464
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	29620.000
max_latency_ns	106420.000
avg_latency_ns	90947.500
type	rfc2544_throughput
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:16:39
start_time	2018-01-29 09:33:29
stop_time	2018-01-29 10:50:09

5.2.4.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	169716
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	16034915
RSS	51052
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.7. Anomalies¶

No anomalies were detected during the course of this test.

5.2.4.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.3. Rationale for decisions¶

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

5.4. Conclusions and recommendations¶

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-28_18-54-25/vswitchperf_logs_2018-01-28_18-54-25.tar.gz.

5.5. General¶

5.5.1. Glossary¶

NFV - Network Function Virtualization
Mbps - 1,000,000bps

5.5.2. Document change procedures and history¶

Document ID	Author	Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT	Christopher Nolan	23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT	Christopher Nolan	28/01/2015