VSPERF Results¶

1. VSPERF Test Scenarios¶

Predefined Tests suitable for automated execution with CI:

Test	Definition
phy2phy_tput	PacketLossRatio for Phy2Phy
back2back	BackToBackFrames for Phy2Phy
phy2phy_tput_mod_vlan	PacketLossRatioFrameModification for Phy2Phy
phy2phy_cont	Phy2Phy blast vswitch at x% TX rate and measure throughput
pvp_cont	PVP blast vswitch at x% TX rate and measure throughput
pvvp_cont	PVVP blast vswitch at x% TX rate and measure throughput
phy2phy_scalability	Scalability0PacketLoss for Phy2Phy
pvp_tput	PacketLossRatio for PVP
pvp_back2back	BackToBackFrames for PVP
pvvp_tput	PacketLossRatio for PVVP
pvvp_back2back	BackToBackFrames for PVVP
phy2phy_cpu_load	CPU0PacketLoss for Phy2Phy
phy2phy_mem_load	Same as CPU0PacketLoss but using a memory intensive app

Deployment topologies:

Phy2Phy: Physical port -> vSwitch -> Physical port.
PVP: Physical port -> vSwitch -> VNF -> vSwitch -> Physical port.
PVVP: Physical port -> vSwitch -> VNF -> vSwitch -> VNF -> vSwitch -> Physical port.

Loopback applications in the Guest:

DPDK testpmd.
Linux Bridge.
l2fwd-module

Supported traffic generators:

Spirent Testcenter
Ixia: IxOS and IxNet.
Xena
MoonGen
Dummy
T-Rex

2. OPNFV Test Results¶

VSPERF CI jobs are run daily and sample results can be found at https://wiki.opnfv.org/display/vsperf/Vsperf+Results

Testcase names shown in the dashboard are combination of orignal testcase name from VSPERF framework and indication of used vswitch.

Example:

Testcase phy2phy_tput is executed for three vSwitch types: OvsDpdkVhost, OvsVanilla and VppDpdkVhost. In this case, following testcase names will be used in the dashboard: phy2phy_tput_ovsdpdkvhost, phy2phy_tput_ovsvanilla and phy2phy_tput_vppdpdkvhost.

In case of RFC2544 Throughput test, the recorded metric is FPS (frames per second) without packet loss. For RFC2544 Back2Back test, the recorded metric is back-to-back value (number of frames) without packet loss.

The loopback application in the VNF used for PVP and PVVP scenarios was DPDK testpmd.

Guest interface types are vhost-user for OvsDpdkVhost and VppDpdkVhost and virtio-net for OvsVanilla.

3. Performance report for OvsDpdkVhost¶

3.1. Introduction¶

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

3.1.1. Document identifier¶

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

3.1.2. Scope¶

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

3.1.3. References¶

OPNFV_vswitchperf_LTD_Brahmaputra_REVIEWED

3.2. Details of the Level Test Report¶

This section provides a test-results-overview. Also included are the rationale and the conclusions.

3.2.1. Test ID: BACK2BACK¶

3.2.1.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: back2back
Description: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: p2p
Traffic type: rfc2544_back2back
Bidirectional : True

3.2.1.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.1.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	25119
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:57:41
start_time	2018-01-25 02:15:11
stop_time	2018-01-25 03:12:53

3.2.1.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	182574
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43375
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	182558
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6628
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.1.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	126689189
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:57:41
start_time	2018-01-25 02:15:11
stop_time	2018-01-25 03:12:53

3.2.1.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	182574
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43375
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	182558
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6628
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.1.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488721
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:57:41
start_time	2018-01-25 02:15:11
stop_time	2018-01-25 03:12:53

3.2.1.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	182574
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43375
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	182558
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6628
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.1.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:57:41
start_time	2018-01-25 02:15:11
stop_time	2018-01-25 03:12:53

3.2.1.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	182574
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43375
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	182558
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6628
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.1.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:57:41
start_time	2018-01-25 02:15:11
stop_time	2018-01-25 03:12:53

3.2.1.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	182574
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43375
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	182558
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6628
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.1.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.1.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.2. Test ID: PVP_TPUT¶

3.2.2.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: pvp
Traffic type: rfc2544_throughput
Bidirectional : True

3.2.2.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.2.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	7663726.735
tx_rate_mbps	Unknown
throughput_rx_mbps	3923.828
tx_rate_percent	25.750
throughput_rx_percent	25.750
frame_loss_percent	0.000
min_latency_ns	5840.000
max_latency_ns	41540.000
avg_latency_ns	7432.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:55:23
start_time	2018-01-25 05:01:54
stop_time	2018-01-25 05:57:18
guest_loopback_app	testpmd

3.2.2.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	20762
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666180
RSS	43348
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	20746
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6644
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	21080
%usr	0.09
%system	0.05
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2761624
RSS	66532
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.69
kB_ccwr/s	0.00

3.2.2.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.2.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	8530460.854
tx_rate_mbps	Unknown
throughput_rx_mbps	8735.192
tx_rate_percent	50.500
throughput_rx_percent	50.500
frame_loss_percent	0.000
min_latency_ns	7680.000
max_latency_ns	41740.000
avg_latency_ns	9755.000
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:55:23
start_time	2018-01-25 05:01:54
stop_time	2018-01-25 05:57:18
guest_loopback_app	testpmd

3.2.2.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	20762
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666180
RSS	43348
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	20746
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6644
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	21080
%usr	0.09
%system	0.05
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2761624
RSS	66532
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.69
kB_ccwr/s	0.00

3.2.2.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.2.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699165.599
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.782
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	42480.000
max_latency_ns	98480.000
avg_latency_ns	86888.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:55:23
start_time	2018-01-25 05:01:54
stop_time	2018-01-25 05:57:18
guest_loopback_app	testpmd

3.2.2.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	20762
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666180
RSS	43348
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	20746
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6644
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	21080
%usr	0.09
%system	0.05
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2761624
RSS	66532
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.69
kB_ccwr/s	0.00

3.2.2.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.2.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394589.724
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.479
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	51520.000
max_latency_ns	117260.000
avg_latency_ns	102823.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:55:23
start_time	2018-01-25 05:01:54
stop_time	2018-01-25 05:57:18
guest_loopback_app	testpmd

3.2.2.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	20762
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666180
RSS	43348
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	20746
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6644
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	21080
%usr	0.09
%system	0.05
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2761624
RSS	66532
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.69
kB_ccwr/s	0.00

3.2.2.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.2.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625461.337
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.602
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	52360.000
max_latency_ns	110620.000
avg_latency_ns	93919.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:55:23
start_time	2018-01-25 05:01:54
stop_time	2018-01-25 05:57:18
guest_loopback_app	testpmd

3.2.2.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	20762
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666180
RSS	43348
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	20746
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6644
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	21080
%usr	0.09
%system	0.05
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2761624
RSS	66532
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.69
kB_ccwr/s	0.00

3.2.2.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.2.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.3. Test ID: PHY2PHY_TPUT_MOD_VLAN¶

3.2.3.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: phy2phy_tput_mod_vlan
Description: LTD.Throughput.RFC2544.PacketLossRatioFrameModification
Deployment: p2p
Traffic type: rfc2544_throughput
Bidirectional : True

3.2.3.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.3.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	16641096.307
tx_rate_mbps	Unknown
throughput_rx_mbps	9052.756
tx_rate_percent	55.914
throughput_rx_percent	58.577
frame_loss_percent	0.000
min_latency_ns	6500.000
max_latency_ns	166300.000
avg_latency_ns	11906.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:57:58
start_time	2018-01-25 03:12:53
stop_time	2018-01-25 04:10:52

3.2.3.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	194037
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43331
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	194021
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6540
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.3.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	16369327.460
tx_rate_mbps	Unknown
throughput_rx_mbps	17286.010
tx_rate_percent	96.906
throughput_rx_percent	99.526
frame_loss_percent	0.000
min_latency_ns	5540.000
max_latency_ns	36480.000
avg_latency_ns	15971.000
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:57:58
start_time	2018-01-25 03:12:53
stop_time	2018-01-25 04:10:52

3.2.3.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	194037
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43331
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	194021
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6540
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.3.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4662904.631
tx_rate_mbps	Unknown
throughput_rx_mbps	19248.470
tx_rate_percent	99.227
throughput_rx_percent	99.973
frame_loss_percent	0.000
min_latency_ns	6160.000
max_latency_ns	22100.000
avg_latency_ns	7508.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:57:58
start_time	2018-01-25 03:12:53
stop_time	2018-01-25 04:10:52

3.2.3.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	194037
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43331
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	194021
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6540
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.3.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2376116.967
tx_rate_mbps	Unknown
throughput_rx_mbps	19541.186
tx_rate_percent	99.227
throughput_rx_percent	99.607
frame_loss_percent	0.000
min_latency_ns	6660.000
max_latency_ns	29460.000
avg_latency_ns	7837.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:57:58
start_time	2018-01-25 03:12:53
stop_time	2018-01-25 04:10:52

3.2.3.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	194037
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43331
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	194021
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6540
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.3.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1612916.336
tx_rate_mbps	Unknown
throughput_rx_mbps	19638.869
tx_rate_percent	99.227
throughput_rx_percent	99.485
frame_loss_percent	0.000
min_latency_ns	7060.000
max_latency_ns	28100.000
avg_latency_ns	8862.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:57:58
start_time	2018-01-25 03:12:53
stop_time	2018-01-25 04:10:52

3.2.3.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	194037
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43331
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	194021
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50672
RSS	6540
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.3.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.3.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.4. Test ID: PVVP_BACK2BACK¶

3.2.4.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvvp_back2back
Description: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: pvvp
Traffic type: rfc2544_back2back
Bidirectional : True

3.2.4.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.4.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	851
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:01:08
start_time	2018-01-25 07:52:20
stop_time	2018-01-25 08:53:28
guest_loopback_app	testpmd testpmd

3.2.4.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	56087
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957660
RSS	43568
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	56062
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6636
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	56464
%usr	0.19
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2782184
RSS	66948
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.56
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	56329
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2805800
RSS	66820
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.4.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.4.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	966
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:01:08
start_time	2018-01-25 07:52:20
stop_time	2018-01-25 08:53:28
guest_loopback_app	testpmd testpmd

3.2.4.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	56087
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957660
RSS	43568
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	56062
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6636
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	56464
%usr	0.19
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2782184
RSS	66948
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.56
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	56329
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2805800
RSS	66820
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.4.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.4.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488721
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:01:08
start_time	2018-01-25 07:52:20
stop_time	2018-01-25 08:53:28
guest_loopback_app	testpmd testpmd

3.2.4.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	56087
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957660
RSS	43568
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	56062
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6636
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	56464
%usr	0.19
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2782184
RSS	66948
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.56
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	56329
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2805800
RSS	66820
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.4.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.4.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:01:08
start_time	2018-01-25 07:52:20
stop_time	2018-01-25 08:53:28
guest_loopback_app	testpmd testpmd

3.2.4.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	56087
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957660
RSS	43568
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	56062
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6636
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	56464
%usr	0.19
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2782184
RSS	66948
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.56
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	56329
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2805800
RSS	66820
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.4.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.4.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	01:01:08
start_time	2018-01-25 07:52:20
stop_time	2018-01-25 08:53:28
guest_loopback_app	testpmd testpmd

3.2.4.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	56087
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957660
RSS	43568
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	56062
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6636
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	56464
%usr	0.19
%system	0.11
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2782184
RSS	66948
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.56
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	56329
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2805800
RSS	66820
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

3.2.4.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.4.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.5. Test ID: PHY2PHY_TPUT¶

3.2.5.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: phy2phy_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: p2p
Traffic type: rfc2544_throughput
Bidirectional : True

3.2.5.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.5.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	23316600.742
tx_rate_mbps	Unknown
throughput_rx_mbps	11938.100
tx_rate_percent	78.344
throughput_rx_percent	78.344
frame_loss_percent	0.000
min_latency_ns	5480.000
max_latency_ns	34540.000
avg_latency_ns	11678.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:44:36
start_time	2018-01-25 01:30:34
stop_time	2018-01-25 02:15:10

3.2.5.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	173323
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43375
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	173290
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6628
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.5.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.5.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	16761273.608
tx_rate_mbps	Unknown
throughput_rx_mbps	17163.544
tx_rate_percent	99.227
throughput_rx_percent	99.227
frame_loss_percent	0.000
min_latency_ns	5060.000
max_latency_ns	25440.000
avg_latency_ns	10084.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:44:36
start_time	2018-01-25 01:30:34
stop_time	2018-01-25 02:15:10

3.2.5.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	173323
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43375
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	173290
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6628
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.5.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.5.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699192.118
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.891
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	34640.000
max_latency_ns	70880.000
avg_latency_ns	60686.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:44:36
start_time	2018-01-25 01:30:34
stop_time	2018-01-25 02:15:10

3.2.5.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	173323
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43375
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	173290
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6628
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.5.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.5.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394608.091
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.629
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	34980.000
max_latency_ns	70460.000
avg_latency_ns	60293.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:44:36
start_time	2018-01-25 01:30:34
stop_time	2018-01-25 02:15:10

3.2.5.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	173323
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43375
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	173290
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6628
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.5.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.5.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625470.314
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.711
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	31520.000
max_latency_ns	63620.000
avg_latency_ns	53727.000
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:44:36
start_time	2018-01-25 01:30:34
stop_time	2018-01-25 02:15:10

3.2.5.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	173323
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43375
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	173290
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6628
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.5.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.5.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.6. Test ID: PHY2PHY_SCALABILITY¶

3.2.6.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: phy2phy_scalability
Description: LTD.Scalability.Flows.RFC2544.0PacketLoss
Deployment: p2p
Traffic type: rfc2544_throughput
Bidirectional : True

3.2.6.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.6.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	15029824.960
tx_rate_mbps	Unknown
throughput_rx_mbps	7695.270
tx_rate_percent	50.500
throughput_rx_percent	50.500
frame_loss_percent	0.000
min_latency_ns	5340.000
max_latency_ns	31700.000
avg_latency_ns	6605.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:51:01
start_time	2018-01-25 04:10:52
stop_time	2018-01-25 05:01:54
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.6.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	10276
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43311
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	10251
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6644
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.6.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.6.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	16761271.848
tx_rate_mbps	Unknown
throughput_rx_mbps	17163.542
tx_rate_percent	99.227
throughput_rx_percent	99.227
frame_loss_percent	0.000
min_latency_ns	5300.000
max_latency_ns	34740.000
avg_latency_ns	13997.000
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:51:01
start_time	2018-01-25 04:10:52
stop_time	2018-01-25 05:01:54
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.6.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	10276
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43311
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	10251
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6644
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.6.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.6.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699190.818
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.886
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	32860.000
max_latency_ns	70940.000
avg_latency_ns	60511.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:51:01
start_time	2018-01-25 04:10:52
stop_time	2018-01-25 05:01:54
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.6.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	10276
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43311
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	10251
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6644
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.6.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.6.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394605.473
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.608
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	34800.000
max_latency_ns	75140.000
avg_latency_ns	63939.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:51:01
start_time	2018-01-25 04:10:52
stop_time	2018-01-25 05:01:54
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.6.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	10276
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43311
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	10251
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6644
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.6.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.6.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625469.339
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.700
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	33940.000
max_latency_ns	72820.000
avg_latency_ns	58995.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:51:01
start_time	2018-01-25 04:10:52
stop_time	2018-01-25 05:01:54
stream_count	8000
match_type	L4
pre-installed_flows	No

3.2.6.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	10276
%usr	100.00
%system	0.14
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	8300988
RSS	43311
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	10251
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6644
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

3.2.6.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.6.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.7. Test ID: PVP_BACK2BACK¶

3.2.7.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_back2back
Description: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: pvp
Traffic type: rfc2544_back2back
Bidirectional : True

3.2.7.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.7.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	2128
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:58:29
start_time	2018-01-25 05:57:19
stop_time	2018-01-25 06:55:48
guest_loopback_app	testpmd

3.2.7.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	32276
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666176
RSS	43308
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	32260
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6520
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	32506
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2775742
RSS	66892
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.43
kB_ccwr/s	0.00

3.2.7.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.7.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	1449
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:58:29
start_time	2018-01-25 05:57:19
stop_time	2018-01-25 06:55:48
guest_loopback_app	testpmd

3.2.7.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	32276
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666176
RSS	43308
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	32260
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6520
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	32506
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2775742
RSS	66892
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.43
kB_ccwr/s	0.00

3.2.7.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.7.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488721
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:58:29
start_time	2018-01-25 05:57:19
stop_time	2018-01-25 06:55:48
guest_loopback_app	testpmd

3.2.7.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	32276
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666176
RSS	43308
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	32260
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6520
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	32506
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2775742
RSS	66892
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.43
kB_ccwr/s	0.00

3.2.7.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.7.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:58:29
start_time	2018-01-25 05:57:19
stop_time	2018-01-25 06:55:48
guest_loopback_app	testpmd

3.2.7.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	32276
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666176
RSS	43308
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	32260
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6520
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	32506
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2775742
RSS	66892
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.43
kB_ccwr/s	0.00

3.2.7.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.7.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:58:29
start_time	2018-01-25 05:57:19
stop_time	2018-01-25 06:55:48
guest_loopback_app	testpmd

3.2.7.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	32276
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	14666176
RSS	43308
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	32260
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50668
RSS	6520
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	32506
%usr	0.02
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2775742
RSS	66892
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.43
kB_ccwr/s	0.00

3.2.7.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.7.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.8. Test ID: PVVP_TPUT¶

3.2.8.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvvp_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: pvvp
Traffic type: rfc2544_throughput
Bidirectional : True

3.2.8.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

3.2.8.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	7663722.009
tx_rate_mbps	Unknown
throughput_rx_mbps	3923.826
tx_rate_percent	25.750
throughput_rx_percent	25.750
frame_loss_percent	0.000
min_latency_ns	10280.000
max_latency_ns	51580.000
avg_latency_ns	13654.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:56:30
start_time	2018-01-25 06:55:49
stop_time	2018-01-25 07:52:19
guest_loopback_app	testpmd testpmd

3.2.8.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	44287
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957660
RSS	43608
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	44271
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6504
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	44758
%usr	0.18
%system	0.10
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2806788
RSS	66320
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.73
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	44529
%usr	0.03
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2847976
RSS	68424
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.02
kB_ccwr/s	0.00

3.2.8.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

3.2.8.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	6440036.489
tx_rate_mbps	Unknown
throughput_rx_mbps	6594.597
tx_rate_percent	38.125
throughput_rx_percent	38.125
frame_loss_percent	0.000
min_latency_ns	9660.000
max_latency_ns	49720.000
avg_latency_ns	12778.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:56:30
start_time	2018-01-25 06:55:49
stop_time	2018-01-25 07:52:19
guest_loopback_app	testpmd testpmd

3.2.8.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	44287
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957660
RSS	43608
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	44271
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6504
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	44758
%usr	0.18
%system	0.10
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2806788
RSS	66320
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.73
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	44529
%usr	0.03
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2847976
RSS	68424
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.02
kB_ccwr/s	0.00

3.2.8.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

3.2.8.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699132.596
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.647
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	67660.000
max_latency_ns	152160.000
avg_latency_ns	133849.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:56:30
start_time	2018-01-25 06:55:49
stop_time	2018-01-25 07:52:19
guest_loopback_app	testpmd testpmd

3.2.8.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	44287
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957660
RSS	43608
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	44271
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6504
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	44758
%usr	0.18
%system	0.10
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2806788
RSS	66320
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.73
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	44529
%usr	0.03
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2847976
RSS	68424
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.02
kB_ccwr/s	0.00

3.2.8.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

3.2.8.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394569.219
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.311
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	72660.000
max_latency_ns	158420.000
avg_latency_ns	147356.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:56:30
start_time	2018-01-25 06:55:49
stop_time	2018-01-25 07:52:19
guest_loopback_app	testpmd testpmd

3.2.8.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	44287
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957660
RSS	43608
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	44271
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6504
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	44758
%usr	0.18
%system	0.10
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2806788
RSS	66320
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.73
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	44529
%usr	0.03
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2847976
RSS	68424
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.02
kB_ccwr/s	0.00

3.2.8.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

3.2.8.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625460.838
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.596
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	78940.000
max_latency_ns	134620.000
avg_latency_ns	123339.000
type	rfc2544_throughput
packet_size	1518
vswitch	OvsDpdkVhost
traffic_type	udp
test_execution_time	00:56:30
start_time	2018-01-25 06:55:49
stop_time	2018-01-25 07:52:19
guest_loopback_app	testpmd testpmd

3.2.8.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	44287
%usr	100.00
%system	0.15
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	20957660
RSS	43608
%MEM	0.07
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	44271
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	50664
RSS	6504
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	44758
%usr	0.18
%system	0.10
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2806788
RSS	66320
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.73
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	44529
%usr	0.03
%system	0.02
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2847976
RSS	68424
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.02
kB_ccwr/s	0.00

3.2.8.7. Anomalies¶

No anomalies were detected during the course of this test.

3.2.8.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.3. Rationale for decisions¶

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

3.4. Conclusions and recommendations¶

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-25_09-30-27/vswitchperf_logs_2018-01-25_09-30-27.tar.gz.

3.5. General¶

3.5.1. Glossary¶

NFV - Network Function Virtualization
Mbps - 1,000,000bps

3.5.2. Document change procedures and history¶

Document ID	Author	Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT	Christopher Nolan	23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT	Christopher Nolan	28/01/2015

4. Performance report for OvsVanilla¶

4.1. Introduction¶

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

4.1.1. Document identifier¶

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

4.1.2. Scope¶

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

4.1.3. References¶

OPNFV_vswitchperf_LTD_Brahmaputra_REVIEWED

4.2. Details of the Level Test Report¶

This section provides a test-results-overview. Also included are the rationale and the conclusions.

4.2.1. Test ID: BACK2BACK¶

4.2.1.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

Test ID: back2back
Description: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: p2p
Traffic type: rfc2544_back2back
Bidirectional : True

4.2.1.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.1.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	5108
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:02:32
start_time	2018-01-25 09:54:44
stop_time	2018-01-25 10:57:17

4.2.1.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	80712
%usr	0.42
%system	3.17
%guest	0.00
%CPU	3.60
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608360
RSS	9165
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	80708
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5820
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.1.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	3382
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:02:32
start_time	2018-01-25 09:54:44
stop_time	2018-01-25 10:57:17

4.2.1.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	80712
%usr	0.42
%system	3.17
%guest	0.00
%CPU	3.60
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608360
RSS	9165
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	80708
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5820
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.1.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	1344
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:02:32
start_time	2018-01-25 09:54:44
stop_time	2018-01-25 10:57:17

4.2.1.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	80712
%usr	0.42
%system	3.17
%guest	0.00
%CPU	3.60
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608360
RSS	9165
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	80708
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5820
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.1.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	1096
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:02:32
start_time	2018-01-25 09:54:44
stop_time	2018-01-25 10:57:17

4.2.1.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	80712
%usr	0.42
%system	3.17
%guest	0.00
%CPU	3.60
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608360
RSS	9165
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	80708
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5820
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.1.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	1488
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:02:32
start_time	2018-01-25 09:54:44
stop_time	2018-01-25 10:57:17

4.2.1.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	80712
%usr	0.42
%system	3.17
%guest	0.00
%CPU	3.60
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608360
RSS	9165
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	80708
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5820
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.1.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.1.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.2. Test ID: PVP_TPUT¶

4.2.2.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: pvp
Traffic type: rfc2544_throughput
Bidirectional : True

4.2.2.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.2.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	497704.840
tx_rate_mbps	Unknown
throughput_rx_mbps	254.825
tx_rate_percent	1.773
throughput_rx_percent	1.672
frame_loss_percent	5.704
min_latency_ns	11660.000
max_latency_ns	6039440.000
avg_latency_ns	876291.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:59:59
start_time	2018-01-25 12:53:32
stop_time	2018-01-25 13:53:32
guest_loopback_app	testpmd

4.2.2.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	116531
%usr	0.41
%system	3.09
%guest	0.00
%CPU	3.49
CPU
minflt/s	0.08
majflt/s	0.00
VSZ	6608352
RSS	9164
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	116528
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5972
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	116805
%usr	0.02
%system	0.66
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2851210
RSS	66261
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.50
kB_ccwr/s	0.00

4.2.2.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.2.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	299567.318
tx_rate_mbps	Unknown
throughput_rx_mbps	306.757
tx_rate_percent	1.773
throughput_rx_percent	1.773
frame_loss_percent	0.000
min_latency_ns	11800.000
max_latency_ns	362420.000
avg_latency_ns	49930.000
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:59:59
start_time	2018-01-25 12:53:32
stop_time	2018-01-25 13:53:32
guest_loopback_app	testpmd

4.2.2.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	116531
%usr	0.41
%system	3.09
%guest	0.00
%CPU	3.49
CPU
minflt/s	0.08
majflt/s	0.00
VSZ	6608352
RSS	9164
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	116528
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5972
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	116805
%usr	0.02
%system	0.66
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2851210
RSS	66261
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.50
kB_ccwr/s	0.00

4.2.2.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.2.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	337758.597
tx_rate_mbps	Unknown
throughput_rx_mbps	1383.459
tx_rate_percent	7.188
throughput_rx_percent	7.188
frame_loss_percent	0.000
min_latency_ns	14300.000
max_latency_ns	771380.000
avg_latency_ns	80295.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:59:59
start_time	2018-01-25 12:53:32
stop_time	2018-01-25 13:53:32
guest_loopback_app	testpmd

4.2.2.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	116531
%usr	0.41
%system	3.09
%guest	0.00
%CPU	3.49
CPU
minflt/s	0.08
majflt/s	0.00
VSZ	6608352
RSS	9164
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	116528
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5972
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	116805
%usr	0.02
%system	0.66
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2851210
RSS	66261
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.50
kB_ccwr/s	0.00

4.2.2.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.2.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	338803.566
tx_rate_mbps	Unknown
throughput_rx_mbps	2775.479
tx_rate_percent	14.148
throughput_rx_percent	14.148
frame_loss_percent	0.000
min_latency_ns	13660.000
max_latency_ns	700380.000
avg_latency_ns	84703.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:59:59
start_time	2018-01-25 12:53:32
stop_time	2018-01-25 13:53:32
guest_loopback_app	testpmd

4.2.2.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	116531
%usr	0.41
%system	3.09
%guest	0.00
%CPU	3.49
CPU
minflt/s	0.08
majflt/s	0.00
VSZ	6608352
RSS	9164
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	116528
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5972
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	116805
%usr	0.02
%system	0.66
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2851210
RSS	66261
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.50
kB_ccwr/s	0.00

4.2.2.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.2.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	330558.375
tx_rate_mbps	Unknown
throughput_rx_mbps	4014.301
tx_rate_percent	20.336
throughput_rx_percent	20.336
frame_loss_percent	0.000
min_latency_ns	12680.000
max_latency_ns	766440.000
avg_latency_ns	83966.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:59:59
start_time	2018-01-25 12:53:32
stop_time	2018-01-25 13:53:32
guest_loopback_app	testpmd

4.2.2.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	116531
%usr	0.41
%system	3.09
%guest	0.00
%CPU	3.49
CPU
minflt/s	0.08
majflt/s	0.00
VSZ	6608352
RSS	9164
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	116528
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5972
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	116805
%usr	0.02
%system	0.66
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2851210
RSS	66261
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.50
kB_ccwr/s	0.00

4.2.2.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.2.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.3. Test ID: PHY2PHY_TPUT_MOD_VLAN¶

4.2.3.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

Test ID: phy2phy_tput_mod_vlan
Description: LTD.Throughput.RFC2544.PacketLossRatioFrameModification
Deployment: p2p
Traffic type: rfc2544_throughput
Bidirectional : True

4.2.3.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.3.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	988191.154
tx_rate_mbps	Unknown
throughput_rx_mbps	537.576
tx_rate_percent	3.320
throughput_rx_percent	3.478
frame_loss_percent	0.000
min_latency_ns	4000.000
max_latency_ns	5347620.000
avg_latency_ns	111845.500
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:57:03
start_time	2018-01-25 10:57:17
stop_time	2018-01-25 11:54:20

4.2.3.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	93165
%usr	0.42
%system	3.00
%guest	0.00
%CPU	3.42
CPU
minflt/s	0.10
majflt/s	0.00
VSZ	6608352
RSS	9125
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	93162
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5832
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.3.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.3.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	822163.659
tx_rate_mbps	Unknown
throughput_rx_mbps	868.205
tx_rate_percent	4.867
throughput_rx_percent	4.999
frame_loss_percent	0.000
min_latency_ns	4160.000
max_latency_ns	611020.000
avg_latency_ns	32899.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:57:03
start_time	2018-01-25 10:57:17
stop_time	2018-01-25 11:54:20

4.2.3.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	93165
%usr	0.42
%system	3.00
%guest	0.00
%CPU	3.42
CPU
minflt/s	0.10
majflt/s	0.00
VSZ	6608352
RSS	9125
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	93162
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5832
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.3.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.3.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	737564.535
tx_rate_mbps	Unknown
throughput_rx_mbps	3044.666
tx_rate_percent	15.695
throughput_rx_percent	15.813
frame_loss_percent	0.000
min_latency_ns	5020.000
max_latency_ns	767780.000
avg_latency_ns	33990.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:57:03
start_time	2018-01-25 10:57:17
stop_time	2018-01-25 11:54:20

4.2.3.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	93165
%usr	0.42
%system	3.00
%guest	0.00
%CPU	3.42
CPU
minflt/s	0.10
majflt/s	0.00
VSZ	6608352
RSS	9125
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	93162
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5832
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.3.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.3.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	857394.523
tx_rate_mbps	Unknown
throughput_rx_mbps	7051.213
tx_rate_percent	35.805
throughput_rx_percent	35.942
frame_loss_percent	0.000
min_latency_ns	5780.000
max_latency_ns	1651460.000
avg_latency_ns	48487.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:57:03
start_time	2018-01-25 10:57:17
stop_time	2018-01-25 11:54:20

4.2.3.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	93165
%usr	0.42
%system	3.00
%guest	0.00
%CPU	3.42
CPU
minflt/s	0.10
majflt/s	0.00
VSZ	6608352
RSS	9125
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	93162
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5832
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.3.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.3.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	858589.009
tx_rate_mbps	Unknown
throughput_rx_mbps	10454.180
tx_rate_percent	52.820
throughput_rx_percent	52.958
frame_loss_percent	0.000
min_latency_ns	8260.000
max_latency_ns	1194980.000
avg_latency_ns	47000.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:57:03
start_time	2018-01-25 10:57:17
stop_time	2018-01-25 11:54:20

4.2.3.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	93165
%usr	0.42
%system	3.00
%guest	0.00
%CPU	3.42
CPU
minflt/s	0.10
majflt/s	0.00
VSZ	6608352
RSS	9125
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	93162
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5832
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.3.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.3.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.4. Test ID: PVVP_BACK2BACK¶

4.2.4.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvvp_back2back
Description: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: pvvp
Traffic type: rfc2544_back2back
Bidirectional : True

4.2.4.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.4.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	425
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:06:05
start_time	2018-01-25 15:57:36
stop_time	2018-01-25 17:03:42
guest_loopback_app	testpmd testpmd

4.2.4.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	153938
%usr	0.40
%system	2.90
%guest	0.00
%CPU	3.29
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608356
RSS	9161
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	153935
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5964
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	154492
%usr	0.03
%system	0.09
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2821388
RSS	67224
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.66
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	154263
%usr	0.02
%system	0.10
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2785408
RSS	66616
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.4.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.4.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	483
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:06:05
start_time	2018-01-25 15:57:36
stop_time	2018-01-25 17:03:42
guest_loopback_app	testpmd testpmd

4.2.4.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	153938
%usr	0.40
%system	2.90
%guest	0.00
%CPU	3.29
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608356
RSS	9161
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	153935
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5964
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	154492
%usr	0.03
%system	0.09
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2821388
RSS	67224
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.66
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	154263
%usr	0.02
%system	0.10
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2785408
RSS	66616
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.4.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.4.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	537
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:06:05
start_time	2018-01-25 15:57:36
stop_time	2018-01-25 17:03:42
guest_loopback_app	testpmd testpmd

4.2.4.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	153938
%usr	0.40
%system	2.90
%guest	0.00
%CPU	3.29
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608356
RSS	9161
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	153935
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5964
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	154492
%usr	0.03
%system	0.09
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2821388
RSS	67224
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.66
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	154263
%usr	0.02
%system	0.10
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2785408
RSS	66616
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.4.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.4.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	548
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:06:05
start_time	2018-01-25 15:57:36
stop_time	2018-01-25 17:03:42
guest_loopback_app	testpmd testpmd

4.2.4.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	153938
%usr	0.40
%system	2.90
%guest	0.00
%CPU	3.29
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608356
RSS	9161
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	153935
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5964
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	154492
%usr	0.03
%system	0.09
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2821388
RSS	67224
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.66
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	154263
%usr	0.02
%system	0.10
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2785408
RSS	66616
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.4.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.4.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	744
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:06:05
start_time	2018-01-25 15:57:36
stop_time	2018-01-25 17:03:42
guest_loopback_app	testpmd testpmd

4.2.4.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	153938
%usr	0.40
%system	2.90
%guest	0.00
%CPU	3.29
CPU
minflt/s	0.07
majflt/s	0.00
VSZ	6608356
RSS	9161
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	153935
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5964
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	154492
%usr	0.03
%system	0.09
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2821388
RSS	67224
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.66
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	154263
%usr	0.02
%system	0.10
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2785408
RSS	66616
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.4.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.4.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.5. Test ID: PHY2PHY_TPUT¶

4.2.5.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

Test ID: phy2phy_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: p2p
Traffic type: rfc2544_throughput
Bidirectional : True

4.2.5.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.5.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	988192.353
tx_rate_mbps	Unknown
throughput_rx_mbps	505.954
tx_rate_percent	3.320
throughput_rx_percent	3.320
frame_loss_percent	0.000
min_latency_ns	3980.000
max_latency_ns	3717780.000
avg_latency_ns	50594.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:01:06
start_time	2018-01-25 08:53:37
stop_time	2018-01-25 09:54:43

4.2.5.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	68932
%usr	0.43
%system	2.95
%guest	0.00
%CPU	3.38
CPU
minflt/s	0.08
majflt/s	0.00
VSZ	6608352
RSS	8940
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	68918
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5968
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.5.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.5.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	952810.722
tx_rate_mbps	Unknown
throughput_rx_mbps	975.678
tx_rate_percent	5.641
throughput_rx_percent	5.641
frame_loss_percent	0.000
min_latency_ns	4120.000
max_latency_ns	5003740.000
avg_latency_ns	47872.000
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:01:06
start_time	2018-01-25 08:53:37
stop_time	2018-01-25 09:54:43

4.2.5.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	68932
%usr	0.43
%system	2.95
%guest	0.00
%CPU	3.38
CPU
minflt/s	0.08
majflt/s	0.00
VSZ	6608352
RSS	8940
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	68918
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5968
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.5.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.5.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	882947.579
tx_rate_mbps	Unknown
throughput_rx_mbps	3616.553
tx_rate_percent	18.789
throughput_rx_percent	18.789
frame_loss_percent	0.000
min_latency_ns	5240.000
max_latency_ns	1963880.000
avg_latency_ns	59561.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:01:06
start_time	2018-01-25 08:53:37
stop_time	2018-01-25 09:54:43

4.2.5.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	68932
%usr	0.43
%system	2.95
%guest	0.00
%CPU	3.38
CPU
minflt/s	0.08
majflt/s	0.00
VSZ	6608352
RSS	8940
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	68918
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5968
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.5.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.5.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	875914.918
tx_rate_mbps	Unknown
throughput_rx_mbps	7175.495
tx_rate_percent	36.578
throughput_rx_percent	36.578
frame_loss_percent	0.000
min_latency_ns	5760.000
max_latency_ns	1750880.000
avg_latency_ns	46782.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:01:06
start_time	2018-01-25 08:53:37
stop_time	2018-01-25 09:54:43

4.2.5.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	68932
%usr	0.43
%system	2.95
%guest	0.00
%CPU	3.38
CPU
minflt/s	0.08
majflt/s	0.00
VSZ	6608352
RSS	8940
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	68918
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5968
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.5.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.5.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	871162.540
tx_rate_mbps	Unknown
throughput_rx_mbps	10579.398
tx_rate_percent	53.594
throughput_rx_percent	53.594
frame_loss_percent	0.000
min_latency_ns	7040.000
max_latency_ns	932680.000
avg_latency_ns	44299.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:01:06
start_time	2018-01-25 08:53:37
stop_time	2018-01-25 09:54:43

4.2.5.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	68932
%usr	0.43
%system	2.95
%guest	0.00
%CPU	3.38
CPU
minflt/s	0.08
majflt/s	0.00
VSZ	6608352
RSS	8940
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	68918
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5968
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.5.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.5.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.6. Test ID: PHY2PHY_SCALABILITY¶

4.2.6.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: p2p
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

Test ID: phy2phy_scalability
Description: LTD.Scalability.Flows.RFC2544.0PacketLoss
Deployment: p2p
Traffic type: rfc2544_throughput
Bidirectional : True

4.2.6.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.6.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	988191.850
tx_rate_mbps	Unknown
throughput_rx_mbps	505.954
tx_rate_percent	3.320
throughput_rx_percent	3.320
frame_loss_percent	0.000
min_latency_ns	4000.000
max_latency_ns	4718920.000
avg_latency_ns	63605.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:59:10
start_time	2018-01-25 11:54:21
stop_time	2018-01-25 12:53:32
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.6.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	104648
%usr	0.42
%system	2.99
%guest	0.00
%CPU	3.41
CPU
minflt/s	0.15
majflt/s	0.00
VSZ	6608356
RSS	8746
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	104645
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5820
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.6.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.6.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	952811.253
tx_rate_mbps	Unknown
throughput_rx_mbps	975.679
tx_rate_percent	5.641
throughput_rx_percent	5.641
frame_loss_percent	0.000
min_latency_ns	4140.000
max_latency_ns	3085400.000
avg_latency_ns	43855.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:59:10
start_time	2018-01-25 11:54:21
stop_time	2018-01-25 12:53:32
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.6.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	104648
%usr	0.42
%system	2.99
%guest	0.00
%CPU	3.41
CPU
minflt/s	0.15
majflt/s	0.00
VSZ	6608356
RSS	8746
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	104645
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5820
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.6.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.6.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	810255.924
tx_rate_mbps	Unknown
throughput_rx_mbps	3318.808
tx_rate_percent	17.242
throughput_rx_percent	17.242
frame_loss_percent	0.000
min_latency_ns	5000.000
max_latency_ns	904960.000
avg_latency_ns	33125.000
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:59:10
start_time	2018-01-25 11:54:21
stop_time	2018-01-25 12:53:32
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.6.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	104648
%usr	0.42
%system	2.99
%guest	0.00
%CPU	3.41
CPU
minflt/s	0.15
majflt/s	0.00
VSZ	6608356
RSS	8746
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	104645
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5820
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.6.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.6.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	857394.545
tx_rate_mbps	Unknown
throughput_rx_mbps	7023.776
tx_rate_percent	35.805
throughput_rx_percent	35.805
frame_loss_percent	0.000
min_latency_ns	5720.000
max_latency_ns	1689720.000
avg_latency_ns	42332.000
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:59:10
start_time	2018-01-25 11:54:21
stop_time	2018-01-25 12:53:32
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.6.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	104648
%usr	0.42
%system	2.99
%guest	0.00
%CPU	3.41
CPU
minflt/s	0.15
majflt/s	0.00
VSZ	6608356
RSS	8746
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	104645
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5820
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.6.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.6.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	858589.977
tx_rate_mbps	Unknown
throughput_rx_mbps	10426.717
tx_rate_percent	52.820
throughput_rx_percent	52.820
frame_loss_percent	0.000
min_latency_ns	8300.000
max_latency_ns	728180.000
avg_latency_ns	38357.000
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:59:10
start_time	2018-01-25 11:54:21
stop_time	2018-01-25 12:53:32
stream_count	8000
match_type	L4
pre-installed_flows	No

4.2.6.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	104648
%usr	0.42
%system	2.99
%guest	0.00
%CPU	3.41
CPU
minflt/s	0.15
majflt/s	0.00
VSZ	6608356
RSS	8746
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	104645
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5820
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

4.2.6.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.6.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.7. Test ID: PVP_BACK2BACK¶

4.2.7.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_back2back
Description: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: pvp
Traffic type: rfc2544_back2back
Bidirectional : True

4.2.7.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.7.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:04:50
start_time	2018-01-25 13:53:32
stop_time	2018-01-25 14:58:23
guest_loopback_app	testpmd

4.2.7.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	128754
%usr	0.43
%system	2.99
%guest	0.00
%CPU	3.42
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	6608352
RSS	9136
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	128669
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5944
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	129030
%usr	0.18
%system	0.16
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2881079
RSS	67040
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.09
kB_ccwr/s	0.00

4.2.7.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.7.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:04:50
start_time	2018-01-25 13:53:32
stop_time	2018-01-25 14:58:23
guest_loopback_app	testpmd

4.2.7.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	128754
%usr	0.43
%system	2.99
%guest	0.00
%CPU	3.42
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	6608352
RSS	9136
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	128669
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5944
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	129030
%usr	0.18
%system	0.16
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2881079
RSS	67040
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.09
kB_ccwr/s	0.00

4.2.7.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.7.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:04:50
start_time	2018-01-25 13:53:32
stop_time	2018-01-25 14:58:23
guest_loopback_app	testpmd

4.2.7.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	128754
%usr	0.43
%system	2.99
%guest	0.00
%CPU	3.42
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	6608352
RSS	9136
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	128669
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5944
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	129030
%usr	0.18
%system	0.16
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2881079
RSS	67040
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.09
kB_ccwr/s	0.00

4.2.7.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.7.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	548
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:04:50
start_time	2018-01-25 13:53:32
stop_time	2018-01-25 14:58:23
guest_loopback_app	testpmd

4.2.7.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	128754
%usr	0.43
%system	2.99
%guest	0.00
%CPU	3.42
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	6608352
RSS	9136
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	128669
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5944
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	129030
%usr	0.18
%system	0.16
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2881079
RSS	67040
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.09
kB_ccwr/s	0.00

4.2.7.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.7.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	372
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	01:04:50
start_time	2018-01-25 13:53:32
stop_time	2018-01-25 14:58:23
guest_loopback_app	testpmd

4.2.7.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	128754
%usr	0.43
%system	2.99
%guest	0.00
%CPU	3.42
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	6608352
RSS	9136
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	128669
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44276
RSS	5944
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	129030
%usr	0.18
%system	0.16
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2881079
RSS	67040
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	5.09
kB_ccwr/s	0.00

4.2.7.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.7.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.8. Test ID: PVVP_TPUT¶

4.2.8.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40
VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvvp_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: pvvp
Traffic type: rfc2544_throughput
Bidirectional : True

4.2.8.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

4.2.8.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	495213.686
tx_rate_mbps	Unknown
throughput_rx_mbps	253.549
tx_rate_percent	1.773
throughput_rx_percent	1.664
frame_loss_percent	6.171
min_latency_ns	19860.000
max_latency_ns	4559100.000
avg_latency_ns	1302826.000
type	rfc2544_throughput
packet_size	64
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:59:12
start_time	2018-01-25 14:58:24
stop_time	2018-01-25 15:57:36
guest_loopback_app	testpmd testpmd

4.2.8.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	141858
%usr	0.42
%system	2.93
%guest	0.00
%CPU	3.35
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	6608352
RSS	9127
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	141855
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5652
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	142318
%usr	0.13
%system	0.77
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2879703
RSS	65792
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.37
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	142183
%usr	0.04
%system	0.74
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2810057
RSS	66484
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.8.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

4.2.8.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	430218.064
tx_rate_mbps	Unknown
throughput_rx_mbps	440.543
tx_rate_percent	2.547
throughput_rx_percent	2.547
frame_loss_percent	0.000
min_latency_ns	30540.000
max_latency_ns	1494140.000
avg_latency_ns	141160.500
type	rfc2544_throughput
packet_size	128
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:59:12
start_time	2018-01-25 14:58:24
stop_time	2018-01-25 15:57:36
guest_loopback_app	testpmd testpmd

4.2.8.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	141858
%usr	0.42
%system	2.93
%guest	0.00
%CPU	3.35
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	6608352
RSS	9127
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	141855
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5652
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	142318
%usr	0.13
%system	0.77
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2879703
RSS	65792
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.37
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	142183
%usr	0.04
%system	0.74
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2810057
RSS	66484
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.8.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

4.2.8.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	265068.372
tx_rate_mbps	Unknown
throughput_rx_mbps	1085.720
tx_rate_percent	5.641
throughput_rx_percent	5.641
frame_loss_percent	0.000
min_latency_ns	28760.000
max_latency_ns	1264440.000
avg_latency_ns	89959.500
type	rfc2544_throughput
packet_size	512
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:59:12
start_time	2018-01-25 14:58:24
stop_time	2018-01-25 15:57:36
guest_loopback_app	testpmd testpmd

4.2.8.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	141858
%usr	0.42
%system	2.93
%guest	0.00
%CPU	3.35
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	6608352
RSS	9127
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	141855
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5652
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	142318
%usr	0.13
%system	0.77
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2879703
RSS	65792
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.37
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	142183
%usr	0.04
%system	0.74
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2810057
RSS	66484
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.8.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

4.2.8.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	320303.772
tx_rate_mbps	Unknown
throughput_rx_mbps	2623.929
tx_rate_percent	13.375
throughput_rx_percent	13.375
frame_loss_percent	0.000
min_latency_ns	33640.000
max_latency_ns	392000.000
avg_latency_ns	95512.500
type	rfc2544_throughput
packet_size	1024
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:59:12
start_time	2018-01-25 14:58:24
stop_time	2018-01-25 15:57:36
guest_loopback_app	testpmd testpmd

4.2.8.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	141858
%usr	0.42
%system	2.93
%guest	0.00
%CPU	3.35
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	6608352
RSS	9127
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	141855
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5652
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	142318
%usr	0.13
%system	0.77
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2879703
RSS	65792
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.37
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	142183
%usr	0.04
%system	0.74
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2810057
RSS	66484
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.8.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

4.2.8.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	317987.550
tx_rate_mbps	Unknown
throughput_rx_mbps	3861.641
tx_rate_percent	19.563
throughput_rx_percent	19.563
frame_loss_percent	0.000
min_latency_ns	31680.000
max_latency_ns	765460.000
avg_latency_ns	105272.500
type	rfc2544_throughput
packet_size	1518
vswitch	OvsVanilla
traffic_type	udp
test_execution_time	00:59:12
start_time	2018-01-25 14:58:24
stop_time	2018-01-25 15:57:36
guest_loopback_app	testpmd testpmd

4.2.8.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic	Value
UID	0
PID	141858
%usr	0.42
%system	2.93
%guest	0.00
%CPU	3.35
CPU
minflt/s	0.06
majflt/s	0.00
VSZ	6608352
RSS	9127
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: ovsdb-server
Statistic	Value
UID	0
PID	141855
%usr	0.00
%system	0.00
%guest	0.00
%CPU	0.01
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	44280
RSS	5652
%MEM	0.01
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	142318
%usr	0.13
%system	0.77
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.01
majflt/s	0.00
VSZ	2879703
RSS	65792
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	6.37
kB_ccwr/s	0.00

Process: qemu-system-x86
Statistic	Value
UID	0
PID	142183
%usr	0.04
%system	0.74
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2810057
RSS	66484
%MEM	0.10
kB_rd/s	0.00
kB_wr/s	0.01
kB_ccwr/s	0.00

4.2.8.7. Anomalies¶

No anomalies were detected during the course of this test.

4.2.8.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.3. Rationale for decisions¶

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

4.4. Conclusions and recommendations¶

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-25_09-30-27/vswitchperf_logs_2018-01-25_09-30-27.tar.gz.

4.5. General¶

4.5.1. Glossary¶

NFV - Network Function Virtualization
Mbps - 1,000,000bps

4.5.2. Document change procedures and history¶

Document ID	Author	Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT	Christopher Nolan	23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT	Christopher Nolan	28/01/2015

5. Performance report for VppDpdkVhost¶

5.1. Introduction¶

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

5.1.1. Document identifier¶

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

5.1.2. Scope¶

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

5.1.3. References¶

OPNFV_vswitchperf_LTD_Brahmaputra_REVIEWED

5.2. Details of the Level Test Report¶

This section provides a test-results-overview. Also included are the rationale and the conclusions.

5.2.1. Test ID: PVP_TPUT_VPP¶

5.2.1.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_tput_vpp
Description: VPP: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: clean
Traffic type: rfc2544_throughput
Bidirectional : True

5.2.1.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

5.2.1.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	6052365.444
tx_rate_mbps	Unknown
throughput_rx_mbps	3098.811
tx_rate_percent	20.336
throughput_rx_percent	20.336
frame_loss_percent	0.000
min_latency_ns	10940.000
max_latency_ns	67680.000
avg_latency_ns	23777.000
type	rfc2544_throughput
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:58:14
start_time	2018-01-25 19:02:35
stop_time	2018-01-25 20:00:49

5.2.1.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	191707
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	10035667
RSS	51218
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

5.2.1.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4349676.006
tx_rate_mbps	Unknown
throughput_rx_mbps	4454.068
tx_rate_percent	25.750
throughput_rx_percent	25.750
frame_loss_percent	0.000
min_latency_ns	9780.000
max_latency_ns	55020.000
avg_latency_ns	16180.000
type	rfc2544_throughput
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:58:14
start_time	2018-01-25 19:02:35
stop_time	2018-01-25 20:00:49

5.2.1.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	191707
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	10035667
RSS	51218
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

5.2.1.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4226755.258
tx_rate_mbps	Unknown
throughput_rx_mbps	17312.790
tx_rate_percent	89.945
throughput_rx_percent	89.945
frame_loss_percent	0.000
min_latency_ns	9840.000
max_latency_ns	86660.000
avg_latency_ns	40286.000
type	rfc2544_throughput
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:58:14
start_time	2018-01-25 19:02:35
stop_time	2018-01-25 20:00:49

5.2.1.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	191707
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	10035667
RSS	51218
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

5.2.1.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394477.665
tx_rate_mbps	Unknown
throughput_rx_mbps	19615.561
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	25180.000
max_latency_ns	230320.000
avg_latency_ns	213955.500
type	rfc2544_throughput
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:58:14
start_time	2018-01-25 19:02:35
stop_time	2018-01-25 20:00:49

5.2.1.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	191707
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	10035667
RSS	51218
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

5.2.1.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625427.539
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.192
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	24020.000
max_latency_ns	137940.000
avg_latency_ns	124861.000
type	rfc2544_throughput
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:58:14
start_time	2018-01-25 19:02:35
stop_time	2018-01-25 20:00:49

5.2.1.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	191707
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.04
majflt/s	0.00
VSZ	10035667
RSS	51218
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.1.7. Anomalies¶

No anomalies were detected during the course of this test.

5.2.1.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.2. Test ID: PVP_BACK2BACK_VPP¶

5.2.2.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_back2back_vpp
Description: VPP: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: clean
Traffic type: rfc2544_back2back
Bidirectional : True

5.2.2.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

5.2.2.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:06:31
start_time	2018-01-25 20:00:50
stop_time	2018-01-25 21:07:21

5.2.2.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	7690
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10059815
RSS	50896
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

5.2.2.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	0
b2b_frame_loss_percent	100
type	rfc2544_back2back
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:06:31
start_time	2018-01-25 20:00:50
stop_time	2018-01-25 21:07:21

5.2.2.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	7690
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10059815
RSS	50896
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

5.2.2.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35244280
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:06:31
start_time	2018-01-25 20:00:50
stop_time	2018-01-25 21:07:21

5.2.2.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	7690
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10059815
RSS	50896
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

5.2.2.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:06:31
start_time	2018-01-25 20:00:50
stop_time	2018-01-25 21:07:21

5.2.2.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	7690
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10059815
RSS	50896
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

5.2.2.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:06:31
start_time	2018-01-25 20:00:50
stop_time	2018-01-25 21:07:21

5.2.2.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	7690
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.03
majflt/s	0.00
VSZ	10059815
RSS	50896
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.2.7. Anomalies¶

No anomalies were detected during the course of this test.

5.2.2.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.3. Test ID: PHY2PHY_BACK2BACK_VPP¶

5.2.3.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: phy2phy_back2back_vpp
Description: VPP: LTD.Throughput.RFC2544.BackToBackFrames
Deployment: clean
Traffic type: rfc2544_back2back
Bidirectional : True

5.2.3.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

5.2.3.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24267
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:01:59
start_time	2018-01-25 18:00:35
stop_time	2018-01-25 19:02:35

5.2.3.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	179308
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	3937544
RSS	50428
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

5.2.3.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	247439
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:01:59
start_time	2018-01-25 18:00:35
stop_time	2018-01-25 19:02:35

5.2.3.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	179308
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	3937544
RSS	50428
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

5.2.3.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	70488721
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:01:59
start_time	2018-01-25 18:00:35
stop_time	2018-01-25 19:02:35

5.2.3.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	179308
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	3937544
RSS	50428
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

5.2.3.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	35919540
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:01:59
start_time	2018-01-25 18:00:35
stop_time	2018-01-25 19:02:35

5.2.3.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	179308
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	3937544
RSS	50428
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

5.2.3.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
b2b_frames	24382314
b2b_frame_loss_percent	0.0
type	rfc2544_back2back
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:01:59
start_time	2018-01-25 18:00:35
stop_time	2018-01-25 19:02:35

5.2.3.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	179308
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	3937544
RSS	50428
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.3.7. Anomalies¶

No anomalies were detected during the course of this test.

5.2.3.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.4. Test ID: PVVP_TPUT_VPP¶

5.2.4.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvvp_tput_vpp
Description: VPP: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: clean
Traffic type: rfc2544_throughput
Bidirectional : True

5.2.4.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

5.2.4.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	7663729.111
tx_rate_mbps	Unknown
throughput_rx_mbps	3923.829
tx_rate_percent	25.750
throughput_rx_percent	25.750
frame_loss_percent	0.000
min_latency_ns	8900.000
max_latency_ns	61800.000
avg_latency_ns	15694.500
type	rfc2544_throughput
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:04:53
start_time	2018-01-25 21:07:21
stop_time	2018-01-25 22:12:15

5.2.4.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	21166
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	15944969
RSS	51188
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

5.2.4.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	7615872.209
tx_rate_mbps	Unknown
throughput_rx_mbps	7798.653
tx_rate_percent	45.086
throughput_rx_percent	45.086
frame_loss_percent	0.000
min_latency_ns	9920.000
max_latency_ns	75560.000
avg_latency_ns	18402.500
type	rfc2544_throughput
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:04:53
start_time	2018-01-25 21:07:21
stop_time	2018-01-25 22:12:15

5.2.4.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	21166
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	15944969
RSS	51188
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

5.2.4.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4662902.148
tx_rate_mbps	Unknown
throughput_rx_mbps	19099.247
tx_rate_percent	99.227
throughput_rx_percent	99.227
frame_loss_percent	0.000
min_latency_ns	17760.000
max_latency_ns	84740.000
avg_latency_ns	38642.000
type	rfc2544_throughput
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:04:53
start_time	2018-01-25 21:07:21
stop_time	2018-01-25 22:12:15

5.2.4.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	21166
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	15944969
RSS	51188
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

5.2.4.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394547.916
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.137
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	26620.000
max_latency_ns	152760.000
avg_latency_ns	128301.000
type	rfc2544_throughput
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:04:53
start_time	2018-01-25 21:07:21
stop_time	2018-01-25 22:12:15

5.2.4.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	21166
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	15944969
RSS	51188
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

5.2.4.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625445.830
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.414
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	28260.000
max_latency_ns	115440.000
avg_latency_ns	97368.500
type	rfc2544_throughput
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	01:04:53
start_time	2018-01-25 21:07:21
stop_time	2018-01-25 22:12:15

5.2.4.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	21166
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.05
majflt/s	0.00
VSZ	15944969
RSS	51188
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.4.7. Anomalies¶

No anomalies were detected during the course of this test.

5.2.4.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.5. Test ID: PHY2PHY_TPUT_VPP¶

5.2.5.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
- Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: clean
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA
DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: phy2phy_tput_vpp
Description: VPP: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: clean
Traffic type: rfc2544_throughput
Bidirectional : True

5.2.5.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

5.2.5.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	22395931.507
tx_rate_mbps	Unknown
throughput_rx_mbps	11466.717
tx_rate_percent	75.250
throughput_rx_percent	75.250
frame_loss_percent	0.000
min_latency_ns	5860.000
max_latency_ns	39320.000
avg_latency_ns	19873.500
type	rfc2544_throughput
packet_size	64
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:56:42
start_time	2018-01-25 17:03:52
stop_time	2018-01-25 18:00:35

5.2.5.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	167910
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	3937544
RSS	50584
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.5.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

5.2.5.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	16369329.522
tx_rate_mbps	Unknown
throughput_rx_mbps	16762.193
tx_rate_percent	96.906
throughput_rx_percent	96.906
frame_loss_percent	0.000
min_latency_ns	5900.000
max_latency_ns	79380.000
avg_latency_ns	12590.500
type	rfc2544_throughput
packet_size	128
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:56:42
start_time	2018-01-25 17:03:52
stop_time	2018-01-25 18:00:35

5.2.5.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	167910
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	3937544
RSS	50584
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.5.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

5.2.5.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699206.717
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.951
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	13360.000
max_latency_ns	40740.000
avg_latency_ns	30122.500
type	rfc2544_throughput
packet_size	512
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:56:42
start_time	2018-01-25 17:03:52
stop_time	2018-01-25 18:00:35

5.2.5.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	167910
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	3937544
RSS	50584
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.5.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

5.2.5.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394616.583
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.699
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	12780.000
max_latency_ns	39180.000
avg_latency_ns	27910.000
type	rfc2544_throughput
packet_size	1024
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:56:42
start_time	2018-01-25 17:03:52
stop_time	2018-01-25 18:00:35

5.2.5.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	167910
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	3937544
RSS	50584
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.5.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

5.2.5.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625474.833
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.766
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	13300.000
max_latency_ns	38460.000
avg_latency_ns	27562.000
type	rfc2544_throughput
packet_size	1518
vswitch	VppDpdkVhost
traffic_type	udp
test_execution_time	00:56:42
start_time	2018-01-25 17:03:52
stop_time	2018-01-25 18:00:35

5.2.5.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic	Value
UID	0
PID	167910
%usr	100.00
%system	0.13
%guest	0.00
%CPU	100.00
CPU
minflt/s	0.02
majflt/s	0.00
VSZ	3937544
RSS	50584
%MEM	0.08
kB_rd/s	0.00
kB_wr/s	0.00
kB_ccwr/s	0.00

5.2.5.7. Anomalies¶

No anomalies were detected during the course of this test.

5.2.5.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.3. Rationale for decisions¶

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

5.4. Conclusions and recommendations¶

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-25_09-30-27/vswitchperf_logs_2018-01-25_09-30-27.tar.gz.

5.5. General¶

5.5.1. Glossary¶

NFV - Network Function Virtualization
Mbps - 1,000,000bps

5.5.2. Document change procedures and history¶

Document ID	Author	Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT	Christopher Nolan	23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT	Christopher Nolan	28/01/2015

6. Performance report for none¶

6.1. Introduction¶

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

6.1.1. Document identifier¶

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

6.1.2. Scope¶

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

6.1.3. References¶

OPNFV_vswitchperf_LTD_Brahmaputra_REVIEWED

6.2. Details of the Level Test Report¶

This section provides a test-results-overview. Also included are the rationale and the conclusions.

6.2.1. Test ID: PVP_TPUT¶

6.2.1.1. Test Environment¶

Below is the environment that the test was performed in:

OS: CentOS Linux 7 Core
Kernel Version: 4.4.112-1.el7.elrepo.x86_64
NIC(s):
- Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
- Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
Board: Intel Corporation S2600WT2R [2 sockets]
CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
CPU cores: 88
Memory: 65917716 kB
Virtual Switch Set-up: pvp
vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4
Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None
vSwitch: none, Version: None, GIT tag: None
VNF: QemuPciPassthrough, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277
VM images:
- /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
VM loopback apps:
- testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

Test ID: pvp_tput
Description: LTD.Throughput.RFC2544.PacketLossRatio
Deployment: pvp
Traffic type: rfc2544_throughput
Bidirectional : True

6.2.1.2. Test results for packet size: 64¶

A detailed summary of the main results is outlined below.

6.2.1.2.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	7663707.550
tx_rate_mbps	Unknown
throughput_rx_mbps	3923.818
tx_rate_percent	25.750
throughput_rx_percent	25.750
frame_loss_percent	0.000
min_latency_ns	3560.000
max_latency_ns	29900.000
avg_latency_ns	3934.500
type	rfc2544_throughput
packet_size	64
vswitch	none
traffic_type	udp
test_execution_time	00:57:48
start_time	2018-01-25 22:17:50
stop_time	2018-01-25 23:15:38
guest_loopback_app	testpmd

6.2.1.2.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic	Value
UID	0
PID	36226
%usr	0.13
%system	0.08
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2803800
RSS	75864
%MEM	0.12
kB_rd/s	0.00
kB_wr/s	6.50
kB_ccwr/s	0.00

6.2.1.3. Test results for packet size: 128¶

A detailed summary of the main results is outlined below.

6.2.1.3.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	6440041.448
tx_rate_mbps	Unknown
throughput_rx_mbps	6594.602
tx_rate_percent	38.125
throughput_rx_percent	38.125
frame_loss_percent	0.000
min_latency_ns	3700.000
max_latency_ns	24020.000
avg_latency_ns	4058.500
type	rfc2544_throughput
packet_size	128
vswitch	none
traffic_type	udp
test_execution_time	00:57:48
start_time	2018-01-25 22:17:50
stop_time	2018-01-25 23:15:38
guest_loopback_app	testpmd

6.2.1.3.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic	Value
UID	0
PID	36226
%usr	0.13
%system	0.08
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2803800
RSS	75864
%MEM	0.12
kB_rd/s	0.00
kB_wr/s	6.50
kB_ccwr/s	0.00

6.2.1.4. Test results for packet size: 512¶

A detailed summary of the main results is outlined below.

6.2.1.4.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	4699194.828
tx_rate_mbps	Unknown
throughput_rx_mbps	19247.902
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	5960.000
max_latency_ns	42540.000
avg_latency_ns	28577.500
type	rfc2544_throughput
packet_size	512
vswitch	none
traffic_type	udp
test_execution_time	00:57:48
start_time	2018-01-25 22:17:50
stop_time	2018-01-25 23:15:38
guest_loopback_app	testpmd

6.2.1.4.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic	Value
UID	0
PID	36226
%usr	0.13
%system	0.08
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2803800
RSS	75864
%MEM	0.12
kB_rd/s	0.00
kB_wr/s	6.50
kB_ccwr/s	0.00

6.2.1.5. Test results for packet size: 1024¶

A detailed summary of the main results is outlined below.

6.2.1.5.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	2394605.936
tx_rate_mbps	Unknown
throughput_rx_mbps	19616.612
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	6620.000
max_latency_ns	45400.000
avg_latency_ns	32381.000
type	rfc2544_throughput
packet_size	1024
vswitch	none
traffic_type	udp
test_execution_time	00:57:48
start_time	2018-01-25 22:17:50
stop_time	2018-01-25 23:15:38
guest_loopback_app	testpmd

6.2.1.5.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic	Value
UID	0
PID	36226
%usr	0.13
%system	0.08
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2803800
RSS	75864
%MEM	0.12
kB_rd/s	0.00
kB_wr/s	6.50
kB_ccwr/s	0.00

6.2.1.6. Test results for packet size: 1518¶

A detailed summary of the main results is outlined below.

6.2.1.6.1. Results/Metrics Collected¶

The following are the metrics obtained during this test:

Metric	Result
tx_rate_fps	Unknown
throughput_rx_fps	1625466.711
tx_rate_mbps	Unknown
throughput_rx_mbps	19739.668
tx_rate_percent	100
throughput_rx_percent	100
frame_loss_percent	0.000
min_latency_ns	6760.000
max_latency_ns	48300.000
avg_latency_ns	33519.500
type	rfc2544_throughput
packet_size	1518
vswitch	none
traffic_type	udp
test_execution_time	00:57:48
start_time	2018-01-25 22:17:50
stop_time	2018-01-25 23:15:38
guest_loopback_app	testpmd

6.2.1.6.2. Statistics collected¶

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic	Value
UID	0
PID	36226
%usr	0.13
%system	0.08
%guest	100.00
%CPU	100.00
CPU
minflt/s	0.00
majflt/s	0.00
VSZ	2803800
RSS	75864
%MEM	0.12
kB_rd/s	0.00
kB_wr/s	6.50
kB_ccwr/s	0.00

6.2.1.7. Anomalies¶

No anomalies were detected during the course of this test.

6.2.1.8. Testing Activities/Events¶

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

6.3. Rationale for decisions¶

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

6.4. Conclusions and recommendations¶

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-25_09-30-27/vswitchperf_logs_2018-01-25_09-30-27.tar.gz.

6.5. General¶

6.5.1. Glossary¶

NFV - Network Function Virtualization
Mbps - 1,000,000bps

6.5.2. Document change procedures and history¶

Document ID	Author	Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT	Christopher Nolan	23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT	Christopher Nolan	28/01/2015