VSPERF Results

1. OPNFV Brahmaputra Scenarios

Available Tests and aspects of scenarios:

Framework Test Definition
phy2phy_tput PacketLossRatio for Phy2Phy
back2back BackToBackFrames for Phy2Phy
phy2phy_tput_mod_vlan PacketLossRatioFrameModification for Phy2Phy
phy2phy_cont Phy2Phy blast vswitch at x% TX rate and measure throughput
pvp_cont PVP blast vswitch at x% TX rate and measure throughput
pvvp_cont PVVP blast vswitch at x% TX rate and measure throughput
phy2phy_scalability Scalability0PacketLoss for Phy2Phy
pvp_tput PacketLossRatio for PVP
pvp_back2back BackToBackFrames for PVP
pvvp_tput PacketLossRatio for PVVP
pvvp_back2back BackToBackFrames for PVVP
phy2phy_cpu_load CPU0PacketLoss for Phy2Phy
phy2phy_mem_load Same as CPU0PacketLoss but using a memory intensive app

Supported deployment scenarios:

  • Phy2Phy: Physical port -> vSwitch -> Physical port.
  • PVP: Physical port -> vSwitch -> VNF -> vSwitch -> Physical port.
  • PVVP: Physical port -> vSwitch -> VNF -> vSwitch -> VNF -> vSwitch -> Physical port.

Loopback applications in the Guest can be:

Supported traffic generators:

  • Ixia: IxOS and IxNet.
  • Spirent.
  • Dummy.

2. OPNFV Brahmaputra Results

The vsperf CI jobs that were used to obtain the results can be found at https://wiki.opnfv.org/wiki/vsperf_results.

The following table maps the results in the test dashboard to the appropriate test case in the VSPERF Framework and specifies the metric the vertical/Y axis is plotting. Please note, the presence of dpdk within a test name signifies that the vswitch under test was OVS with DPDK, while its absence indicates that the vswitch under test was stock OVS.

Dashboard Test Framework Test Metric Guest Interface
tput_ovsdpdk phy2phy_tput Throughput (FPS) N/A
tput_ovs phy2phy_tput Throughput (FPS) N/A
b2b_ovsdpdk back2back Back-to-back value N/A
b2b_ovs back2back Back-to-back value N/A
tput_mod_vlan_ovs phy2phy_tput_mod_vlan Throughput (FPS) N/A
tput_mod_vlan_ovsdpdk phy2phy_tput_mod_vlan Throughput (FPS) N/A
scalability_ovs phy2phy_scalability Throughput (FPS) N/A
scalability_ovsdpdk phy2phy_scalability Throughput (FPS) N/A
pvp_tput_ovsdpdkuser pvp_tput Throughput (FPS) vhost-user
pvp_tput_ovsvirtio pvp_tput Throughput (FPS) virtio-net
pvp_b2b_ovsdpdkuser pvp_back2back Back-to-back value vhost-user
pvp_b2b_ovsvirtio pvp_back2back Back-to-back value virtio-net
pvvp_tput_ovsdpdkuser pvvp_tput Throughput (FPS) vhost-user
pvvp_tput_ovsvirtio pvvp_tput Throughput (FPS) virtio-net
pvvp_b2b_ovsdpdkuser pvvp_back2back Throughput (FPS) vhost-user
pvvp_b2b_ovsvirtio pvvp_back2back Throughput (FPS) virtio-net

The loopback application in the VNF used for PVP and PVVP scenarios was DPDK testpmd.

3. Performance report for Open vSwitch with DPDK support

3.1. Introduction

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

3.1.1. Document identifier

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

3.1.2. Scope

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

3.2. Details of the Level Test Report

This section provides a test-results-overview. Also included are the rationale and the conclusions.

3.2.1. Test ID: BACK2BACK

3.2.1.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 3d33e32f9fe9d8c8e6f4fb935d67fc39b2c0a483

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • DPDK Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: p2p
  • Traffic type: rfc2544
  • Bidirectional : True
3.2.1.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.1.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 26396
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:46:39
3.2.1.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 36435
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 17.34
majflt/s 0.00
VSZ 8057820
RSS 25291
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 36419
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3464
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.1.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 15836148
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:46:39
3.2.1.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 36435
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 17.34
majflt/s 0.00
VSZ 8057820
RSS 25291
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 36419
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3464
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.1.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 70488721
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:46:39
3.2.1.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 36435
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 17.34
majflt/s 0.00
VSZ 8057820
RSS 25291
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 36419
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3464
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.1.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 35919540
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:46:39
3.2.1.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 36435
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 17.34
majflt/s 0.00
VSZ 8057820
RSS 25291
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 36419
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3464
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.1.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 24382314
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:46:39
3.2.1.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 36435
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 17.34
majflt/s 0.00
VSZ 8057820
RSS 25291
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 36419
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3464
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.7. Anomalies

No anomalies were detected during the course of this test.

3.2.1.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.2. Test ID: PVP_TPUT

3.2.2.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: pvp

  • vswitchperf: GIT tag: 3d33e32f9fe9d8c8e6f4fb935d67fc39b2c0a483

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • DPDK Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

  • VNF: QemuDpdkVhostUser, Version: 2.5.0, GIT tag: a8c40fa2d667e585382080db36ac44e216b37a1c

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: pvp_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: pvp
  • Traffic type: rfc2544
  • Bidirectional : True
3.2.2.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.2.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4671226.771
tx_rate_mbps Unknown
throughput_rx_mbps 2391.668
tx_rate_percent 15.695
throughput_rx_percent 15.695
frame_loss_percent 0.000
min_latency_ns 4940.000
max_latency_ns 100820.000
avg_latency_ns 6544.500
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:43:19
guest_loopback_app testpmd
3.2.2.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 54164
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 7.24
majflt/s 0.00
VSZ 12256220
RSS 27563
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 54148
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52096
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 54423
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.16
CPU
minflt/s 0.38
majflt/s 0.00
VSZ 2710920
RSS 313089
%MEM 0.48
kB_rd/s 0.00
kB_wr/s 5.60
kB_ccwr/s 0.00
3.2.2.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.2.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 3827070.853
tx_rate_mbps Unknown
throughput_rx_mbps 3918.921
tx_rate_percent 22.656
throughput_rx_percent 22.656
frame_loss_percent 0.000
min_latency_ns 4900.000
max_latency_ns 86820.000
avg_latency_ns 6280.500
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:43:19
guest_loopback_app testpmd
3.2.2.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 54164
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 7.24
majflt/s 0.00
VSZ 12256220
RSS 27563
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 54148
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52096
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 54423
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.16
CPU
minflt/s 0.38
majflt/s 0.00
VSZ 2710920
RSS 313089
%MEM 0.48
kB_rd/s 0.00
kB_wr/s 5.60
kB_ccwr/s 0.00
3.2.2.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.2.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4117716.761
tx_rate_mbps Unknown
throughput_rx_mbps 16866.168
tx_rate_percent 87.625
throughput_rx_percent 87.625
frame_loss_percent 0.000
min_latency_ns 22160.000
max_latency_ns 125120.000
avg_latency_ns 32374.500
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:43:19
guest_loopback_app testpmd
3.2.2.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 54164
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 7.24
majflt/s 0.00
VSZ 12256220
RSS 27563
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 54148
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52096
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 54423
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.16
CPU
minflt/s 0.38
majflt/s 0.00
VSZ 2710920
RSS 313089
%MEM 0.48
kB_rd/s 0.00
kB_wr/s 5.60
kB_ccwr/s 0.00
3.2.2.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.2.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394566.873
tx_rate_mbps Unknown
throughput_rx_mbps 19616.292
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 48420.000
max_latency_ns 144780.000
avg_latency_ns 133401.500
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:43:19
guest_loopback_app testpmd
3.2.2.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 54164
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 7.24
majflt/s 0.00
VSZ 12256220
RSS 27563
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 54148
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52096
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 54423
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.16
CPU
minflt/s 0.38
majflt/s 0.00
VSZ 2710920
RSS 313089
%MEM 0.48
kB_rd/s 0.00
kB_wr/s 5.60
kB_ccwr/s 0.00
3.2.2.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.2.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625453.025
tx_rate_mbps Unknown
throughput_rx_mbps 19739.502
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 49400.000
max_latency_ns 131560.000
avg_latency_ns 112865.500
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:43:19
guest_loopback_app testpmd
3.2.2.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 54164
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 7.24
majflt/s 0.00
VSZ 12256220
RSS 27563
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 54148
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52096
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 54423
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.16
CPU
minflt/s 0.38
majflt/s 0.00
VSZ 2710920
RSS 313089
%MEM 0.48
kB_rd/s 0.00
kB_wr/s 5.60
kB_ccwr/s 0.00
3.2.2.7. Anomalies

No anomalies were detected during the course of this test.

3.2.2.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.3. Test ID: PHY2PHY_TPUT_MOD_VLAN

3.2.3.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 3d33e32f9fe9d8c8e6f4fb935d67fc39b2c0a483

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • DPDK Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: phy2phy_tput_mod_vlan
  • Description: LTD.Throughput.RFC2544.PacketLossRatioFrameModification
  • Deployment: p2p
  • Traffic type: rfc2544
  • Bidirectional : False
3.2.3.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.3.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 11888509.943
tx_rate_mbps Unknown
throughput_rx_mbps 6467.349
tx_rate_percent 79.891
throughput_rx_percent 83.695
frame_loss_percent 0.000
min_latency_ns 6360.000
max_latency_ns 471920.000
avg_latency_ns 8330.000
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:48:31
3.2.3.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 42395
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 18.79
majflt/s 0.00
VSZ 8057816
RSS 23253
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 42379
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52096
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.3.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 8184668.297
tx_rate_mbps Unknown
throughput_rx_mbps 8643.010
tx_rate_percent 96.906
throughput_rx_percent 99.526
frame_loss_percent 0.000
min_latency_ns 5460.000
max_latency_ns 366960.000
avg_latency_ns 8775.000
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:48:31
3.2.3.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 42395
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 18.79
majflt/s 0.00
VSZ 8057816
RSS 23253
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 42379
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52096
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.3.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2331451.378
tx_rate_mbps Unknown
throughput_rx_mbps 9624.231
tx_rate_percent 99.227
throughput_rx_percent 99.973
frame_loss_percent 0.000
min_latency_ns 6000.000
max_latency_ns 392520.000
avg_latency_ns 26612.000
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:48:31
3.2.3.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 42395
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 18.79
majflt/s 0.00
VSZ 8057816
RSS 23253
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 42379
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52096
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.3.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1188058.640
tx_rate_mbps Unknown
throughput_rx_mbps 9770.594
tx_rate_percent 99.227
throughput_rx_percent 99.607
frame_loss_percent 0.000
min_latency_ns 5760.000
max_latency_ns 36100.000
avg_latency_ns 8367.000
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:48:31
3.2.3.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 42395
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 18.79
majflt/s 0.00
VSZ 8057816
RSS 23253
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 42379
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52096
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.3.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 806458.299
tx_rate_mbps Unknown
throughput_rx_mbps 9819.436
tx_rate_percent 99.227
throughput_rx_percent 99.485
frame_loss_percent 0.000
min_latency_ns 6220.000
max_latency_ns 41860.000
avg_latency_ns 8355.000
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:48:31
3.2.3.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 42395
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 18.79
majflt/s 0.00
VSZ 8057816
RSS 23253
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 42379
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52096
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.7. Anomalies

No anomalies were detected during the course of this test.

3.2.3.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.4. Test ID: PVVP_BACK2BACK

3.2.4.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: pvvp

  • vswitchperf: GIT tag: 3d33e32f9fe9d8c8e6f4fb935d67fc39b2c0a483

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • DPDK Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

  • VNF: QemuDpdkVhostUser, Version: 2.5.0, GIT tag: a8c40fa2d667e585382080db36ac44e216b37a1c

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: pvvp_back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: pvvp
  • Traffic type: rfc2544
  • Bidirectional : True
3.2.4.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.4.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1702
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:58:03
guest_loopback_app testpmd testpmd
3.2.4.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 73574
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 15.73
majflt/s 0.00
VSZ 16454620
RSS 27497
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 73558
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3484
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 73976
%usr 0.00
%system 0.04
%guest 200.17
%CPU 100.16
CPU
minflt/s 0.93
majflt/s 0.00
VSZ 2679172
RSS 248453
%MEM 0.38
kB_rd/s 0.00
kB_wr/s 4.42
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 73820
%usr 0.00
%system 0.15
%guest 200.31
%CPU 100.15
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 2721164
RSS 265939
%MEM 0.40
kB_rd/s 0.00
kB_wr/s 0.04
kB_ccwr/s 0.00
3.2.4.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.4.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 3866
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:58:03
guest_loopback_app testpmd testpmd
3.2.4.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 73574
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 15.73
majflt/s 0.00
VSZ 16454620
RSS 27497
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 73558
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3484
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 73976
%usr 0.00
%system 0.04
%guest 200.17
%CPU 100.16
CPU
minflt/s 0.93
majflt/s 0.00
VSZ 2679172
RSS 248453
%MEM 0.38
kB_rd/s 0.00
kB_wr/s 4.42
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 73820
%usr 0.00
%system 0.15
%guest 200.31
%CPU 100.15
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 2721164
RSS 265939
%MEM 0.40
kB_rd/s 0.00
kB_wr/s 0.04
kB_ccwr/s 0.00
3.2.4.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.4.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 2151
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:58:03
guest_loopback_app testpmd testpmd
3.2.4.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 73574
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 15.73
majflt/s 0.00
VSZ 16454620
RSS 27497
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 73558
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3484
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 73976
%usr 0.00
%system 0.04
%guest 200.17
%CPU 100.16
CPU
minflt/s 0.93
majflt/s 0.00
VSZ 2679172
RSS 248453
%MEM 0.38
kB_rd/s 0.00
kB_wr/s 4.42
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 73820
%usr 0.00
%system 0.15
%guest 200.31
%CPU 100.15
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 2721164
RSS 265939
%MEM 0.40
kB_rd/s 0.00
kB_wr/s 0.04
kB_ccwr/s 0.00
3.2.4.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.4.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 35919508
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:58:03
guest_loopback_app testpmd testpmd
3.2.4.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 73574
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 15.73
majflt/s 0.00
VSZ 16454620
RSS 27497
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 73558
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3484
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 73976
%usr 0.00
%system 0.04
%guest 200.17
%CPU 100.16
CPU
minflt/s 0.93
majflt/s 0.00
VSZ 2679172
RSS 248453
%MEM 0.38
kB_rd/s 0.00
kB_wr/s 4.42
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 73820
%usr 0.00
%system 0.15
%guest 200.31
%CPU 100.15
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 2721164
RSS 265939
%MEM 0.40
kB_rd/s 0.00
kB_wr/s 0.04
kB_ccwr/s 0.00
3.2.4.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.4.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 24382314
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:58:03
guest_loopback_app testpmd testpmd
3.2.4.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 73574
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 15.73
majflt/s 0.00
VSZ 16454620
RSS 27497
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 73558
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3484
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 73976
%usr 0.00
%system 0.04
%guest 200.17
%CPU 100.16
CPU
minflt/s 0.93
majflt/s 0.00
VSZ 2679172
RSS 248453
%MEM 0.38
kB_rd/s 0.00
kB_wr/s 4.42
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 73820
%usr 0.00
%system 0.15
%guest 200.31
%CPU 100.15
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 2721164
RSS 265939
%MEM 0.40
kB_rd/s 0.00
kB_wr/s 0.04
kB_ccwr/s 0.00
3.2.4.7. Anomalies

No anomalies were detected during the course of this test.

3.2.4.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.5. Test ID: PHY2PHY_TPUT

3.2.5.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 3d33e32f9fe9d8c8e6f4fb935d67fc39b2c0a483

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • DPDK Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: phy2phy_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: p2p
  • Traffic type: rfc2544
  • Bidirectional : True
3.2.5.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.5.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 23086566.451
tx_rate_mbps Unknown
throughput_rx_mbps 11820.322
tx_rate_percent 77.570
throughput_rx_percent 77.570
frame_loss_percent 0.000
min_latency_ns 4700.000
max_latency_ns 385400.000
avg_latency_ns 8407.500
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:37:09
3.2.5.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 31660
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 20.34
majflt/s 0.00
VSZ 8057816
RSS 25322
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 31644
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3456
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.5.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 15324202.182
tx_rate_mbps Unknown
throughput_rx_mbps 15691.983
tx_rate_percent 90.719
throughput_rx_percent 90.719
frame_loss_percent 0.000
min_latency_ns 6740.000
max_latency_ns 77800.000
avg_latency_ns 8308.500
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:37:09
3.2.5.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 31660
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 20.34
majflt/s 0.00
VSZ 8057816
RSS 25322
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 31644
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3456
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.5.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4699200.169
tx_rate_mbps Unknown
throughput_rx_mbps 19247.924
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 35660.000
max_latency_ns 67040.000
avg_latency_ns 55694.500
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:37:09
3.2.5.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 31660
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 20.34
majflt/s 0.00
VSZ 8057816
RSS 25322
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 31644
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3456
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.5.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394611.898
tx_rate_mbps Unknown
throughput_rx_mbps 19616.661
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 37580.000
max_latency_ns 68400.000
avg_latency_ns 57181.000
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:37:09
3.2.5.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 31660
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 20.34
majflt/s 0.00
VSZ 8057816
RSS 25322
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 31644
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3456
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.5.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625465.985
tx_rate_mbps Unknown
throughput_rx_mbps 19739.659
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 37820.000
max_latency_ns 84580.000
avg_latency_ns 67378.500
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:37:09
3.2.5.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 31660
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 20.34
majflt/s 0.00
VSZ 8057816
RSS 25322
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 31644
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3456
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.7. Anomalies

No anomalies were detected during the course of this test.

3.2.5.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.6. Test ID: PHY2PHY_SCALABILITY

3.2.6.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 3d33e32f9fe9d8c8e6f4fb935d67fc39b2c0a483

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • DPDK Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: phy2phy_scalability
  • Description: LTD.Scalability.Flows.RFC2544.0PacketLoss
  • Deployment: p2p
  • Traffic type: rfc2544
  • Bidirectional : True
3.2.6.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.6.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 23316602.490
tx_rate_mbps Unknown
throughput_rx_mbps 11938.100
tx_rate_percent 78.344
throughput_rx_percent 78.344
frame_loss_percent 0.000
min_latency_ns 5000.000
max_latency_ns 281580.000
avg_latency_ns 9779.000
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:41:58
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 48620
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 6.15
majflt/s 0.00
VSZ 8057820
RSS 27313
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 48604
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.6.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 15585428.101
tx_rate_mbps Unknown
throughput_rx_mbps 15959.478
tx_rate_percent 92.266
throughput_rx_percent 92.266
frame_loss_percent 0.000
min_latency_ns 7620.000
max_latency_ns 119260.000
avg_latency_ns 8720.500
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:41:58
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 48620
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 6.15
majflt/s 0.00
VSZ 8057820
RSS 27313
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 48604
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.6.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4698960.786
tx_rate_mbps Unknown
throughput_rx_mbps 19246.943
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 37680.000
max_latency_ns 369240.000
avg_latency_ns 65780.000
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:41:58
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 48620
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 6.15
majflt/s 0.00
VSZ 8057820
RSS 27313
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 48604
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.6.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394609.472
tx_rate_mbps Unknown
throughput_rx_mbps 19616.641
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 33440.000
max_latency_ns 67480.000
avg_latency_ns 56195.500
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:41:58
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 48620
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 6.15
majflt/s 0.00
VSZ 8057820
RSS 27313
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 48604
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.6.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625461.228
tx_rate_mbps Unknown
throughput_rx_mbps 19739.601
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 31400.000
max_latency_ns 80580.000
avg_latency_ns 56843.000
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:41:58
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 48620
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 6.15
majflt/s 0.00
VSZ 8057820
RSS 27313
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 48604
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.7. Anomalies

No anomalies were detected during the course of this test.

3.2.6.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.7. Test ID: PVP_BACK2BACK

3.2.7.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: pvp

  • vswitchperf: GIT tag: 3d33e32f9fe9d8c8e6f4fb935d67fc39b2c0a483

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • DPDK Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

  • VNF: QemuDpdkVhostUser, Version: 2.5.0, GIT tag: a8c40fa2d667e585382080db36ac44e216b37a1c

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: pvp_back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: pvp
  • Traffic type: rfc2544
  • Bidirectional : True
3.2.7.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.7.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 851
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:58:30
guest_loopback_app testpmd
3.2.7.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 59851
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 14.10
majflt/s 0.00
VSZ 12256216
RSS 27459
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 59834
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3484
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 60082
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.15
CPU
minflt/s 0.26
majflt/s 0.00
VSZ 2622860
RSS 298901
%MEM 0.46
kB_rd/s 0.00
kB_wr/s 4.19
kB_ccwr/s 0.00
3.2.7.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.7.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1933
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:58:30
guest_loopback_app testpmd
3.2.7.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 59851
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 14.10
majflt/s 0.00
VSZ 12256216
RSS 27459
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 59834
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3484
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 60082
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.15
CPU
minflt/s 0.26
majflt/s 0.00
VSZ 2622860
RSS 298901
%MEM 0.46
kB_rd/s 0.00
kB_wr/s 4.19
kB_ccwr/s 0.00
3.2.7.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.7.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1352801
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:58:30
guest_loopback_app testpmd
3.2.7.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 59851
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 14.10
majflt/s 0.00
VSZ 12256216
RSS 27459
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 59834
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3484
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 60082
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.15
CPU
minflt/s 0.26
majflt/s 0.00
VSZ 2622860
RSS 298901
%MEM 0.46
kB_rd/s 0.00
kB_wr/s 4.19
kB_ccwr/s 0.00
3.2.7.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.7.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 35919540
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:58:30
guest_loopback_app testpmd
3.2.7.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 59851
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 14.10
majflt/s 0.00
VSZ 12256216
RSS 27459
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 59834
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3484
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 60082
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.15
CPU
minflt/s 0.26
majflt/s 0.00
VSZ 2622860
RSS 298901
%MEM 0.46
kB_rd/s 0.00
kB_wr/s 4.19
kB_ccwr/s 0.00
3.2.7.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.7.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 24382314
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:58:30
guest_loopback_app testpmd
3.2.7.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 59851
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.43
CPU
minflt/s 14.10
majflt/s 0.00
VSZ 12256216
RSS 27459
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 59834
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3484
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 60082
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.15
CPU
minflt/s 0.26
majflt/s 0.00
VSZ 2622860
RSS 298901
%MEM 0.46
kB_rd/s 0.00
kB_wr/s 4.19
kB_ccwr/s 0.00
3.2.7.7. Anomalies

No anomalies were detected during the course of this test.

3.2.7.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.8. Test ID: PVVP_TPUT

3.2.8.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: pvvp

  • vswitchperf: GIT tag: 3d33e32f9fe9d8c8e6f4fb935d67fc39b2c0a483

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • DPDK Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

  • VNF: QemuDpdkVhostUser, Version: 2.5.0, GIT tag: a8c40fa2d667e585382080db36ac44e216b37a1c

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: pvvp_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: pvvp
  • Traffic type: rfc2544
  • Bidirectional : True
3.2.8.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.8.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 3980652.461
tx_rate_mbps Unknown
throughput_rx_mbps 2038.094
tx_rate_percent 13.375
throughput_rx_percent 13.375
frame_loss_percent 0.000
min_latency_ns 9460.000
max_latency_ns 126200.000
avg_latency_ns 18056.500
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:48:28
guest_loopback_app testpmd testpmd
3.2.8.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 67189
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 13.85
majflt/s 0.00
VSZ 16454620
RSS 23543
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 67173
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3456
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 67575
%usr 0.00
%system 0.28
%guest 200.34
%CPU 100.17
CPU
minflt/s 1.51
majflt/s 0.00
VSZ 2652560
RSS 138803
%MEM 0.21
kB_rd/s 0.00
kB_wr/s 5.47
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 67448
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.15
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 2692492
RSS 162155
%MEM 0.25
kB_rd/s 0.00
kB_wr/s 0.03
kB_ccwr/s 0.00
3.2.8.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.8.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2781886.572
tx_rate_mbps Unknown
throughput_rx_mbps 2848.652
tx_rate_percent 16.469
throughput_rx_percent 16.469
frame_loss_percent 0.000
min_latency_ns 7980.000
max_latency_ns 104540.000
avg_latency_ns 11875.000
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:48:28
guest_loopback_app testpmd testpmd
3.2.8.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 67189
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 13.85
majflt/s 0.00
VSZ 16454620
RSS 23543
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 67173
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3456
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 67575
%usr 0.00
%system 0.28
%guest 200.34
%CPU 100.17
CPU
minflt/s 1.51
majflt/s 0.00
VSZ 2652560
RSS 138803
%MEM 0.21
kB_rd/s 0.00
kB_wr/s 5.47
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 67448
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.15
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 2692492
RSS 162155
%MEM 0.25
kB_rd/s 0.00
kB_wr/s 0.03
kB_ccwr/s 0.00
3.2.8.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.8.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2518505.165
tx_rate_mbps Unknown
throughput_rx_mbps 10315.797
tx_rate_percent 53.594
throughput_rx_percent 53.594
frame_loss_percent 0.000
min_latency_ns 11620.000
max_latency_ns 111140.000
avg_latency_ns 15986.000
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:48:28
guest_loopback_app testpmd testpmd
3.2.8.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 67189
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 13.85
majflt/s 0.00
VSZ 16454620
RSS 23543
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 67173
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3456
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 67575
%usr 0.00
%system 0.28
%guest 200.34
%CPU 100.17
CPU
minflt/s 1.51
majflt/s 0.00
VSZ 2652560
RSS 138803
%MEM 0.21
kB_rd/s 0.00
kB_wr/s 5.47
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 67448
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.15
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 2692492
RSS 162155
%MEM 0.25
kB_rd/s 0.00
kB_wr/s 0.03
kB_ccwr/s 0.00
3.2.8.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.8.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1616754.713
tx_rate_mbps Unknown
throughput_rx_mbps 13244.455
tx_rate_percent 67.516
throughput_rx_percent 67.516
frame_loss_percent 0.000
min_latency_ns 11360.000
max_latency_ns 110360.000
avg_latency_ns 15203.000
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:48:28
guest_loopback_app testpmd testpmd
3.2.8.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 67189
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 13.85
majflt/s 0.00
VSZ 16454620
RSS 23543
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 67173
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3456
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 67575
%usr 0.00
%system 0.28
%guest 200.34
%CPU 100.17
CPU
minflt/s 1.51
majflt/s 0.00
VSZ 2652560
RSS 138803
%MEM 0.21
kB_rd/s 0.00
kB_wr/s 5.47
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 67448
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.15
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 2692492
RSS 162155
%MEM 0.25
kB_rd/s 0.00
kB_wr/s 0.03
kB_ccwr/s 0.00
3.2.8.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.8.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1436905.978
tx_rate_mbps Unknown
throughput_rx_mbps 17449.786
tx_rate_percent 88.398
throughput_rx_percent 88.398
frame_loss_percent 0.000
min_latency_ns 14780.000
max_latency_ns 115660.000
avg_latency_ns 18749.500
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:48:28
guest_loopback_app testpmd testpmd
3.2.8.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 67189
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 13.85
majflt/s 0.00
VSZ 16454620
RSS 23543
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 67173
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3456
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 67575
%usr 0.00
%system 0.28
%guest 200.34
%CPU 100.17
CPU
minflt/s 1.51
majflt/s 0.00
VSZ 2652560
RSS 138803
%MEM 0.21
kB_rd/s 0.00
kB_wr/s 5.47
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 67448
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.15
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 2692492
RSS 162155
%MEM 0.25
kB_rd/s 0.00
kB_wr/s 0.03
kB_ccwr/s 0.00
3.2.8.7. Anomalies

No anomalies were detected during the course of this test.

3.2.8.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.3. Rationale for decisions

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

3.4. Conclusions and recommendations

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod3/2016-12-07_21-06-07/vswitchperf_logs_2016-12-07_21-06-07.tar.gz.

3.5. General

3.5.1. Glossary

  • NFV - Network Function Virtualization
  • Mbps - 1,000,000bps

3.5.2. Document change procedures and history

Document ID Author Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT Christopher Nolan 23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT Christopher Nolan 28/01/2015

4. Performance report for Open vSwitch

4.1. Introduction

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

4.1.1. Document identifier

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

4.1.2. Scope

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

4.2. Details of the Level Test Report

This section provides a test-results-overview. Also included are the rationale and the conclusions.

4.2.1. Test ID: BACK2BACK

4.2.1.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 3d33e32f9fe9d8c8e6f4fb935d67fc39b2c0a483

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

Below are test details:

  • Test ID: back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: p2p
  • Traffic type: rfc2544
  • Bidirectional : True
4.2.1.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.1.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 5108
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:52:53
4.2.1.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 86848
%usr 0.34
%system 4.37
%guest 0.00
%CPU 4.71
CPU
minflt/s 5.06
majflt/s 0.00
VSZ 6609932
RSS 32700
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 86845
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45909
RSS 3253
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.1.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 3382
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:52:53
4.2.1.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 86848
%usr 0.34
%system 4.37
%guest 0.00
%CPU 4.71
CPU
minflt/s 5.06
majflt/s 0.00
VSZ 6609932
RSS 32700
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 86845
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45909
RSS 3253
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.1.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1344
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:52:53
4.2.1.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 86848
%usr 0.34
%system 4.37
%guest 0.00
%CPU 4.71
CPU
minflt/s 5.06
majflt/s 0.00
VSZ 6609932
RSS 32700
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 86845
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45909
RSS 3253
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.1.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1096
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:52:53
4.2.1.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 86848
%usr 0.34
%system 4.37
%guest 0.00
%CPU 4.71
CPU
minflt/s 5.06
majflt/s 0.00
VSZ 6609932
RSS 32700
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 86845
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45909
RSS 3253
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.1.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 744
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:52:53
4.2.1.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 86848
%usr 0.34
%system 4.37
%guest 0.00
%CPU 4.71
CPU
minflt/s 5.06
majflt/s 0.00
VSZ 6609932
RSS 32700
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 86845
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45909
RSS 3253
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.7. Anomalies

No anomalies were detected during the course of this test.

4.2.1.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.2. Test ID: PVP_TPUT

4.2.2.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: pvp

  • vswitchperf: GIT tag: 3d33e32f9fe9d8c8e6f4fb935d67fc39b2c0a483

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • VNF: QemuVirtioNet, Version: 2.5.0, GIT tag: a8c40fa2d667e585382080db36ac44e216b37a1c

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: pvp_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: pvp
  • Traffic type: rfc2544
  • Bidirectional : True
4.2.2.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.2.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 526218.890
tx_rate_mbps Unknown
throughput_rx_mbps 269.424
tx_rate_percent 1.773
throughput_rx_percent 1.768
frame_loss_percent 0.302
min_latency_ns 10880.000
max_latency_ns 28855760.000
avg_latency_ns 63912.500
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:49:32
guest_loopback_app testpmd
4.2.2.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 105098
%usr 0.34
%system 4.32
%guest 0.00
%CPU 4.65
CPU
minflt/s 5.58
majflt/s 0.00
VSZ 6609932
RSS 31586
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 105095
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3264
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 105391
%usr 0.00
%system 0.39
%guest 199.76
%CPU 100.16
CPU
minflt/s 1.69
majflt/s 0.00
VSZ 2662936
RSS 186804
%MEM 0.28
kB_rd/s 0.00
kB_wr/s 4.87
kB_ccwr/s 0.00
4.2.2.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.2.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 299554.246
tx_rate_mbps Unknown
throughput_rx_mbps 306.744
tx_rate_percent 1.773
throughput_rx_percent 1.773
frame_loss_percent 0.005
min_latency_ns 12480.000
max_latency_ns 2152320.000
avg_latency_ns 45558.500
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:49:32
guest_loopback_app testpmd
4.2.2.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 105098
%usr 0.34
%system 4.32
%guest 0.00
%CPU 4.65
CPU
minflt/s 5.58
majflt/s 0.00
VSZ 6609932
RSS 31586
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 105095
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3264
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 105391
%usr 0.00
%system 0.39
%guest 199.76
%CPU 100.16
CPU
minflt/s 1.69
majflt/s 0.00
VSZ 2662936
RSS 186804
%MEM 0.28
kB_rd/s 0.00
kB_wr/s 4.87
kB_ccwr/s 0.00
4.2.2.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.2.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 192375.587
tx_rate_mbps Unknown
throughput_rx_mbps 787.970
tx_rate_percent 4.094
throughput_rx_percent 4.094
frame_loss_percent 0.000
min_latency_ns 25000.000
max_latency_ns 571600.000
avg_latency_ns 98823.000
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:49:32
guest_loopback_app testpmd
4.2.2.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 105098
%usr 0.34
%system 4.32
%guest 0.00
%CPU 4.65
CPU
minflt/s 5.58
majflt/s 0.00
VSZ 6609932
RSS 31586
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 105095
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3264
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 105391
%usr 0.00
%system 0.39
%guest 199.76
%CPU 100.16
CPU
minflt/s 1.69
majflt/s 0.00
VSZ 2662936
RSS 186804
%MEM 0.28
kB_rd/s 0.00
kB_wr/s 4.87
kB_ccwr/s 0.00
4.2.2.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.2.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 190635.466
tx_rate_mbps Unknown
throughput_rx_mbps 1561.686
tx_rate_percent 7.961
throughput_rx_percent 7.961
frame_loss_percent 0.000
min_latency_ns 30400.000
max_latency_ns 572320.000
avg_latency_ns 99793.500
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:49:32
guest_loopback_app testpmd
4.2.2.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 105098
%usr 0.34
%system 4.32
%guest 0.00
%CPU 4.65
CPU
minflt/s 5.58
majflt/s 0.00
VSZ 6609932
RSS 31586
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 105095
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3264
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 105391
%usr 0.00
%system 0.39
%guest 199.76
%CPU 100.16
CPU
minflt/s 1.69
majflt/s 0.00
VSZ 2662936
RSS 186804
%MEM 0.28
kB_rd/s 0.00
kB_wr/s 4.87
kB_ccwr/s 0.00
4.2.2.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.2.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 255125.731
tx_rate_mbps Unknown
throughput_rx_mbps 3098.247
tx_rate_percent 15.695
throughput_rx_percent 15.695
frame_loss_percent 0.000
min_latency_ns 34280.000
max_latency_ns 1078240.000
avg_latency_ns 114732.500
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:49:32
guest_loopback_app testpmd
4.2.2.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 105098
%usr 0.34
%system 4.32
%guest 0.00
%CPU 4.65
CPU
minflt/s 5.58
majflt/s 0.00
VSZ 6609932
RSS 31586
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 105095
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3264
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 105391
%usr 0.00
%system 0.39
%guest 199.76
%CPU 100.16
CPU
minflt/s 1.69
majflt/s 0.00
VSZ 2662936
RSS 186804
%MEM 0.28
kB_rd/s 0.00
kB_wr/s 4.87
kB_ccwr/s 0.00
4.2.2.7. Anomalies

No anomalies were detected during the course of this test.

4.2.2.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.3. Test ID: PHY2PHY_TPUT_MOD_VLAN

4.2.3.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 3d33e32f9fe9d8c8e6f4fb935d67fc39b2c0a483

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

Below are test details:

  • Test ID: phy2phy_tput_mod_vlan
  • Description: LTD.Throughput.RFC2544.PacketLossRatioFrameModification
  • Deployment: p2p
  • Traffic type: rfc2544
  • Bidirectional : False
4.2.3.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.3.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 724284.265
tx_rate_mbps Unknown
throughput_rx_mbps 394.011
tx_rate_percent 4.867
throughput_rx_percent 5.099
frame_loss_percent 0.000
min_latency_ns 4140.000
max_latency_ns 5550140.000
avg_latency_ns 333559.000
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:48:08
4.2.3.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 93350
%usr 0.36
%system 4.39
%guest 0.00
%CPU 4.74
CPU
minflt/s 5.23
majflt/s 0.00
VSZ 6609936
RSS 39461
%MEM 0.06
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 93347
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45908
RSS 3259
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.3.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 607053.439
tx_rate_mbps Unknown
throughput_rx_mbps 641.048
tx_rate_percent 7.188
throughput_rx_percent 7.382
frame_loss_percent 0.000
min_latency_ns 4600.000
max_latency_ns 891920.000
avg_latency_ns 64763.000
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:48:08
4.2.3.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 93350
%usr 0.36
%system 4.39
%guest 0.00
%CPU 4.74
CPU
minflt/s 5.23
majflt/s 0.00
VSZ 6609936
RSS 39461
%MEM 0.06
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 93347
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45908
RSS 3259
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.3.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 586855.883
tx_rate_mbps Unknown
throughput_rx_mbps 2422.541
tx_rate_percent 24.977
throughput_rx_percent 25.164
frame_loss_percent 0.000
min_latency_ns 5360.000
max_latency_ns 1811120.000
avg_latency_ns 106669.000
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:48:08
4.2.3.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 93350
%usr 0.36
%system 4.39
%guest 0.00
%CPU 4.74
CPU
minflt/s 5.23
majflt/s 0.00
VSZ 6609936
RSS 39461
%MEM 0.06
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 93347
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45908
RSS 3259
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.3.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 558340.574
tx_rate_mbps Unknown
throughput_rx_mbps 4591.793
tx_rate_percent 46.633
throughput_rx_percent 46.811
frame_loss_percent 0.000
min_latency_ns 5840.000
max_latency_ns 871600.000
avg_latency_ns 63082.000
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:48:08
4.2.3.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 93350
%usr 0.36
%system 4.39
%guest 0.00
%CPU 4.74
CPU
minflt/s 5.23
majflt/s 0.00
VSZ 6609936
RSS 39461
%MEM 0.06
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 93347
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45908
RSS 3259
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.3.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 573870.254
tx_rate_mbps Unknown
throughput_rx_mbps 6987.444
tx_rate_percent 70.609
throughput_rx_percent 70.793
frame_loss_percent 0.000
min_latency_ns 6340.000
max_latency_ns 1326240.000
avg_latency_ns 88008.000
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:48:08
4.2.3.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 93350
%usr 0.36
%system 4.39
%guest 0.00
%CPU 4.74
CPU
minflt/s 5.23
majflt/s 0.00
VSZ 6609936
RSS 39461
%MEM 0.06
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 93347
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45908
RSS 3259
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.7. Anomalies

No anomalies were detected during the course of this test.

4.2.3.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.4. Test ID: PVVP_BACK2BACK

4.2.4.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: pvvp

  • vswitchperf: GIT tag: 3d33e32f9fe9d8c8e6f4fb935d67fc39b2c0a483

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • VNF: QemuVirtioNet, Version: 2.5.0, GIT tag: a8c40fa2d667e585382080db36ac44e216b37a1c

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: pvvp_back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: pvvp
  • Traffic type: rfc2544
  • Bidirectional : True
4.2.4.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.4.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:55:47
guest_loopback_app testpmd testpmd
4.2.4.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 124604
%usr 0.33
%system 4.24
%guest 0.00
%CPU 4.58
CPU
minflt/s 6.60
majflt/s 0.00
VSZ 6610060
RSS 32402
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 124601
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3268
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 125184
%usr 0.00
%system 0.05
%guest 200.09
%CPU 100.16
CPU
minflt/s 1.36
majflt/s 0.00
VSZ 2668056
RSS 174301
%MEM 0.27
kB_rd/s 0.00
kB_wr/s 3.78
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 125057
%usr 0.00
%system 0.22
%guest 200.38
%CPU 100.16
CPU
minflt/s 1.33
majflt/s 0.00
VSZ 2669048
RSS 197076
%MEM 0.30
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.4.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.4.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:55:47
guest_loopback_app testpmd testpmd
4.2.4.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 124604
%usr 0.33
%system 4.24
%guest 0.00
%CPU 4.58
CPU
minflt/s 6.60
majflt/s 0.00
VSZ 6610060
RSS 32402
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 124601
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3268
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 125184
%usr 0.00
%system 0.05
%guest 200.09
%CPU 100.16
CPU
minflt/s 1.36
majflt/s 0.00
VSZ 2668056
RSS 174301
%MEM 0.27
kB_rd/s 0.00
kB_wr/s 3.78
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 125057
%usr 0.00
%system 0.22
%guest 200.38
%CPU 100.16
CPU
minflt/s 1.33
majflt/s 0.00
VSZ 2669048
RSS 197076
%MEM 0.30
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.4.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.4.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:55:47
guest_loopback_app testpmd testpmd
4.2.4.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 124604
%usr 0.33
%system 4.24
%guest 0.00
%CPU 4.58
CPU
minflt/s 6.60
majflt/s 0.00
VSZ 6610060
RSS 32402
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 124601
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3268
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 125184
%usr 0.00
%system 0.05
%guest 200.09
%CPU 100.16
CPU
minflt/s 1.36
majflt/s 0.00
VSZ 2668056
RSS 174301
%MEM 0.27
kB_rd/s 0.00
kB_wr/s 3.78
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 125057
%usr 0.00
%system 0.22
%guest 200.38
%CPU 100.16
CPU
minflt/s 1.33
majflt/s 0.00
VSZ 2669048
RSS 197076
%MEM 0.30
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.4.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.4.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:55:47
guest_loopback_app testpmd testpmd
4.2.4.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 124604
%usr 0.33
%system 4.24
%guest 0.00
%CPU 4.58
CPU
minflt/s 6.60
majflt/s 0.00
VSZ 6610060
RSS 32402
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 124601
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3268
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 125184
%usr 0.00
%system 0.05
%guest 200.09
%CPU 100.16
CPU
minflt/s 1.36
majflt/s 0.00
VSZ 2668056
RSS 174301
%MEM 0.27
kB_rd/s 0.00
kB_wr/s 3.78
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 125057
%usr 0.00
%system 0.22
%guest 200.38
%CPU 100.16
CPU
minflt/s 1.33
majflt/s 0.00
VSZ 2669048
RSS 197076
%MEM 0.30
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.4.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.4.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:55:47
guest_loopback_app testpmd testpmd
4.2.4.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 124604
%usr 0.33
%system 4.24
%guest 0.00
%CPU 4.58
CPU
minflt/s 6.60
majflt/s 0.00
VSZ 6610060
RSS 32402
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 124601
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3268
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 125184
%usr 0.00
%system 0.05
%guest 200.09
%CPU 100.16
CPU
minflt/s 1.36
majflt/s 0.00
VSZ 2668056
RSS 174301
%MEM 0.27
kB_rd/s 0.00
kB_wr/s 3.78
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 125057
%usr 0.00
%system 0.22
%guest 200.38
%CPU 100.16
CPU
minflt/s 1.33
majflt/s 0.00
VSZ 2669048
RSS 197076
%MEM 0.30
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.4.7. Anomalies

No anomalies were detected during the course of this test.

4.2.4.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.5. Test ID: PHY2PHY_TPUT

4.2.5.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 3d33e32f9fe9d8c8e6f4fb935d67fc39b2c0a483

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

Below are test details:

  • Test ID: phy2phy_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: p2p
  • Traffic type: rfc2544
  • Bidirectional : True
4.2.5.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.5.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 758000.473
tx_rate_mbps Unknown
throughput_rx_mbps 388.096
tx_rate_percent 2.547
throughput_rx_percent 2.547
frame_loss_percent 0.000
min_latency_ns 4060.000
max_latency_ns 10640780.000
avg_latency_ns 512650.500
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:44:31
4.2.5.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 81394
%usr 0.34
%system 4.34
%guest 0.00
%CPU 4.69
CPU
minflt/s 4.99
majflt/s 0.00
VSZ 6609932
RSS 40806
%MEM 0.06
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 81391
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3259
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.5.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 691513.436
tx_rate_mbps Unknown
throughput_rx_mbps 708.110
tx_rate_percent 4.094
throughput_rx_percent 4.094
frame_loss_percent 0.000
min_latency_ns 4260.000
max_latency_ns 8841360.000
avg_latency_ns 220781.000
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:44:31
4.2.5.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 81394
%usr 0.34
%system 4.34
%guest 0.00
%CPU 4.69
CPU
minflt/s 4.99
majflt/s 0.00
VSZ 6609932
RSS 40806
%MEM 0.06
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 81391
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3259
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.5.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 628531.360
tx_rate_mbps Unknown
throughput_rx_mbps 2574.464
tx_rate_percent 13.375
throughput_rx_percent 13.375
frame_loss_percent 0.000
min_latency_ns 5240.000
max_latency_ns 3599500.000
avg_latency_ns 222885.500
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:44:31
4.2.5.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 81394
%usr 0.34
%system 4.34
%guest 0.00
%CPU 4.69
CPU
minflt/s 4.99
majflt/s 0.00
VSZ 6609932
RSS 40806
%MEM 0.06
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 81391
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3259
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.5.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 616630.016
tx_rate_mbps Unknown
throughput_rx_mbps 5051.433
tx_rate_percent 25.750
throughput_rx_percent 25.750
frame_loss_percent 0.000
min_latency_ns 5800.000
max_latency_ns 2733720.000
avg_latency_ns 167904.500
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:44:31
4.2.5.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 81394
%usr 0.34
%system 4.34
%guest 0.00
%CPU 4.69
CPU
minflt/s 4.99
majflt/s 0.00
VSZ 6609932
RSS 40806
%MEM 0.06
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 81391
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3259
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.5.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 582002.049
tx_rate_mbps Unknown
throughput_rx_mbps 7067.833
tx_rate_percent 35.805
throughput_rx_percent 35.805
frame_loss_percent 0.000
min_latency_ns 6420.000
max_latency_ns 1209260.000
avg_latency_ns 77463.000
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:44:31
4.2.5.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 81394
%usr 0.34
%system 4.34
%guest 0.00
%CPU 4.69
CPU
minflt/s 4.99
majflt/s 0.00
VSZ 6609932
RSS 40806
%MEM 0.06
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 81391
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3259
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.7. Anomalies

No anomalies were detected during the course of this test.

4.2.5.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.6. Test ID: PHY2PHY_SCALABILITY

4.2.6.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 3d33e32f9fe9d8c8e6f4fb935d67fc39b2c0a483

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

Below are test details:

  • Test ID: phy2phy_scalability
  • Description: LTD.Scalability.Flows.RFC2544.0PacketLoss
  • Deployment: p2p
  • Traffic type: rfc2544
  • Bidirectional : True
4.2.6.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.6.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 758000.627
tx_rate_mbps Unknown
throughput_rx_mbps 388.096
tx_rate_percent 2.547
throughput_rx_percent 2.547
frame_loss_percent 0.000
min_latency_ns 4020.000
max_latency_ns 6889000.000
avg_latency_ns 516015.500
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:46:34
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 99317
%usr 0.35
%system 4.48
%guest 0.00
%CPU 4.83
CPU
minflt/s 6.03
majflt/s 0.00
VSZ 6609932
RSS 32950
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 99314
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3012
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.6.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 691513.643
tx_rate_mbps Unknown
throughput_rx_mbps 708.110
tx_rate_percent 4.094
throughput_rx_percent 4.094
frame_loss_percent 0.000
min_latency_ns 4320.000
max_latency_ns 4025280.000
avg_latency_ns 213493.000
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:46:34
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 99317
%usr 0.35
%system 4.48
%guest 0.00
%CPU 4.83
CPU
minflt/s 6.03
majflt/s 0.00
VSZ 6609932
RSS 32950
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 99314
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3012
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.6.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 628539.984
tx_rate_mbps Unknown
throughput_rx_mbps 2574.500
tx_rate_percent 13.375
throughput_rx_percent 13.375
frame_loss_percent 0.000
min_latency_ns 5200.000
max_latency_ns 3715760.000
avg_latency_ns 235783.500
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:46:34
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 99317
%usr 0.35
%system 4.48
%guest 0.00
%CPU 4.83
CPU
minflt/s 6.03
majflt/s 0.00
VSZ 6609932
RSS 32950
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 99314
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3012
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.6.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 616629.679
tx_rate_mbps Unknown
throughput_rx_mbps 5051.430
tx_rate_percent 25.750
throughput_rx_percent 25.750
frame_loss_percent 0.000
min_latency_ns 5760.000
max_latency_ns 2902520.000
avg_latency_ns 252270.500
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:46:34
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 99317
%usr 0.35
%system 4.48
%guest 0.00
%CPU 4.83
CPU
minflt/s 6.03
majflt/s 0.00
VSZ 6609932
RSS 32950
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 99314
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3012
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.6.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 619488.299
tx_rate_mbps Unknown
throughput_rx_mbps 7523.066
tx_rate_percent 38.125
throughput_rx_percent 38.125
frame_loss_percent 0.000
min_latency_ns 6780.000
max_latency_ns 2275260.000
avg_latency_ns 164216.500
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:46:34
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 99317
%usr 0.35
%system 4.48
%guest 0.00
%CPU 4.83
CPU
minflt/s 6.03
majflt/s 0.00
VSZ 6609932
RSS 32950
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 99314
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3012
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.7. Anomalies

No anomalies were detected during the course of this test.

4.2.6.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.7. Test ID: PVP_BACK2BACK

4.2.7.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: pvp

  • vswitchperf: GIT tag: 3d33e32f9fe9d8c8e6f4fb935d67fc39b2c0a483

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • VNF: QemuVirtioNet, Version: 2.5.0, GIT tag: a8c40fa2d667e585382080db36ac44e216b37a1c

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: pvp_back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: pvp
  • Traffic type: rfc2544
  • Bidirectional : True
4.2.7.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.7.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:55:10
guest_loopback_app testpmd
4.2.7.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 111367
%usr 0.34
%system 4.32
%guest 0.00
%CPU 4.66
CPU
minflt/s 5.49
majflt/s 0.00
VSZ 6609932
RSS 31981
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 111262
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45908
RSS 3260
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 111656
%usr 0.00
%system 0.21
%guest 200.41
%CPU 100.17
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 2659864
RSS 301722
%MEM 0.46
kB_rd/s 0.00
kB_wr/s 4.51
kB_ccwr/s 0.00
4.2.7.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.7.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:55:10
guest_loopback_app testpmd
4.2.7.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 111367
%usr 0.34
%system 4.32
%guest 0.00
%CPU 4.66
CPU
minflt/s 5.49
majflt/s 0.00
VSZ 6609932
RSS 31981
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 111262
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45908
RSS 3260
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 111656
%usr 0.00
%system 0.21
%guest 200.41
%CPU 100.17
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 2659864
RSS 301722
%MEM 0.46
kB_rd/s 0.00
kB_wr/s 4.51
kB_ccwr/s 0.00
4.2.7.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.7.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:55:10
guest_loopback_app testpmd
4.2.7.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 111367
%usr 0.34
%system 4.32
%guest 0.00
%CPU 4.66
CPU
minflt/s 5.49
majflt/s 0.00
VSZ 6609932
RSS 31981
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 111262
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45908
RSS 3260
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 111656
%usr 0.00
%system 0.21
%guest 200.41
%CPU 100.17
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 2659864
RSS 301722
%MEM 0.46
kB_rd/s 0.00
kB_wr/s 4.51
kB_ccwr/s 0.00
4.2.7.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.7.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:55:10
guest_loopback_app testpmd
4.2.7.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 111367
%usr 0.34
%system 4.32
%guest 0.00
%CPU 4.66
CPU
minflt/s 5.49
majflt/s 0.00
VSZ 6609932
RSS 31981
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 111262
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45908
RSS 3260
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 111656
%usr 0.00
%system 0.21
%guest 200.41
%CPU 100.17
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 2659864
RSS 301722
%MEM 0.46
kB_rd/s 0.00
kB_wr/s 4.51
kB_ccwr/s 0.00
4.2.7.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.7.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:55:10
guest_loopback_app testpmd
4.2.7.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 111367
%usr 0.34
%system 4.32
%guest 0.00
%CPU 4.66
CPU
minflt/s 5.49
majflt/s 0.00
VSZ 6609932
RSS 31981
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 111262
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45908
RSS 3260
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 111656
%usr 0.00
%system 0.21
%guest 200.41
%CPU 100.17
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 2659864
RSS 301722
%MEM 0.46
kB_rd/s 0.00
kB_wr/s 4.51
kB_ccwr/s 0.00
4.2.7.7. Anomalies

No anomalies were detected during the course of this test.

4.2.7.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.8. Test ID: PVVP_TPUT

4.2.8.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: pvvp

  • vswitchperf: GIT tag: 3d33e32f9fe9d8c8e6f4fb935d67fc39b2c0a483

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • VNF: QemuVirtioNet, Version: 2.5.0, GIT tag: a8c40fa2d667e585382080db36ac44e216b37a1c

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: pvvp_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: pvvp
  • Traffic type: rfc2544
  • Bidirectional : True
4.2.8.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.8.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 525200.501
tx_rate_mbps Unknown
throughput_rx_mbps 268.903
tx_rate_percent 1.773
throughput_rx_percent 1.765
frame_loss_percent 0.496
min_latency_ns 21920.000
max_latency_ns 30547100.000
avg_latency_ns 121569.500
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:48:44
guest_loopback_app testpmd testpmd
4.2.8.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 118268
%usr 0.35
%system 4.28
%guest 0.00
%CPU 4.63
CPU
minflt/s 6.50
majflt/s 0.00
VSZ 6610052
RSS 33328
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 118265
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3272
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 118756
%usr 0.00
%system 0.46
%guest 199.64
%CPU 100.16
CPU
minflt/s 0.36
majflt/s 0.00
VSZ 2621968
RSS 225662
%MEM 0.34
kB_rd/s 0.00
kB_wr/s 5.17
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 118631
%usr 0.00
%system 0.48
%guest 199.66
%CPU 100.16
CPU
minflt/s 1.34
majflt/s 0.00
VSZ 2686484
RSS 244301
%MEM 0.37
kB_rd/s 0.00
kB_wr/s 0.05
kB_ccwr/s 0.00
4.2.8.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.8.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 299539.326
tx_rate_mbps Unknown
throughput_rx_mbps 306.728
tx_rate_percent 1.773
throughput_rx_percent 1.773
frame_loss_percent 0.010
min_latency_ns 21440.000
max_latency_ns 2116320.000
avg_latency_ns 69335.000
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:48:44
guest_loopback_app testpmd testpmd
4.2.8.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 118268
%usr 0.35
%system 4.28
%guest 0.00
%CPU 4.63
CPU
minflt/s 6.50
majflt/s 0.00
VSZ 6610052
RSS 33328
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 118265
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3272
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 118756
%usr 0.00
%system 0.46
%guest 199.64
%CPU 100.16
CPU
minflt/s 0.36
majflt/s 0.00
VSZ 2621968
RSS 225662
%MEM 0.34
kB_rd/s 0.00
kB_wr/s 5.17
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 118631
%usr 0.00
%system 0.48
%guest 199.66
%CPU 100.16
CPU
minflt/s 1.34
majflt/s 0.00
VSZ 2686484
RSS 244301
%MEM 0.37
kB_rd/s 0.00
kB_wr/s 0.05
kB_ccwr/s 0.00
4.2.8.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.8.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 156030.638
tx_rate_mbps Unknown
throughput_rx_mbps 639.101
tx_rate_percent 3.320
throughput_rx_percent 3.320
frame_loss_percent 0.000
min_latency_ns 41740.000
max_latency_ns 575420.000
avg_latency_ns 120217.000
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:48:44
guest_loopback_app testpmd testpmd
4.2.8.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 118268
%usr 0.35
%system 4.28
%guest 0.00
%CPU 4.63
CPU
minflt/s 6.50
majflt/s 0.00
VSZ 6610052
RSS 33328
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 118265
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3272
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 118756
%usr 0.00
%system 0.46
%guest 199.64
%CPU 100.16
CPU
minflt/s 0.36
majflt/s 0.00
VSZ 2621968
RSS 225662
%MEM 0.34
kB_rd/s 0.00
kB_wr/s 5.17
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 118631
%usr 0.00
%system 0.48
%guest 199.66
%CPU 100.16
CPU
minflt/s 1.34
majflt/s 0.00
VSZ 2686484
RSS 244301
%MEM 0.37
kB_rd/s 0.00
kB_wr/s 0.05
kB_ccwr/s 0.00
4.2.8.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.8.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 190636.055
tx_rate_mbps Unknown
throughput_rx_mbps 1561.691
tx_rate_percent 7.961
throughput_rx_percent 7.961
frame_loss_percent 0.000
min_latency_ns 57240.000
max_latency_ns 705120.000
avg_latency_ns 136749.000
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:48:44
guest_loopback_app testpmd testpmd
4.2.8.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 118268
%usr 0.35
%system 4.28
%guest 0.00
%CPU 4.63
CPU
minflt/s 6.50
majflt/s 0.00
VSZ 6610052
RSS 33328
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 118265
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3272
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 118756
%usr 0.00
%system 0.46
%guest 199.64
%CPU 100.16
CPU
minflt/s 0.36
majflt/s 0.00
VSZ 2621968
RSS 225662
%MEM 0.34
kB_rd/s 0.00
kB_wr/s 5.17
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 118631
%usr 0.00
%system 0.48
%guest 199.66
%CPU 100.16
CPU
minflt/s 1.34
majflt/s 0.00
VSZ 2686484
RSS 244301
%MEM 0.37
kB_rd/s 0.00
kB_wr/s 0.05
kB_ccwr/s 0.00
4.2.8.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.8.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 217421.827
tx_rate_mbps Unknown
throughput_rx_mbps 2640.371
tx_rate_percent 13.375
throughput_rx_percent 13.375
frame_loss_percent 0.000
min_latency_ns 63700.000
max_latency_ns 760540.000
avg_latency_ns 158030.000
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:48:44
guest_loopback_app testpmd testpmd
4.2.8.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 118268
%usr 0.35
%system 4.28
%guest 0.00
%CPU 4.63
CPU
minflt/s 6.50
majflt/s 0.00
VSZ 6610052
RSS 33328
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 118265
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3272
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 118756
%usr 0.00
%system 0.46
%guest 199.64
%CPU 100.16
CPU
minflt/s 0.36
majflt/s 0.00
VSZ 2621968
RSS 225662
%MEM 0.34
kB_rd/s 0.00
kB_wr/s 5.17
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 118631
%usr 0.00
%system 0.48
%guest 199.66
%CPU 100.16
CPU
minflt/s 1.34
majflt/s 0.00
VSZ 2686484
RSS 244301
%MEM 0.37
kB_rd/s 0.00
kB_wr/s 0.05
kB_ccwr/s 0.00
4.2.8.7. Anomalies

No anomalies were detected during the course of this test.

4.2.8.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.3. Rationale for decisions

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

4.4. Conclusions and recommendations

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod3/2016-12-07_21-06-07/vswitchperf_logs_2016-12-07_21-06-07.tar.gz.

4.5. General

4.5.1. Glossary

  • NFV - Network Function Virtualization
  • Mbps - 1,000,000bps

4.5.2. Document change procedures and history

Document ID Author Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT Christopher Nolan 23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT Christopher Nolan 28/01/2015