VSPERF Results

1. OPNFV Brahmaputra Scenarios

Available Tests and aspects of scenarios:

Framework Test Definition
phy2phy_tput PacketLossRatio for Phy2Phy
back2back BackToBackFrames for Phy2Phy
phy2phy_tput_mod_vlan PacketLossRatioFrameModification for Phy2Phy
phy2phy_cont Phy2Phy blast vswitch at x% TX rate and measure throughput
pvp_cont PVP blast vswitch at x% TX rate and measure throughput
pvvp_cont PVVP blast vswitch at x% TX rate and measure throughput
phy2phy_scalability Scalability0PacketLoss for Phy2Phy
pvp_tput PacketLossRatio for PVP
pvp_back2back BackToBackFrames for PVP
pvvp_tput PacketLossRatio for PVVP
pvvp_back2back BackToBackFrames for PVVP
phy2phy_cpu_load CPU0PacketLoss for Phy2Phy
phy2phy_mem_load Same as CPU0PacketLoss but using a memory intensive app

Supported deployment scenarios:

  • Phy2Phy: Physical port -> vSwitch -> Physical port.
  • PVP: Physical port -> vSwitch -> VNF -> vSwitch -> Physical port.
  • PVVP: Physical port -> vSwitch -> VNF -> vSwitch -> VNF -> vSwitch -> Physical port.

Loopback applications in the Guest can be:

Supported traffic generators:

  • Ixia: IxOS and IxNet.
  • Spirent.
  • Dummy.

2. OPNFV Brahmaputra Results

The vsperf CI jobs that were used to obtain the results can be found at https://wiki.opnfv.org/wiki/vsperf_results.

The following table maps the results in the test dashboard to the appropriate test case in the VSPERF Framework and specifies the metric the vertical/Y axis is plotting. Please note, the presence of dpdk within a test name signifies that the vswitch under test was OVS with DPDK, while its absence indicates that the vswitch under test was stock OVS.

Dashboard Test Framework Test Metric Guest Interface
tput_ovsdpdk phy2phy_tput Throughput (FPS) N/A
tput_ovs phy2phy_tput Throughput (FPS) N/A
b2b_ovsdpdk back2back Back-to-back value N/A
b2b_ovs back2back Back-to-back value N/A
tput_mod_vlan_ovs phy2phy_tput_mod_vlan Throughput (FPS) N/A
tput_mod_vlan_ovsdpdk phy2phy_tput_mod_vlan Throughput (FPS) N/A
scalability_ovs phy2phy_scalability Throughput (FPS) N/A
scalability_ovsdpdk phy2phy_scalability Throughput (FPS) N/A
pvp_tput_ovsdpdkuser pvp_tput Throughput (FPS) vhost-user
pvp_tput_ovsvirtio pvp_tput Throughput (FPS) virtio-net
pvp_b2b_ovsdpdkuser pvp_back2back Back-to-back value vhost-user
pvp_b2b_ovsvirtio pvp_back2back Back-to-back value virtio-net
pvvp_tput_ovsdpdkuser pvvp_tput Throughput (FPS) vhost-user
pvvp_tput_ovsvirtio pvvp_tput Throughput (FPS) virtio-net
pvvp_b2b_ovsdpdkuser pvvp_back2back Throughput (FPS) vhost-user
pvvp_b2b_ovsvirtio pvvp_back2back Throughput (FPS) virtio-net

The loopback application in the VNF used for PVP and PVVP scenarios was DPDK testpmd.

3. Performance report for Open vSwitch with DPDK support

3.1. Introduction

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

3.1.1. Document identifier

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

3.1.2. Scope

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

3.2. Details of the Level Test Report

This section provides a test-results-overview. Also included are the rationale and the conclusions.

3.2.1. Test ID: BACK2BACK

3.2.1.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: efdc282f4b08e96f3e09d43f94ba0508e4f26090

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • DPDK Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: p2p
  • Traffic type: rfc2544
  • Bidirectional : True
3.2.1.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.1.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 25544
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:25:18
3.2.1.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 90239
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 22.12
majflt/s 0.00
VSZ 8057820
RSS 25398
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 90223
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3460
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.1.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 31672297
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:25:18
3.2.1.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 90239
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 22.12
majflt/s 0.00
VSZ 8057820
RSS 25398
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 90223
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3460
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.1.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 70488721
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:25:18
3.2.1.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 90239
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 22.12
majflt/s 0.00
VSZ 8057820
RSS 25398
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 90223
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3460
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.1.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 35919540
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:25:18
3.2.1.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 90239
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 22.12
majflt/s 0.00
VSZ 8057820
RSS 25398
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 90223
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3460
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.1.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 24382314
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:25:18
3.2.1.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 90239
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 22.12
majflt/s 0.00
VSZ 8057820
RSS 25398
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 90223
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3460
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.7. Anomalies

No anomalies were detected during the course of this test.

3.2.1.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.2. Test ID: PVP_TPUT

3.2.2.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: pvp

  • vswitchperf: GIT tag: efdc282f4b08e96f3e09d43f94ba0508e4f26090

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • DPDK Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

  • VNF: QemuDpdkVhostUser, Version: 2.5.0, GIT tag: a8c40fa2d667e585382080db36ac44e216b37a1c

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: pvp_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: pvp
  • Traffic type: rfc2544
  • Bidirectional : True
3.2.2.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.2.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4441037.472
tx_rate_mbps Unknown
throughput_rx_mbps 2273.811
tx_rate_percent 14.922
throughput_rx_percent 14.922
frame_loss_percent 0.000
min_latency_ns 4820.000
max_latency_ns 79280.000
avg_latency_ns 6378.000
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:17:17
guest_loopback_app testpmd
3.2.2.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 100039
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 23.59
majflt/s 0.00
VSZ 12256216
RSS 25338
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 100023
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52076
RSS 3492
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 100270
%usr 0.00
%system 0.22
%guest 200.20
%CPU 100.17
CPU
minflt/s 1.86
majflt/s 0.00
VSZ 2656660
RSS 62473
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 14.84
kB_ccwr/s 0.00
3.2.2.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.2.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 3435125.961
tx_rate_mbps Unknown
throughput_rx_mbps 3517.569
tx_rate_percent 20.336
throughput_rx_percent 20.336
frame_loss_percent 0.000
min_latency_ns 4860.000
max_latency_ns 105100.000
avg_latency_ns 6144.000
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:17:17
guest_loopback_app testpmd
3.2.2.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 100039
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 23.59
majflt/s 0.00
VSZ 12256216
RSS 25338
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 100023
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52076
RSS 3492
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 100270
%usr 0.00
%system 0.22
%guest 200.20
%CPU 100.17
CPU
minflt/s 1.86
majflt/s 0.00
VSZ 2656660
RSS 62473
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 14.84
kB_ccwr/s 0.00
3.2.2.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.2.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4699040.325
tx_rate_mbps Unknown
throughput_rx_mbps 19247.269
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 22220.000
max_latency_ns 161780.000
avg_latency_ns 136891.000
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:17:17
guest_loopback_app testpmd
3.2.2.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 100039
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 23.59
majflt/s 0.00
VSZ 12256216
RSS 25338
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 100023
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52076
RSS 3492
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 100270
%usr 0.00
%system 0.22
%guest 200.20
%CPU 100.17
CPU
minflt/s 1.86
majflt/s 0.00
VSZ 2656660
RSS 62473
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 14.84
kB_ccwr/s 0.00
3.2.2.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.2.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394585.606
tx_rate_mbps Unknown
throughput_rx_mbps 19616.445
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 20700.000
max_latency_ns 87020.000
avg_latency_ns 74497.500
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:17:17
guest_loopback_app testpmd
3.2.2.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 100039
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 23.59
majflt/s 0.00
VSZ 12256216
RSS 25338
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 100023
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52076
RSS 3492
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 100270
%usr 0.00
%system 0.22
%guest 200.20
%CPU 100.17
CPU
minflt/s 1.86
majflt/s 0.00
VSZ 2656660
RSS 62473
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 14.84
kB_ccwr/s 0.00
3.2.2.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.2.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625463.867
tx_rate_mbps Unknown
throughput_rx_mbps 19739.633
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 29740.000
max_latency_ns 82160.000
avg_latency_ns 67245.500
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:17:17
guest_loopback_app testpmd
3.2.2.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 100039
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 23.59
majflt/s 0.00
VSZ 12256216
RSS 25338
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 100023
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52076
RSS 3492
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 100270
%usr 0.00
%system 0.22
%guest 200.20
%CPU 100.17
CPU
minflt/s 1.86
majflt/s 0.00
VSZ 2656660
RSS 62473
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 14.84
kB_ccwr/s 0.00
3.2.2.7. Anomalies

No anomalies were detected during the course of this test.

3.2.2.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.3. Test ID: PHY2PHY_TPUT_MOD_VLAN

3.2.3.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: efdc282f4b08e96f3e09d43f94ba0508e4f26090

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • DPDK Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: phy2phy_tput_mod_vlan
  • Description: LTD.Throughput.RFC2544.PacketLossRatioFrameModification
  • Deployment: p2p
  • Traffic type: rfc2544
  • Bidirectional : False
3.2.3.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.3.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 11658302.621
tx_rate_mbps Unknown
throughput_rx_mbps 6342.117
tx_rate_percent 78.344
throughput_rx_percent 82.074
frame_loss_percent 0.000
min_latency_ns 6200.000
max_latency_ns 215740.000
avg_latency_ns 7621.000
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:27:47
3.2.3.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 93764
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 22.68
majflt/s 0.00
VSZ 8057816
RSS 27371
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 93748
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52076
RSS 3464
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.3.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 8119355.716
tx_rate_mbps Unknown
throughput_rx_mbps 8574.040
tx_rate_percent 96.133
throughput_rx_percent 98.731
frame_loss_percent 0.000
min_latency_ns 5280.000
max_latency_ns 209880.000
avg_latency_ns 6974.000
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:27:47
3.2.3.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 93764
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 22.68
majflt/s 0.00
VSZ 8057816
RSS 27371
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 93748
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52076
RSS 3464
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.3.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2186068.697
tx_rate_mbps Unknown
throughput_rx_mbps 9024.092
tx_rate_percent 93.039
throughput_rx_percent 93.739
frame_loss_percent 0.000
min_latency_ns 4640.000
max_latency_ns 39820.000
avg_latency_ns 5673.000
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:27:47
3.2.3.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 93764
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 22.68
majflt/s 0.00
VSZ 8057816
RSS 27371
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 93748
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52076
RSS 3464
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.3.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1188058.606
tx_rate_mbps Unknown
throughput_rx_mbps 9770.594
tx_rate_percent 99.227
throughput_rx_percent 99.607
frame_loss_percent 0.000
min_latency_ns 5780.000
max_latency_ns 37860.000
avg_latency_ns 8491.000
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:27:47
3.2.3.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 93764
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 22.68
majflt/s 0.00
VSZ 8057816
RSS 27371
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 93748
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52076
RSS 3464
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.3.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 806458.217
tx_rate_mbps Unknown
throughput_rx_mbps 9819.435
tx_rate_percent 99.227
throughput_rx_percent 99.485
frame_loss_percent 0.000
min_latency_ns 6220.000
max_latency_ns 35500.000
avg_latency_ns 8315.000
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:27:47
3.2.3.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 93764
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 22.68
majflt/s 0.00
VSZ 8057816
RSS 27371
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 93748
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52076
RSS 3464
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.7. Anomalies

No anomalies were detected during the course of this test.

3.2.3.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.4. Test ID: PVVP_BACK2BACK

3.2.4.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: pvvp

  • vswitchperf: GIT tag: efdc282f4b08e96f3e09d43f94ba0508e4f26090

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • DPDK Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

  • VNF: QemuDpdkVhostUser, Version: 2.5.0, GIT tag: a8c40fa2d667e585382080db36ac44e216b37a1c

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: pvvp_back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: pvvp
  • Traffic type: rfc2544
  • Bidirectional : True
3.2.4.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.4.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 3405
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:51:13
guest_loopback_app testpmd testpmd
3.2.4.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 114316
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 7.57
majflt/s 0.00
VSZ 16454620
RSS 25456
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 114300
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3484
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 114611
%usr 0.00
%system 0.22
%guest 200.37
%CPU 100.17
CPU
minflt/s 1.63
majflt/s 0.00
VSZ 2698644
RSS 265596
%MEM 0.40
kB_rd/s 0.00
kB_wr/s 5.34
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 114586
%usr 0.00
%system 0.18
%guest 200.32
%CPU 100.16
CPU
minflt/s 1.22
majflt/s 0.00
VSZ 2646408
RSS 270119
%MEM 0.41
kB_rd/s 0.00
kB_wr/s 0.05
kB_ccwr/s 0.00
3.2.4.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.4.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1933
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:51:13
guest_loopback_app testpmd testpmd
3.2.4.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 114316
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 7.57
majflt/s 0.00
VSZ 16454620
RSS 25456
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 114300
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3484
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 114611
%usr 0.00
%system 0.22
%guest 200.37
%CPU 100.17
CPU
minflt/s 1.63
majflt/s 0.00
VSZ 2698644
RSS 265596
%MEM 0.40
kB_rd/s 0.00
kB_wr/s 5.34
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 114586
%usr 0.00
%system 0.18
%guest 200.32
%CPU 100.16
CPU
minflt/s 1.22
majflt/s 0.00
VSZ 2646408
RSS 270119
%MEM 0.41
kB_rd/s 0.00
kB_wr/s 0.05
kB_ccwr/s 0.00
3.2.4.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.4.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1075
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:51:13
guest_loopback_app testpmd testpmd
3.2.4.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 114316
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 7.57
majflt/s 0.00
VSZ 16454620
RSS 25456
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 114300
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3484
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 114611
%usr 0.00
%system 0.22
%guest 200.37
%CPU 100.17
CPU
minflt/s 1.63
majflt/s 0.00
VSZ 2698644
RSS 265596
%MEM 0.40
kB_rd/s 0.00
kB_wr/s 5.34
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 114586
%usr 0.00
%system 0.18
%guest 200.32
%CPU 100.16
CPU
minflt/s 1.22
majflt/s 0.00
VSZ 2646408
RSS 270119
%MEM 0.41
kB_rd/s 0.00
kB_wr/s 0.05
kB_ccwr/s 0.00
3.2.4.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.4.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 11224856
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:51:13
guest_loopback_app testpmd testpmd
3.2.4.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 114316
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 7.57
majflt/s 0.00
VSZ 16454620
RSS 25456
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 114300
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3484
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 114611
%usr 0.00
%system 0.22
%guest 200.37
%CPU 100.17
CPU
minflt/s 1.63
majflt/s 0.00
VSZ 2698644
RSS 265596
%MEM 0.40
kB_rd/s 0.00
kB_wr/s 5.34
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 114586
%usr 0.00
%system 0.18
%guest 200.32
%CPU 100.16
CPU
minflt/s 1.22
majflt/s 0.00
VSZ 2646408
RSS 270119
%MEM 0.41
kB_rd/s 0.00
kB_wr/s 0.05
kB_ccwr/s 0.00
3.2.4.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.4.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 10667262
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:51:13
guest_loopback_app testpmd testpmd
3.2.4.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 114316
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 7.57
majflt/s 0.00
VSZ 16454620
RSS 25456
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 114300
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52084
RSS 3484
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 114611
%usr 0.00
%system 0.22
%guest 200.37
%CPU 100.17
CPU
minflt/s 1.63
majflt/s 0.00
VSZ 2698644
RSS 265596
%MEM 0.40
kB_rd/s 0.00
kB_wr/s 5.34
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 114586
%usr 0.00
%system 0.18
%guest 200.32
%CPU 100.16
CPU
minflt/s 1.22
majflt/s 0.00
VSZ 2646408
RSS 270119
%MEM 0.41
kB_rd/s 0.00
kB_wr/s 0.05
kB_ccwr/s 0.00
3.2.4.7. Anomalies

No anomalies were detected during the course of this test.

3.2.4.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.5. Test ID: PHY2PHY_TPUT

3.2.5.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: efdc282f4b08e96f3e09d43f94ba0508e4f26090

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • DPDK Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: phy2phy_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: p2p
  • Traffic type: rfc2544
  • Bidirectional : True
3.2.5.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.5.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 22626032.857
tx_rate_mbps Unknown
throughput_rx_mbps 11584.529
tx_rate_percent 76.023
throughput_rx_percent 76.023
frame_loss_percent 0.000
min_latency_ns 5000.000
max_latency_ns 383400.000
avg_latency_ns 7781.500
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:16:47
3.2.5.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 87761
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 26.05
majflt/s 0.00
VSZ 8057820
RSS 27243
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 87745
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3480
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.5.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 15585428.698
tx_rate_mbps Unknown
throughput_rx_mbps 15959.479
tx_rate_percent 92.266
throughput_rx_percent 92.266
frame_loss_percent 0.000
min_latency_ns 7600.000
max_latency_ns 112880.000
avg_latency_ns 8601.500
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:16:47
3.2.5.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 87761
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 26.05
majflt/s 0.00
VSZ 8057820
RSS 27243
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 87745
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3480
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.5.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4699184.192
tx_rate_mbps Unknown
throughput_rx_mbps 19247.858
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 21000.000
max_latency_ns 63400.000
avg_latency_ns 46867.500
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:16:47
3.2.5.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 87761
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 26.05
majflt/s 0.00
VSZ 8057820
RSS 27243
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 87745
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3480
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.5.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394601.705
tx_rate_mbps Unknown
throughput_rx_mbps 19616.577
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 15000.000
max_latency_ns 60740.000
avg_latency_ns 45801.500
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:16:47
3.2.5.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 87761
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 26.05
majflt/s 0.00
VSZ 8057820
RSS 27243
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 87745
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3480
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.5.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625466.527
tx_rate_mbps Unknown
throughput_rx_mbps 19739.666
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 15560.000
max_latency_ns 56500.000
avg_latency_ns 45116.500
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:16:47
3.2.5.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 87761
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 26.05
majflt/s 0.00
VSZ 8057820
RSS 27243
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 87745
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52088
RSS 3480
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.7. Anomalies

No anomalies were detected during the course of this test.

3.2.5.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.6. Test ID: PHY2PHY_SCALABILITY

3.2.6.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: efdc282f4b08e96f3e09d43f94ba0508e4f26090

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • DPDK Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: phy2phy_scalability
  • Description: LTD.Scalability.Flows.RFC2544.0PacketLoss
  • Deployment: p2p
  • Traffic type: rfc2544
  • Bidirectional : True
3.2.6.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.6.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 22626034.879
tx_rate_mbps Unknown
throughput_rx_mbps 11584.530
tx_rate_percent 76.023
throughput_rx_percent 76.023
frame_loss_percent 0.000
min_latency_ns 7120.000
max_latency_ns 470420.000
avg_latency_ns 8420.000
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:16:40
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 97581
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 26.92
majflt/s 0.00
VSZ 8057816
RSS 27377
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 97565
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52076
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.6.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 15454830.669
tx_rate_mbps Unknown
throughput_rx_mbps 15825.747
tx_rate_percent 91.492
throughput_rx_percent 91.492
frame_loss_percent 0.000
min_latency_ns 7180.000
max_latency_ns 564320.000
avg_latency_ns 8703.000
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:16:40
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 97581
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 26.92
majflt/s 0.00
VSZ 8057816
RSS 27377
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 97565
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52076
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.6.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4699193.058
tx_rate_mbps Unknown
throughput_rx_mbps 19247.895
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 23040.000
max_latency_ns 61300.000
avg_latency_ns 48666.000
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:16:40
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 97581
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 26.92
majflt/s 0.00
VSZ 8057816
RSS 27377
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 97565
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52076
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.6.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394605.425
tx_rate_mbps Unknown
throughput_rx_mbps 19616.608
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 15880.000
max_latency_ns 55320.000
avg_latency_ns 43801.500
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:16:40
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 97581
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 26.92
majflt/s 0.00
VSZ 8057816
RSS 27377
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 97565
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52076
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.6.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625465.243
tx_rate_mbps Unknown
throughput_rx_mbps 19739.650
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 16060.000
max_latency_ns 57900.000
avg_latency_ns 46345.500
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:16:40
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 97581
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 26.92
majflt/s 0.00
VSZ 8057816
RSS 27377
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 97565
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52076
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.7. Anomalies

No anomalies were detected during the course of this test.

3.2.6.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.7. Test ID: PVP_BACK2BACK

3.2.7.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: pvp

  • vswitchperf: GIT tag: efdc282f4b08e96f3e09d43f94ba0508e4f26090

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • DPDK Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

  • VNF: QemuDpdkVhostUser, Version: 2.5.0, GIT tag: a8c40fa2d667e585382080db36ac44e216b37a1c

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: pvp_back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: pvp
  • Traffic type: rfc2544
  • Bidirectional : True
3.2.7.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.7.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 3831
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:55:42
guest_loopback_app testpmd
3.2.7.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 102725
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 6.77
majflt/s 0.00
VSZ 12256220
RSS 25475
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 102709
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52092
RSS 3492
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 102955
%usr 0.00
%system 0.16
%guest 200.33
%CPU 100.16
CPU
minflt/s 1.77
majflt/s 0.00
VSZ 2648460
RSS 266949
%MEM 0.41
kB_rd/s 0.00
kB_wr/s 4.40
kB_ccwr/s 0.00
3.2.7.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.7.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1933
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:55:42
guest_loopback_app testpmd
3.2.7.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 102725
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 6.77
majflt/s 0.00
VSZ 12256220
RSS 25475
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 102709
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52092
RSS 3492
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 102955
%usr 0.00
%system 0.16
%guest 200.33
%CPU 100.16
CPU
minflt/s 1.77
majflt/s 0.00
VSZ 2648460
RSS 266949
%MEM 0.41
kB_rd/s 0.00
kB_wr/s 4.40
kB_ccwr/s 0.00
3.2.7.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.7.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 48460921
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:55:42
guest_loopback_app testpmd
3.2.7.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 102725
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 6.77
majflt/s 0.00
VSZ 12256220
RSS 25475
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 102709
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52092
RSS 3492
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 102955
%usr 0.00
%system 0.16
%guest 200.33
%CPU 100.16
CPU
minflt/s 1.77
majflt/s 0.00
VSZ 2648460
RSS 266949
%MEM 0.41
kB_rd/s 0.00
kB_wr/s 4.40
kB_ccwr/s 0.00
3.2.7.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.7.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 35919540
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:55:42
guest_loopback_app testpmd
3.2.7.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 102725
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 6.77
majflt/s 0.00
VSZ 12256220
RSS 25475
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 102709
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52092
RSS 3492
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 102955
%usr 0.00
%system 0.16
%guest 200.33
%CPU 100.16
CPU
minflt/s 1.77
majflt/s 0.00
VSZ 2648460
RSS 266949
%MEM 0.41
kB_rd/s 0.00
kB_wr/s 4.40
kB_ccwr/s 0.00
3.2.7.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.7.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 24382314
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:55:42
guest_loopback_app testpmd
3.2.7.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 102725
%usr 200.32
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 6.77
majflt/s 0.00
VSZ 12256220
RSS 25475
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 102709
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52092
RSS 3492
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 102955
%usr 0.00
%system 0.16
%guest 200.33
%CPU 100.16
CPU
minflt/s 1.77
majflt/s 0.00
VSZ 2648460
RSS 266949
%MEM 0.41
kB_rd/s 0.00
kB_wr/s 4.40
kB_ccwr/s 0.00
3.2.7.7. Anomalies

No anomalies were detected during the course of this test.

3.2.7.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.8. Test ID: PVVP_TPUT

3.2.8.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: pvvp

  • vswitchperf: GIT tag: efdc282f4b08e96f3e09d43f94ba0508e4f26090

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • DPDK Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

  • VNF: QemuDpdkVhostUser, Version: 2.5.0, GIT tag: a8c40fa2d667e585382080db36ac44e216b37a1c

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: pvvp_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: pvvp
  • Traffic type: rfc2544
  • Bidirectional : True
3.2.8.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.8.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 3980652.633
tx_rate_mbps Unknown
throughput_rx_mbps 2038.094
tx_rate_percent 13.375
throughput_rx_percent 13.375
frame_loss_percent 0.000
min_latency_ns 8960.000
max_latency_ns 90760.000
avg_latency_ns 17350.000
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:31:58
guest_loopback_app testpmd testpmd
3.2.8.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 109821
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 15.04
majflt/s 0.00
VSZ 16454620
RSS 27436
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 109804
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52096
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 110219
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.16
CPU
minflt/s 0.61
majflt/s 0.00
VSZ 2732428
RSS 223486
%MEM 0.34
kB_rd/s 0.00
kB_wr/s 16.57
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 110091
%usr 0.00
%system 0.26
%guest 200.19
%CPU 100.17
CPU
minflt/s 1.25
majflt/s 0.00
VSZ 2640272
RSS 236321
%MEM 0.36
kB_rd/s 0.00
kB_wr/s 0.04
kB_ccwr/s 0.00
3.2.8.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.8.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2259295.001
tx_rate_mbps Unknown
throughput_rx_mbps 2313.518
tx_rate_percent 13.375
throughput_rx_percent 13.375
frame_loss_percent 0.000
min_latency_ns 6940.000
max_latency_ns 60100.000
avg_latency_ns 9806.500
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:31:58
guest_loopback_app testpmd testpmd
3.2.8.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 109821
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 15.04
majflt/s 0.00
VSZ 16454620
RSS 27436
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 109804
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52096
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 110219
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.16
CPU
minflt/s 0.61
majflt/s 0.00
VSZ 2732428
RSS 223486
%MEM 0.34
kB_rd/s 0.00
kB_wr/s 16.57
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 110091
%usr 0.00
%system 0.26
%guest 200.19
%CPU 100.17
CPU
minflt/s 1.25
majflt/s 0.00
VSZ 2640272
RSS 236321
%MEM 0.36
kB_rd/s 0.00
kB_wr/s 0.04
kB_ccwr/s 0.00
3.2.8.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.8.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2954664.048
tx_rate_mbps Unknown
throughput_rx_mbps 12102.304
tx_rate_percent 62.875
throughput_rx_percent 62.875
frame_loss_percent 0.000
min_latency_ns 14760.000
max_latency_ns 89260.000
avg_latency_ns 20065.000
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:31:58
guest_loopback_app testpmd testpmd
3.2.8.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 109821
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 15.04
majflt/s 0.00
VSZ 16454620
RSS 27436
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 109804
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52096
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 110219
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.16
CPU
minflt/s 0.61
majflt/s 0.00
VSZ 2732428
RSS 223486
%MEM 0.34
kB_rd/s 0.00
kB_wr/s 16.57
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 110091
%usr 0.00
%system 0.26
%guest 200.19
%CPU 100.17
CPU
minflt/s 1.25
majflt/s 0.00
VSZ 2640272
RSS 236321
%MEM 0.36
kB_rd/s 0.00
kB_wr/s 0.04
kB_ccwr/s 0.00
3.2.8.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.8.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1579711.430
tx_rate_mbps Unknown
throughput_rx_mbps 12940.996
tx_rate_percent 65.969
throughput_rx_percent 65.969
frame_loss_percent 0.000
min_latency_ns 10540.000
max_latency_ns 188700.000
avg_latency_ns 14497.500
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:31:58
guest_loopback_app testpmd testpmd
3.2.8.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 109821
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 15.04
majflt/s 0.00
VSZ 16454620
RSS 27436
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 109804
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52096
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 110219
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.16
CPU
minflt/s 0.61
majflt/s 0.00
VSZ 2732428
RSS 223486
%MEM 0.34
kB_rd/s 0.00
kB_wr/s 16.57
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 110091
%usr 0.00
%system 0.26
%guest 200.19
%CPU 100.17
CPU
minflt/s 1.25
majflt/s 0.00
VSZ 2640272
RSS 236321
%MEM 0.36
kB_rd/s 0.00
kB_wr/s 0.04
kB_ccwr/s 0.00
3.2.8.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.8.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1424333.393
tx_rate_mbps Unknown
throughput_rx_mbps 17297.105
tx_rate_percent 87.625
throughput_rx_percent 87.625
frame_loss_percent 0.000
min_latency_ns 14260.000
max_latency_ns 76720.000
avg_latency_ns 17690.500
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:31:58
guest_loopback_app testpmd testpmd
3.2.8.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 109821
%usr 200.33
%system 0.11
%guest 0.00
%CPU 200.44
CPU
minflt/s 15.04
majflt/s 0.00
VSZ 16454620
RSS 27436
%MEM 0.04
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 109804
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 52096
RSS 3488
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 110219
%usr 0.00
%system 0.00
%guest 200.10
%CPU 100.16
CPU
minflt/s 0.61
majflt/s 0.00
VSZ 2732428
RSS 223486
%MEM 0.34
kB_rd/s 0.00
kB_wr/s 16.57
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 110091
%usr 0.00
%system 0.26
%guest 200.19
%CPU 100.17
CPU
minflt/s 1.25
majflt/s 0.00
VSZ 2640272
RSS 236321
%MEM 0.36
kB_rd/s 0.00
kB_wr/s 0.04
kB_ccwr/s 0.00
3.2.8.7. Anomalies

No anomalies were detected during the course of this test.

3.2.8.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.3. Rationale for decisions

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

3.4. Conclusions and recommendations

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod3/2016-11-29_06-14-03/vswitchperf_logs_2016-11-29_06-14-03.tar.gz.

3.5. General

3.5.1. Glossary

  • NFV - Network Function Virtualization
  • Mbps - 1,000,000bps

3.5.2. Document change procedures and history

Document ID Author Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT Christopher Nolan 23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT Christopher Nolan 28/01/2015

4. Performance report for Open vSwitch

4.1. Introduction

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

4.1.1. Document identifier

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

4.1.2. Scope

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

4.2. Details of the Level Test Report

This section provides a test-results-overview. Also included are the rationale and the conclusions.

4.2.1. Test ID: BACK2BACK

4.2.1.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: efdc282f4b08e96f3e09d43f94ba0508e4f26090

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

Below are test details:

  • Test ID: back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: p2p
  • Traffic type: rfc2544
  • Bidirectional : True
4.2.1.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.1.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 5108
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:42:34
4.2.1.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 124776
%usr 0.35
%system 4.42
%guest 0.00
%CPU 4.78
CPU
minflt/s 6.12
majflt/s 0.00
VSZ 6609932
RSS 32172
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 124773
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45916
RSS 3228
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.1.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 3382
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:42:34
4.2.1.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 124776
%usr 0.35
%system 4.42
%guest 0.00
%CPU 4.78
CPU
minflt/s 6.12
majflt/s 0.00
VSZ 6609932
RSS 32172
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 124773
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45916
RSS 3228
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.1.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1344
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:42:34
4.2.1.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 124776
%usr 0.35
%system 4.42
%guest 0.00
%CPU 4.78
CPU
minflt/s 6.12
majflt/s 0.00
VSZ 6609932
RSS 32172
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 124773
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45916
RSS 3228
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.1.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1096
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:42:34
4.2.1.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 124776
%usr 0.35
%system 4.42
%guest 0.00
%CPU 4.78
CPU
minflt/s 6.12
majflt/s 0.00
VSZ 6609932
RSS 32172
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 124773
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45916
RSS 3228
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.1.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1116
b2b_frame_loss_percent 0.0
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:42:34
4.2.1.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 124776
%usr 0.35
%system 4.42
%guest 0.00
%CPU 4.78
CPU
minflt/s 6.12
majflt/s 0.00
VSZ 6609932
RSS 32172
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 124773
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45916
RSS 3228
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.7. Anomalies

No anomalies were detected during the course of this test.

4.2.1.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.2. Test ID: PVP_TPUT

4.2.2.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: pvp

  • vswitchperf: GIT tag: efdc282f4b08e96f3e09d43f94ba0508e4f26090

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • VNF: QemuVirtioNet, Version: 2.5.0, GIT tag: a8c40fa2d667e585382080db36ac44e216b37a1c

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: pvp_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: pvp
  • Traffic type: rfc2544
  • Bidirectional : True
4.2.2.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.2.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 526482.707
tx_rate_mbps Unknown
throughput_rx_mbps 269.559
tx_rate_percent 1.773
throughput_rx_percent 1.769
frame_loss_percent 0.295
min_latency_ns 14500.000
max_latency_ns 26059540.000
avg_latency_ns 65232.000
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:28:29
guest_loopback_app testpmd
4.2.2.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 137322
%usr 0.36
%system 4.39
%guest 0.00
%CPU 4.75
CPU
minflt/s 6.31
majflt/s 0.00
VSZ 6609928
RSS 49348
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 137319
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45916
RSS 3228
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 137607
%usr 0.00
%system 0.71
%guest 199.81
%CPU 100.18
CPU
minflt/s 1.66
majflt/s 0.00
VSZ 2619932
RSS 115159
%MEM 0.18
kB_rd/s 0.00
kB_wr/s 8.90
kB_ccwr/s 0.00
4.2.2.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.2.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 299554.221
tx_rate_mbps Unknown
throughput_rx_mbps 306.744
tx_rate_percent 1.773
throughput_rx_percent 1.773
frame_loss_percent 0.005
min_latency_ns 11280.000
max_latency_ns 1718600.000
avg_latency_ns 46141.000
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:28:29
guest_loopback_app testpmd
4.2.2.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 137322
%usr 0.36
%system 4.39
%guest 0.00
%CPU 4.75
CPU
minflt/s 6.31
majflt/s 0.00
VSZ 6609928
RSS 49348
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 137319
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45916
RSS 3228
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 137607
%usr 0.00
%system 0.71
%guest 199.81
%CPU 100.18
CPU
minflt/s 1.66
majflt/s 0.00
VSZ 2619932
RSS 115159
%MEM 0.18
kB_rd/s 0.00
kB_wr/s 8.90
kB_ccwr/s 0.00
4.2.2.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.2.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 265067.490
tx_rate_mbps Unknown
throughput_rx_mbps 1085.716
tx_rate_percent 5.641
throughput_rx_percent 5.641
frame_loss_percent 0.000
min_latency_ns 19560.000
max_latency_ns 1187760.000
avg_latency_ns 109278.500
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:28:29
guest_loopback_app testpmd
4.2.2.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 137322
%usr 0.36
%system 4.39
%guest 0.00
%CPU 4.75
CPU
minflt/s 6.31
majflt/s 0.00
VSZ 6609928
RSS 49348
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 137319
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45916
RSS 3228
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 137607
%usr 0.00
%system 0.71
%guest 199.81
%CPU 100.18
CPU
minflt/s 1.66
majflt/s 0.00
VSZ 2619932
RSS 115159
%MEM 0.18
kB_rd/s 0.00
kB_wr/s 8.90
kB_ccwr/s 0.00
4.2.2.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.2.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 190635.657
tx_rate_mbps Unknown
throughput_rx_mbps 1561.687
tx_rate_percent 7.961
throughput_rx_percent 7.961
frame_loss_percent 0.000
min_latency_ns 18440.000
max_latency_ns 861000.000
avg_latency_ns 94964.500
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:28:29
guest_loopback_app testpmd
4.2.2.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 137322
%usr 0.36
%system 4.39
%guest 0.00
%CPU 4.75
CPU
minflt/s 6.31
majflt/s 0.00
VSZ 6609928
RSS 49348
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 137319
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45916
RSS 3228
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 137607
%usr 0.00
%system 0.71
%guest 199.81
%CPU 100.18
CPU
minflt/s 1.66
majflt/s 0.00
VSZ 2619932
RSS 115159
%MEM 0.18
kB_rd/s 0.00
kB_wr/s 8.90
kB_ccwr/s 0.00
4.2.2.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.2.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 267697.429
tx_rate_mbps Unknown
throughput_rx_mbps 3250.918
tx_rate_percent 16.469
throughput_rx_percent 16.469
frame_loss_percent 0.000
min_latency_ns 34720.000
max_latency_ns 1184700.000
avg_latency_ns 111635.500
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:28:29
guest_loopback_app testpmd
4.2.2.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 137322
%usr 0.36
%system 4.39
%guest 0.00
%CPU 4.75
CPU
minflt/s 6.31
majflt/s 0.00
VSZ 6609928
RSS 49348
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 137319
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45916
RSS 3228
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 137607
%usr 0.00
%system 0.71
%guest 199.81
%CPU 100.18
CPU
minflt/s 1.66
majflt/s 0.00
VSZ 2619932
RSS 115159
%MEM 0.18
kB_rd/s 0.00
kB_wr/s 8.90
kB_ccwr/s 0.00
4.2.2.7. Anomalies

No anomalies were detected during the course of this test.

4.2.2.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.3. Test ID: PHY2PHY_TPUT_MOD_VLAN

4.2.3.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: efdc282f4b08e96f3e09d43f94ba0508e4f26090

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

Below are test details:

  • Test ID: phy2phy_tput_mod_vlan
  • Description: LTD.Throughput.RFC2544.PacketLossRatioFrameModification
  • Deployment: p2p
  • Traffic type: rfc2544
  • Bidirectional : False
4.2.3.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.3.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 724284.265
tx_rate_mbps Unknown
throughput_rx_mbps 394.011
tx_rate_percent 4.867
throughput_rx_percent 5.099
frame_loss_percent 0.000
min_latency_ns 4200.000
max_latency_ns 5280200.000
avg_latency_ns 456459.000
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:27:36
4.2.3.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 130109
%usr 0.35
%system 4.34
%guest 0.00
%CPU 4.70
CPU
minflt/s 5.91
majflt/s 0.00
VSZ 6609936
RSS 33383
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 130106
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3255
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.3.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 672376.270
tx_rate_mbps Unknown
throughput_rx_mbps 710.029
tx_rate_percent 7.961
throughput_rx_percent 8.176
frame_loss_percent 0.000
min_latency_ns 4460.000
max_latency_ns 3398240.000
avg_latency_ns 203928.000
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:27:36
4.2.3.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 130109
%usr 0.35
%system 4.34
%guest 0.00
%CPU 4.70
CPU
minflt/s 5.91
majflt/s 0.00
VSZ 6609936
RSS 33383
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 130106
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3255
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.3.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 550510.275
tx_rate_mbps Unknown
throughput_rx_mbps 2272.506
tx_rate_percent 23.430
throughput_rx_percent 23.606
frame_loss_percent 0.000
min_latency_ns 5540.000
max_latency_ns 817120.000
avg_latency_ns 59908.000
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:27:36
4.2.3.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 130109
%usr 0.35
%system 4.34
%guest 0.00
%CPU 4.70
CPU
minflt/s 5.91
majflt/s 0.00
VSZ 6609936
RSS 33383
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 130106
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3255
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.3.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 549082.664
tx_rate_mbps Unknown
throughput_rx_mbps 4515.656
tx_rate_percent 45.859
throughput_rx_percent 46.035
frame_loss_percent 0.000
min_latency_ns 5960.000
max_latency_ns 854940.000
avg_latency_ns 57875.000
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:27:36
4.2.3.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 130109
%usr 0.35
%system 4.34
%guest 0.00
%CPU 4.70
CPU
minflt/s 5.91
majflt/s 0.00
VSZ 6609936
RSS 33383
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 130106
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3255
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.3.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 567586.891
tx_rate_mbps Unknown
throughput_rx_mbps 6910.938
tx_rate_percent 69.836
throughput_rx_percent 70.018
frame_loss_percent 0.000
min_latency_ns 6400.000
max_latency_ns 1206960.000
avg_latency_ns 81142.000
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:27:36
4.2.3.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 130109
%usr 0.35
%system 4.34
%guest 0.00
%CPU 4.70
CPU
minflt/s 5.91
majflt/s 0.00
VSZ 6609936
RSS 33383
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 130106
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3255
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.7. Anomalies

No anomalies were detected during the course of this test.

4.2.3.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.4. Test ID: PVVP_BACK2BACK

4.2.4.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: pvvp

  • vswitchperf: GIT tag: efdc282f4b08e96f3e09d43f94ba0508e4f26090

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • VNF: QemuVirtioNet, Version: 2.5.0, GIT tag: a8c40fa2d667e585382080db36ac44e216b37a1c

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: pvvp_back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: pvvp
  • Traffic type: rfc2544
  • Bidirectional : True
4.2.4.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.4.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:43:43
guest_loopback_app testpmd testpmd
4.2.4.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 150647
%usr 0.35
%system 4.36
%guest 0.00
%CPU 4.72
CPU
minflt/s 6.30
majflt/s 0.00
VSZ 6610048
RSS 34280
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 150644
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3268
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 151136
%usr 0.00
%system 0.19
%guest 200.34
%CPU 100.16
CPU
minflt/s 1.70
majflt/s 0.00
VSZ 2615836
RSS 209061
%MEM 0.32
kB_rd/s 0.00
kB_wr/s 5.60
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 151010
%usr 0.00
%system 0.04
%guest 200.06
%CPU 100.16
CPU
minflt/s 0.08
majflt/s 0.00
VSZ 2693652
RSS 304113
%MEM 0.46
kB_rd/s 0.00
kB_wr/s 0.06
kB_ccwr/s 0.00
4.2.4.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.4.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:43:43
guest_loopback_app testpmd testpmd
4.2.4.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 150647
%usr 0.35
%system 4.36
%guest 0.00
%CPU 4.72
CPU
minflt/s 6.30
majflt/s 0.00
VSZ 6610048
RSS 34280
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 150644
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3268
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 151136
%usr 0.00
%system 0.19
%guest 200.34
%CPU 100.16
CPU
minflt/s 1.70
majflt/s 0.00
VSZ 2615836
RSS 209061
%MEM 0.32
kB_rd/s 0.00
kB_wr/s 5.60
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 151010
%usr 0.00
%system 0.04
%guest 200.06
%CPU 100.16
CPU
minflt/s 0.08
majflt/s 0.00
VSZ 2693652
RSS 304113
%MEM 0.46
kB_rd/s 0.00
kB_wr/s 0.06
kB_ccwr/s 0.00
4.2.4.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.4.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:43:43
guest_loopback_app testpmd testpmd
4.2.4.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 150647
%usr 0.35
%system 4.36
%guest 0.00
%CPU 4.72
CPU
minflt/s 6.30
majflt/s 0.00
VSZ 6610048
RSS 34280
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 150644
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3268
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 151136
%usr 0.00
%system 0.19
%guest 200.34
%CPU 100.16
CPU
minflt/s 1.70
majflt/s 0.00
VSZ 2615836
RSS 209061
%MEM 0.32
kB_rd/s 0.00
kB_wr/s 5.60
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 151010
%usr 0.00
%system 0.04
%guest 200.06
%CPU 100.16
CPU
minflt/s 0.08
majflt/s 0.00
VSZ 2693652
RSS 304113
%MEM 0.46
kB_rd/s 0.00
kB_wr/s 0.06
kB_ccwr/s 0.00
4.2.4.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.4.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:43:43
guest_loopback_app testpmd testpmd
4.2.4.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 150647
%usr 0.35
%system 4.36
%guest 0.00
%CPU 4.72
CPU
minflt/s 6.30
majflt/s 0.00
VSZ 6610048
RSS 34280
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 150644
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3268
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 151136
%usr 0.00
%system 0.19
%guest 200.34
%CPU 100.16
CPU
minflt/s 1.70
majflt/s 0.00
VSZ 2615836
RSS 209061
%MEM 0.32
kB_rd/s 0.00
kB_wr/s 5.60
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 151010
%usr 0.00
%system 0.04
%guest 200.06
%CPU 100.16
CPU
minflt/s 0.08
majflt/s 0.00
VSZ 2693652
RSS 304113
%MEM 0.46
kB_rd/s 0.00
kB_wr/s 0.06
kB_ccwr/s 0.00
4.2.4.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.4.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:43:43
guest_loopback_app testpmd testpmd
4.2.4.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 150647
%usr 0.35
%system 4.36
%guest 0.00
%CPU 4.72
CPU
minflt/s 6.30
majflt/s 0.00
VSZ 6610048
RSS 34280
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 150644
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3268
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 151136
%usr 0.00
%system 0.19
%guest 200.34
%CPU 100.16
CPU
minflt/s 1.70
majflt/s 0.00
VSZ 2615836
RSS 209061
%MEM 0.32
kB_rd/s 0.00
kB_wr/s 5.60
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 151010
%usr 0.00
%system 0.04
%guest 200.06
%CPU 100.16
CPU
minflt/s 0.08
majflt/s 0.00
VSZ 2693652
RSS 304113
%MEM 0.46
kB_rd/s 0.00
kB_wr/s 0.06
kB_ccwr/s 0.00
4.2.4.7. Anomalies

No anomalies were detected during the course of this test.

4.2.4.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.5. Test ID: PHY2PHY_TPUT

4.2.5.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: efdc282f4b08e96f3e09d43f94ba0508e4f26090

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

Below are test details:

  • Test ID: phy2phy_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: p2p
  • Traffic type: rfc2544
  • Bidirectional : True
4.2.5.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.5.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 758000.414
tx_rate_mbps Unknown
throughput_rx_mbps 388.096
tx_rate_percent 2.547
throughput_rx_percent 2.547
frame_loss_percent 0.000
min_latency_ns 4040.000
max_latency_ns 6257000.000
avg_latency_ns 643599.500
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:27:51
4.2.5.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 121290
%usr 0.35
%system 4.47
%guest 0.00
%CPU 4.82
CPU
minflt/s 5.48
majflt/s 0.00
VSZ 6609928
RSS 32152
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 121287
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45908
RSS 3259
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.5.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 691513.486
tx_rate_mbps Unknown
throughput_rx_mbps 708.110
tx_rate_percent 4.094
throughput_rx_percent 4.094
frame_loss_percent 0.000
min_latency_ns 4300.000
max_latency_ns 3137900.000
avg_latency_ns 182354.000
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:27:51
4.2.5.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 121290
%usr 0.35
%system 4.47
%guest 0.00
%CPU 4.82
CPU
minflt/s 5.48
majflt/s 0.00
VSZ 6609928
RSS 32152
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 121287
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45908
RSS 3259
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.5.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 628533.539
tx_rate_mbps Unknown
throughput_rx_mbps 2574.473
tx_rate_percent 13.375
throughput_rx_percent 13.375
frame_loss_percent 0.000
min_latency_ns 5240.000
max_latency_ns 3377940.000
avg_latency_ns 221620.500
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:27:51
4.2.5.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 121290
%usr 0.35
%system 4.47
%guest 0.00
%CPU 4.82
CPU
minflt/s 5.48
majflt/s 0.00
VSZ 6609928
RSS 32152
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 121287
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45908
RSS 3259
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.5.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 616632.322
tx_rate_mbps Unknown
throughput_rx_mbps 5051.452
tx_rate_percent 25.750
throughput_rx_percent 25.750
frame_loss_percent 0.000
min_latency_ns 5820.000
max_latency_ns 2780540.000
avg_latency_ns 175879.500
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:27:51
4.2.5.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 121290
%usr 0.35
%system 4.47
%guest 0.00
%CPU 4.82
CPU
minflt/s 5.48
majflt/s 0.00
VSZ 6609928
RSS 32152
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 121287
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45908
RSS 3259
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.5.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 594574.468
tx_rate_mbps Unknown
throughput_rx_mbps 7220.512
tx_rate_percent 36.578
throughput_rx_percent 36.578
frame_loss_percent 0.000
min_latency_ns 6620.000
max_latency_ns 2140480.000
avg_latency_ns 103013.500
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:27:51
4.2.5.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 121290
%usr 0.35
%system 4.47
%guest 0.00
%CPU 4.82
CPU
minflt/s 5.48
majflt/s 0.00
VSZ 6609928
RSS 32152
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 121287
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45908
RSS 3259
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.7. Anomalies

No anomalies were detected during the course of this test.

4.2.5.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.6. Test ID: PHY2PHY_SCALABILITY

4.2.6.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: efdc282f4b08e96f3e09d43f94ba0508e4f26090

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

Below are test details:

  • Test ID: phy2phy_scalability
  • Description: LTD.Scalability.Flows.RFC2544.0PacketLoss
  • Deployment: p2p
  • Traffic type: rfc2544
  • Bidirectional : True
4.2.6.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.6.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 758000.897
tx_rate_mbps Unknown
throughput_rx_mbps 388.096
tx_rate_percent 2.547
throughput_rx_percent 2.547
frame_loss_percent 0.000
min_latency_ns 4000.000
max_latency_ns 7813040.000
avg_latency_ns 713196.500
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:27:44
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 133729
%usr 0.35
%system 4.50
%guest 0.00
%CPU 4.85
CPU
minflt/s 6.10
majflt/s 0.00
VSZ 6609932
RSS 45485
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 133726
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45916
RSS 3232
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.6.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 691512.909
tx_rate_mbps Unknown
throughput_rx_mbps 708.109
tx_rate_percent 4.094
throughput_rx_percent 4.094
frame_loss_percent 0.000
min_latency_ns 4240.000
max_latency_ns 9287600.000
avg_latency_ns 280409.000
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:27:44
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 133729
%usr 0.35
%system 4.50
%guest 0.00
%CPU 4.85
CPU
minflt/s 6.10
majflt/s 0.00
VSZ 6609932
RSS 45485
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 133726
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45916
RSS 3232
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.6.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 628531.056
tx_rate_mbps Unknown
throughput_rx_mbps 2574.463
tx_rate_percent 13.375
throughput_rx_percent 13.375
frame_loss_percent 0.000
min_latency_ns 5220.000
max_latency_ns 3618260.000
avg_latency_ns 373706.500
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:27:44
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 133729
%usr 0.35
%system 4.50
%guest 0.00
%CPU 4.85
CPU
minflt/s 6.10
majflt/s 0.00
VSZ 6609932
RSS 45485
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 133726
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45916
RSS 3232
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.6.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 598099.300
tx_rate_mbps Unknown
throughput_rx_mbps 4899.629
tx_rate_percent 24.977
throughput_rx_percent 24.977
frame_loss_percent 0.000
min_latency_ns 5720.000
max_latency_ns 3045120.000
avg_latency_ns 155493.500
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:27:44
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 133729
%usr 0.35
%system 4.50
%guest 0.00
%CPU 4.85
CPU
minflt/s 6.10
majflt/s 0.00
VSZ 6609932
RSS 45485
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 133726
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45916
RSS 3232
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.6.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 506568.987
tx_rate_mbps Unknown
throughput_rx_mbps 6151.774
tx_rate_percent 31.164
throughput_rx_percent 31.164
frame_loss_percent 0.000
min_latency_ns 6620.000
max_latency_ns 601660.000
avg_latency_ns 46123.500
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:27:44
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 133729
%usr 0.35
%system 4.50
%guest 0.00
%CPU 4.85
CPU
minflt/s 6.10
majflt/s 0.00
VSZ 6609932
RSS 45485
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 133726
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45916
RSS 3232
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.7. Anomalies

No anomalies were detected during the course of this test.

4.2.6.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.7. Test ID: PVP_BACK2BACK

4.2.7.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: pvp

  • vswitchperf: GIT tag: efdc282f4b08e96f3e09d43f94ba0508e4f26090

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • VNF: QemuVirtioNet, Version: 2.5.0, GIT tag: a8c40fa2d667e585382080db36ac44e216b37a1c

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: pvp_back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: pvp
  • Traffic type: rfc2544
  • Bidirectional : True
4.2.7.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.7.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:43:13
guest_loopback_app testpmd
4.2.7.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 141071
%usr 0.35
%system 4.35
%guest 0.00
%CPU 4.71
CPU
minflt/s 5.94
majflt/s 0.00
VSZ 6609932
RSS 31271
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 141068
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3260
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 141360
%usr 0.00
%system 0.21
%guest 200.29
%CPU 100.16
CPU
minflt/s 1.58
majflt/s 0.00
VSZ 2756112
RSS 214058
%MEM 0.33
kB_rd/s 0.00
kB_wr/s 5.84
kB_ccwr/s 0.00
4.2.7.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.7.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:43:13
guest_loopback_app testpmd
4.2.7.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 141071
%usr 0.35
%system 4.35
%guest 0.00
%CPU 4.71
CPU
minflt/s 5.94
majflt/s 0.00
VSZ 6609932
RSS 31271
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 141068
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3260
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 141360
%usr 0.00
%system 0.21
%guest 200.29
%CPU 100.16
CPU
minflt/s 1.58
majflt/s 0.00
VSZ 2756112
RSS 214058
%MEM 0.33
kB_rd/s 0.00
kB_wr/s 5.84
kB_ccwr/s 0.00
4.2.7.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.7.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:43:13
guest_loopback_app testpmd
4.2.7.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 141071
%usr 0.35
%system 4.35
%guest 0.00
%CPU 4.71
CPU
minflt/s 5.94
majflt/s 0.00
VSZ 6609932
RSS 31271
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 141068
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3260
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 141360
%usr 0.00
%system 0.21
%guest 200.29
%CPU 100.16
CPU
minflt/s 1.58
majflt/s 0.00
VSZ 2756112
RSS 214058
%MEM 0.33
kB_rd/s 0.00
kB_wr/s 5.84
kB_ccwr/s 0.00
4.2.7.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.7.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:43:13
guest_loopback_app testpmd
4.2.7.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 141071
%usr 0.35
%system 4.35
%guest 0.00
%CPU 4.71
CPU
minflt/s 5.94
majflt/s 0.00
VSZ 6609932
RSS 31271
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 141068
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3260
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 141360
%usr 0.00
%system 0.21
%guest 200.29
%CPU 100.16
CPU
minflt/s 1.58
majflt/s 0.00
VSZ 2756112
RSS 214058
%MEM 0.33
kB_rd/s 0.00
kB_wr/s 5.84
kB_ccwr/s 0.00
4.2.7.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.7.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:43:13
guest_loopback_app testpmd
4.2.7.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 141071
%usr 0.35
%system 4.35
%guest 0.00
%CPU 4.71
CPU
minflt/s 5.94
majflt/s 0.00
VSZ 6609932
RSS 31271
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 141068
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3260
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 141360
%usr 0.00
%system 0.21
%guest 200.29
%CPU 100.16
CPU
minflt/s 1.58
majflt/s 0.00
VSZ 2756112
RSS 214058
%MEM 0.33
kB_rd/s 0.00
kB_wr/s 5.84
kB_ccwr/s 0.00
4.2.7.7. Anomalies

No anomalies were detected during the course of this test.

4.2.7.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.8. Test ID: PVVP_TPUT

4.2.8.1. Test Environment

Below is the environment that the test was performed in:

  • OS: centos 7.2.1511 Core

  • Kernel Version: 3.10.0-327.28.2.el7.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65687480 kB

  • Virtual Switch Set-up: pvvp

  • vswitchperf: GIT tag: efdc282f4b08e96f3e09d43f94ba0508e4f26090

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.6.90, GIT tag: ed26e3ea9995ba632e681d5990af5ee9814f650e

  • VNF: QemuVirtioNet, Version: 2.5.0, GIT tag: a8c40fa2d667e585382080db36ac44e216b37a1c

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325
    • testpmd, Version: 16.07.0, GIT tag: 20e2b6eba13d9eb61b23ea75f09f2aa966fa6325

Below are test details:

  • Test ID: pvvp_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: pvvp
  • Traffic type: rfc2544
  • Bidirectional : True
4.2.8.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.8.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 526099.583
tx_rate_mbps Unknown
throughput_rx_mbps 269.363
tx_rate_percent 1.773
throughput_rx_percent 1.768
frame_loss_percent 0.326
min_latency_ns 24580.000
max_latency_ns 30361440.000
avg_latency_ns 93553.000
type rfc2544
packet_size 64
traffic_type udp
test_execution_time 00:28:58
guest_loopback_app testpmd testpmd
4.2.8.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 146674
%usr 0.34
%system 4.27
%guest 0.00
%CPU 4.61
CPU
minflt/s 7.53
majflt/s 0.00
VSZ 6610052
RSS 34756
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 146671
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3272
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 147089
%usr 0.00
%system 0.85
%guest 199.30
%CPU 100.16
CPU
minflt/s 1.47
majflt/s 0.00
VSZ 2638360
RSS 218135
%MEM 0.33
kB_rd/s 0.00
kB_wr/s 8.63
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 147037
%usr 0.00
%system 0.87
%guest 199.28
%CPU 100.15
CPU
minflt/s 1.34
majflt/s 0.00
VSZ 2609692
RSS 249764
%MEM 0.38
kB_rd/s 0.00
kB_wr/s 0.09
kB_ccwr/s 0.00
4.2.8.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.8.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 299558.832
tx_rate_mbps Unknown
throughput_rx_mbps 306.748
tx_rate_percent 1.773
throughput_rx_percent 1.773
frame_loss_percent 0.003
min_latency_ns 18280.000
max_latency_ns 2219020.000
avg_latency_ns 63981.500
type rfc2544
packet_size 128
traffic_type udp
test_execution_time 00:28:58
guest_loopback_app testpmd testpmd
4.2.8.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 146674
%usr 0.34
%system 4.27
%guest 0.00
%CPU 4.61
CPU
minflt/s 7.53
majflt/s 0.00
VSZ 6610052
RSS 34756
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 146671
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3272
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 147089
%usr 0.00
%system 0.85
%guest 199.30
%CPU 100.16
CPU
minflt/s 1.47
majflt/s 0.00
VSZ 2638360
RSS 218135
%MEM 0.33
kB_rd/s 0.00
kB_wr/s 8.63
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 147037
%usr 0.00
%system 0.87
%guest 199.28
%CPU 100.15
CPU
minflt/s 1.34
majflt/s 0.00
VSZ 2609692
RSS 249764
%MEM 0.38
kB_rd/s 0.00
kB_wr/s 0.09
kB_ccwr/s 0.00
4.2.8.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.8.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 265068.254
tx_rate_mbps Unknown
throughput_rx_mbps 1085.720
tx_rate_percent 5.641
throughput_rx_percent 5.641
frame_loss_percent 0.000
min_latency_ns 49120.000
max_latency_ns 1064660.000
avg_latency_ns 152580.000
type rfc2544
packet_size 512
traffic_type udp
test_execution_time 00:28:58
guest_loopback_app testpmd testpmd
4.2.8.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 146674
%usr 0.34
%system 4.27
%guest 0.00
%CPU 4.61
CPU
minflt/s 7.53
majflt/s 0.00
VSZ 6610052
RSS 34756
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 146671
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3272
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 147089
%usr 0.00
%system 0.85
%guest 199.30
%CPU 100.16
CPU
minflt/s 1.47
majflt/s 0.00
VSZ 2638360
RSS 218135
%MEM 0.33
kB_rd/s 0.00
kB_wr/s 8.63
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 147037
%usr 0.00
%system 0.87
%guest 199.28
%CPU 100.15
CPU
minflt/s 1.34
majflt/s 0.00
VSZ 2609692
RSS 249764
%MEM 0.38
kB_rd/s 0.00
kB_wr/s 0.09
kB_ccwr/s 0.00
4.2.8.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.8.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 190635.757
tx_rate_mbps Unknown
throughput_rx_mbps 1561.688
tx_rate_percent 7.961
throughput_rx_percent 7.961
frame_loss_percent 0.000
min_latency_ns 45340.000
max_latency_ns 582980.000
avg_latency_ns 130463.500
type rfc2544
packet_size 1024
traffic_type udp
test_execution_time 00:28:58
guest_loopback_app testpmd testpmd
4.2.8.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 146674
%usr 0.34
%system 4.27
%guest 0.00
%CPU 4.61
CPU
minflt/s 7.53
majflt/s 0.00
VSZ 6610052
RSS 34756
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 146671
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3272
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 147089
%usr 0.00
%system 0.85
%guest 199.30
%CPU 100.16
CPU
minflt/s 1.47
majflt/s 0.00
VSZ 2638360
RSS 218135
%MEM 0.33
kB_rd/s 0.00
kB_wr/s 8.63
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 147037
%usr 0.00
%system 0.87
%guest 199.28
%CPU 100.15
CPU
minflt/s 1.34
majflt/s 0.00
VSZ 2609692
RSS 249764
%MEM 0.38
kB_rd/s 0.00
kB_wr/s 0.09
kB_ccwr/s 0.00
4.2.8.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.8.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 217415.768
tx_rate_mbps Unknown
throughput_rx_mbps 2640.297
tx_rate_percent 13.375
throughput_rx_percent 13.375
frame_loss_percent 0.000
min_latency_ns 55180.000
max_latency_ns 469540.000
avg_latency_ns 129416.500
type rfc2544
packet_size 1518
traffic_type udp
test_execution_time 00:28:58
guest_loopback_app testpmd testpmd
4.2.8.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 146674
%usr 0.34
%system 4.27
%guest 0.00
%CPU 4.61
CPU
minflt/s 7.53
majflt/s 0.00
VSZ 6610052
RSS 34756
%MEM 0.05
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 146671
%usr 0.01
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 45912
RSS 3272
%MEM 0.00
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 147089
%usr 0.00
%system 0.85
%guest 199.30
%CPU 100.16
CPU
minflt/s 1.47
majflt/s 0.00
VSZ 2638360
RSS 218135
%MEM 0.33
kB_rd/s 0.00
kB_wr/s 8.63
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 147037
%usr 0.00
%system 0.87
%guest 199.28
%CPU 100.15
CPU
minflt/s 1.34
majflt/s 0.00
VSZ 2609692
RSS 249764
%MEM 0.38
kB_rd/s 0.00
kB_wr/s 0.09
kB_ccwr/s 0.00
4.2.8.7. Anomalies

No anomalies were detected during the course of this test.

4.2.8.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.3. Rationale for decisions

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

4.4. Conclusions and recommendations

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod3/2016-11-29_06-14-03/vswitchperf_logs_2016-11-29_06-14-03.tar.gz.

4.5. General

4.5.1. Glossary

  • NFV - Network Function Virtualization
  • Mbps - 1,000,000bps

4.5.2. Document change procedures and history

Document ID Author Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT Christopher Nolan 23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT Christopher Nolan 28/01/2015