VSPERF Results

1. VSPERF Test Scenarios

Predefined Tests suitable for automated execution with CI:

Test Definition
phy2phy_tput PacketLossRatio for Phy2Phy
back2back BackToBackFrames for Phy2Phy
phy2phy_tput_mod_vlan PacketLossRatioFrameModification for Phy2Phy
phy2phy_cont Phy2Phy blast vswitch at x% TX rate and measure throughput
pvp_cont PVP blast vswitch at x% TX rate and measure throughput
pvvp_cont PVVP blast vswitch at x% TX rate and measure throughput
phy2phy_scalability Scalability0PacketLoss for Phy2Phy
pvp_tput PacketLossRatio for PVP
pvp_back2back BackToBackFrames for PVP
pvvp_tput PacketLossRatio for PVVP
pvvp_back2back BackToBackFrames for PVVP
phy2phy_cpu_load CPU0PacketLoss for Phy2Phy
phy2phy_mem_load Same as CPU0PacketLoss but using a memory intensive app

Deployment topologies:

  • Phy2Phy: Physical port -> vSwitch -> Physical port.
  • PVP: Physical port -> vSwitch -> VNF -> vSwitch -> Physical port.
  • PVVP: Physical port -> vSwitch -> VNF -> vSwitch -> VNF -> vSwitch -> Physical port.

Loopback applications in the Guest:

Supported traffic generators:

  • Spirent Testcenter
  • Ixia: IxOS and IxNet.
  • Xena
  • MoonGen
  • Dummy
  • T-Rex

2. OPNFV Test Results

VSPERF CI jobs are run daily and sample results can be found at https://wiki.opnfv.org/display/vsperf/Vsperf+Results

Testcase names shown in the dashboard are combination of orignal testcase name from VSPERF framework and indication of used vswitch.

Example:

Testcase phy2phy_tput is executed for three vSwitch types: OvsDpdkVhost, OvsVanilla and VppDpdkVhost. In this case, following testcase names will be used in the dashboard: phy2phy_tput_ovsdpdkvhost, phy2phy_tput_ovsvanilla and phy2phy_tput_vppdpdkvhost.

In case of RFC2544 Throughput test, the recorded metric is FPS (frames per second) without packet loss. For RFC2544 Back2Back test, the recorded metric is back-to-back value (number of frames) without packet loss.

The loopback application in the VNF used for PVP and PVVP scenarios was DPDK testpmd.

Guest interface types are vhost-user for OvsDpdkVhost and VppDpdkVhost and virtio-net for OvsVanilla.

3. Performance report for OvsDpdkVhost

3.1. Introduction

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

3.1.1. Document identifier

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

3.1.2. Scope

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

3.2. Details of the Level Test Report

This section provides a test-results-overview. Also included are the rationale and the conclusions.

3.2.1. Test ID: BACK2BACK

3.2.1.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: p2p
  • Traffic type: rfc2544_back2back
  • Bidirectional : True
3.2.1.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.1.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 26396
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 64
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:42:07
start_time 2018-01-22 23:53:06
stop_time 2018-01-23 00:35:14
3.2.1.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 94743
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8301016
RSS 43467
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 94727
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6628
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.1.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 253378378
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 128
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:42:07
start_time 2018-01-22 23:53:06
stop_time 2018-01-23 00:35:14
3.2.1.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 94743
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8301016
RSS 43467
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 94727
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6628
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.1.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 70488721
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 512
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:42:07
start_time 2018-01-22 23:53:06
stop_time 2018-01-23 00:35:14
3.2.1.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 94743
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8301016
RSS 43467
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 94727
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6628
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.1.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 35919540
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1024
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:42:07
start_time 2018-01-22 23:53:06
stop_time 2018-01-23 00:35:14
3.2.1.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 94743
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8301016
RSS 43467
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 94727
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6628
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.1.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 24382314
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1518
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:42:07
start_time 2018-01-22 23:53:06
stop_time 2018-01-23 00:35:14
3.2.1.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 94743
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8301016
RSS 43467
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 94727
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6628
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.7. Anomalies

No anomalies were detected during the course of this test.

3.2.1.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.2. Test ID: PVP_TPUT

3.2.2.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: pvp

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

  • VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvp_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: pvp
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
3.2.2.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.2.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 7203313.973
tx_rate_mbps Unknown
throughput_rx_mbps 3688.097
tx_rate_percent 24.203
throughput_rx_percent 24.203
frame_loss_percent 0.000
min_latency_ns 5580.000
max_latency_ns 46500.000
avg_latency_ns 7023.500
type rfc2544_throughput
packet_size 64
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:29:55
start_time 2018-01-23 01:34:39
stop_time 2018-01-23 02:04:35
guest_loopback_app testpmd
3.2.2.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 116400
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 14666176
RSS 43396
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 116384
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50672
RSS 6656
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 116630
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 2871268
RSS 61431
%MEM 0.09
kB_rd/s 0.00
kB_wr/s 12.40
kB_ccwr/s 0.00
3.2.2.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.2.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 8530468.588
tx_rate_mbps Unknown
throughput_rx_mbps 8735.200
tx_rate_percent 50.500
throughput_rx_percent 50.500
frame_loss_percent 0.000
min_latency_ns 7560.000
max_latency_ns 45480.000
avg_latency_ns 9675.000
type rfc2544_throughput
packet_size 128
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:29:55
start_time 2018-01-23 01:34:39
stop_time 2018-01-23 02:04:35
guest_loopback_app testpmd
3.2.2.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 116400
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 14666176
RSS 43396
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 116384
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50672
RSS 6656
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 116630
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 2871268
RSS 61431
%MEM 0.09
kB_rd/s 0.00
kB_wr/s 12.40
kB_ccwr/s 0.00
3.2.2.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.2.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4699172.773
tx_rate_mbps Unknown
throughput_rx_mbps 19247.812
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 30020.000
max_latency_ns 81460.000
avg_latency_ns 69761.000
type rfc2544_throughput
packet_size 512
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:29:55
start_time 2018-01-23 01:34:39
stop_time 2018-01-23 02:04:35
guest_loopback_app testpmd
3.2.2.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 116400
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 14666176
RSS 43396
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 116384
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50672
RSS 6656
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 116630
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 2871268
RSS 61431
%MEM 0.09
kB_rd/s 0.00
kB_wr/s 12.40
kB_ccwr/s 0.00
3.2.2.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.2.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394592.175
tx_rate_mbps Unknown
throughput_rx_mbps 19616.499
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 44880.000
max_latency_ns 100920.000
avg_latency_ns 90418.000
type rfc2544_throughput
packet_size 1024
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:29:55
start_time 2018-01-23 01:34:39
stop_time 2018-01-23 02:04:35
guest_loopback_app testpmd
3.2.2.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 116400
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 14666176
RSS 43396
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 116384
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50672
RSS 6656
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 116630
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 2871268
RSS 61431
%MEM 0.09
kB_rd/s 0.00
kB_wr/s 12.40
kB_ccwr/s 0.00
3.2.2.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.2.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625458.963
tx_rate_mbps Unknown
throughput_rx_mbps 19739.574
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 49040.000
max_latency_ns 103020.000
avg_latency_ns 92690.000
type rfc2544_throughput
packet_size 1518
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:29:55
start_time 2018-01-23 01:34:39
stop_time 2018-01-23 02:04:35
guest_loopback_app testpmd
3.2.2.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 116400
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 14666176
RSS 43396
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 116384
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50672
RSS 6656
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 116630
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 2871268
RSS 61431
%MEM 0.09
kB_rd/s 0.00
kB_wr/s 12.40
kB_ccwr/s 0.00
3.2.2.7. Anomalies

No anomalies were detected during the course of this test.

3.2.2.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.3. Test ID: PHY2PHY_TPUT_MOD_VLAN

3.2.3.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: phy2phy_tput_mod_vlan
  • Description: LTD.Throughput.RFC2544.PacketLossRatioFrameModification
  • Deployment: p2p
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
3.2.3.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.3.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 16871294.958
tx_rate_mbps Unknown
throughput_rx_mbps 9177.984
tx_rate_percent 56.688
throughput_rx_percent 59.387
frame_loss_percent 0.000
min_latency_ns 5980.000
max_latency_ns 561220.000
avg_latency_ns 11721.000
type rfc2544_throughput
packet_size 64
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:33:17
start_time 2018-01-23 00:35:14
stop_time 2018-01-23 01:08:32
3.2.3.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 103630
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8300988
RSS 43123
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 103517
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6524
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.3.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 14932248.377
tx_rate_mbps Unknown
throughput_rx_mbps 15768.454
tx_rate_percent 88.398
throughput_rx_percent 90.788
frame_loss_percent 0.000
min_latency_ns 5460.000
max_latency_ns 46500.000
avg_latency_ns 10795.500
type rfc2544_throughput
packet_size 128
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:33:17
start_time 2018-01-23 00:35:14
stop_time 2018-01-23 01:08:32
3.2.3.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 103630
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8300988
RSS 43123
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 103517
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6524
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.3.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4662904.654
tx_rate_mbps Unknown
throughput_rx_mbps 19248.470
tx_rate_percent 99.227
throughput_rx_percent 99.973
frame_loss_percent 0.000
min_latency_ns 6220.000
max_latency_ns 21920.000
avg_latency_ns 7674.000
type rfc2544_throughput
packet_size 512
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:33:17
start_time 2018-01-23 00:35:14
stop_time 2018-01-23 01:08:32
3.2.3.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 103630
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8300988
RSS 43123
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 103517
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6524
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.3.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2376116.994
tx_rate_mbps Unknown
throughput_rx_mbps 19541.186
tx_rate_percent 99.227
throughput_rx_percent 99.607
frame_loss_percent 0.000
min_latency_ns 6640.000
max_latency_ns 32300.000
avg_latency_ns 7805.500
type rfc2544_throughput
packet_size 1024
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:33:17
start_time 2018-01-23 00:35:14
stop_time 2018-01-23 01:08:32
3.2.3.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 103630
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8300988
RSS 43123
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 103517
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6524
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.3.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1612916.409
tx_rate_mbps Unknown
throughput_rx_mbps 19638.870
tx_rate_percent 99.227
throughput_rx_percent 99.485
frame_loss_percent 0.000
min_latency_ns 7140.000
max_latency_ns 23360.000
avg_latency_ns 8854.000
type rfc2544_throughput
packet_size 1518
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:33:17
start_time 2018-01-23 00:35:14
stop_time 2018-01-23 01:08:32
3.2.3.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 103630
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8300988
RSS 43123
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 103517
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6524
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.7. Anomalies

No anomalies were detected during the course of this test.

3.2.3.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.4. Test ID: PVVP_BACK2BACK

3.2.4.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: pvvp

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

  • VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvvp_back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: pvvp
  • Traffic type: rfc2544_back2back
  • Bidirectional : True
3.2.4.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.4.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1277
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 64
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:38:17
start_time 2018-01-23 03:14:04
stop_time 2018-01-23 03:52:22
guest_loopback_app testpmd testpmd
3.2.4.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 138275
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 20957652
RSS 43332
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 138259
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6644
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 138651
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2825371
RSS 67159
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 10.02
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 138517
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2797604
RSS 65212
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
3.2.4.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.4.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 483
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 128
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:38:17
start_time 2018-01-23 03:14:04
stop_time 2018-01-23 03:52:22
guest_loopback_app testpmd testpmd
3.2.4.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 138275
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 20957652
RSS 43332
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 138259
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6644
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 138651
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2825371
RSS 67159
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 10.02
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 138517
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2797604
RSS 65212
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
3.2.4.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.4.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 70488721
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 512
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:38:17
start_time 2018-01-23 03:14:04
stop_time 2018-01-23 03:52:22
guest_loopback_app testpmd testpmd
3.2.4.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 138275
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 20957652
RSS 43332
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 138259
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6644
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 138651
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2825371
RSS 67159
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 10.02
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 138517
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2797604
RSS 65212
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
3.2.4.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.4.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 35919540
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1024
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:38:17
start_time 2018-01-23 03:14:04
stop_time 2018-01-23 03:52:22
guest_loopback_app testpmd testpmd
3.2.4.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 138275
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 20957652
RSS 43332
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 138259
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6644
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 138651
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2825371
RSS 67159
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 10.02
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 138517
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2797604
RSS 65212
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
3.2.4.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.4.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 24382314
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1518
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:38:17
start_time 2018-01-23 03:14:04
stop_time 2018-01-23 03:52:22
guest_loopback_app testpmd testpmd
3.2.4.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 138275
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 20957652
RSS 43332
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 138259
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6644
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 138651
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2825371
RSS 67159
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 10.02
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 138517
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2797604
RSS 65212
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
3.2.4.7. Anomalies

No anomalies were detected during the course of this test.

3.2.4.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.5. Test ID: PHY2PHY_TPUT

3.2.5.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: phy2phy_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: p2p
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
3.2.5.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.5.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 23316600.827
tx_rate_mbps Unknown
throughput_rx_mbps 11938.100
tx_rate_percent 78.344
throughput_rx_percent 78.344
frame_loss_percent 0.000
min_latency_ns 5360.000
max_latency_ns 64240.000
avg_latency_ns 11591.500
type rfc2544_throughput
packet_size 64
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:24:39
start_time 2018-01-22 23:28:26
stop_time 2018-01-22 23:53:05
3.2.5.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 89414
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8300988
RSS 43311
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 89398
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6536
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.5.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 16761274.379
tx_rate_mbps Unknown
throughput_rx_mbps 17163.545
tx_rate_percent 99.227
throughput_rx_percent 99.227
frame_loss_percent 0.000
min_latency_ns 6700.000
max_latency_ns 55240.000
avg_latency_ns 10095.000
type rfc2544_throughput
packet_size 128
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:24:39
start_time 2018-01-22 23:28:26
stop_time 2018-01-22 23:53:05
3.2.5.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 89414
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8300988
RSS 43311
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 89398
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6536
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.5.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4699194.749
tx_rate_mbps Unknown
throughput_rx_mbps 19247.902
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 17720.000
max_latency_ns 52920.000
avg_latency_ns 42412.000
type rfc2544_throughput
packet_size 512
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:24:39
start_time 2018-01-22 23:28:26
stop_time 2018-01-22 23:53:05
3.2.5.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 89414
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8300988
RSS 43311
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 89398
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6536
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.5.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394609.088
tx_rate_mbps Unknown
throughput_rx_mbps 19616.638
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 33760.000
max_latency_ns 68220.000
avg_latency_ns 58054.500
type rfc2544_throughput
packet_size 1024
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:24:39
start_time 2018-01-22 23:28:26
stop_time 2018-01-22 23:53:05
3.2.5.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 89414
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8300988
RSS 43311
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 89398
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6536
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.5.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625470.174
tx_rate_mbps Unknown
throughput_rx_mbps 19739.710
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 33840.000
max_latency_ns 67300.000
avg_latency_ns 56622.000
type rfc2544_throughput
packet_size 1518
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:24:39
start_time 2018-01-22 23:28:26
stop_time 2018-01-22 23:53:05
3.2.5.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 89414
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8300988
RSS 43311
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 89398
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6536
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.7. Anomalies

No anomalies were detected during the course of this test.

3.2.5.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.6. Test ID: PHY2PHY_SCALABILITY

3.2.6.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: phy2phy_scalability
  • Description: LTD.Scalability.Flows.RFC2544.0PacketLoss
  • Deployment: p2p
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
3.2.6.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.6.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 16871294.519
tx_rate_mbps Unknown
throughput_rx_mbps 8638.103
tx_rate_percent 56.688
throughput_rx_percent 56.688
frame_loss_percent 0.000
min_latency_ns 4900.000
max_latency_ns 45900.000
avg_latency_ns 10140.000
type rfc2544_throughput
packet_size 64
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:26:05
start_time 2018-01-23 01:08:33
stop_time 2018-01-23 01:34:39
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 110645
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8301004
RSS 43407
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 110627
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6640
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.6.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 16761271.938
tx_rate_mbps Unknown
throughput_rx_mbps 17163.542
tx_rate_percent 99.227
throughput_rx_percent 99.227
frame_loss_percent 0.000
min_latency_ns 5200.000
max_latency_ns 92980.000
avg_latency_ns 13097.000
type rfc2544_throughput
packet_size 128
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:26:05
start_time 2018-01-23 01:08:33
stop_time 2018-01-23 01:34:39
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 110645
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8301004
RSS 43407
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 110627
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6640
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.6.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4699195.611
tx_rate_mbps Unknown
throughput_rx_mbps 19247.905
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 26980.000
max_latency_ns 62800.000
avg_latency_ns 51911.500
type rfc2544_throughput
packet_size 512
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:26:05
start_time 2018-01-23 01:08:33
stop_time 2018-01-23 01:34:39
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 110645
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8301004
RSS 43407
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 110627
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6640
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.6.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394608.059
tx_rate_mbps Unknown
throughput_rx_mbps 19616.629
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 37440.000
max_latency_ns 73500.000
avg_latency_ns 63117.500
type rfc2544_throughput
packet_size 1024
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:26:05
start_time 2018-01-23 01:08:33
stop_time 2018-01-23 01:34:39
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 110645
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8301004
RSS 43407
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 110627
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6640
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.6.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625468.862
tx_rate_mbps Unknown
throughput_rx_mbps 19739.694
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 44060.000
max_latency_ns 80420.000
avg_latency_ns 69239.500
type rfc2544_throughput
packet_size 1518
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:26:05
start_time 2018-01-23 01:08:33
stop_time 2018-01-23 01:34:39
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 110645
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8301004
RSS 43407
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 110627
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6640
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.7. Anomalies

No anomalies were detected during the course of this test.

3.2.6.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.7. Test ID: PVP_BACK2BACK

3.2.7.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: pvp

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

  • VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvp_back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: pvp
  • Traffic type: rfc2544_back2back
  • Bidirectional : True
3.2.7.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.7.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 2554
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 64
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:37:45
start_time 2018-01-23 02:04:35
stop_time 2018-01-23 02:42:21
guest_loopback_app testpmd
3.2.7.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 122900
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 14666176
RSS 43308
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 122884
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6764
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 123131
%usr 0.42
%system 0.23
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2830516
RSS 66616
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 9.84
kB_ccwr/s 0.00
3.2.7.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.7.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1449
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 128
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:37:45
start_time 2018-01-23 02:04:35
stop_time 2018-01-23 02:42:21
guest_loopback_app testpmd
3.2.7.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 122900
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 14666176
RSS 43308
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 122884
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6764
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 123131
%usr 0.42
%system 0.23
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2830516
RSS 66616
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 9.84
kB_ccwr/s 0.00
3.2.7.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.7.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 70488721
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 512
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:37:45
start_time 2018-01-23 02:04:35
stop_time 2018-01-23 02:42:21
guest_loopback_app testpmd
3.2.7.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 122900
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 14666176
RSS 43308
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 122884
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6764
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 123131
%usr 0.42
%system 0.23
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2830516
RSS 66616
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 9.84
kB_ccwr/s 0.00
3.2.7.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.7.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 35919540
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1024
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:37:45
start_time 2018-01-23 02:04:35
stop_time 2018-01-23 02:42:21
guest_loopback_app testpmd
3.2.7.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 122900
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 14666176
RSS 43308
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 122884
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6764
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 123131
%usr 0.42
%system 0.23
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2830516
RSS 66616
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 9.84
kB_ccwr/s 0.00
3.2.7.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.7.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 24382314
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1518
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:37:45
start_time 2018-01-23 02:04:35
stop_time 2018-01-23 02:42:21
guest_loopback_app testpmd
3.2.7.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 122900
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 14666176
RSS 43308
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 122884
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6764
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 123131
%usr 0.42
%system 0.23
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2830516
RSS 66616
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 9.84
kB_ccwr/s 0.00
3.2.7.7. Anomalies

No anomalies were detected during the course of this test.

3.2.7.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.8. Test ID: PVVP_TPUT

3.2.8.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: pvvp

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

  • VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvvp_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: pvvp
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
3.2.8.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.8.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 7663727.884
tx_rate_mbps Unknown
throughput_rx_mbps 3923.829
tx_rate_percent 25.750
throughput_rx_percent 25.750
frame_loss_percent 0.000
min_latency_ns 9900.000
max_latency_ns 49380.000
avg_latency_ns 13240.500
type rfc2544_throughput
packet_size 64
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:31:42
start_time 2018-01-23 02:42:21
stop_time 2018-01-23 03:14:03
guest_loopback_app testpmd testpmd
3.2.8.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 130993
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.04
majflt/s 0.00
VSZ 20957731
RSS 43679
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 130977
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50665
RSS 6664
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 131367
%usr 0.08
%system 0.05
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2830500
RSS 64887
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 10.74
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 131235
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2764715
RSS 66768
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.03
kB_ccwr/s 0.00
3.2.8.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.8.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 7485226.153
tx_rate_mbps Unknown
throughput_rx_mbps 7664.872
tx_rate_percent 44.313
throughput_rx_percent 44.313
frame_loss_percent 0.000
min_latency_ns 11640.000
max_latency_ns 58920.000
avg_latency_ns 17120.000
type rfc2544_throughput
packet_size 128
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:31:42
start_time 2018-01-23 02:42:21
stop_time 2018-01-23 03:14:03
guest_loopback_app testpmd testpmd
3.2.8.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 130993
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.04
majflt/s 0.00
VSZ 20957731
RSS 43679
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 130977
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50665
RSS 6664
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 131367
%usr 0.08
%system 0.05
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2830500
RSS 64887
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 10.74
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 131235
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2764715
RSS 66768
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.03
kB_ccwr/s 0.00
3.2.8.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.8.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4699141.744
tx_rate_mbps Unknown
throughput_rx_mbps 19247.685
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 56280.000
max_latency_ns 133080.000
avg_latency_ns 116273.000
type rfc2544_throughput
packet_size 512
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:31:42
start_time 2018-01-23 02:42:21
stop_time 2018-01-23 03:14:03
guest_loopback_app testpmd testpmd
3.2.8.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 130993
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.04
majflt/s 0.00
VSZ 20957731
RSS 43679
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 130977
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50665
RSS 6664
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 131367
%usr 0.08
%system 0.05
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2830500
RSS 64887
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 10.74
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 131235
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2764715
RSS 66768
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.03
kB_ccwr/s 0.00
3.2.8.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.8.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394583.275
tx_rate_mbps Unknown
throughput_rx_mbps 19616.426
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 73500.000
max_latency_ns 148100.000
avg_latency_ns 134848.500
type rfc2544_throughput
packet_size 1024
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:31:42
start_time 2018-01-23 02:42:21
stop_time 2018-01-23 03:14:03
guest_loopback_app testpmd testpmd
3.2.8.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 130993
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.04
majflt/s 0.00
VSZ 20957731
RSS 43679
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 130977
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50665
RSS 6664
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 131367
%usr 0.08
%system 0.05
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2830500
RSS 64887
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 10.74
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 131235
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2764715
RSS 66768
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.03
kB_ccwr/s 0.00
3.2.8.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.8.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625451.535
tx_rate_mbps Unknown
throughput_rx_mbps 19739.483
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 64140.000
max_latency_ns 136820.000
avg_latency_ns 123405.000
type rfc2544_throughput
packet_size 1518
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:31:42
start_time 2018-01-23 02:42:21
stop_time 2018-01-23 03:14:03
guest_loopback_app testpmd testpmd
3.2.8.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 130993
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.04
majflt/s 0.00
VSZ 20957731
RSS 43679
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 130977
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50665
RSS 6664
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 131367
%usr 0.08
%system 0.05
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2830500
RSS 64887
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 10.74
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 131235
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2764715
RSS 66768
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.03
kB_ccwr/s 0.00
3.2.8.7. Anomalies

No anomalies were detected during the course of this test.

3.2.8.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.3. Rationale for decisions

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

3.4. Conclusions and recommendations

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-23_07-28-19/vswitchperf_logs_2018-01-23_07-28-19.tar.gz.

3.5. General

3.5.1. Glossary

  • NFV - Network Function Virtualization
  • Mbps - 1,000,000bps

3.5.2. Document change procedures and history

Document ID Author Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT Christopher Nolan 23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT Christopher Nolan 28/01/2015

4. Performance report for OvsVanilla

4.1. Introduction

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

4.1.1. Document identifier

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

4.1.2. Scope

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

4.2. Details of the Level Test Report

This section provides a test-results-overview. Also included are the rationale and the conclusions.

4.2.1. Test ID: BACK2BACK

4.2.1.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

  • Test ID: back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: p2p
  • Traffic type: rfc2544_back2back
  • Bidirectional : True
4.2.1.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.1.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 5108
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 64
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:43:13
start_time 2018-01-23 04:28:51
stop_time 2018-01-23 05:12:04
4.2.1.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 154126
%usr 0.43
%system 3.12
%guest 0.00
%CPU 3.54
CPU
minflt/s 0.12
majflt/s 0.00
VSZ 6608356
RSS 9094
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 154123
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5940
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.1.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 3382
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 128
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:43:13
start_time 2018-01-23 04:28:51
stop_time 2018-01-23 05:12:04
4.2.1.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 154126
%usr 0.43
%system 3.12
%guest 0.00
%CPU 3.54
CPU
minflt/s 0.12
majflt/s 0.00
VSZ 6608356
RSS 9094
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 154123
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5940
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.1.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1613
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 512
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:43:13
start_time 2018-01-23 04:28:51
stop_time 2018-01-23 05:12:04
4.2.1.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 154126
%usr 0.43
%system 3.12
%guest 0.00
%CPU 3.54
CPU
minflt/s 0.12
majflt/s 0.00
VSZ 6608356
RSS 9094
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 154123
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5940
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.1.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1644
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1024
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:43:13
start_time 2018-01-23 04:28:51
stop_time 2018-01-23 05:12:04
4.2.1.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 154126
%usr 0.43
%system 3.12
%guest 0.00
%CPU 3.54
CPU
minflt/s 0.12
majflt/s 0.00
VSZ 6608356
RSS 9094
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 154123
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5940
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.1.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 12191157
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1518
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:43:13
start_time 2018-01-23 04:28:51
stop_time 2018-01-23 05:12:04
4.2.1.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 154126
%usr 0.43
%system 3.12
%guest 0.00
%CPU 3.54
CPU
minflt/s 0.12
majflt/s 0.00
VSZ 6608356
RSS 9094
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 154123
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5940
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.7. Anomalies

No anomalies were detected during the course of this test.

4.2.1.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.2. Test ID: PVP_TPUT

4.2.2.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: pvp

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvp_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: pvp
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
4.2.2.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.2.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 491755.049
tx_rate_mbps Unknown
throughput_rx_mbps 251.779
tx_rate_percent 1.773
throughput_rx_percent 1.652
frame_loss_percent 6.826
min_latency_ns 12900.000
max_latency_ns 30433040.000
avg_latency_ns 878280.000
type rfc2544_throughput
packet_size 64
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:34:50
start_time 2018-01-23 06:19:14
stop_time 2018-01-23 06:54:04
guest_loopback_app testpmd
4.2.2.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 176692
%usr 0.42
%system 2.93
%guest 0.00
%CPU 3.35
CPU
minflt/s 0.12
majflt/s 0.00
VSZ 6608352
RSS 9229
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 176607
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44276
RSS 5820
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 176967
%usr 0.14
%system 1.09
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2780340
RSS 63800
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 10.49
kB_ccwr/s 0.00
4.2.2.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.2.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 299567.275
tx_rate_mbps Unknown
throughput_rx_mbps 306.757
tx_rate_percent 1.773
throughput_rx_percent 1.773
frame_loss_percent 0.000
min_latency_ns 9620.000
max_latency_ns 444720.000
avg_latency_ns 61364.500
type rfc2544_throughput
packet_size 128
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:34:50
start_time 2018-01-23 06:19:14
stop_time 2018-01-23 06:54:04
guest_loopback_app testpmd
4.2.2.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 176692
%usr 0.42
%system 2.93
%guest 0.00
%CPU 3.35
CPU
minflt/s 0.12
majflt/s 0.00
VSZ 6608352
RSS 9229
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 176607
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44276
RSS 5820
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 176967
%usr 0.14
%system 1.09
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2780340
RSS 63800
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 10.49
kB_ccwr/s 0.00
4.2.2.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.2.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 337758.629
tx_rate_mbps Unknown
throughput_rx_mbps 1383.459
tx_rate_percent 7.188
throughput_rx_percent 7.188
frame_loss_percent 0.000
min_latency_ns 15020.000
max_latency_ns 850040.000
avg_latency_ns 82835.000
type rfc2544_throughput
packet_size 512
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:34:50
start_time 2018-01-23 06:19:14
stop_time 2018-01-23 06:54:04
guest_loopback_app testpmd
4.2.2.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 176692
%usr 0.42
%system 2.93
%guest 0.00
%CPU 3.35
CPU
minflt/s 0.12
majflt/s 0.00
VSZ 6608352
RSS 9229
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 176607
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44276
RSS 5820
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 176967
%usr 0.14
%system 1.09
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2780340
RSS 63800
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 10.49
kB_ccwr/s 0.00
4.2.2.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.2.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 357324.479
tx_rate_mbps Unknown
throughput_rx_mbps 2927.202
tx_rate_percent 14.922
throughput_rx_percent 14.922
frame_loss_percent 0.000
min_latency_ns 12460.000
max_latency_ns 2491980.000
avg_latency_ns 89392.000
type rfc2544_throughput
packet_size 1024
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:34:50
start_time 2018-01-23 06:19:14
stop_time 2018-01-23 06:54:04
guest_loopback_app testpmd
4.2.2.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 176692
%usr 0.42
%system 2.93
%guest 0.00
%CPU 3.35
CPU
minflt/s 0.12
majflt/s 0.00
VSZ 6608352
RSS 9229
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 176607
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44276
RSS 5820
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 176967
%usr 0.14
%system 1.09
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2780340
RSS 63800
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 10.49
kB_ccwr/s 0.00
4.2.2.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.2.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 355702.586
tx_rate_mbps Unknown
throughput_rx_mbps 4319.652
tx_rate_percent 21.883
throughput_rx_percent 21.883
frame_loss_percent 0.000
min_latency_ns 17260.000
max_latency_ns 1005240.000
avg_latency_ns 91848.000
type rfc2544_throughput
packet_size 1518
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:34:50
start_time 2018-01-23 06:19:14
stop_time 2018-01-23 06:54:04
guest_loopback_app testpmd
4.2.2.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 176692
%usr 0.42
%system 2.93
%guest 0.00
%CPU 3.35
CPU
minflt/s 0.12
majflt/s 0.00
VSZ 6608352
RSS 9229
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 176607
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44276
RSS 5820
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 176967
%usr 0.14
%system 1.09
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2780340
RSS 63800
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 10.49
kB_ccwr/s 0.00
4.2.2.7. Anomalies

No anomalies were detected during the course of this test.

4.2.2.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.3. Test ID: PHY2PHY_TPUT_MOD_VLAN

4.2.3.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

  • Test ID: phy2phy_tput_mod_vlan
  • Description: LTD.Throughput.RFC2544.PacketLossRatioFrameModification
  • Deployment: p2p
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
4.2.3.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.3.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1448568.719
tx_rate_mbps Unknown
throughput_rx_mbps 788.021
tx_rate_percent 4.867
throughput_rx_percent 5.099
frame_loss_percent 0.000
min_latency_ns 4040.000
max_latency_ns 4084500.000
avg_latency_ns 33021.000
type rfc2544_throughput
packet_size 64
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:32:48
start_time 2018-01-23 05:12:04
stop_time 2018-01-23 05:44:53
4.2.3.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 162962
%usr 0.42
%system 3.16
%guest 0.00
%CPU 3.58
CPU
minflt/s 0.15
majflt/s 0.00
VSZ 6608356
RSS 9117
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 162871
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5820
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.3.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1344754.687
tx_rate_mbps Unknown
throughput_rx_mbps 1420.061
tx_rate_percent 7.961
throughput_rx_percent 8.176
frame_loss_percent 0.000
min_latency_ns 4200.000
max_latency_ns 798020.000
avg_latency_ns 33199.500
type rfc2544_throughput
packet_size 128
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:32:48
start_time 2018-01-23 05:12:04
stop_time 2018-01-23 05:44:53
4.2.3.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 162962
%usr 0.42
%system 3.16
%guest 0.00
%CPU 3.58
CPU
minflt/s 0.15
majflt/s 0.00
VSZ 6608356
RSS 9117
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 162871
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5820
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.3.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1210069.513
tx_rate_mbps Unknown
throughput_rx_mbps 4995.167
tx_rate_percent 25.750
throughput_rx_percent 25.944
frame_loss_percent 0.000
min_latency_ns 5120.000
max_latency_ns 880720.000
avg_latency_ns 43059.000
type rfc2544_throughput
packet_size 512
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:32:48
start_time 2018-01-23 05:12:04
stop_time 2018-01-23 05:44:53
4.2.3.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 162962
%usr 0.42
%system 3.16
%guest 0.00
%CPU 3.58
CPU
minflt/s 0.15
majflt/s 0.00
VSZ 6608356
RSS 9117
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 162871
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5820
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.3.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1209296.754
tx_rate_mbps Unknown
throughput_rx_mbps 9945.257
tx_rate_percent 50.500
throughput_rx_percent 50.694
frame_loss_percent 0.000
min_latency_ns 5820.000
max_latency_ns 811520.000
avg_latency_ns 39741.500
type rfc2544_throughput
packet_size 1024
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:32:48
start_time 2018-01-23 05:12:04
stop_time 2018-01-23 05:44:53
4.2.3.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 162962
%usr 0.42
%system 3.16
%guest 0.00
%CPU 3.58
CPU
minflt/s 0.15
majflt/s 0.00
VSZ 6608356
RSS 9117
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 162871
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5820
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.3.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1223191.596
tx_rate_mbps Unknown
throughput_rx_mbps 14893.581
tx_rate_percent 75.250
throughput_rx_percent 75.446
frame_loss_percent 0.000
min_latency_ns 9380.000
max_latency_ns 844880.000
avg_latency_ns 51991.500
type rfc2544_throughput
packet_size 1518
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:32:48
start_time 2018-01-23 05:12:04
stop_time 2018-01-23 05:44:53
4.2.3.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 162962
%usr 0.42
%system 3.16
%guest 0.00
%CPU 3.58
CPU
minflt/s 0.15
majflt/s 0.00
VSZ 6608356
RSS 9117
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.01
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 162871
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5820
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.7. Anomalies

No anomalies were detected during the course of this test.

4.2.3.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.4. Test ID: PVVP_BACK2BACK

4.2.4.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: pvvp

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvvp_back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: pvvp
  • Traffic type: rfc2544_back2back
  • Bidirectional : True
4.2.4.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.4.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544_back2back
packet_size 64
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:43:56
start_time 2018-01-23 08:13:39
stop_time 2018-01-23 08:57:36
guest_loopback_app testpmd testpmd
4.2.4.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 4759
%usr 0.33
%system 2.33
%guest 0.00
%CPU 2.66
CPU
minflt/s 0.15
majflt/s 0.00
VSZ 6608352
RSS 9254
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 4756
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5644
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 5218
%usr 0.02
%system 0.11
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 2826340
RSS 66452
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.08
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 5085
%usr 0.02
%system 0.12
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2877616
RSS 66488
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.4.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.4.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 483
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 128
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:43:56
start_time 2018-01-23 08:13:39
stop_time 2018-01-23 08:57:36
guest_loopback_app testpmd testpmd
4.2.4.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 4759
%usr 0.33
%system 2.33
%guest 0.00
%CPU 2.66
CPU
minflt/s 0.15
majflt/s 0.00
VSZ 6608352
RSS 9254
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 4756
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5644
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 5218
%usr 0.02
%system 0.11
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 2826340
RSS 66452
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.08
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 5085
%usr 0.02
%system 0.12
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2877616
RSS 66488
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.4.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.4.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 537
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 512
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:43:56
start_time 2018-01-23 08:13:39
stop_time 2018-01-23 08:57:36
guest_loopback_app testpmd testpmd
4.2.4.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 4759
%usr 0.33
%system 2.33
%guest 0.00
%CPU 2.66
CPU
minflt/s 0.15
majflt/s 0.00
VSZ 6608352
RSS 9254
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 4756
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5644
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 5218
%usr 0.02
%system 0.11
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 2826340
RSS 66452
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.08
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 5085
%usr 0.02
%system 0.12
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2877616
RSS 66488
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.4.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.4.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 274
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1024
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:43:56
start_time 2018-01-23 08:13:39
stop_time 2018-01-23 08:57:36
guest_loopback_app testpmd testpmd
4.2.4.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 4759
%usr 0.33
%system 2.33
%guest 0.00
%CPU 2.66
CPU
minflt/s 0.15
majflt/s 0.00
VSZ 6608352
RSS 9254
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 4756
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5644
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 5218
%usr 0.02
%system 0.11
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 2826340
RSS 66452
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.08
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 5085
%usr 0.02
%system 0.12
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2877616
RSS 66488
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.4.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.4.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 372
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1518
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:43:56
start_time 2018-01-23 08:13:39
stop_time 2018-01-23 08:57:36
guest_loopback_app testpmd testpmd
4.2.4.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 4759
%usr 0.33
%system 2.33
%guest 0.00
%CPU 2.66
CPU
minflt/s 0.15
majflt/s 0.00
VSZ 6608352
RSS 9254
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 4756
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5644
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 5218
%usr 0.02
%system 0.11
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 2826340
RSS 66452
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.08
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 5085
%usr 0.02
%system 0.12
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2877616
RSS 66488
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.4.7. Anomalies

No anomalies were detected during the course of this test.

4.2.4.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.5. Test ID: PHY2PHY_TPUT

4.2.5.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

  • Test ID: phy2phy_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: p2p
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
4.2.5.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.5.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1448568.671
tx_rate_mbps Unknown
throughput_rx_mbps 741.667
tx_rate_percent 4.867
throughput_rx_percent 4.867
frame_loss_percent 0.000
min_latency_ns 4000.000
max_latency_ns 5139140.000
avg_latency_ns 33820.500
type rfc2544_throughput
packet_size 64
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:36:19
start_time 2018-01-23 03:52:31
stop_time 2018-01-23 04:28:50
4.2.5.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 146760
%usr 0.41
%system 2.97
%guest 0.00
%CPU 3.38
CPU
minflt/s 0.14
majflt/s 0.00
VSZ 6608356
RSS 9080
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 146737
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5684
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.5.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1344754.761
tx_rate_mbps Unknown
throughput_rx_mbps 1377.029
tx_rate_percent 7.961
throughput_rx_percent 7.961
frame_loss_percent 0.000
min_latency_ns 4140.000
max_latency_ns 3151580.000
avg_latency_ns 36773.500
type rfc2544_throughput
packet_size 128
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:36:19
start_time 2018-01-23 03:52:31
stop_time 2018-01-23 04:28:50
4.2.5.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 146760
%usr 0.41
%system 2.97
%guest 0.00
%CPU 3.38
CPU
minflt/s 0.14
majflt/s 0.00
VSZ 6608356
RSS 9080
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 146737
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5684
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.5.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1246404.213
tx_rate_mbps Unknown
throughput_rx_mbps 5105.272
tx_rate_percent 26.523
throughput_rx_percent 26.523
frame_loss_percent 0.000
min_latency_ns 5040.000
max_latency_ns 973740.000
avg_latency_ns 36912.500
type rfc2544_throughput
packet_size 512
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:36:19
start_time 2018-01-23 03:52:31
stop_time 2018-01-23 04:28:50
4.2.5.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 146760
%usr 0.41
%system 2.97
%guest 0.00
%CPU 3.38
CPU
minflt/s 0.14
majflt/s 0.00
VSZ 6608356
RSS 9080
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 146737
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5684
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.5.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1209302.175
tx_rate_mbps Unknown
throughput_rx_mbps 9906.603
tx_rate_percent 50.500
throughput_rx_percent 50.500
frame_loss_percent 0.000
min_latency_ns 5760.000
max_latency_ns 854320.000
avg_latency_ns 39369.500
type rfc2544_throughput
packet_size 1024
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:36:19
start_time 2018-01-23 03:52:31
stop_time 2018-01-23 04:28:50
4.2.5.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 146760
%usr 0.41
%system 2.97
%guest 0.00
%CPU 3.38
CPU
minflt/s 0.14
majflt/s 0.00
VSZ 6608356
RSS 9080
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 146737
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5684
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.5.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1273467.725
tx_rate_mbps Unknown
throughput_rx_mbps 15464.992
tx_rate_percent 78.344
throughput_rx_percent 78.344
frame_loss_percent 0.000
min_latency_ns 9760.000
max_latency_ns 446300.000
avg_latency_ns 49312.000
type rfc2544_throughput
packet_size 1518
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:36:19
start_time 2018-01-23 03:52:31
stop_time 2018-01-23 04:28:50
4.2.5.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 146760
%usr 0.41
%system 2.97
%guest 0.00
%CPU 3.38
CPU
minflt/s 0.14
majflt/s 0.00
VSZ 6608356
RSS 9080
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 146737
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5684
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.7. Anomalies

No anomalies were detected during the course of this test.

4.2.5.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.6. Test ID: PHY2PHY_SCALABILITY

4.2.6.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

  • Test ID: phy2phy_scalability
  • Description: LTD.Scalability.Flows.RFC2544.0PacketLoss
  • Deployment: p2p
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
4.2.6.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.6.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1448570.439
tx_rate_mbps Unknown
throughput_rx_mbps 741.668
tx_rate_percent 4.867
throughput_rx_percent 4.867
frame_loss_percent 0.000
min_latency_ns 3980.000
max_latency_ns 2368420.000
avg_latency_ns 29910.500
type rfc2544_throughput
packet_size 64
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:34:19
start_time 2018-01-23 05:44:53
stop_time 2018-01-23 06:19:13
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 169610
%usr 0.42
%system 3.04
%guest 0.00
%CPU 3.46
CPU
minflt/s 0.32
majflt/s 0.00
VSZ 6608356
RSS 8850
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 169607
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5976
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.6.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1475403.833
tx_rate_mbps Unknown
throughput_rx_mbps 1510.814
tx_rate_percent 8.734
throughput_rx_percent 8.734
frame_loss_percent 0.000
min_latency_ns 4180.000
max_latency_ns 4029200.000
avg_latency_ns 38145.500
type rfc2544_throughput
packet_size 128
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:34:19
start_time 2018-01-23 05:44:53
stop_time 2018-01-23 06:19:13
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 169610
%usr 0.42
%system 3.04
%guest 0.00
%CPU 3.46
CPU
minflt/s 0.32
majflt/s 0.00
VSZ 6608356
RSS 8850
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 169607
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5976
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.6.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1210062.163
tx_rate_mbps Unknown
throughput_rx_mbps 4956.415
tx_rate_percent 25.750
throughput_rx_percent 25.750
frame_loss_percent 0.000
min_latency_ns 5140.000
max_latency_ns 1351700.000
avg_latency_ns 47011.500
type rfc2544_throughput
packet_size 512
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:34:19
start_time 2018-01-23 05:44:53
stop_time 2018-01-23 06:19:13
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 169610
%usr 0.42
%system 3.04
%guest 0.00
%CPU 3.46
CPU
minflt/s 0.32
majflt/s 0.00
VSZ 6608356
RSS 8850
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 169607
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5976
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.6.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1209299.692
tx_rate_mbps Unknown
throughput_rx_mbps 9906.583
tx_rate_percent 50.500
throughput_rx_percent 50.500
frame_loss_percent 0.000
min_latency_ns 5800.000
max_latency_ns 407780.000
avg_latency_ns 38896.000
type rfc2544_throughput
packet_size 1024
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:34:19
start_time 2018-01-23 05:44:53
stop_time 2018-01-23 06:19:13
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 169610
%usr 0.42
%system 3.04
%guest 0.00
%CPU 3.46
CPU
minflt/s 0.32
majflt/s 0.00
VSZ 6608356
RSS 8850
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 169607
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5976
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.6.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1223176.828
tx_rate_mbps Unknown
throughput_rx_mbps 14854.259
tx_rate_percent 75.250
throughput_rx_percent 75.250
frame_loss_percent 0.000
min_latency_ns 8460.000
max_latency_ns 400120.000
avg_latency_ns 49000.500
type rfc2544_throughput
packet_size 1518
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:34:19
start_time 2018-01-23 05:44:53
stop_time 2018-01-23 06:19:13
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 169610
%usr 0.42
%system 3.04
%guest 0.00
%CPU 3.46
CPU
minflt/s 0.32
majflt/s 0.00
VSZ 6608356
RSS 8850
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 169607
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5976
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.7. Anomalies

No anomalies were detected during the course of this test.

4.2.6.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.7. Test ID: PVP_BACK2BACK

4.2.7.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: pvp

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvp_back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: pvp
  • Traffic type: rfc2544_back2back
  • Bidirectional : True
4.2.7.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.7.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544_back2back
packet_size 64
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:43:38
start_time 2018-01-23 06:54:05
stop_time 2018-01-23 07:37:43
guest_loopback_app testpmd
4.2.7.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 183888
%usr 0.43
%system 3.00
%guest 0.00
%CPU 3.43
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 6608352
RSS 9109
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 183885
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5976
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 184162
%usr 0.03
%system 0.09
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2819332
RSS 65803
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.36
kB_ccwr/s 0.00
4.2.7.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.7.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544_back2back
packet_size 128
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:43:38
start_time 2018-01-23 06:54:05
stop_time 2018-01-23 07:37:43
guest_loopback_app testpmd
4.2.7.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 183888
%usr 0.43
%system 3.00
%guest 0.00
%CPU 3.43
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 6608352
RSS 9109
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 183885
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5976
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 184162
%usr 0.03
%system 0.09
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2819332
RSS 65803
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.36
kB_ccwr/s 0.00
4.2.7.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.7.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544_back2back
packet_size 512
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:43:38
start_time 2018-01-23 06:54:05
stop_time 2018-01-23 07:37:43
guest_loopback_app testpmd
4.2.7.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 183888
%usr 0.43
%system 3.00
%guest 0.00
%CPU 3.43
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 6608352
RSS 9109
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 183885
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5976
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 184162
%usr 0.03
%system 0.09
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2819332
RSS 65803
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.36
kB_ccwr/s 0.00
4.2.7.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.7.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 274
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1024
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:43:38
start_time 2018-01-23 06:54:05
stop_time 2018-01-23 07:37:43
guest_loopback_app testpmd
4.2.7.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 183888
%usr 0.43
%system 3.00
%guest 0.00
%CPU 3.43
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 6608352
RSS 9109
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 183885
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5976
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 184162
%usr 0.03
%system 0.09
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2819332
RSS 65803
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.36
kB_ccwr/s 0.00
4.2.7.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.7.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544_back2back
packet_size 1518
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:43:38
start_time 2018-01-23 06:54:05
stop_time 2018-01-23 07:37:43
guest_loopback_app testpmd
4.2.7.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 183888
%usr 0.43
%system 3.00
%guest 0.00
%CPU 3.43
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 6608352
RSS 9109
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 183885
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5976
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 184162
%usr 0.03
%system 0.09
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2819332
RSS 65803
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.36
kB_ccwr/s 0.00
4.2.7.7. Anomalies

No anomalies were detected during the course of this test.

4.2.7.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.8. Test ID: PVVP_TPUT

4.2.8.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: pvvp

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvvp_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: pvvp
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
4.2.8.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.8.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 502037.746
tx_rate_mbps Unknown
throughput_rx_mbps 257.043
tx_rate_percent 1.773
throughput_rx_percent 1.687
frame_loss_percent 4.881
min_latency_ns 29580.000
max_latency_ns 34910260.000
avg_latency_ns 1134353.000
type rfc2544_throughput
packet_size 64
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:35:55
start_time 2018-01-23 07:37:43
stop_time 2018-01-23 08:13:39
guest_loopback_app testpmd testpmd
4.2.8.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 192887
%usr 0.37
%system 2.60
%guest 0.00
%CPU 2.97
CPU
minflt/s 0.13
majflt/s 0.00
VSZ 6608356
RSS 9202
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 192884
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5808
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 193441
%usr 0.04
%system 1.11
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2814192
RSS 64295
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 9.44
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 193213
%usr 0.12
%system 1.19
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2801856
RSS 64848
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.8.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.8.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 430218.131
tx_rate_mbps Unknown
throughput_rx_mbps 440.543
tx_rate_percent 2.547
throughput_rx_percent 2.547
frame_loss_percent 0.000
min_latency_ns 31320.000
max_latency_ns 1822160.000
avg_latency_ns 129612.500
type rfc2544_throughput
packet_size 128
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:35:55
start_time 2018-01-23 07:37:43
stop_time 2018-01-23 08:13:39
guest_loopback_app testpmd testpmd
4.2.8.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 192887
%usr 0.37
%system 2.60
%guest 0.00
%CPU 2.97
CPU
minflt/s 0.13
majflt/s 0.00
VSZ 6608356
RSS 9202
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 192884
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5808
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 193441
%usr 0.04
%system 1.11
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2814192
RSS 64295
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 9.44
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 193213
%usr 0.12
%system 1.19
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2801856
RSS 64848
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.8.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.8.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 374105.211
tx_rate_mbps Unknown
throughput_rx_mbps 1532.335
tx_rate_percent 7.961
throughput_rx_percent 7.961
frame_loss_percent 0.000
min_latency_ns 31780.000
max_latency_ns 700360.000
avg_latency_ns 127432.500
type rfc2544_throughput
packet_size 512
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:35:55
start_time 2018-01-23 07:37:43
stop_time 2018-01-23 08:13:39
guest_loopback_app testpmd testpmd
4.2.8.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 192887
%usr 0.37
%system 2.60
%guest 0.00
%CPU 2.97
CPU
minflt/s 0.13
majflt/s 0.00
VSZ 6608356
RSS 9202
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 192884
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5808
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 193441
%usr 0.04
%system 1.11
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2814192
RSS 64295
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 9.44
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 193213
%usr 0.12
%system 1.19
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2801856
RSS 64848
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.8.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.8.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 375847.692
tx_rate_mbps Unknown
throughput_rx_mbps 3078.944
tx_rate_percent 15.695
throughput_rx_percent 15.695
frame_loss_percent 0.000
min_latency_ns 33560.000
max_latency_ns 1420500.000
avg_latency_ns 134174.500
type rfc2544_throughput
packet_size 1024
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:35:55
start_time 2018-01-23 07:37:43
stop_time 2018-01-23 08:13:39
guest_loopback_app testpmd testpmd
4.2.8.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 192887
%usr 0.37
%system 2.60
%guest 0.00
%CPU 2.97
CPU
minflt/s 0.13
majflt/s 0.00
VSZ 6608356
RSS 9202
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 192884
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5808
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 193441
%usr 0.04
%system 1.11
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2814192
RSS 64295
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 9.44
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 193213
%usr 0.12
%system 1.19
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2801856
RSS 64848
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.8.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.8.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 343131.134
tx_rate_mbps Unknown
throughput_rx_mbps 4166.984
tx_rate_percent 21.109
throughput_rx_percent 21.109
frame_loss_percent 0.000
min_latency_ns 36320.000
max_latency_ns 1253140.000
avg_latency_ns 121312.500
type rfc2544_throughput
packet_size 1518
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:35:55
start_time 2018-01-23 07:37:43
stop_time 2018-01-23 08:13:39
guest_loopback_app testpmd testpmd
4.2.8.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 192887
%usr 0.37
%system 2.60
%guest 0.00
%CPU 2.97
CPU
minflt/s 0.13
majflt/s 0.00
VSZ 6608356
RSS 9202
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 192884
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5808
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 193441
%usr 0.04
%system 1.11
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2814192
RSS 64295
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 9.44
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 193213
%usr 0.12
%system 1.19
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2801856
RSS 64848
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.8.7. Anomalies

No anomalies were detected during the course of this test.

4.2.8.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.3. Rationale for decisions

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

4.4. Conclusions and recommendations

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-23_07-28-19/vswitchperf_logs_2018-01-23_07-28-19.tar.gz.

4.5. General

4.5.1. Glossary

  • NFV - Network Function Virtualization
  • Mbps - 1,000,000bps

4.5.2. Document change procedures and history

Document ID Author Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT Christopher Nolan 23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT Christopher Nolan 28/01/2015

5. Performance report for VppDpdkVhost

5.1. Introduction

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

5.1.1. Document identifier

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

5.1.2. Scope

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

5.2. Details of the Level Test Report

This section provides a test-results-overview. Also included are the rationale and the conclusions.

5.2.1. Test ID: PVP_TPUT_VPP

5.2.1.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: clean

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvp_tput_vpp
  • Description: VPP: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: clean
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
5.2.1.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

5.2.1.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4671225.690
tx_rate_mbps Unknown
throughput_rx_mbps 2391.668
tx_rate_percent 15.695
throughput_rx_percent 15.695
frame_loss_percent 0.000
min_latency_ns 8840.000
max_latency_ns 81900.000
avg_latency_ns 15904.500
type rfc2544_throughput
packet_size 64
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:38:40
start_time 2018-01-23 10:12:07
stop_time 2018-01-23 10:50:47
5.2.1.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 29731
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.06
majflt/s 0.00
VSZ 9931873
RSS 50963
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.1.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

5.2.1.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 5133551.626
tx_rate_mbps Unknown
throughput_rx_mbps 5256.757
tx_rate_percent 30.391
throughput_rx_percent 30.391
frame_loss_percent 0.000
min_latency_ns 9200.000
max_latency_ns 75460.000
avg_latency_ns 21128.500
type rfc2544_throughput
packet_size 128
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:38:40
start_time 2018-01-23 10:12:07
stop_time 2018-01-23 10:50:47
5.2.1.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 29731
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.06
majflt/s 0.00
VSZ 9931873
RSS 50963
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.1.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

5.2.1.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4117704.504
tx_rate_mbps Unknown
throughput_rx_mbps 16866.118
tx_rate_percent 87.625
throughput_rx_percent 87.625
frame_loss_percent 0.000
min_latency_ns 13200.000
max_latency_ns 91180.000
avg_latency_ns 36301.500
type rfc2544_throughput
packet_size 512
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:38:40
start_time 2018-01-23 10:12:07
stop_time 2018-01-23 10:50:47
5.2.1.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 29731
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.06
majflt/s 0.00
VSZ 9931873
RSS 50963
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.1.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

5.2.1.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394507.938
tx_rate_mbps Unknown
throughput_rx_mbps 19615.809
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 18080.000
max_latency_ns 191760.000
avg_latency_ns 170609.500
type rfc2544_throughput
packet_size 1024
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:38:40
start_time 2018-01-23 10:12:07
stop_time 2018-01-23 10:50:47
5.2.1.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 29731
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.06
majflt/s 0.00
VSZ 9931873
RSS 50963
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.1.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

5.2.1.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625431.667
tx_rate_mbps Unknown
throughput_rx_mbps 19739.242
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 21460.000
max_latency_ns 128200.000
avg_latency_ns 117159.000
type rfc2544_throughput
packet_size 1518
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:38:40
start_time 2018-01-23 10:12:07
stop_time 2018-01-23 10:50:47
5.2.1.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 29731
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.06
majflt/s 0.00
VSZ 9931873
RSS 50963
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.1.7. Anomalies

No anomalies were detected during the course of this test.

5.2.1.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.2. Test ID: PVP_BACK2BACK_VPP

5.2.2.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: clean

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvp_back2back_vpp
  • Description: VPP: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: clean
  • Traffic type: rfc2544_back2back
  • Bidirectional : True
5.2.2.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

5.2.2.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544_back2back
packet_size 64
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:42:32
start_time 2018-01-23 10:50:47
stop_time 2018-01-23 11:33:20
5.2.2.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 37672
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.06
majflt/s 0.00
VSZ 9963966
RSS 51002
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.2.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

5.2.2.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544_back2back
packet_size 128
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:42:32
start_time 2018-01-23 10:50:47
stop_time 2018-01-23 11:33:20
5.2.2.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 37672
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.06
majflt/s 0.00
VSZ 9963966
RSS 51002
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.2.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

5.2.2.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 17622180
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 512
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:42:32
start_time 2018-01-23 10:50:47
stop_time 2018-01-23 11:33:20
5.2.2.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 37672
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.06
majflt/s 0.00
VSZ 9963966
RSS 51002
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.2.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

5.2.2.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 35919540
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1024
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:42:32
start_time 2018-01-23 10:50:47
stop_time 2018-01-23 11:33:20
5.2.2.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 37672
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.06
majflt/s 0.00
VSZ 9963966
RSS 51002
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.2.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

5.2.2.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 24382314
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1518
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:42:32
start_time 2018-01-23 10:50:47
stop_time 2018-01-23 11:33:20
5.2.2.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 37672
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.06
majflt/s 0.00
VSZ 9963966
RSS 51002
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.2.7. Anomalies

No anomalies were detected during the course of this test.

5.2.2.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.3. Test ID: PHY2PHY_BACK2BACK_VPP

5.2.3.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: clean

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: phy2phy_back2back_vpp
  • Description: VPP: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: clean
  • Traffic type: rfc2544_back2back
  • Bidirectional : True
5.2.3.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

5.2.3.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 13623
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 64
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:41:40
start_time 2018-01-23 09:30:25
stop_time 2018-01-23 10:12:06
5.2.3.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 21135
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 3937544
RSS 50911
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.3.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

5.2.3.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 216509
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 128
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:41:40
start_time 2018-01-23 09:30:25
stop_time 2018-01-23 10:12:06
5.2.3.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 21135
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 3937544
RSS 50911
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.3.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

5.2.3.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 70488721
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 512
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:41:40
start_time 2018-01-23 09:30:25
stop_time 2018-01-23 10:12:06
5.2.3.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 21135
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 3937544
RSS 50911
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.3.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

5.2.3.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 35919540
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1024
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:41:40
start_time 2018-01-23 09:30:25
stop_time 2018-01-23 10:12:06
5.2.3.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 21135
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 3937544
RSS 50911
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.3.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

5.2.3.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 24382314
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1518
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:41:40
start_time 2018-01-23 09:30:25
stop_time 2018-01-23 10:12:06
5.2.3.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 21135
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 3937544
RSS 50911
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.3.7. Anomalies

No anomalies were detected during the course of this test.

5.2.3.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.4. Test ID: PVVP_BACK2BACK_VPP

5.2.4.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: clean

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvvp_back2back_vpp
  • Description: VPP: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: clean
  • Traffic type: rfc2544_back2back
  • Bidirectional : True
5.2.4.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

5.2.4.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544_back2back
packet_size 64
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:42:51
start_time 2018-01-23 12:12:54
stop_time 2018-01-23 12:55:45
5.2.4.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 54749
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 15650126
RSS 51559
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.4.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

5.2.4.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 483
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 128
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:42:51
start_time 2018-01-23 12:12:54
stop_time 2018-01-23 12:55:45
5.2.4.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 54749
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 15650126
RSS 51559
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.4.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

5.2.4.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 70488721
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 512
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:42:51
start_time 2018-01-23 12:12:54
stop_time 2018-01-23 12:55:45
5.2.4.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 54749
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 15650126
RSS 51559
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.4.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

5.2.4.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 35919540
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1024
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:42:51
start_time 2018-01-23 12:12:54
stop_time 2018-01-23 12:55:45
5.2.4.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 54749
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 15650126
RSS 51559
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.4.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

5.2.4.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 24382314
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1518
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:42:51
start_time 2018-01-23 12:12:54
stop_time 2018-01-23 12:55:45
5.2.4.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 54749
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 15650126
RSS 51559
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.4.7. Anomalies

No anomalies were detected during the course of this test.

5.2.4.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.5. Test ID: PVVP_TPUT_VPP

5.2.5.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: clean

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvvp_tput_vpp
  • Description: VPP: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: clean
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
5.2.5.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

5.2.5.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 7663721.370
tx_rate_mbps Unknown
throughput_rx_mbps 3923.825
tx_rate_percent 25.750
throughput_rx_percent 25.750
frame_loss_percent 0.000
min_latency_ns 9140.000
max_latency_ns 65020.000
avg_latency_ns 16175.000
type rfc2544_throughput
packet_size 64
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:39:32
start_time 2018-01-23 11:33:20
stop_time 2018-01-23 12:12:53
5.2.5.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 46452
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 15584735
RSS 51111
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.5.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

5.2.5.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 8530439.727
tx_rate_mbps Unknown
throughput_rx_mbps 8735.170
tx_rate_percent 50.500
throughput_rx_percent 50.500
frame_loss_percent 0.000
min_latency_ns 11240.000
max_latency_ns 63240.000
avg_latency_ns 22084.500
type rfc2544_throughput
packet_size 128
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:39:32
start_time 2018-01-23 11:33:20
stop_time 2018-01-23 12:12:53
5.2.5.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 46452
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 15584735
RSS 51111
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.5.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

5.2.5.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4699041.421
tx_rate_mbps Unknown
throughput_rx_mbps 19247.274
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 20760.000
max_latency_ns 158020.000
avg_latency_ns 142587.500
type rfc2544_throughput
packet_size 512
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:39:32
start_time 2018-01-23 11:33:20
stop_time 2018-01-23 12:12:53
5.2.5.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 46452
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 15584735
RSS 51111
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.5.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

5.2.5.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394551.556
tx_rate_mbps Unknown
throughput_rx_mbps 19616.166
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 21240.000
max_latency_ns 131140.000
avg_latency_ns 117423.500
type rfc2544_throughput
packet_size 1024
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:39:32
start_time 2018-01-23 11:33:20
stop_time 2018-01-23 12:12:53
5.2.5.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 46452
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 15584735
RSS 51111
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.5.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

5.2.5.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625451.319
tx_rate_mbps Unknown
throughput_rx_mbps 19739.481
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 31640.000
max_latency_ns 110280.000
avg_latency_ns 88995.500
type rfc2544_throughput
packet_size 1518
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:39:32
start_time 2018-01-23 11:33:20
stop_time 2018-01-23 12:12:53
5.2.5.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 46452
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 15584735
RSS 51111
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.5.7. Anomalies

No anomalies were detected during the course of this test.

5.2.5.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.6. Test ID: PHY2PHY_TPUT_VPP

5.2.6.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: clean

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: phy2phy_tput_vpp
  • Description: VPP: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: clean
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
5.2.6.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

5.2.6.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 22856315.930
tx_rate_mbps Unknown
throughput_rx_mbps 11702.434
tx_rate_percent 76.797
throughput_rx_percent 76.797
frame_loss_percent 0.000
min_latency_ns 5800.000
max_latency_ns 57200.000
avg_latency_ns 22266.000
type rfc2544_throughput
packet_size 64
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:32:37
start_time 2018-01-23 08:57:47
stop_time 2018-01-23 09:30:25
5.2.6.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 14397
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 3937544
RSS 51083
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.6.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

5.2.6.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 15846778.710
tx_rate_mbps Unknown
throughput_rx_mbps 16227.101
tx_rate_percent 93.813
throughput_rx_percent 93.813
frame_loss_percent 0.000
min_latency_ns 6220.000
max_latency_ns 218640.000
avg_latency_ns 11980.500
type rfc2544_throughput
packet_size 128
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:32:37
start_time 2018-01-23 08:57:47
stop_time 2018-01-23 09:30:25
5.2.6.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 14397
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 3937544
RSS 51083
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.6.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

5.2.6.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4699210.288
tx_rate_mbps Unknown
throughput_rx_mbps 19247.965
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 10520.000
max_latency_ns 38920.000
avg_latency_ns 26319.500
type rfc2544_throughput
packet_size 512
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:32:37
start_time 2018-01-23 08:57:47
stop_time 2018-01-23 09:30:25
5.2.6.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 14397
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 3937544
RSS 51083
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.6.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

5.2.6.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394617.901
tx_rate_mbps Unknown
throughput_rx_mbps 19616.710
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 12380.000
max_latency_ns 37320.000
avg_latency_ns 26100.000
type rfc2544_throughput
packet_size 1024
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:32:37
start_time 2018-01-23 08:57:47
stop_time 2018-01-23 09:30:25
5.2.6.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 14397
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 3937544
RSS 51083
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.6.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

5.2.6.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625476.551
tx_rate_mbps Unknown
throughput_rx_mbps 19739.787
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 12100.000
max_latency_ns 35860.000
avg_latency_ns 24342.000
type rfc2544_throughput
packet_size 1518
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:32:37
start_time 2018-01-23 08:57:47
stop_time 2018-01-23 09:30:25
5.2.6.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 14397
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 3937544
RSS 51083
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.6.7. Anomalies

No anomalies were detected during the course of this test.

5.2.6.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.3. Rationale for decisions

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

5.4. Conclusions and recommendations

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-23_07-28-19/vswitchperf_logs_2018-01-23_07-28-19.tar.gz.

5.5. General

5.5.1. Glossary

  • NFV - Network Function Virtualization
  • Mbps - 1,000,000bps

5.5.2. Document change procedures and history

Document ID Author Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT Christopher Nolan 23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT Christopher Nolan 28/01/2015

6. Performance report for none

6.1. Introduction

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

6.1.1. Document identifier

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

6.1.2. Scope

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

6.2. Details of the Level Test Report

This section provides a test-results-overview. Also included are the rationale and the conclusions.

6.2.1. Test ID: PVP_TPUT

6.2.1.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
    • Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: pvp

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: none, Version: None, GIT tag: None

  • VNF: QemuPciPassthrough, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvp_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: pvp
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
6.2.1.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

6.2.1.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 7663707.320
tx_rate_mbps Unknown
throughput_rx_mbps 3923.818
tx_rate_percent 25.750
throughput_rx_percent 25.750
frame_loss_percent 0.000
min_latency_ns 3540.000
max_latency_ns 26220.000
avg_latency_ns 3938.000
type rfc2544_throughput
packet_size 64
vswitch none
traffic_type udp
test_execution_time 00:38:29
start_time 2018-01-23 12:55:56
stop_time 2018-01-23 13:34:25
guest_loopback_app testpmd
6.2.1.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic Value
UID 0
PID 64021
%usr 0.24
%system 0.14
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2831052
RSS 73788
%MEM 0.11
kB_rd/s 0.00
kB_wr/s 9.81
kB_ccwr/s 0.00
6.2.1.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

6.2.1.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 6831986.564
tx_rate_mbps Unknown
throughput_rx_mbps 6995.954
tx_rate_percent 40.445
throughput_rx_percent 40.445
frame_loss_percent 0.000
min_latency_ns 3740.000
max_latency_ns 27180.000
avg_latency_ns 4097.000
type rfc2544_throughput
packet_size 128
vswitch none
traffic_type udp
test_execution_time 00:38:29
start_time 2018-01-23 12:55:56
stop_time 2018-01-23 13:34:25
guest_loopback_app testpmd
6.2.1.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic Value
UID 0
PID 64021
%usr 0.24
%system 0.14
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2831052
RSS 73788
%MEM 0.11
kB_rd/s 0.00
kB_wr/s 9.81
kB_ccwr/s 0.00
6.2.1.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

6.2.1.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4699194.405
tx_rate_mbps Unknown
throughput_rx_mbps 19247.900
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 5580.000
max_latency_ns 40280.000
avg_latency_ns 27148.000
type rfc2544_throughput
packet_size 512
vswitch none
traffic_type udp
test_execution_time 00:38:29
start_time 2018-01-23 12:55:56
stop_time 2018-01-23 13:34:25
guest_loopback_app testpmd
6.2.1.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic Value
UID 0
PID 64021
%usr 0.24
%system 0.14
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2831052
RSS 73788
%MEM 0.11
kB_rd/s 0.00
kB_wr/s 9.81
kB_ccwr/s 0.00
6.2.1.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

6.2.1.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394602.839
tx_rate_mbps Unknown
throughput_rx_mbps 19616.586
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 6760.000
max_latency_ns 57440.000
avg_latency_ns 36310.500
type rfc2544_throughput
packet_size 1024
vswitch none
traffic_type udp
test_execution_time 00:38:29
start_time 2018-01-23 12:55:56
stop_time 2018-01-23 13:34:25
guest_loopback_app testpmd
6.2.1.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic Value
UID 0
PID 64021
%usr 0.24
%system 0.14
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2831052
RSS 73788
%MEM 0.11
kB_rd/s 0.00
kB_wr/s 9.81
kB_ccwr/s 0.00
6.2.1.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

6.2.1.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625468.873
tx_rate_mbps Unknown
throughput_rx_mbps 19739.694
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 6920.000
max_latency_ns 44920.000
avg_latency_ns 29660.500
type rfc2544_throughput
packet_size 1518
vswitch none
traffic_type udp
test_execution_time 00:38:29
start_time 2018-01-23 12:55:56
stop_time 2018-01-23 13:34:25
guest_loopback_app testpmd
6.2.1.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic Value
UID 0
PID 64021
%usr 0.24
%system 0.14
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2831052
RSS 73788
%MEM 0.11
kB_rd/s 0.00
kB_wr/s 9.81
kB_ccwr/s 0.00
6.2.1.7. Anomalies

No anomalies were detected during the course of this test.

6.2.1.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

6.3. Rationale for decisions

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

6.4. Conclusions and recommendations

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-23_07-28-19/vswitchperf_logs_2018-01-23_07-28-19.tar.gz.

6.5. General

6.5.1. Glossary

  • NFV - Network Function Virtualization
  • Mbps - 1,000,000bps

6.5.2. Document change procedures and history

Document ID Author Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT Christopher Nolan 23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT Christopher Nolan 28/01/2015