VSPERF Results

1. VSPERF Test Scenarios

Predefined Tests suitable for automated execution with CI:

Test Definition
phy2phy_tput PacketLossRatio for Phy2Phy
back2back BackToBackFrames for Phy2Phy
phy2phy_tput_mod_vlan PacketLossRatioFrameModification for Phy2Phy
phy2phy_cont Phy2Phy blast vswitch at x% TX rate and measure throughput
pvp_cont PVP blast vswitch at x% TX rate and measure throughput
pvvp_cont PVVP blast vswitch at x% TX rate and measure throughput
phy2phy_scalability Scalability0PacketLoss for Phy2Phy
pvp_tput PacketLossRatio for PVP
pvp_back2back BackToBackFrames for PVP
pvvp_tput PacketLossRatio for PVVP
pvvp_back2back BackToBackFrames for PVVP
phy2phy_cpu_load CPU0PacketLoss for Phy2Phy
phy2phy_mem_load Same as CPU0PacketLoss but using a memory intensive app

Deployment topologies:

  • Phy2Phy: Physical port -> vSwitch -> Physical port.
  • PVP: Physical port -> vSwitch -> VNF -> vSwitch -> Physical port.
  • PVVP: Physical port -> vSwitch -> VNF -> vSwitch -> VNF -> vSwitch -> Physical port.

Loopback applications in the Guest:

Supported traffic generators:

  • Spirent Testcenter
  • Ixia: IxOS and IxNet.
  • Xena
  • MoonGen
  • Dummy
  • T-Rex

2. OPNFV Test Results

VSPERF CI jobs are run daily and sample results can be found at https://wiki.opnfv.org/display/vsperf/Vsperf+Results

Testcase names shown in the dashboard are combination of orignal testcase name from VSPERF framework and indication of used vswitch.

Example:

Testcase phy2phy_tput is executed for three vSwitch types: OvsDpdkVhost, OvsVanilla and VppDpdkVhost. In this case, following testcase names will be used in the dashboard: phy2phy_tput_ovsdpdkvhost, phy2phy_tput_ovsvanilla and phy2phy_tput_vppdpdkvhost.

In case of RFC2544 Throughput test, the recorded metric is FPS (frames per second) without packet loss. For RFC2544 Back2Back test, the recorded metric is back-to-back value (number of frames) without packet loss.

The loopback application in the VNF used for PVP and PVVP scenarios was DPDK testpmd.

Guest interface types are vhost-user for OvsDpdkVhost and VppDpdkVhost and virtio-net for OvsVanilla.

3. Performance report for OvsDpdkVhost

3.1. Introduction

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

3.1.1. Document identifier

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

3.1.2. Scope

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

3.2. Details of the Level Test Report

This section provides a test-results-overview. Also included are the rationale and the conclusions.

3.2.1. Test ID: BACK2BACK

3.2.1.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: p2p
  • Traffic type: rfc2544_back2back
  • Bidirectional : True
3.2.1.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.1.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 26396
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 64
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:46:15
start_time 2018-01-24 00:32:52
stop_time 2018-01-24 01:19:07
3.2.1.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 131594
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8300988
RSS 43359
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 131577
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6764
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.1.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 79180743
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 128
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:46:15
start_time 2018-01-24 00:32:52
stop_time 2018-01-24 01:19:07
3.2.1.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 131594
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8300988
RSS 43359
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 131577
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6764
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.1.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 70488721
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 512
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:46:15
start_time 2018-01-24 00:32:52
stop_time 2018-01-24 01:19:07
3.2.1.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 131594
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8300988
RSS 43359
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 131577
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6764
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.1.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 35919540
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1024
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:46:15
start_time 2018-01-24 00:32:52
stop_time 2018-01-24 01:19:07
3.2.1.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 131594
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8300988
RSS 43359
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 131577
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6764
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.1.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 24382314
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1518
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:46:15
start_time 2018-01-24 00:32:52
stop_time 2018-01-24 01:19:07
3.2.1.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 131594
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8300988
RSS 43359
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 131577
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6764
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.1.7. Anomalies

No anomalies were detected during the course of this test.

3.2.1.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.2. Test ID: PVP_TPUT

3.2.2.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: pvp

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

  • VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvp_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: pvp
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
3.2.2.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.2.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 7663731.921
tx_rate_mbps Unknown
throughput_rx_mbps 3923.831
tx_rate_percent 25.750
throughput_rx_percent 25.750
frame_loss_percent 0.000
min_latency_ns 5800.000
max_latency_ns 41800.000
avg_latency_ns 7503.000
type rfc2544_throughput
packet_size 64
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:42:43
start_time 2018-01-24 02:43:19
stop_time 2018-01-24 03:26:03
guest_loopback_app testpmd
3.2.2.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 158765
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 14666204
RSS 43604
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 158749
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6536
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 158996
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2815973
RSS 65607
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.70
kB_ccwr/s 0.00
3.2.2.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.2.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 8530446.608
tx_rate_mbps Unknown
throughput_rx_mbps 8735.177
tx_rate_percent 50.500
throughput_rx_percent 50.500
frame_loss_percent 0.000
min_latency_ns 7600.000
max_latency_ns 38980.000
avg_latency_ns 9791.000
type rfc2544_throughput
packet_size 128
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:42:43
start_time 2018-01-24 02:43:19
stop_time 2018-01-24 03:26:03
guest_loopback_app testpmd
3.2.2.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 158765
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 14666204
RSS 43604
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 158749
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6536
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 158996
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2815973
RSS 65607
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.70
kB_ccwr/s 0.00
3.2.2.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.2.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4699164.675
tx_rate_mbps Unknown
throughput_rx_mbps 19247.779
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 33940.000
max_latency_ns 90400.000
avg_latency_ns 78220.000
type rfc2544_throughput
packet_size 512
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:42:43
start_time 2018-01-24 02:43:19
stop_time 2018-01-24 03:26:03
guest_loopback_app testpmd
3.2.2.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 158765
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 14666204
RSS 43604
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 158749
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6536
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 158996
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2815973
RSS 65607
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.70
kB_ccwr/s 0.00
3.2.2.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.2.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394592.063
tx_rate_mbps Unknown
throughput_rx_mbps 19616.498
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 43900.000
max_latency_ns 104960.000
avg_latency_ns 92130.000
type rfc2544_throughput
packet_size 1024
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:42:43
start_time 2018-01-24 02:43:19
stop_time 2018-01-24 03:26:03
guest_loopback_app testpmd
3.2.2.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 158765
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 14666204
RSS 43604
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 158749
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6536
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 158996
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2815973
RSS 65607
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.70
kB_ccwr/s 0.00
3.2.2.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.2.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625463.423
tx_rate_mbps Unknown
throughput_rx_mbps 19739.628
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 42820.000
max_latency_ns 92020.000
avg_latency_ns 80761.500
type rfc2544_throughput
packet_size 1518
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:42:43
start_time 2018-01-24 02:43:19
stop_time 2018-01-24 03:26:03
guest_loopback_app testpmd
3.2.2.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 158765
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 14666204
RSS 43604
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 158749
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6536
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 158996
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2815973
RSS 65607
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.70
kB_ccwr/s 0.00
3.2.2.7. Anomalies

No anomalies were detected during the course of this test.

3.2.2.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.3. Test ID: PHY2PHY_TPUT_MOD_VLAN

3.2.3.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: phy2phy_tput_mod_vlan
  • Description: LTD.Throughput.RFC2544.PacketLossRatioFrameModification
  • Deployment: p2p
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
3.2.3.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.3.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 16641096.523
tx_rate_mbps Unknown
throughput_rx_mbps 9052.757
tx_rate_percent 55.914
throughput_rx_percent 58.577
frame_loss_percent 0.000
min_latency_ns 6400.000
max_latency_ns 629380.000
avg_latency_ns 11355.000
type rfc2544_throughput
packet_size 64
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:45:35
start_time 2018-01-24 01:19:08
stop_time 2018-01-24 02:04:43
3.2.3.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 141178
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8301016
RSS 43635
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 141080
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50672
RSS 6504
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.3.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 14670905.631
tx_rate_mbps Unknown
throughput_rx_mbps 15492.476
tx_rate_percent 86.852
throughput_rx_percent 89.199
frame_loss_percent 0.000
min_latency_ns 5880.000
max_latency_ns 69140.000
avg_latency_ns 10432.000
type rfc2544_throughput
packet_size 128
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:45:35
start_time 2018-01-24 01:19:08
stop_time 2018-01-24 02:04:43
3.2.3.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 141178
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8301016
RSS 43635
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 141080
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50672
RSS 6504
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.3.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4662904.522
tx_rate_mbps Unknown
throughput_rx_mbps 19248.470
tx_rate_percent 99.227
throughput_rx_percent 99.973
frame_loss_percent 0.000
min_latency_ns 6760.000
max_latency_ns 21960.000
avg_latency_ns 7689.500
type rfc2544_throughput
packet_size 512
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:45:35
start_time 2018-01-24 01:19:08
stop_time 2018-01-24 02:04:43
3.2.3.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 141178
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8301016
RSS 43635
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 141080
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50672
RSS 6504
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.3.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2376116.985
tx_rate_mbps Unknown
throughput_rx_mbps 19541.186
tx_rate_percent 99.227
throughput_rx_percent 99.607
frame_loss_percent 0.000
min_latency_ns 6700.000
max_latency_ns 27660.000
avg_latency_ns 7816.500
type rfc2544_throughput
packet_size 1024
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:45:35
start_time 2018-01-24 01:19:08
stop_time 2018-01-24 02:04:43
3.2.3.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 141178
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8301016
RSS 43635
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 141080
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50672
RSS 6504
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.3.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1612916.372
tx_rate_mbps Unknown
throughput_rx_mbps 19638.870
tx_rate_percent 99.227
throughput_rx_percent 99.485
frame_loss_percent 0.000
min_latency_ns 7380.000
max_latency_ns 23140.000
avg_latency_ns 8807.000
type rfc2544_throughput
packet_size 1518
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:45:35
start_time 2018-01-24 01:19:08
stop_time 2018-01-24 02:04:43
3.2.3.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 141178
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8301016
RSS 43635
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 141080
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50672
RSS 6504
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.3.7. Anomalies

No anomalies were detected during the course of this test.

3.2.3.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.4. Test ID: PVVP_BACK2BACK

3.2.4.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: pvvp

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

  • VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvvp_back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: pvvp
  • Traffic type: rfc2544_back2back
  • Bidirectional : True
3.2.4.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.4.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1702
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 64
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:46:56
start_time 2018-01-24 04:55:53
stop_time 2018-01-24 05:42:50
guest_loopback_app testpmd testpmd
3.2.4.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 186732
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 20957648
RSS 43316
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 186716
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6440
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 187203
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2803772
RSS 62647
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.21
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 186974
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2801716
RSS 62940
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
3.2.4.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.4.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 483
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 128
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:46:56
start_time 2018-01-24 04:55:53
stop_time 2018-01-24 05:42:50
guest_loopback_app testpmd testpmd
3.2.4.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 186732
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 20957648
RSS 43316
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 186716
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6440
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 187203
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2803772
RSS 62647
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.21
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 186974
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2801716
RSS 62940
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
3.2.4.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.4.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 70488721
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 512
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:46:56
start_time 2018-01-24 04:55:53
stop_time 2018-01-24 05:42:50
guest_loopback_app testpmd testpmd
3.2.4.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 186732
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 20957648
RSS 43316
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 186716
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6440
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 187203
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2803772
RSS 62647
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.21
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 186974
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2801716
RSS 62940
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
3.2.4.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.4.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 35919540
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1024
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:46:56
start_time 2018-01-24 04:55:53
stop_time 2018-01-24 05:42:50
guest_loopback_app testpmd testpmd
3.2.4.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 186732
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 20957648
RSS 43316
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 186716
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6440
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 187203
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2803772
RSS 62647
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.21
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 186974
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2801716
RSS 62940
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
3.2.4.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.4.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 24382314
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1518
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:46:56
start_time 2018-01-24 04:55:53
stop_time 2018-01-24 05:42:50
guest_loopback_app testpmd testpmd
3.2.4.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 186732
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 20957648
RSS 43316
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 186716
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6440
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 187203
%usr 0.03
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2803772
RSS 62647
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.21
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 186974
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2801716
RSS 62940
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
3.2.4.7. Anomalies

No anomalies were detected during the course of this test.

3.2.4.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.5. Test ID: PHY2PHY_TPUT

3.2.5.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: phy2phy_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: p2p
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
3.2.5.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.5.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 23316600.477
tx_rate_mbps Unknown
throughput_rx_mbps 11938.099
tx_rate_percent 78.344
throughput_rx_percent 78.344
frame_loss_percent 0.000
min_latency_ns 5220.000
max_latency_ns 29720.000
avg_latency_ns 11795.000
type rfc2544_throughput
packet_size 64
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:34:43
start_time 2018-01-23 23:58:07
stop_time 2018-01-24 00:32:51
3.2.5.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 124165
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8300996
RSS 43307
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 124149
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6640
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.5.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 16761273.418
tx_rate_mbps Unknown
throughput_rx_mbps 17163.544
tx_rate_percent 99.227
throughput_rx_percent 99.227
frame_loss_percent 0.000
min_latency_ns 5120.000
max_latency_ns 35820.000
avg_latency_ns 10131.500
type rfc2544_throughput
packet_size 128
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:34:43
start_time 2018-01-23 23:58:07
stop_time 2018-01-24 00:32:51
3.2.5.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 124165
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8300996
RSS 43307
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 124149
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6640
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.5.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4699187.058
tx_rate_mbps Unknown
throughput_rx_mbps 19247.870
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 32820.000
max_latency_ns 72880.000
avg_latency_ns 61899.000
type rfc2544_throughput
packet_size 512
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:34:43
start_time 2018-01-23 23:58:07
stop_time 2018-01-24 00:32:51
3.2.5.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 124165
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8300996
RSS 43307
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 124149
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6640
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.5.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394605.664
tx_rate_mbps Unknown
throughput_rx_mbps 19616.610
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 35200.000
max_latency_ns 73500.000
avg_latency_ns 63379.000
type rfc2544_throughput
packet_size 1024
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:34:43
start_time 2018-01-23 23:58:07
stop_time 2018-01-24 00:32:51
3.2.5.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 124165
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8300996
RSS 43307
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 124149
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6640
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.5.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625469.740
tx_rate_mbps Unknown
throughput_rx_mbps 19739.705
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 31740.000
max_latency_ns 65320.000
avg_latency_ns 54998.500
type rfc2544_throughput
packet_size 1518
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:34:43
start_time 2018-01-23 23:58:07
stop_time 2018-01-24 00:32:51
3.2.5.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 124165
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 8300996
RSS 43307
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 124149
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6640
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.5.7. Anomalies

No anomalies were detected during the course of this test.

3.2.5.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.6. Test ID: PHY2PHY_SCALABILITY

3.2.6.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: phy2phy_scalability
  • Description: LTD.Scalability.Flows.RFC2544.0PacketLoss
  • Deployment: p2p
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
3.2.6.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.6.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 16641096.911
tx_rate_mbps Unknown
throughput_rx_mbps 8520.242
tx_rate_percent 55.914
throughput_rx_percent 55.914
frame_loss_percent 0.000
min_latency_ns 6560.000
max_latency_ns 115840.000
avg_latency_ns 9920.000
type rfc2544_throughput
packet_size 64
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:38:34
start_time 2018-01-24 02:04:44
stop_time 2018-01-24 02:43:18
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 150649
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8301016
RSS 43435
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 150536
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6836
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.6.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 15716124.924
tx_rate_mbps Unknown
throughput_rx_mbps 16093.312
tx_rate_percent 93.039
throughput_rx_percent 93.039
frame_loss_percent 0.000
min_latency_ns 5340.000
max_latency_ns 35000.000
avg_latency_ns 10663.000
type rfc2544_throughput
packet_size 128
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:38:34
start_time 2018-01-24 02:04:44
stop_time 2018-01-24 02:43:18
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 150649
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8301016
RSS 43435
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 150536
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6836
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.6.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4699190.536
tx_rate_mbps Unknown
throughput_rx_mbps 19247.884
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 37360.000
max_latency_ns 75740.000
avg_latency_ns 64552.500
type rfc2544_throughput
packet_size 512
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:38:34
start_time 2018-01-24 02:04:44
stop_time 2018-01-24 02:43:18
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 150649
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8301016
RSS 43435
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 150536
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6836
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.6.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394607.859
tx_rate_mbps Unknown
throughput_rx_mbps 19616.628
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 33960.000
max_latency_ns 70580.000
avg_latency_ns 59708.500
type rfc2544_throughput
packet_size 1024
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:38:34
start_time 2018-01-24 02:04:44
stop_time 2018-01-24 02:43:18
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 150649
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8301016
RSS 43435
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 150536
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6836
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.6.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625470.125
tx_rate_mbps Unknown
throughput_rx_mbps 19739.709
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 33860.000
max_latency_ns 67300.000
avg_latency_ns 56503.000
type rfc2544_throughput
packet_size 1518
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:38:34
start_time 2018-01-24 02:04:44
stop_time 2018-01-24 02:43:18
stream_count 8000
match_type L4
pre-installed_flows No
3.2.6.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 150649
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.01
majflt/s 0.00
VSZ 8301016
RSS 43435
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 150536
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50664
RSS 6836
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
3.2.6.7. Anomalies

No anomalies were detected during the course of this test.

3.2.6.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.7. Test ID: PVP_BACK2BACK

3.2.7.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: pvp

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

  • VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvp_back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: pvp
  • Traffic type: rfc2544_back2back
  • Bidirectional : True
3.2.7.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.7.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 2128
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 64
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:45:50
start_time 2018-01-24 03:26:03
stop_time 2018-01-24 04:11:54
guest_loopback_app testpmd
3.2.7.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 167762
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 14666204
RSS 43576
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 167746
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6632
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 168089
%usr 0.11
%system 0.07
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2785268
RSS 65628
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.35
kB_ccwr/s 0.00
3.2.7.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.7.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1449
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 128
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:45:50
start_time 2018-01-24 03:26:03
stop_time 2018-01-24 04:11:54
guest_loopback_app testpmd
3.2.7.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 167762
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 14666204
RSS 43576
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 167746
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6632
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 168089
%usr 0.11
%system 0.07
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2785268
RSS 65628
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.35
kB_ccwr/s 0.00
3.2.7.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.7.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 70488721
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 512
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:45:50
start_time 2018-01-24 03:26:03
stop_time 2018-01-24 04:11:54
guest_loopback_app testpmd
3.2.7.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 167762
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 14666204
RSS 43576
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 167746
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6632
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 168089
%usr 0.11
%system 0.07
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2785268
RSS 65628
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.35
kB_ccwr/s 0.00
3.2.7.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.7.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 35919540
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1024
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:45:50
start_time 2018-01-24 03:26:03
stop_time 2018-01-24 04:11:54
guest_loopback_app testpmd
3.2.7.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 167762
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 14666204
RSS 43576
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 167746
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6632
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 168089
%usr 0.11
%system 0.07
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2785268
RSS 65628
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.35
kB_ccwr/s 0.00
3.2.7.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.7.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 24382314
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1518
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:45:50
start_time 2018-01-24 03:26:03
stop_time 2018-01-24 04:11:54
guest_loopback_app testpmd
3.2.7.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 167762
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 14666204
RSS 43576
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 167746
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6632
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 168089
%usr 0.11
%system 0.07
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2785268
RSS 65628
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.35
kB_ccwr/s 0.00
3.2.7.7. Anomalies

No anomalies were detected during the course of this test.

3.2.7.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.2.8. Test ID: PVVP_TPUT

3.2.8.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: pvvp

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsDpdkVhost, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

  • VNF: QemuDpdkVhostUser, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvvp_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: pvvp
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
3.2.8.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

3.2.8.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 7663728.089
tx_rate_mbps Unknown
throughput_rx_mbps 3923.829
tx_rate_percent 25.750
throughput_rx_percent 25.750
frame_loss_percent 0.000
min_latency_ns 9860.000
max_latency_ns 55380.000
avg_latency_ns 13090.000
type rfc2544_throughput
packet_size 64
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:43:58
start_time 2018-01-24 04:11:54
stop_time 2018-01-24 04:55:53
guest_loopback_app testpmd testpmd
3.2.8.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 177403
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 20957636
RSS 43240
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 177376
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6656
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 177876
%usr 0.30
%system 0.17
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2857200
RSS 66891
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.83
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 177645
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2846948
RSS 65832
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
3.2.8.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

3.2.8.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 6440041.147
tx_rate_mbps Unknown
throughput_rx_mbps 6594.602
tx_rate_percent 38.125
throughput_rx_percent 38.125
frame_loss_percent 0.000
min_latency_ns 9540.000
max_latency_ns 54960.000
avg_latency_ns 12398.000
type rfc2544_throughput
packet_size 128
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:43:58
start_time 2018-01-24 04:11:54
stop_time 2018-01-24 04:55:53
guest_loopback_app testpmd testpmd
3.2.8.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 177403
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 20957636
RSS 43240
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 177376
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6656
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 177876
%usr 0.30
%system 0.17
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2857200
RSS 66891
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.83
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 177645
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2846948
RSS 65832
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
3.2.8.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

3.2.8.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4699155.434
tx_rate_mbps Unknown
throughput_rx_mbps 19247.741
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 70800.000
max_latency_ns 136940.000
avg_latency_ns 125709.500
type rfc2544_throughput
packet_size 512
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:43:58
start_time 2018-01-24 04:11:54
stop_time 2018-01-24 04:55:53
guest_loopback_app testpmd testpmd
3.2.8.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 177403
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 20957636
RSS 43240
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 177376
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6656
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 177876
%usr 0.30
%system 0.17
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2857200
RSS 66891
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.83
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 177645
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2846948
RSS 65832
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
3.2.8.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

3.2.8.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394582.022
tx_rate_mbps Unknown
throughput_rx_mbps 19616.416
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 73480.000
max_latency_ns 151940.000
avg_latency_ns 138144.500
type rfc2544_throughput
packet_size 1024
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:43:58
start_time 2018-01-24 04:11:54
stop_time 2018-01-24 04:55:53
guest_loopback_app testpmd testpmd
3.2.8.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 177403
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 20957636
RSS 43240
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 177376
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6656
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 177876
%usr 0.30
%system 0.17
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2857200
RSS 66891
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.83
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 177645
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2846948
RSS 65832
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
3.2.8.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

3.2.8.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625447.055
tx_rate_mbps Unknown
throughput_rx_mbps 19739.429
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 76320.000
max_latency_ns 162680.000
avg_latency_ns 148963.500
type rfc2544_throughput
packet_size 1518
vswitch OvsDpdkVhost
traffic_type udp
test_execution_time 00:43:58
start_time 2018-01-24 04:11:54
stop_time 2018-01-24 04:55:53
guest_loopback_app testpmd testpmd
3.2.8.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 177403
%usr 100.00
%system 0.15
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 20957636
RSS 43240
%MEM 0.07
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 177376
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 50668
RSS 6656
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 177876
%usr 0.30
%system 0.17
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2857200
RSS 66891
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.83
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 177645
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2846948
RSS 65832
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
3.2.8.7. Anomalies

No anomalies were detected during the course of this test.

3.2.8.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

3.3. Rationale for decisions

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

3.4. Conclusions and recommendations

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-24_07-58-00/vswitchperf_logs_2018-01-24_07-58-00.tar.gz.

3.5. General

3.5.1. Glossary

  • NFV - Network Function Virtualization
  • Mbps - 1,000,000bps

3.5.2. Document change procedures and history

Document ID Author Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT Christopher Nolan 23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT Christopher Nolan 28/01/2015

4. Performance report for OvsVanilla

4.1. Introduction

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

4.1.1. Document identifier

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

4.1.2. Scope

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

4.2. Details of the Level Test Report

This section provides a test-results-overview. Also included are the rationale and the conclusions.

4.2.1. Test ID: BACK2BACK

4.2.1.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

  • Test ID: back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: p2p
  • Traffic type: rfc2544_back2back
  • Bidirectional : True
4.2.1.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.1.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 5108
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 64
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:47:32
start_time 2018-01-24 06:31:34
stop_time 2018-01-24 07:19:07
4.2.1.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 10947
%usr 0.43
%system 2.99
%guest 0.00
%CPU 3.42
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 6608352
RSS 9079
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 10944
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5664
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.1.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 3382
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 128
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:47:32
start_time 2018-01-24 06:31:34
stop_time 2018-01-24 07:19:07
4.2.1.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 10947
%usr 0.43
%system 2.99
%guest 0.00
%CPU 3.42
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 6608352
RSS 9079
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 10944
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5664
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.1.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1344
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 512
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:47:32
start_time 2018-01-24 06:31:34
stop_time 2018-01-24 07:19:07
4.2.1.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 10947
%usr 0.43
%system 2.99
%guest 0.00
%CPU 3.42
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 6608352
RSS 9079
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 10944
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5664
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.1.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1096
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1024
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:47:32
start_time 2018-01-24 06:31:34
stop_time 2018-01-24 07:19:07
4.2.1.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 10947
%usr 0.43
%system 2.99
%guest 0.00
%CPU 3.42
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 6608352
RSS 9079
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 10944
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5664
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.1.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 1488
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1518
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:47:32
start_time 2018-01-24 06:31:34
stop_time 2018-01-24 07:19:07
4.2.1.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 10947
%usr 0.43
%system 2.99
%guest 0.00
%CPU 3.42
CPU
minflt/s 0.09
majflt/s 0.00
VSZ 6608352
RSS 9079
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 10944
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5664
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.1.7. Anomalies

No anomalies were detected during the course of this test.

4.2.1.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.2. Test ID: PVP_TPUT

4.2.2.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: pvp

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvp_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: pvp
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
4.2.2.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.2.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 289219.176
tx_rate_mbps Unknown
throughput_rx_mbps 148.080
tx_rate_percent 1.773
throughput_rx_percent 0.972
frame_loss_percent 45.202
min_latency_ns 11680.000
max_latency_ns 86866840.000
avg_latency_ns 3410832.000
type rfc2544_throughput
packet_size 64
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:47:14
start_time 2018-01-24 08:50:15
stop_time 2018-01-24 09:37:30
guest_loopback_app testpmd
4.2.2.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 38596
%usr 0.41
%system 2.96
%guest 0.00
%CPU 3.37
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608352
RSS 9233
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 38593
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5812
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 38870
%usr 0.02
%system 0.80
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2822347
RSS 64900
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.94
kB_ccwr/s 0.00
4.2.2.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.2.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 299567.883
tx_rate_mbps Unknown
throughput_rx_mbps 306.758
tx_rate_percent 1.773
throughput_rx_percent 1.773
frame_loss_percent 0.000
min_latency_ns 9440.000
max_latency_ns 611840.000
avg_latency_ns 45682.000
type rfc2544_throughput
packet_size 128
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:47:14
start_time 2018-01-24 08:50:15
stop_time 2018-01-24 09:37:30
guest_loopback_app testpmd
4.2.2.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 38596
%usr 0.41
%system 2.96
%guest 0.00
%CPU 3.37
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608352
RSS 9233
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 38593
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5812
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 38870
%usr 0.02
%system 0.80
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2822347
RSS 64900
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.94
kB_ccwr/s 0.00
4.2.2.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.2.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 265067.414
tx_rate_mbps Unknown
throughput_rx_mbps 1085.716
tx_rate_percent 5.641
throughput_rx_percent 5.641
frame_loss_percent 0.000
min_latency_ns 10520.000
max_latency_ns 623920.000
avg_latency_ns 63635.500
type rfc2544_throughput
packet_size 512
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:47:14
start_time 2018-01-24 08:50:15
stop_time 2018-01-24 09:37:30
guest_loopback_app testpmd
4.2.2.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 38596
%usr 0.41
%system 2.96
%guest 0.00
%CPU 3.37
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608352
RSS 9233
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 38593
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5812
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 38870
%usr 0.02
%system 0.80
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2822347
RSS 64900
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.94
kB_ccwr/s 0.00
4.2.2.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.2.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 283240.618
tx_rate_mbps Unknown
throughput_rx_mbps 2320.307
tx_rate_percent 11.828
throughput_rx_percent 11.828
frame_loss_percent 0.000
min_latency_ns 14080.000
max_latency_ns 929520.000
avg_latency_ns 70880.000
type rfc2544_throughput
packet_size 1024
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:47:14
start_time 2018-01-24 08:50:15
stop_time 2018-01-24 09:37:30
guest_loopback_app testpmd
4.2.2.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 38596
%usr 0.41
%system 2.96
%guest 0.00
%CPU 3.37
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608352
RSS 9233
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 38593
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5812
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 38870
%usr 0.02
%system 0.80
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2822347
RSS 64900
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.94
kB_ccwr/s 0.00
4.2.2.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.2.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 280270.113
tx_rate_mbps Unknown
throughput_rx_mbps 3403.600
tx_rate_percent 17.242
throughput_rx_percent 17.242
frame_loss_percent 0.000
min_latency_ns 14660.000
max_latency_ns 1467880.000
avg_latency_ns 74037.000
type rfc2544_throughput
packet_size 1518
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:47:14
start_time 2018-01-24 08:50:15
stop_time 2018-01-24 09:37:30
guest_loopback_app testpmd
4.2.2.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 38596
%usr 0.41
%system 2.96
%guest 0.00
%CPU 3.37
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608352
RSS 9233
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 38593
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5812
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 38870
%usr 0.02
%system 0.80
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2822347
RSS 64900
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.94
kB_ccwr/s 0.00
4.2.2.7. Anomalies

No anomalies were detected during the course of this test.

4.2.2.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.3. Test ID: PHY2PHY_TPUT_MOD_VLAN

4.2.3.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

  • Test ID: phy2phy_tput_mod_vlan
  • Description: LTD.Throughput.RFC2544.PacketLossRatioFrameModification
  • Deployment: p2p
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
4.2.3.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.3.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 988190.171
tx_rate_mbps Unknown
throughput_rx_mbps 537.575
tx_rate_percent 3.320
throughput_rx_percent 3.478
frame_loss_percent 0.000
min_latency_ns 4020.000
max_latency_ns 5937500.000
avg_latency_ns 149941.500
type rfc2544_throughput
packet_size 64
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:44:20
start_time 2018-01-24 07:19:07
stop_time 2018-01-24 08:03:27
4.2.3.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 20564
%usr 0.42
%system 3.06
%guest 0.00
%CPU 3.48
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608360
RSS 9149
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 20561
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5964
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.3.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 560865.297
tx_rate_mbps Unknown
throughput_rx_mbps 592.274
tx_rate_percent 3.320
throughput_rx_percent 3.410
frame_loss_percent 0.000
min_latency_ns 4160.000
max_latency_ns 271200.000
avg_latency_ns 36289.000
type rfc2544_throughput
packet_size 128
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:44:20
start_time 2018-01-24 07:19:07
stop_time 2018-01-24 08:03:27
4.2.3.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 20564
%usr 0.42
%system 3.06
%guest 0.00
%CPU 3.48
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608360
RSS 9149
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 20561
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5964
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.3.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 846602.384
tx_rate_mbps Unknown
throughput_rx_mbps 3494.775
tx_rate_percent 18.016
throughput_rx_percent 18.151
frame_loss_percent 0.000
min_latency_ns 5260.000
max_latency_ns 1435020.000
avg_latency_ns 36508.000
type rfc2544_throughput
packet_size 512
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:44:20
start_time 2018-01-24 07:19:07
stop_time 2018-01-24 08:03:27
4.2.3.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 20564
%usr 0.42
%system 3.06
%guest 0.00
%CPU 3.48
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608360
RSS 9149
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 20561
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5964
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.3.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 857395.029
tx_rate_mbps Unknown
throughput_rx_mbps 7051.217
tx_rate_percent 35.805
throughput_rx_percent 35.942
frame_loss_percent 0.000
min_latency_ns 5780.000
max_latency_ns 1287860.000
avg_latency_ns 37496.000
type rfc2544_throughput
packet_size 1024
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:44:20
start_time 2018-01-24 07:19:07
stop_time 2018-01-24 08:03:27
4.2.3.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 20564
%usr 0.42
%system 3.06
%guest 0.00
%CPU 3.48
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608360
RSS 9149
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 20561
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5964
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.3.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 858591.453
tx_rate_mbps Unknown
throughput_rx_mbps 10454.210
tx_rate_percent 52.820
throughput_rx_percent 52.958
frame_loss_percent 0.000
min_latency_ns 9220.000
max_latency_ns 1588640.000
avg_latency_ns 50703.500
type rfc2544_throughput
packet_size 1518
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:44:20
start_time 2018-01-24 07:19:07
stop_time 2018-01-24 08:03:27
4.2.3.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 20564
%usr 0.42
%system 3.06
%guest 0.00
%CPU 3.48
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608360
RSS 9149
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 20561
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5964
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.3.7. Anomalies

No anomalies were detected during the course of this test.

4.2.3.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.4. Test ID: PVVP_BACK2BACK

4.2.4.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: pvvp

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvvp_back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: pvvp
  • Traffic type: rfc2544_back2back
  • Bidirectional : True
4.2.4.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.4.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 851
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 64
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:53:19
start_time 2018-01-24 11:16:13
stop_time 2018-01-24 12:09:32
guest_loopback_app testpmd testpmd
4.2.4.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 68368
%usr 0.43
%system 3.02
%guest 0.00
%CPU 3.45
CPU
minflt/s 0.07
majflt/s 0.00
VSZ 6608352
RSS 9269
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 68365
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5832
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 68955
%usr 0.19
%system 0.20
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2811080
RSS 63152
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 6.35
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 68693
%usr 0.01
%system 0.09
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2859112
RSS 65920
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.4.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.4.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 966
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 128
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:53:19
start_time 2018-01-24 11:16:13
stop_time 2018-01-24 12:09:32
guest_loopback_app testpmd testpmd
4.2.4.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 68368
%usr 0.43
%system 3.02
%guest 0.00
%CPU 3.45
CPU
minflt/s 0.07
majflt/s 0.00
VSZ 6608352
RSS 9269
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 68365
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5832
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 68955
%usr 0.19
%system 0.20
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2811080
RSS 63152
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 6.35
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 68693
%usr 0.01
%system 0.09
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2859112
RSS 65920
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.4.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.4.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 537
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 512
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:53:19
start_time 2018-01-24 11:16:13
stop_time 2018-01-24 12:09:32
guest_loopback_app testpmd testpmd
4.2.4.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 68368
%usr 0.43
%system 3.02
%guest 0.00
%CPU 3.45
CPU
minflt/s 0.07
majflt/s 0.00
VSZ 6608352
RSS 9269
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 68365
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5832
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 68955
%usr 0.19
%system 0.20
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2811080
RSS 63152
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 6.35
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 68693
%usr 0.01
%system 0.09
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2859112
RSS 65920
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.4.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.4.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 548
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1024
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:53:19
start_time 2018-01-24 11:16:13
stop_time 2018-01-24 12:09:32
guest_loopback_app testpmd testpmd
4.2.4.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 68368
%usr 0.43
%system 3.02
%guest 0.00
%CPU 3.45
CPU
minflt/s 0.07
majflt/s 0.00
VSZ 6608352
RSS 9269
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 68365
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5832
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 68955
%usr 0.19
%system 0.20
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2811080
RSS 63152
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 6.35
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 68693
%usr 0.01
%system 0.09
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2859112
RSS 65920
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.4.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.4.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 744
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1518
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:53:19
start_time 2018-01-24 11:16:13
stop_time 2018-01-24 12:09:32
guest_loopback_app testpmd testpmd
4.2.4.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 68368
%usr 0.43
%system 3.02
%guest 0.00
%CPU 3.45
CPU
minflt/s 0.07
majflt/s 0.00
VSZ 6608352
RSS 9269
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 68365
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5832
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 68955
%usr 0.19
%system 0.20
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2811080
RSS 63152
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 6.35
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 68693
%usr 0.01
%system 0.09
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2859112
RSS 65920
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.4.7. Anomalies

No anomalies were detected during the course of this test.

4.2.4.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.5. Test ID: PHY2PHY_TPUT

4.2.5.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

  • Test ID: phy2phy_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: p2p
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
4.2.5.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.5.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 988190.083
tx_rate_mbps Unknown
throughput_rx_mbps 505.953
tx_rate_percent 3.320
throughput_rx_percent 3.320
frame_loss_percent 0.000
min_latency_ns 3980.000
max_latency_ns 2903940.000
avg_latency_ns 43547.500
type rfc2544_throughput
packet_size 64
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:48:35
start_time 2018-01-24 05:42:59
stop_time 2018-01-24 06:31:34
4.2.5.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 956
%usr 0.42
%system 2.95
%guest 0.00
%CPU 3.37
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608348
RSS 8983
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 931
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5764
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.5.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 952811.234
tx_rate_mbps Unknown
throughput_rx_mbps 975.679
tx_rate_percent 5.641
throughput_rx_percent 5.641
frame_loss_percent 0.000
min_latency_ns 4140.000
max_latency_ns 1710440.000
avg_latency_ns 33895.000
type rfc2544_throughput
packet_size 128
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:48:35
start_time 2018-01-24 05:42:59
stop_time 2018-01-24 06:31:34
4.2.5.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 956
%usr 0.42
%system 2.95
%guest 0.00
%CPU 3.37
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608348
RSS 8983
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 931
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5764
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.5.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 882947.588
tx_rate_mbps Unknown
throughput_rx_mbps 3616.553
tx_rate_percent 18.789
throughput_rx_percent 18.789
frame_loss_percent 0.000
min_latency_ns 5240.000
max_latency_ns 2394260.000
avg_latency_ns 73217.500
type rfc2544_throughput
packet_size 512
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:48:35
start_time 2018-01-24 05:42:59
stop_time 2018-01-24 06:31:34
4.2.5.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 956
%usr 0.42
%system 2.95
%guest 0.00
%CPU 3.37
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608348
RSS 8983
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 931
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5764
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.5.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 746266.878
tx_rate_mbps Unknown
throughput_rx_mbps 6113.418
tx_rate_percent 31.164
throughput_rx_percent 31.164
frame_loss_percent 0.000
min_latency_ns 5700.000
max_latency_ns 744020.000
avg_latency_ns 34496.500
type rfc2544_throughput
packet_size 1024
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:48:35
start_time 2018-01-24 05:42:59
stop_time 2018-01-24 06:31:34
4.2.5.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 956
%usr 0.42
%system 2.95
%guest 0.00
%CPU 3.37
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608348
RSS 8983
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 931
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5764
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.5.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 871162.443
tx_rate_mbps Unknown
throughput_rx_mbps 10579.397
tx_rate_percent 53.594
throughput_rx_percent 53.594
frame_loss_percent 0.000
min_latency_ns 6900.000
max_latency_ns 754680.000
avg_latency_ns 39470.000
type rfc2544_throughput
packet_size 1518
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:48:35
start_time 2018-01-24 05:42:59
stop_time 2018-01-24 06:31:34
4.2.5.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 956
%usr 0.42
%system 2.95
%guest 0.00
%CPU 3.37
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608348
RSS 8983
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 931
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5764
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.5.7. Anomalies

No anomalies were detected during the course of this test.

4.2.5.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.6. Test ID: PHY2PHY_SCALABILITY

4.2.6.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: p2p

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

Below are test details:

  • Test ID: phy2phy_scalability
  • Description: LTD.Scalability.Flows.RFC2544.0PacketLoss
  • Deployment: p2p
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
4.2.6.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.6.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 988191.140
tx_rate_mbps Unknown
throughput_rx_mbps 505.954
tx_rate_percent 3.320
throughput_rx_percent 3.320
frame_loss_percent 0.000
min_latency_ns 3980.000
max_latency_ns 3412320.000
avg_latency_ns 63848.500
type rfc2544_throughput
packet_size 64
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:46:46
start_time 2018-01-24 08:03:28
stop_time 2018-01-24 08:50:15
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 29388
%usr 0.40
%system 3.01
%guest 0.00
%CPU 3.41
CPU
minflt/s 0.19
majflt/s 0.00
VSZ 6608356
RSS 8697
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 29370
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5972
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.6.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 952811.464
tx_rate_mbps Unknown
throughput_rx_mbps 975.679
tx_rate_percent 5.641
throughput_rx_percent 5.641
frame_loss_percent 0.000
min_latency_ns 4140.000
max_latency_ns 2440620.000
avg_latency_ns 42090.000
type rfc2544_throughput
packet_size 128
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:46:46
start_time 2018-01-24 08:03:28
stop_time 2018-01-24 08:50:15
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 29388
%usr 0.40
%system 3.01
%guest 0.00
%CPU 3.41
CPU
minflt/s 0.19
majflt/s 0.00
VSZ 6608356
RSS 8697
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 29370
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5972
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.6.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 737562.390
tx_rate_mbps Unknown
throughput_rx_mbps 3021.056
tx_rate_percent 15.695
throughput_rx_percent 15.695
frame_loss_percent 0.000
min_latency_ns 5000.000
max_latency_ns 969200.000
avg_latency_ns 35371.000
type rfc2544_throughput
packet_size 512
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:46:46
start_time 2018-01-24 08:03:28
stop_time 2018-01-24 08:50:15
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 29388
%usr 0.40
%system 3.01
%guest 0.00
%CPU 3.41
CPU
minflt/s 0.19
majflt/s 0.00
VSZ 6608356
RSS 8697
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 29370
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5972
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.6.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 746266.434
tx_rate_mbps Unknown
throughput_rx_mbps 6113.415
tx_rate_percent 31.164
throughput_rx_percent 31.164
frame_loss_percent 0.000
min_latency_ns 5540.000
max_latency_ns 451340.000
avg_latency_ns 34049.500
type rfc2544_throughput
packet_size 1024
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:46:46
start_time 2018-01-24 08:03:28
stop_time 2018-01-24 08:50:15
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 29388
%usr 0.40
%system 3.01
%guest 0.00
%CPU 3.41
CPU
minflt/s 0.19
majflt/s 0.00
VSZ 6608356
RSS 8697
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 29370
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5972
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.6.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 871163.134
tx_rate_mbps Unknown
throughput_rx_mbps 10579.405
tx_rate_percent 53.594
throughput_rx_percent 53.594
frame_loss_percent 0.000
min_latency_ns 7140.000
max_latency_ns 1351060.000
avg_latency_ns 51094.500
type rfc2544_throughput
packet_size 1518
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:46:46
start_time 2018-01-24 08:03:28
stop_time 2018-01-24 08:50:15
stream_count 8000
match_type L4
pre-installed_flows No
4.2.6.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 29388
%usr 0.40
%system 3.01
%guest 0.00
%CPU 3.41
CPU
minflt/s 0.19
majflt/s 0.00
VSZ 6608356
RSS 8697
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 29370
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5972
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
4.2.6.7. Anomalies

No anomalies were detected during the course of this test.

4.2.6.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.7. Test ID: PVP_BACK2BACK

4.2.7.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: pvp

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvp_back2back
  • Description: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: pvp
  • Traffic type: rfc2544_back2back
  • Bidirectional : True
4.2.7.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.7.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 851
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 64
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:52:13
start_time 2018-01-24 09:37:30
stop_time 2018-01-24 10:29:43
guest_loopback_app testpmd
4.2.7.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 48088
%usr 0.42
%system 3.02
%guest 0.00
%CPU 3.44
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608356
RSS 9192
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 48085
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44276
RSS 5812
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 48362
%usr 0.25
%system 0.20
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2809260
RSS 64748
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.25
kB_ccwr/s 0.00
4.2.7.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.7.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 966
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 128
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:52:13
start_time 2018-01-24 09:37:30
stop_time 2018-01-24 10:29:43
guest_loopback_app testpmd
4.2.7.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 48088
%usr 0.42
%system 3.02
%guest 0.00
%CPU 3.44
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608356
RSS 9192
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 48085
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44276
RSS 5812
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 48362
%usr 0.25
%system 0.20
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2809260
RSS 64748
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.25
kB_ccwr/s 0.00
4.2.7.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.7.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 537
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 512
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:52:13
start_time 2018-01-24 09:37:30
stop_time 2018-01-24 10:29:43
guest_loopback_app testpmd
4.2.7.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 48088
%usr 0.42
%system 3.02
%guest 0.00
%CPU 3.44
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608356
RSS 9192
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 48085
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44276
RSS 5812
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 48362
%usr 0.25
%system 0.20
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2809260
RSS 64748
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.25
kB_ccwr/s 0.00
4.2.7.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.7.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 274
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1024
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:52:13
start_time 2018-01-24 09:37:30
stop_time 2018-01-24 10:29:43
guest_loopback_app testpmd
4.2.7.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 48088
%usr 0.42
%system 3.02
%guest 0.00
%CPU 3.44
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608356
RSS 9192
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 48085
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44276
RSS 5812
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 48362
%usr 0.25
%system 0.20
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2809260
RSS 64748
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.25
kB_ccwr/s 0.00
4.2.7.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.7.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 744
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1518
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:52:13
start_time 2018-01-24 09:37:30
stop_time 2018-01-24 10:29:43
guest_loopback_app testpmd
4.2.7.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 48088
%usr 0.42
%system 3.02
%guest 0.00
%CPU 3.44
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608356
RSS 9192
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 48085
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44276
RSS 5812
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 48362
%usr 0.25
%system 0.20
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2809260
RSS 64748
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 7.25
kB_ccwr/s 0.00
4.2.7.7. Anomalies

No anomalies were detected during the course of this test.

4.2.7.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.2.8. Test ID: PVVP_TPUT

4.2.8.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: pvvp

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: OvsVanilla, Version: 2.8.1, GIT tag: 5c67e9cfc1eaab19187720c857841be6c8046c40

  • VNF: QemuVirtioNet, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvvp_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: pvvp
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
4.2.8.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

4.2.8.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 302417.945
tx_rate_mbps Unknown
throughput_rx_mbps 154.838
tx_rate_percent 1.773
throughput_rx_percent 1.016
frame_loss_percent 42.702
min_latency_ns 34380.000
max_latency_ns 66084120.000
avg_latency_ns 4033336.500
type rfc2544_throughput
packet_size 64
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:46:28
start_time 2018-01-24 10:29:44
stop_time 2018-01-24 11:16:12
guest_loopback_app testpmd testpmd
4.2.8.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 58758
%usr 0.33
%system 2.36
%guest 0.00
%CPU 2.68
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608352
RSS 9254
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 58755
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5664
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 59224
%usr 0.13
%system 1.06
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2800828
RSS 66720
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.07
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 59083
%usr 0.03
%system 1.01
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2819332
RSS 66460
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.8.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

4.2.8.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 299569.795
tx_rate_mbps Unknown
throughput_rx_mbps 306.759
tx_rate_percent 1.773
throughput_rx_percent 1.773
frame_loss_percent 0.000
min_latency_ns 19860.000
max_latency_ns 824100.000
avg_latency_ns 72670.500
type rfc2544_throughput
packet_size 128
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:46:28
start_time 2018-01-24 10:29:44
stop_time 2018-01-24 11:16:12
guest_loopback_app testpmd testpmd
4.2.8.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 58758
%usr 0.33
%system 2.36
%guest 0.00
%CPU 2.68
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608352
RSS 9254
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 58755
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5664
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 59224
%usr 0.13
%system 1.06
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2800828
RSS 66720
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.07
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 59083
%usr 0.03
%system 1.01
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2819332
RSS 66460
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.8.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

4.2.8.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 265069.539
tx_rate_mbps Unknown
throughput_rx_mbps 1085.725
tx_rate_percent 5.641
throughput_rx_percent 5.641
frame_loss_percent 0.000
min_latency_ns 27980.000
max_latency_ns 554800.000
avg_latency_ns 87395.000
type rfc2544_throughput
packet_size 512
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:46:28
start_time 2018-01-24 10:29:44
stop_time 2018-01-24 11:16:12
guest_loopback_app testpmd testpmd
4.2.8.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 58758
%usr 0.33
%system 2.36
%guest 0.00
%CPU 2.68
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608352
RSS 9254
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 58755
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5664
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 59224
%usr 0.13
%system 1.06
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2800828
RSS 66720
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.07
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 59083
%usr 0.03
%system 1.01
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2819332
RSS 66460
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.8.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

4.2.8.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 264720.556
tx_rate_mbps Unknown
throughput_rx_mbps 2168.591
tx_rate_percent 11.055
throughput_rx_percent 11.055
frame_loss_percent 0.000
min_latency_ns 28060.000
max_latency_ns 699400.000
avg_latency_ns 92670.000
type rfc2544_throughput
packet_size 1024
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:46:28
start_time 2018-01-24 10:29:44
stop_time 2018-01-24 11:16:12
guest_loopback_app testpmd testpmd
4.2.8.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 58758
%usr 0.33
%system 2.36
%guest 0.00
%CPU 2.68
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608352
RSS 9254
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 58755
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5664
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 59224
%usr 0.13
%system 1.06
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2800828
RSS 66720
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.07
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 59083
%usr 0.03
%system 1.01
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2819332
RSS 66460
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.8.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

4.2.8.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 280269.788
tx_rate_mbps Unknown
throughput_rx_mbps 3403.596
tx_rate_percent 17.242
throughput_rx_percent 17.242
frame_loss_percent 0.000
min_latency_ns 31480.000
max_latency_ns 867780.000
avg_latency_ns 103447.000
type rfc2544_throughput
packet_size 1518
vswitch OvsVanilla
traffic_type udp
test_execution_time 00:46:28
start_time 2018-01-24 10:29:44
stop_time 2018-01-24 11:16:12
guest_loopback_app testpmd testpmd
4.2.8.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: ovs-vswitchd
Statistic Value
UID 0
PID 58758
%usr 0.33
%system 2.36
%guest 0.00
%CPU 2.68
CPU
minflt/s 0.10
majflt/s 0.00
VSZ 6608352
RSS 9254
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: ovsdb-server
Statistic Value
UID 0
PID 58755
%usr 0.00
%system 0.00
%guest 0.00
%CPU 0.01
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 44280
RSS 5664
%MEM 0.01
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 59224
%usr 0.13
%system 1.06
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2800828
RSS 66720
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 8.07
kB_ccwr/s 0.00
Process: qemu-system-x86
Statistic Value
UID 0
PID 59083
%usr 0.03
%system 1.01
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2819332
RSS 66460
%MEM 0.10
kB_rd/s 0.00
kB_wr/s 0.02
kB_ccwr/s 0.00
4.2.8.7. Anomalies

No anomalies were detected during the course of this test.

4.2.8.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

4.3. Rationale for decisions

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

4.4. Conclusions and recommendations

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-24_07-58-00/vswitchperf_logs_2018-01-24_07-58-00.tar.gz.

4.5. General

4.5.1. Glossary

  • NFV - Network Function Virtualization
  • Mbps - 1,000,000bps

4.5.2. Document change procedures and history

Document ID Author Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT Christopher Nolan 23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT Christopher Nolan 28/01/2015

5. Performance report for VppDpdkVhost

5.1. Introduction

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

5.1.1. Document identifier

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

5.1.2. Scope

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

5.2. Details of the Level Test Report

This section provides a test-results-overview. Also included are the rationale and the conclusions.

5.2.1. Test ID: PVP_BACK2BACK_VPP

5.2.1.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: clean

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvp_back2back_vpp
  • Description: VPP: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: clean
  • Traffic type: rfc2544_back2back
  • Bidirectional : True
5.2.1.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

5.2.1.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544_back2back
packet_size 64
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:48:34
start_time 2018-01-24 13:51:18
stop_time 2018-01-24 14:39:53
5.2.1.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 100735
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.06
majflt/s 0.00
VSZ 9997027
RSS 51171
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.1.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

5.2.1.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544_back2back
packet_size 128
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:48:34
start_time 2018-01-24 13:51:18
stop_time 2018-01-24 14:39:53
5.2.1.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 100735
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.06
majflt/s 0.00
VSZ 9997027
RSS 51171
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.1.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

5.2.1.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 8811090
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 512
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:48:34
start_time 2018-01-24 13:51:18
stop_time 2018-01-24 14:39:53
5.2.1.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 100735
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.06
majflt/s 0.00
VSZ 9997027
RSS 51171
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.1.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

5.2.1.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 35919540
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1024
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:48:34
start_time 2018-01-24 13:51:18
stop_time 2018-01-24 14:39:53
5.2.1.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 100735
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.06
majflt/s 0.00
VSZ 9997027
RSS 51171
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.1.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

5.2.1.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 24382314
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1518
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:48:34
start_time 2018-01-24 13:51:18
stop_time 2018-01-24 14:39:53
5.2.1.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 100735
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.06
majflt/s 0.00
VSZ 9997027
RSS 51171
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.1.7. Anomalies

No anomalies were detected during the course of this test.

5.2.1.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.2. Test ID: PHY2PHY_BACK2BACK_VPP

5.2.2.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: clean

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: phy2phy_back2back_vpp
  • Description: VPP: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: clean
  • Traffic type: rfc2544_back2back
  • Bidirectional : True
5.2.2.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

5.2.2.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 23416
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 64
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:52:30
start_time 2018-01-24 12:53:51
stop_time 2018-01-24 13:46:21
5.2.2.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 88645
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 3937544
RSS 50738
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.2.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

5.2.2.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 185579
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 128
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:52:30
start_time 2018-01-24 12:53:51
stop_time 2018-01-24 13:46:21
5.2.2.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 88645
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 3937544
RSS 50738
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.2.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

5.2.2.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 70488721
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 512
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:52:30
start_time 2018-01-24 12:53:51
stop_time 2018-01-24 13:46:21
5.2.2.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 88645
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 3937544
RSS 50738
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.2.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

5.2.2.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 35919540
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1024
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:52:30
start_time 2018-01-24 12:53:51
stop_time 2018-01-24 13:46:21
5.2.2.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 88645
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 3937544
RSS 50738
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.2.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

5.2.2.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 24382314
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1518
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:52:30
start_time 2018-01-24 12:53:51
stop_time 2018-01-24 13:46:21
5.2.2.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 88645
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.02
majflt/s 0.00
VSZ 3937544
RSS 50738
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.2.7. Anomalies

No anomalies were detected during the course of this test.

5.2.2.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.3. Test ID: PVVP_BACK2BACK_VPP

5.2.3.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: clean

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvvp_back2back_vpp
  • Description: VPP: LTD.Throughput.RFC2544.BackToBackFrames
  • Deployment: clean
  • Traffic type: rfc2544_back2back
  • Bidirectional : True
5.2.3.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

5.2.3.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 0
b2b_frame_loss_percent 100
type rfc2544_back2back
packet_size 64
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:59:45
start_time 2018-01-24 15:31:25
stop_time 2018-01-24 16:31:11
5.2.3.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 121231
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.05
majflt/s 0.00
VSZ 15904164
RSS 51127
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.3.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

5.2.3.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 483
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 128
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:59:45
start_time 2018-01-24 15:31:25
stop_time 2018-01-24 16:31:11
5.2.3.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 121231
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.05
majflt/s 0.00
VSZ 15904164
RSS 51127
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.3.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

5.2.3.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 70488711
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 512
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:59:45
start_time 2018-01-24 15:31:25
stop_time 2018-01-24 16:31:11
5.2.3.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 121231
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.05
majflt/s 0.00
VSZ 15904164
RSS 51127
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.3.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

5.2.3.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 35919540
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1024
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:59:45
start_time 2018-01-24 15:31:25
stop_time 2018-01-24 16:31:11
5.2.3.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 121231
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.05
majflt/s 0.00
VSZ 15904164
RSS 51127
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.3.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

5.2.3.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
b2b_frames 24382314
b2b_frame_loss_percent 0.0
type rfc2544_back2back
packet_size 1518
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:59:45
start_time 2018-01-24 15:31:25
stop_time 2018-01-24 16:31:11
5.2.3.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 121231
%usr 100.00
%system 0.13
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.05
majflt/s 0.00
VSZ 15904164
RSS 51127
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.3.7. Anomalies

No anomalies were detected during the course of this test.

5.2.3.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.4. Test ID: PVVP_TPUT_VPP

5.2.4.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: clean

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvvp_tput_vpp
  • Description: VPP: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: clean
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
5.2.4.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

5.2.4.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 7893899.266
tx_rate_mbps Unknown
throughput_rx_mbps 4041.676
tx_rate_percent 26.523
throughput_rx_percent 26.523
frame_loss_percent 0.000
min_latency_ns 9160.000
max_latency_ns 78800.000
avg_latency_ns 16002.000
type rfc2544_throughput
packet_size 64
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:51:31
start_time 2018-01-24 14:39:54
stop_time 2018-01-24 15:31:25
5.2.4.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 110679
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.05
majflt/s 0.00
VSZ 15797112
RSS 51188
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.4.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

5.2.4.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 6570690.731
tx_rate_mbps Unknown
throughput_rx_mbps 6728.387
tx_rate_percent 38.898
throughput_rx_percent 38.898
frame_loss_percent 0.000
min_latency_ns 9180.000
max_latency_ns 75900.000
avg_latency_ns 15161.000
type rfc2544_throughput
packet_size 128
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:51:31
start_time 2018-01-24 14:39:54
stop_time 2018-01-24 15:31:25
5.2.4.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 110679
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.05
majflt/s 0.00
VSZ 15797112
RSS 51188
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.4.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

5.2.4.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4699040.388
tx_rate_mbps Unknown
throughput_rx_mbps 19247.269
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 19880.000
max_latency_ns 163480.000
avg_latency_ns 142954.500
type rfc2544_throughput
packet_size 512
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:51:31
start_time 2018-01-24 14:39:54
stop_time 2018-01-24 15:31:25
5.2.4.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 110679
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.05
majflt/s 0.00
VSZ 15797112
RSS 51188
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.4.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

5.2.4.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394550.207
tx_rate_mbps Unknown
throughput_rx_mbps 19616.155
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 29020.000
max_latency_ns 138620.000
avg_latency_ns 126020.500
type rfc2544_throughput
packet_size 1024
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:51:31
start_time 2018-01-24 14:39:54
stop_time 2018-01-24 15:31:25
5.2.4.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 110679
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.05
majflt/s 0.00
VSZ 15797112
RSS 51188
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.4.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

5.2.4.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625445.407
tx_rate_mbps Unknown
throughput_rx_mbps 19739.409
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 28420.000
max_latency_ns 109220.000
avg_latency_ns 97160.000
type rfc2544_throughput
packet_size 1518
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:51:31
start_time 2018-01-24 14:39:54
stop_time 2018-01-24 15:31:25
5.2.4.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 110679
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.05
majflt/s 0.00
VSZ 15797112
RSS 51188
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.4.7. Anomalies

No anomalies were detected during the course of this test.

5.2.4.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.2.5. Test ID: PHY2PHY_TPUT_VPP

5.2.5.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: clean

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: VppDpdkVhost, Version: v17.07-release, GIT tag: NA

  • DPDK Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: phy2phy_tput_vpp
  • Description: VPP: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: clean
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
5.2.5.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

5.2.5.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 22856314.848
tx_rate_mbps Unknown
throughput_rx_mbps 11702.433
tx_rate_percent 76.797
throughput_rx_percent 76.797
frame_loss_percent 0.000
min_latency_ns 5500.000
max_latency_ns 127100.000
avg_latency_ns 22852.500
type rfc2544_throughput
packet_size 64
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:44:07
start_time 2018-01-24 12:09:43
stop_time 2018-01-24 12:53:50
5.2.5.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 79887
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 3937544
RSS 50900
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.5.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

5.2.5.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 14801528.856
tx_rate_mbps Unknown
throughput_rx_mbps 15156.766
tx_rate_percent 87.625
throughput_rx_percent 87.625
frame_loss_percent 0.000
min_latency_ns 6840.000
max_latency_ns 31080.000
avg_latency_ns 10602.000
type rfc2544_throughput
packet_size 128
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:44:07
start_time 2018-01-24 12:09:43
stop_time 2018-01-24 12:53:50
5.2.5.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 79887
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 3937544
RSS 50900
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.5.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

5.2.5.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4699205.495
tx_rate_mbps Unknown
throughput_rx_mbps 19247.946
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 13400.000
max_latency_ns 46280.000
avg_latency_ns 32394.500
type rfc2544_throughput
packet_size 512
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:44:07
start_time 2018-01-24 12:09:43
stop_time 2018-01-24 12:53:50
5.2.5.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 79887
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 3937544
RSS 50900
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.5.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

5.2.5.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394615.793
tx_rate_mbps Unknown
throughput_rx_mbps 19616.693
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 14020.000
max_latency_ns 44180.000
avg_latency_ns 30635.000
type rfc2544_throughput
packet_size 1024
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:44:07
start_time 2018-01-24 12:09:43
stop_time 2018-01-24 12:53:50
5.2.5.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 79887
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 3937544
RSS 50900
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.5.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

5.2.5.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625472.980
tx_rate_mbps Unknown
throughput_rx_mbps 19739.744
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 14120.000
max_latency_ns 43900.000
avg_latency_ns 33057.000
type rfc2544_throughput
packet_size 1518
vswitch VppDpdkVhost
traffic_type udp
test_execution_time 00:44:07
start_time 2018-01-24 12:09:43
stop_time 2018-01-24 12:53:50
5.2.5.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: vpp_main
Statistic Value
UID 0
PID 79887
%usr 100.00
%system 0.14
%guest 0.00
%CPU 100.00
CPU
minflt/s 0.03
majflt/s 0.00
VSZ 3937544
RSS 50900
%MEM 0.08
kB_rd/s 0.00
kB_wr/s 0.00
kB_ccwr/s 0.00
5.2.5.7. Anomalies

No anomalies were detected during the course of this test.

5.2.5.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

5.3. Rationale for decisions

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

5.4. Conclusions and recommendations

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-24_07-58-00/vswitchperf_logs_2018-01-24_07-58-00.tar.gz.

5.5. General

5.5.1. Glossary

  • NFV - Network Function Virtualization
  • Mbps - 1,000,000bps

5.5.2. Document change procedures and history

Document ID Author Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT Christopher Nolan 23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT Christopher Nolan 28/01/2015

6. Performance report for none

6.1. Introduction

The objective of the OPNFV project titled “Characterise vSwitch Performance for Telco NFV Use Cases”, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. As well as this, the project aims to identify any gaps or bottlenecks in order to drive architectural changes to improve virtual switch performance and determinism. The purpose of this document is to summarize the results of the tests carried out on the virtual switch in the Network Function Virtualization Infrastructure (NFVI) and, from these results, provide evaluations and recommendations for the virtual switch. Test results will be outlined in details-of-LTR, preceded by the document-identifier and the scope and references).

This document is currently in draft form.

6.1.1. Document identifier

The document id will be used to uniquely identify versions of the LTR. The format for the document id will be: OPNFV_vswitchperf_LTR_rel_STATUS, the status is one of: DRAFT, REVIEWED, CORRECTED or FINAL. The document id for this version of the LTR is: OPNFV_vswitchperf_LTR_Brahmaputra_DRAFT.

6.1.2. Scope

The scope of this report is to detail the results of the tests that have been performed on the virtual switch. This report will also evaluate the results of these tests and, based on these evaluations, provide recommendations on the suitability of the virtual switch for use in a Telco NFV environment.

6.2. Details of the Level Test Report

This section provides a test-results-overview. Also included are the rationale and the conclusions.

6.2.1. Test ID: PVP_TPUT

6.2.1.1. Test Environment

Below is the environment that the test was performed in:

  • OS: CentOS Linux 7 Core

  • Kernel Version: 4.4.112-1.el7.elrepo.x86_64

  • NIC(s):
    • Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
    • Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)

  • Board: Intel Corporation S2600WT2R [2 sockets]

  • CPU: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz

  • CPU cores: 88

  • Memory: 65917716 kB

  • Virtual Switch Set-up: pvp

  • vswitchperf: GIT tag: 52c154c463705b51c54d639026093ecd80c9a6b4

  • Traffic Generator: IxNet, Version: 8.01.1029.6, GIT tag: None

  • vSwitch: none, Version: None, GIT tag: None

  • VNF: QemuPciPassthrough, Version: 2.9.1, GIT tag: 4cd42653f5c1df326a2678a84f24a78fb9601277

  • VM images:
    • /home/jenkins/vloop-vnf-ubuntu-14.04_20160823.qcow2
  • VM loopback apps:
    • testpmd, Version: 17.08.0, GIT tag: 02657b4adcb8af773e26ec061b01cd7abdd3f0b6

Below are test details:

  • Test ID: pvp_tput
  • Description: LTD.Throughput.RFC2544.PacketLossRatio
  • Deployment: pvp
  • Traffic type: rfc2544_throughput
  • Bidirectional : True
6.2.1.2. Test results for packet size: 64

A detailed summary of the main results is outlined below.

6.2.1.2.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 5822178.070
tx_rate_mbps Unknown
throughput_rx_mbps 2980.955
tx_rate_percent 19.563
throughput_rx_percent 19.563
frame_loss_percent 0.000
min_latency_ns 3500.000
max_latency_ns 28960.000
avg_latency_ns 3849.000
type rfc2544_throughput
packet_size 64
vswitch none
traffic_type udp
test_execution_time 00:50:28
start_time 2018-01-24 16:31:23
stop_time 2018-01-24 17:21:51
guest_loopback_app testpmd
6.2.1.2.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic Value
UID 0
PID 133880
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2829500
RSS 76416
%MEM 0.12
kB_rd/s 0.00
kB_wr/s 7.31
kB_ccwr/s 0.00
6.2.1.3. Test results for packet size: 128

A detailed summary of the main results is outlined below.

6.2.1.3.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 7093279.442
tx_rate_mbps Unknown
throughput_rx_mbps 7263.518
tx_rate_percent 41.992
throughput_rx_percent 41.992
frame_loss_percent 0.000
min_latency_ns 3720.000
max_latency_ns 30180.000
avg_latency_ns 4124.000
type rfc2544_throughput
packet_size 128
vswitch none
traffic_type udp
test_execution_time 00:50:28
start_time 2018-01-24 16:31:23
stop_time 2018-01-24 17:21:51
guest_loopback_app testpmd
6.2.1.3.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic Value
UID 0
PID 133880
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2829500
RSS 76416
%MEM 0.12
kB_rd/s 0.00
kB_wr/s 7.31
kB_ccwr/s 0.00
6.2.1.4. Test results for packet size: 512

A detailed summary of the main results is outlined below.

6.2.1.4.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 4699182.563
tx_rate_mbps Unknown
throughput_rx_mbps 19247.852
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 5980.000
max_latency_ns 50440.000
avg_latency_ns 35994.000
type rfc2544_throughput
packet_size 512
vswitch none
traffic_type udp
test_execution_time 00:50:28
start_time 2018-01-24 16:31:23
stop_time 2018-01-24 17:21:51
guest_loopback_app testpmd
6.2.1.4.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic Value
UID 0
PID 133880
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2829500
RSS 76416
%MEM 0.12
kB_rd/s 0.00
kB_wr/s 7.31
kB_ccwr/s 0.00
6.2.1.5. Test results for packet size: 1024

A detailed summary of the main results is outlined below.

6.2.1.5.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 2394604.882
tx_rate_mbps Unknown
throughput_rx_mbps 19616.603
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 6780.000
max_latency_ns 46600.000
avg_latency_ns 33750.000
type rfc2544_throughput
packet_size 1024
vswitch none
traffic_type udp
test_execution_time 00:50:28
start_time 2018-01-24 16:31:23
stop_time 2018-01-24 17:21:51
guest_loopback_app testpmd
6.2.1.5.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic Value
UID 0
PID 133880
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2829500
RSS 76416
%MEM 0.12
kB_rd/s 0.00
kB_wr/s 7.31
kB_ccwr/s 0.00
6.2.1.6. Test results for packet size: 1518

A detailed summary of the main results is outlined below.

6.2.1.6.1. Results/Metrics Collected

The following are the metrics obtained during this test:

Metric Result
tx_rate_fps Unknown
throughput_rx_fps 1625463.043
tx_rate_mbps Unknown
throughput_rx_mbps 19739.623
tx_rate_percent 100
throughput_rx_percent 100
frame_loss_percent 0.000
min_latency_ns 6920.000
max_latency_ns 61120.000
avg_latency_ns 40785.000
type rfc2544_throughput
packet_size 1518
vswitch none
traffic_type udp
test_execution_time 00:50:28
start_time 2018-01-24 16:31:23
stop_time 2018-01-24 17:21:51
guest_loopback_app testpmd
6.2.1.6.2. Statistics collected

The following system statistics were collected during testcase execution:

Process: qemu-system-x86
Statistic Value
UID 0
PID 133880
%usr 0.02
%system 0.02
%guest 100.00
%CPU 100.00
CPU
minflt/s 0.00
majflt/s 0.00
VSZ 2829500
RSS 76416
%MEM 0.12
kB_rd/s 0.00
kB_wr/s 7.31
kB_ccwr/s 0.00
6.2.1.7. Anomalies

No anomalies were detected during the course of this test.

6.2.1.8. Testing Activities/Events

pidstat is used to collect the process statistics, as such some values such as %CPU and %USER maybe > 100% as the values are summed across multiple cores. For more info on pidstat please see: http://linux.die.net/man/1/pidstat.

Known issues: Some reported metrics have the value “unkown”. These values are marked unknown as they are not values retrieved from the external tester (traffic generator). They were incorrectly derived in a way that made assumptions about packet sizes, as such they have been deprecated from vsperf and marked as unknown. They will be resolved in the next release.

6.3. Rationale for decisions

The tests conducted do not have pass/fail/conditional-pass criteria. The test is simply conducted and the results are reported.

6.4. Conclusions and recommendations

The test results are stable. The vsperf CI jobs that were used to obtain the results can be found at https://artifacts.opnfv.org/logs/vswitchperf/intel-pod12/2018-01-24_07-58-00/vswitchperf_logs_2018-01-24_07-58-00.tar.gz.

6.5. General

6.5.1. Glossary

  • NFV - Network Function Virtualization
  • Mbps - 1,000,000bps

6.5.2. Document change procedures and history

Document ID Author Date Modified
OPNFV_vswitchperf_LTR_ver_1.0_Jan_15_CN_DRAFT Christopher Nolan 23/01/2015
OPNFV_vswitchperf_LTR_ver_1.1_Jan_15_CN_DRAFT Christopher Nolan 28/01/2015