Benchmarking Methodology for Network Security Device Performance
draft-ietf-bmwg-ngfw-performance-06
Benchmarking Methodology Working Group B. Balarajah
Internet-Draft
Intended status: Informational C. Rossenhoevel
Expires: August 26, 2021 EANTC AG
B. Monkman
NetSecOPEN
February 22, 2021
Benchmarking Methodology for Network Security Device Performance
draft-ietf-bmwg-ngfw-performance-06
Abstract
This document provides benchmarking terminology and methodology for
next-generation network security devices including next-generation
firewalls (NGFW), next-generation intrusion detection and prevention
systems (NGIDS/NGIPS) and unified threat management (UTM)
implementations. This document aims to strongly improve the
applicability, reproducibility, and transparency of benchmarks and to
align the test methodology with today's increasingly complex layer 7
security centric network application use cases. The main areas
covered in this document are test terminology, test configuration
parameters, and benchmarking methodology for NGFW and NGIDS/NGIPS to
start with.
Status of This Memo
This Internet-Draft is submitted in full conformance with the
provisions of BCP 78 and BCP 79.
Internet-Drafts are working documents of the Internet Engineering
Task Force (IETF). Note that other groups may also distribute
working documents as Internet-Drafts. The list of current Internet-
Drafts is at https://datatracker.ietf.org/drafts/current/.
Internet-Drafts are draft documents valid for a maximum of six months
and may be updated, replaced, or obsoleted by other documents at any
time. It is inappropriate to use Internet-Drafts as reference
material or to cite them other than as "work in progress."
This Internet-Draft will expire on August 26, 2021.
Copyright Notice
Copyright (c) 2021 IETF Trust and the persons identified as the
document authors. All rights reserved.
Balarajah, et al. Expires August 26, 2021 [Page 1]
Internet-Draft Benchmarking Network Security Devices February 2021
This document is subject to BCP 78 and the IETF Trust's Legal
Provisions Relating to IETF Documents
(https://trustee.ietf.org/license-info) in effect on the date of
publication of this document. Please review these documents
carefully, as they describe your rights and restrictions with respect
to this document. Code Components extracted from this document must
include Simplified BSD License text as described in Section 4.e of
the Trust Legal Provisions and are provided without warranty as
described in the Simplified BSD License.
Table of Contents
1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 4
2. Requirements . . . . . . . . . . . . . . . . . . . . . . . . 4
3. Scope . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
4. Test Setup . . . . . . . . . . . . . . . . . . . . . . . . . 4
4.1. Test Bed Configuration . . . . . . . . . . . . . . . . . 4
4.2. DUT/SUT Configuration . . . . . . . . . . . . . . . . . . 6
4.2.1. Security Effectiveness Configuration . . . . . . . . 12
4.3. Test Equipment Configuration . . . . . . . . . . . . . . 12
4.3.1. Client Configuration . . . . . . . . . . . . . . . . 12
4.3.2. Backend Server Configuration . . . . . . . . . . . . 15
4.3.3. Traffic Flow Definition . . . . . . . . . . . . . . . 16
4.3.4. Traffic Load Profile . . . . . . . . . . . . . . . . 17
5. Test Bed Considerations . . . . . . . . . . . . . . . . . . . 17
6. Reporting . . . . . . . . . . . . . . . . . . . . . . . . . . 18
6.1. Introduction . . . . . . . . . . . . . . . . . . . . . . 18
6.2. Detailed Test Results . . . . . . . . . . . . . . . . . . 20
6.3. Benchmarks and Key Performance Indicators . . . . . . . . 20
7. Benchmarking Tests . . . . . . . . . . . . . . . . . . . . . 22
7.1. Throughput Performance with Application Traffic Mix . . . 22
7.1.1. Objective . . . . . . . . . . . . . . . . . . . . . . 22
7.1.2. Test Setup . . . . . . . . . . . . . . . . . . . . . 22
7.1.3. Test Parameters . . . . . . . . . . . . . . . . . . . 22
7.1.4. Test Procedures and Expected Results . . . . . . . . 24
7.2. TCP/HTTP Connections Per Second . . . . . . . . . . . . . 25
7.2.1. Objective . . . . . . . . . . . . . . . . . . . . . . 25
7.2.2. Test Setup . . . . . . . . . . . . . . . . . . . . . 25
7.2.3. Test Parameters . . . . . . . . . . . . . . . . . . . 25
7.2.4. Test Procedures and Expected Results . . . . . . . . 27
7.3. HTTP Throughput . . . . . . . . . . . . . . . . . . . . . 28
Show full document text