Benchmarking Methodology for Network Security Device Performance
draft-balarajah-bmwg-ngfw-performance-05

• Status
• IESG evaluation record
• IESG writeups
• Email expansions
• History

• Versions
• 00
• 01
• 02
• 03
• 04
• 05

Benchmarking Methodology Working Group                      B. Balarajah
Internet-Draft                                           C. Rossenhoevel
Intended status: Informational                                  EANTC AG
Expires: April 17, 2019                                 October 14, 2018

    Benchmarking Methodology for Network Security Device Performance
                draft-balarajah-bmwg-ngfw-performance-05

Abstract

   This document provides benchmarking terminology and methodology for
   next-generation network security devices including next-generation
   firewalls (NGFW), intrusion detection and prevention solutions (IDS/
   IPS) and unified threat management (UTM) implementations.  The
   document aims to strongly improve the applicability, reproducibility,
   and transparency of benchmarks and to align the test methodology with
   today's increasingly complex layer 7 application use cases.  The main
   areas covered in this document are test terminology, traffic profiles
   and benchmarking methodology for NGFWs to start with.

Status of This Memo

   This Internet-Draft is submitted in full conformance with the
   provisions of BCP 78 and BCP 79.

   Internet-Drafts are working documents of the Internet Engineering
   Task Force (IETF).  Note that other groups may also distribute
   working documents as Internet-Drafts.  The list of current Internet-
   Drafts is at https://datatracker.ietf.org/drafts/current/.

   Internet-Drafts are draft documents valid for a maximum of six months
   and may be updated, replaced, or obsoleted by other documents at any
   time.  It is inappropriate to use Internet-Drafts as reference
   material or to cite them other than as "work in progress."

   This Internet-Draft will expire on April 17, 2019.

Copyright Notice

   Copyright (c) 2018 IETF Trust and the persons identified as the
   document authors.  All rights reserved.

   This document is subject to BCP 78 and the IETF Trust's Legal
   Provisions Relating to IETF Documents
   (https://trustee.ietf.org/license-info) in effect on the date of
   publication of this document.  Please review these documents
   carefully, as they describe your rights and restrictions with respect

Balarajah & Rossenhoevel Expires April 17, 2019                 [Page 1]
Internet-Draft      Benchmarking for NGFW performance       October 2018

   to this document.  Code Components extracted from this document must
   include Simplified BSD License text as described in Section 4.e of
   the Trust Legal Provisions and are provided without warranty as
   described in the Simplified BSD License.

Table of Contents

   1.  Introduction  . . . . . . . . . . . . . . . . . . . . . . . .   3
   2.  Requirements  . . . . . . . . . . . . . . . . . . . . . . . .   4
   3.  Scope . . . . . . . . . . . . . . . . . . . . . . . . . . . .   4
   4.  Test Setup  . . . . . . . . . . . . . . . . . . . . . . . . .   4
     4.1.  Testbed Configuration . . . . . . . . . . . . . . . . . .   4
     4.2.  DUT/SUT Configuration . . . . . . . . . . . . . . . . . .   5
     4.3.  Test Equipment Configuration  . . . . . . . . . . . . . .   8
       4.3.1.  Client Configuration  . . . . . . . . . . . . . . . .   9
       4.3.2.  Backend Server Configuration  . . . . . . . . . . . .  10
       4.3.3.  Traffic Flow Definition . . . . . . . . . . . . . . .  11
       4.3.4.  Traffic Load Profile  . . . . . . . . . . . . . . . .  12
   5.  Test Bed Considerations . . . . . . . . . . . . . . . . . . .  13
   6.  Reporting . . . . . . . . . . . . . . . . . . . . . . . . . .  14
     6.1.  Key Performance Indicators  . . . . . . . . . . . . . . .  15
   7.  Benchmarking Tests  . . . . . . . . . . . . . . . . . . . . .  16
     7.1.  Throughput Performance With NetSecOPEN Traffic Mix  . . .  17
       7.1.1.  Objective . . . . . . . . . . . . . . . . . . . . . .  17
       7.1.2.  Test Setup  . . . . . . . . . . . . . . . . . . . . .  17
       7.1.3.  Test Parameters . . . . . . . . . . . . . . . . . . .  17
       7.1.4.  Test Procedures and expected Results  . . . . . . . .  19
     7.2.  TCP/HTTP Connections Per Second . . . . . . . . . . . . .  20
       7.2.1.  Objective . . . . . . . . . . . . . . . . . . . . . .  20
       7.2.2.  Test Setup  . . . . . . . . . . . . . . . . . . . . .  20
       7.2.3.  Test Parameters . . . . . . . . . . . . . . . . . . .  20
       7.2.4.  Test Procedures and Expected Results  . . . . . . . .  21
     7.3.  HTTP Transaction per Second . . . . . . . . . . . . . . .  23
       7.3.1.  Objective . . . . . . . . . . . . . . . . . . . . . .  23
       7.3.2.  Test Setup  . . . . . . . . . . . . . . . . . . . . .  23
       7.3.3.  Test Parameters . . . . . . . . . . . . . . . . . . .  23
       7.3.4.  Test Procedures and Expected Results  . . . . . . . .  24
     7.4.  TCP/HTTP Transaction Latency  . . . . . . . . . . . . . .  26
       7.4.1.  Objective . . . . . . . . . . . . . . . . . . . . . .  26
       7.4.2.  Test Setup  . . . . . . . . . . . . . . . . . . . . .  26