VNF Benchmarking Methodology
draft-rosa-bmwg-vnfbench-01

Document Type Active Internet-Draft (individual)
Last updated 2018-03-03
Stream (None)
Intended RFC status (None)
Formats plain text xml pdf html bibtex
Stream Stream state (No stream defined)
Consensus Boilerplate Unknown
RFC Editor Note (None)
IESG IESG state I-D Exists
Telechat date
Responsible AD (None)
Send notices to (None)
BMWG                                                        R. Rosa, Ed.
Internet-Draft                                             C. Rothenberg
Intended status: Informational                                   UNICAMP
Expires: September 3, 2018                                 March 2, 2018

                      VNF Benchmarking Methodology
                      draft-rosa-bmwg-vnfbench-01

Abstract

   This document describes a common methodology for benchmarking
   Virtualized Network Functions (VNFs) in general-purpose hardware.
   Specific cases of benchmarking methodologies for particular VNFs can
   be derived from this document.  An open source reference
   implementation called Gym is reported as a running code embodiment of
   the proposed methodology for VNFs.

Status of This Memo

   This Internet-Draft is submitted in full conformance with the
   provisions of BCP 78 and BCP 79.

   Internet-Drafts are working documents of the Internet Engineering
   Task Force (IETF).  Note that other groups may also distribute
   working documents as Internet-Drafts.  The list of current Internet-
   Drafts is at https://datatracker.ietf.org/drafts/current/.

   Internet-Drafts are draft documents valid for a maximum of six months
   and may be updated, replaced, or obsoleted by other documents at any
   time.  It is inappropriate to use Internet-Drafts as reference
   material or to cite them other than as "work in progress."

   This Internet-Draft will expire on September 3, 2018.

Copyright Notice

   Copyright (c) 2018 IETF Trust and the persons identified as the
   document authors.  All rights reserved.

   This document is subject to BCP 78 and the IETF Trust's Legal
   Provisions Relating to IETF Documents
   (https://trustee.ietf.org/license-info) in effect on the date of
   publication of this document.  Please review these documents
   carefully, as they describe your rights and restrictions with respect
   to this document.  Code Components extracted from this document must
   include Simplified BSD License text as described in Section 4.e of

Rosa & Rothenberg       Expires September 3, 2018               [Page 1]
Internet-Draft                  VNFBench                      March 2018

   the Trust Legal Provisions and are provided without warranty as
   described in the Simplified BSD License.

Table of Contents

   1.  Introduction  . . . . . . . . . . . . . . . . . . . . . . . .   2
   2.  Terminology . . . . . . . . . . . . . . . . . . . . . . . . .   3
   3.  Scope . . . . . . . . . . . . . . . . . . . . . . . . . . . .   3
   4.  Considerations  . . . . . . . . . . . . . . . . . . . . . . .   4
   4.1.  VNF Testing Methods . . . . . . . . . . . . . . . . . . . .   4
   4.2.  Generic VNF Benchmarking Setup  . . . . . . . . . . . . . .   4
   4.3.  Deployment Scenarios  . . . . . . . . . . . . . . . . . . .   6
   4.4.  Influencing Aspects . . . . . . . . . . . . . . . . . . . .   7
   5.  Methodology . . . . . . . . . . . . . . . . . . . . . . . . .   8
   5.1.  General Description . . . . . . . . . . . . . . . . . . . .   8
   5.1.1.  Configurations  . . . . . . . . . . . . . . . . . . . . .   8
   5.1.2.  Testing Procedures  . . . . . . . . . . . . . . . . . . .   9
   5.2.  Particular Cases  . . . . . . . . . . . . . . . . . . . . .  10
   6.  VNF Benchmark Report  . . . . . . . . . . . . . . . . . . . .  11
   7.  Open Source Reference Implementation  . . . . . . . . . . . .  11
   8.  Security Considerations . . . . . . . . . . . . . . . . . . .  12
   9.  IANA Considerations . . . . . . . . . . . . . . . . . . . . .  12
   10. Acknowledgement . . . . . . . . . . . . . . . . . . . . . . .  12
   11. References  . . . . . . . . . . . . . . . . . . . . . . . . .  12
   11.1.  Normative References . . . . . . . . . . . . . . . . . . .  12
   11.2.  Informative References . . . . . . . . . . . . . . . . . .  13
   Authors' Addresses  . . . . . . . . . . . . . . . . . . . . . . .  13

1.  Introduction

   Benchmarking Methodology Working Group (BMWG) initiated efforts,
   approaching considerations in [RFC8172], to develop methodologies for
   benchmarking VNFs.  Similarly described in [RFC8172], VNF benchmark
   motivating aspects define: (i) pre-deployment infrastructure
   dimensioning to realize associated VNF performance profiles; (ii)
   comparison factor with physical network functions; (iii) and output
   results for analytical VNF development.

   Having no strict and clear execution boundaries, different from
   earlier self-contained black-box benchmarking methodologies described
   in BMWG, a VNF depends on underlying virtualized environment
   parameters [ETS14a], intrinsic considerations for analysis when
   addressing performance.  This document stands as a ground methodology
   guide for VNF benchmarking.  It addresses the state-of-the-art
   publications and the current developments in similar standardization
   efforts (e.g., [ETS14c] and [RFC8204]) towards bechmarking VNFs.
Show full document text