Benchmarking Methodology for SDN Controller Performance
draft-ietf-bmwg-sdn-controller-benchmark-meth-00

The information below is for an old version of the document
Document Type Active Internet-Draft (bmwg WG)
Last updated 2015-11-04 (latest revision 2015-10-18)
Replaces draft-bhuvan-bmwg-sdn-controller-benchmark-meth
Stream IETF
Intended RFC status Informational
Formats plain text pdf html bibtex
Reviews
Stream WG state WG Document
Document shepherd No shepherd assigned
IESG IESG state I-D Exists
Consensus Boilerplate Unknown
Telechat date
Responsible AD (None)
Send notices to (None)
Internet-Draft                               Bhuvaneswaran Vengainathan 
Network Working Group                                       Anton Basil 
Intended Status: Informational                       Veryx Technologies 
Expires: April 18, 2016                                  Mark Tassinari 
                                                        Hewlett-Packard 
                                                         Vishwas Manral 
                                                             Ionos Corp 
                                                            Sarah Banks 
                                                         VSS Monitoring 
                                                       October 19, 2015 
 
                                      
          Benchmarking Methodology for SDN Controller Performance 
              draft-ietf-bmwg-sdn-controller-benchmark-meth-00 

Abstract 

   This document defines the methodologies for benchmarking performance 
   of SDN controllers. Terminology related to benchmarking SDN 
   controllers is described in the companion terminology document. SDN 
   controllers have been implemented with many varying designs in order 
   to achieve their intended network functionality. Hence, the authors 
   have taken the approach of considering an SDN controller as a black 
   box, defining the methodology in a manner that is agnostic to 
   protocols and network services supported by controllers. The intent 
   of this document is to provide a standard mechanism to measure the 
   performance of all controller implementations. 

Status of this Memo 

   This Internet-Draft is submitted in full conformance with the 
   provisions of BCP 78 and BCP 79.  

   Internet-Drafts are working documents of the Internet Engineering 
   Task Force (IETF). Note that other groups may also distribute 
   working documents as Internet-Drafts. The list of current Internet-
   Drafts is at http://datatracker.ietf.org/drafts/current. 

   Internet-Drafts are draft documents valid for a maximum of six 
   months and may be updated, replaced, or obsoleted by other documents 
   at any time. It is inappropriate to use Internet-Drafts as reference 
   material or to cite them other than as "work in progress. 

   This Internet-Draft will expire on April 18, 2016. 

 
 
 
Bhuvan, et al.         Expires April 18, 2016                 [Page 1] 


Internet-Draft SDN Controller Benchmarking Methodology     October 2015 
    

Copyright Notice 

   Copyright (c) 2015 IETF Trust and the persons identified as the 
   document authors. All rights reserved. 

   This document is subject to BCP 78 and the IETF Trust's Legal 
   Provisions Relating to IETF Documents 
   (http://trustee.ietf.org/license-info) in effect on the date of 
   publication of this document. Please review these documents 
   carefully, as they describe your rights and restrictions with 
   respect to this document. Code Components extracted from this 
   document must include Simplified BSD License text as described in 
   Section 4.e of the Trust Legal Provisions and are provided without 
   warranty as described in the Simplified BSD License. 

Table of Contents 

    
   1. Introduction ................................................ 3 
   2. Scope ....................................................... 4 
   3. Test Setup .................................................. 4 
      3.1. Test setup - Controller working in Standalone Mode ..... 4 
      3.2. Test setup - Controller working in Cluster Mode ........ 5 
   4. Test Considerations ......................................... 6 
      4.1. Network Topology ....................................... 6 
      4.2. Test Traffic ........................................... 7 
      4.3. Connection Setup ....................................... 7 
      4.4. Measurement Point Specification and Recommendation ..... 7 
      4.5. Connectivity Recommendation ............................ 8 
      4.6. Test Repeatability ..................................... 8 
   5. Benchmarking Tests .......................................... 9 
      5.1. Performance ............................................ 9 
         5.1.1. Network Topology Discovery Time ................... 9 
         5.1.2. Asynchronous Message Processing Time ............. 10 
         5.1.3. Asynchronous Message Processing Rate ............. 11 
         5.1.4. Reactive Path Provisioning Time .................. 13 
         5.1.5. Proactive Path Provisioning Time ................. 14 
         5.1.6. Reactive Path Provisioning Rate .................. 16 
         5.1.7. Proactive Path Provisioning Rate ................. 17 
         5.1.8. Network Topology Change Detection Time ........... 18 
      5.2. 6.2 Scalability........................................ 20 
         5.2.1. Control Session Capacity ......................... 20 
         5.2.2. Network Discovery Size ........................... 20 
         5.2.3. 6.2.3 Forwarding Table Capacity .................. 21 
Show full document text