Methodology for Benchmarking Session Initiation Protocol (SIP) Devices: Basic Session Setup and Registration
RFC 7502

• Status
• IESG evaluation record
• IESG writeups
• Email expansions
• History

• Versions
• 03
• 04
• 05
• 06
• 07
• 08
• 09
• 10
• 11
• 12

Internet Engineering Task Force (IETF)                         C. Davids
Request for Comments: 7502              Illinois Institute of Technology
Category: Informational                                       V. Gurbani
ISSN: 2070-1721                        Bell Laboratories, Alcatel-Lucent
                                                             S. Poretsky
                                                    Allot Communications
                                                              April 2015

Methodology for Benchmarking Session Initiation Protocol (SIP) Devices:
                  Basic Session Setup and Registration

Abstract

   This document provides a methodology for benchmarking the Session
   Initiation Protocol (SIP) performance of devices.  Terminology
   related to benchmarking SIP devices is described in the companion
   terminology document (RFC 7501).  Using these two documents,
   benchmarks can be obtained and compared for different types of
   devices such as SIP Proxy Servers, Registrars, and Session Border
   Controllers.  The term "performance" in this context means the
   capacity of the Device Under Test (DUT) to process SIP messages.
   Media streams are used only to study how they impact the signaling
   behavior.  The intent of the two documents is to provide a normalized
   set of tests that will enable an objective comparison of the capacity
   of SIP devices.  Test setup parameters and a methodology are
   necessary because SIP allows a wide range of configurations and
   operational conditions that can influence performance benchmark
   measurements.

Status of This Memo

   This document is not an Internet Standards Track specification; it is
   published for informational purposes.

   This document is a product of the Internet Engineering Task Force
   (IETF).  It represents the consensus of the IETF community.  It has
   received public review and has been approved for publication by the
   Internet Engineering Steering Group (IESG).  Not all documents
   approved by the IESG are a candidate for any level of Internet
   Standard; see Section 2 of RFC 5741.

   Information about the current status of this document, any errata,
   and how to provide feedback on it may be obtained at
   http://www.rfc-editor.org/info/rfc7502.

Davids, et al.                Informational                     [Page 1]
RFC 7502              SIP Benchmarking Methodology            April 2015

Copyright Notice

   Copyright (c) 2015 IETF Trust and the persons identified as the
   document authors.  All rights reserved.

   This document is subject to BCP 78 and the IETF Trust's Legal
   Provisions Relating to IETF Documents
   (http://trustee.ietf.org/license-info) in effect on the date of
   publication of this document.  Please review these documents
   carefully, as they describe your rights and restrictions with respect
   to this document.  Code Components extracted from this document must
   include Simplified BSD License text as described in Section 4.e of
   the Trust Legal Provisions and are provided without warranty as
   described in the Simplified BSD License.

Davids, et al.                Informational                     [Page 2]
RFC 7502              SIP Benchmarking Methodology            April 2015

Table of Contents

   1.  Introduction  . . . . . . . . . . . . . . . . . . . . . . . .   4
   2.  Terminology . . . . . . . . . . . . . . . . . . . . . . . . .   5
   3.  Benchmarking Topologies . . . . . . . . . . . . . . . . . . .   5
   4.  Test Setup Parameters . . . . . . . . . . . . . . . . . . . .   7
     4.1.  Selection of SIP Transport Protocol . . . . . . . . . . .   7
     4.2.  Connection-Oriented Transport Management  . . . . . . . .   7
     4.3.  Signaling Server  . . . . . . . . . . . . . . . . . . . .   7
     4.4.  Associated Media  . . . . . . . . . . . . . . . . . . . .   8
     4.5.  Selection of Associated Media Protocol  . . . . . . . . .   8
     4.6.  Number of Associated Media Streams per SIP Session  . . .   8
     4.7.  Codec Type  . . . . . . . . . . . . . . . . . . . . . . .   8
     4.8.  Session Duration  . . . . . . . . . . . . . . . . . . . .   8
     4.9.  Attempted Sessions per Second (sps) . . . . . . . . . . .   8
     4.10. Benchmarking Algorithm  . . . . . . . . . . . . . . . . .   9
   5.  Reporting Format  . . . . . . . . . . . . . . . . . . . . . .  11
     5.1.  Test Setup Report . . . . . . . . . . . . . . . . . . . .  11
     5.2.  Device Benchmarks for Session Setup . . . . . . . . . . .  12
     5.3.  Device Benchmarks for Registrations . . . . . . . . . . .  12
   6.  Test Cases  . . . . . . . . . . . . . . . . . . . . . . . . .  13
     6.1.  Baseline Session Establishment Rate of the Testbed  . . .  13
     6.2.  Session Establishment Rate without Media  . . . . . . . .  13
     6.3.  Session Establishment Rate with Media Not on DUT  . . . .  13
     6.4.  Session Establishment Rate with Media on DUT  . . . . . .  14