Internet Engineering Task Force (IETF) R. Geib, Ed.
Request for Comments: 6576 Deutsche Telekom
BCP: 176 A. Morton
Category: Best Current Practice AT&T Labs
ISSN: 2070-1721 R. Fardid
Cariden Technologies
A. Steinmitz
Deutsche Telekom
March 2012
IP Performance Metrics (IPPM) Standard Advancement Testing
Abstract
This document specifies tests to determine if multiple independent
instantiations of a performance-metric RFC have implemented the
specifications in the same way. This is the performance-metric
equivalent of interoperability, required to advance RFCs along the
Standards Track. Results from different implementations of metric
RFCs will be collected under the same underlying network conditions
and compared using statistical methods. The goal is an evaluation of
the metric RFC itself to determine whether its definitions are clear
and unambiguous to implementors and therefore a candidate for
advancement on the IETF Standards Track. This document is an
Internet Best Current Practice.
Status of This Memo
This memo documents an Internet Best Current Practice.
This document is a product of the Internet Engineering Task Force
(IETF). It represents the consensus of the IETF community. It has
received public review and has been approved for publication by the
Internet Engineering Steering Group (IESG). Further information on
BCPs is available in Section 2 of RFC 5741.
Information about the current status of this document, any errata,
and how to provide feedback on it may be obtained at
http://www.rfc-editor.org/info/rfc6576.
Geib, et al. Best Current Practice [Page 1]
RFC 6576 IPPM Standard Advancement Testing March 2012
Copyright Notice
Copyright (c) 2012 IETF Trust and the persons identified as the
document authors. All rights reserved.
This document is subject to BCP 78 and the IETF Trust's Legal
Provisions Relating to IETF Documents
(http://trustee.ietf.org/license-info) in effect on the date of
publication of this document. Please review these documents
carefully, as they describe your rights and restrictions with respect
to this document. Code Components extracted from this document must
include Simplified BSD License text as described in Section 4.e of
the Trust Legal Provisions and are provided without warranty as
described in the Simplified BSD License.
Table of Contents
1. Introduction ....................................................3
1.1. Requirements Language ......................................5
2. Basic Idea ......................................................5
3. Verification of Conformance to a Metric Specification ...........7
3.1. Tests of an Individual Implementation against a Metric
Specification ..............................................8
3.2. Test Setup Resulting in Identical Live Network
Testing Conditions .........................................9
3.3. Tests of Two or More Different Implementations
against a Metric Specification ............................15
3.4. Clock Synchronization .....................................16
3.5. Recommended Metric Verification Measurement Process .......17
3.6. Proposal to Determine an Equivalence Threshold for
Each Metric Evaluated .....................................20
4. Acknowledgements ...............................................21
5. Contributors ...................................................21
6. Security Considerations ........................................21
7. References .....................................................21
7.1. Normative References ......................................21
7.2. Informative References ....................................23
Appendix A. An Example on a One-Way Delay Metric Validation ......24
A.1. Compliance to Metric Specification Requirements ...........24
A.2. Examples Related to Statistical Tests for One-Way Delay ...25
Appendix B. Anderson-Darling K-sample Reference and 2 Sample
C++ Code .............................................27
Appendix C. Glossary .............................................36
Geib, et al. Best Current Practice [Page 2]
datatracker.ietf.org