Network Working Group S. Shalunov
Internet-Draft Internet2
Expires: October 13, 2006 April 11, 2006
Reporting IP Performance Metrics to Users
draft-shalunov-ippm-reporting-01.txt
Status of this Memo
By submitting this Internet-Draft, each author represents that any
applicable patent or other IPR claims of which he or she is aware
have been or will be disclosed, and any of which he or she becomes
aware will be disclosed, in accordance with Section 6 of BCP 79.
Internet-Drafts are working documents of the Internet Engineering
Task Force (IETF), its areas, and its working groups. Note that
other groups may also distribute working documents as Internet-
Drafts.
Internet-Drafts are draft documents valid for a maximum of six months
and may be updated, replaced, or obsoleted by other documents at any
time. It is inappropriate to use Internet-Drafts as reference
material or to cite them other than as "work in progress."
The list of current Internet-Drafts can be accessed at
http://www.ietf.org/ietf/1id-abstracts.txt.
The list of Internet-Draft Shadow Directories can be accessed at
http://www.ietf.org/shadow.html.
This Internet-Draft will expire on October 13, 2006.
Copyright Notice
Copyright (C) The Internet Society (2006).
Abstract
The aim of this document is to define a small set of metrics that are
robust, easy to understand, orthogonal, relevant, and easy to
compute. The IPPM WG has defined a large number of richly
parameterized metrics because network measurement has many purposes.
Often, the ultimate purpose is to report a concise set of metrics
describing a network's state to an end user. It is for this purpose
that the present set of metrics is defined.
Shalunov Expires October 13, 2006 [Page 1]
Internet-Draft Reporting IP Performance Metrics to Users April 2006
Table of Contents
1. Requirements Notation . . . . . . . . . . . . . . . . . . . . 3
2. Goals and Motivation . . . . . . . . . . . . . . . . . . . . . 4
3. Reportable Metrics Set . . . . . . . . . . . . . . . . . . . . 5
3.1. Delay . . . . . . . . . . . . . . . . . . . . . . . . . . 5
3.2. Loss . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
3.3. Jitter . . . . . . . . . . . . . . . . . . . . . . . . . . 5
3.4. Duplication . . . . . . . . . . . . . . . . . . . . . . . 6
3.5. Reordering . . . . . . . . . . . . . . . . . . . . . . . . 6
4. Security Considerations . . . . . . . . . . . . . . . . . . . 7
5. Internationalization Considerations . . . . . . . . . . . . . 8
6. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 9
7. Normative References . . . . . . . . . . . . . . . . . . . . . 9
Appendix A. Acknowledgments . . . . . . . . . . . . . . . . . . . 10
Appendix B. TODO . . . . . . . . . . . . . . . . . . . . . . . . 11
Appendix C. Revision History . . . . . . . . . . . . . . . . . . 12
Author's Address . . . . . . . . . . . . . . . . . . . . . . . . . 13
Intellectual Property and Copyright Statements . . . . . . . . . . 14
Shalunov Expires October 13, 2006 [Page 2]
Internet-Draft Reporting IP Performance Metrics to Users April 2006
1. Requirements Notation
The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT",
"SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this
document are to be interpreted as described in [RFC2119].
Shalunov Expires October 13, 2006 [Page 3]
Internet-Draft Reporting IP Performance Metrics to Users April 2006
2. Goals and Motivation
The IPPM working group has defined many richly parameterized
performance metrics with a number of variants (one-way delay, one-way
loss, delay variation, reordering, etc.) and a protocol for obtaining
the measurement data needed to compute these metrics (OWAMP). It
would be beneficial to define a standard way to report a set of
performance metrics to end users. Parameterization might be
acceptable in such a set, but there must still be defaults for
everything. It is especially important to get these defaults right.
Such a set would enable different tools to produce results that can
be compared against each other.
The set is meant for human consumption. It must therefore be small.
Anything greater than half-dozen numbers is certainly too confusing.
Each of the metrics must be statistically robust. Intuitively, this
means that having a small number of bad data points and a small
amount of noise must not dramatically change the metric.
Each metric in the set must have, qualitatively, an immediate
intuitive meaning that has to be obvious for an advanced end user
without consulting documentation (that is, it has to be clear what
rough meaning, intuitively, the larger values of a given metric
have).
To be small, the set has to be orthogonal: each of the metrics has to
express a property not covered by other metrics (otherwise, there's
redundancy).
The metrics in the set must be relevant. Partly, being easy to
understand will help achieve this, but additional constraint may be
placed by relevancy.
Finally, while this set will most frequently be computed for small
data sets, where efficiency is not a serious consideration, it must
be possible to compute for large data sets, too. In particular, it
must be possible to compute the metrics in a single pass over the
data using a limited amount of memory (i.e., it must be possible to
take a source of measurement data with a high data rate and compute
the metrics on the fly, discarding each data point after it is
processed).
Shalunov Expires October 13, 2006 [Page 4]
Internet-Draft Reporting IP Performance Metrics to Users April 2006
3. Reportable Metrics Set
The following metrics comprise the set:
1. delay;
2. loss;
3. jitter;
4. duplication;
5. reordering.
Each of the above is represented by a single numeric quantity,
computed as described below.
3.1. Delay
The reported delay is the median of all delays in the sample. When a
packet is lost, its delay is to be considered +infinity for the
purposes of this computation; therefore, if more than half of all
packets are lost, the delay is +infinity.
FIXME: References.
3.2. Loss
Loss is the fraction, expressed in per cent, of packets that did not
arrive intact within a given number of seconds (timeout value) after
being sent. Since this set of metrics often has to be reported to a
waiting human user, the default timeout value has to be small. By
default, 2 seconds MUST be the timeout value.
FIXME: References.
3.3. Jitter
Jitter is the interquartile spread of delay. In other words, jitter
is equal to the difference of the 75th and 25th percentiles of delay.
When both percentiles are +infinity, the value of jitter is
undefined. Therefore, if less than 25% of packets are lost, jitter
is defined and finite; if between 75% and 25% of packets are lost,
jitter is +infinity; finally, if more than 75% of packets are lost,
jitter is undefined.
FIXME: References.
Shalunov Expires October 13, 2006 [Page 5]
Internet-Draft Reporting IP Performance Metrics to Users April 2006
3.4. Duplication
Duplication is the fraction of packets for which more than a single
copy of the packet was received within the timeout period, expressed
in percentage points.
Note: while most received packets can be ones previously seen,
duplication can never exceed 100%.
FIXME: References (tough one---IPPM hasn't defined duplication).
3.5. Reordering
Reordering is the fraction of sent packets for which the sequence
number of the packet received immediately before the first copy of
the given packet is not the decrement of the sequence number of the
given packet. For the purposes of determining the sequence number of
the preceding packet in this definition, assuming sequence numbers
starting with 1, an extra packet at the start of the stream of
received packets, with a sequence number of 0, is considered to be
present (this extra packet, of course, is not counted for the
purposes of computing the fraction).
FIXME: References.
Shalunov Expires October 13, 2006 [Page 6]
Internet-Draft Reporting IP Performance Metrics to Users April 2006
4. Security Considerations
The reporting per se, not being a protocol, does not raise security
considerations.
An aspect of reporting relevant to security is how the reported
metrics are used and how they are collected. If it is important that
the metrics satisfy certain conditions (e.g., that the ISP whose
network is being measured be unable to make the metrics appear better
than they are), the collection mechanism MUST ensure that this is,
indeed, so. The exact mechanisms to do so our outside of scope of
this document and belong with discussion of particular measurement
data collection protocols.
Shalunov Expires October 13, 2006 [Page 7]
Internet-Draft Reporting IP Performance Metrics to Users April 2006
5. Internationalization Considerations
The reported metrics, while they might occasionally be parsed by
machine, are primarily meant for human consumption. As such, they
MAY be reported in the language preferred by the user, using an
encoding suitable for the purpose, such as UTF-8.
Shalunov Expires October 13, 2006 [Page 8]
Internet-Draft Reporting IP Performance Metrics to Users April 2006
6. IANA Considerations
This document requires no action from the IANA.
7. Normative References
[RFC2119] Bradner, S., "Key words for use in RFCs to Indicate
Requirement Levels", BCP 14, RFC 2119, March 1997.
Shalunov Expires October 13, 2006 [Page 9]
Internet-Draft Reporting IP Performance Metrics to Users April 2006
Appendix A. Acknowledgments
The author gratefully acknowledges discussion with, encouragement
from, and contributions of Lawrence D. Dunn, Matt Mathis,
Henk Uijterwaal, and Matthew J. Zekauskas.
Shalunov Expires October 13, 2006 [Page 10]
Internet-Draft Reporting IP Performance Metrics to Users April 2006
Appendix B. TODO
FIXME: This section needs to be removed before publication.
Describe default sending schedule for active measurements
Add references
Add non-normative code for illustration
Add examples (code output)
Shalunov Expires October 13, 2006 [Page 11]
Internet-Draft Reporting IP Performance Metrics to Users April 2006
Appendix C. Revision History
FIXME: This section needs to be removed before publication.
$Log: draft-shalunov-ippm-reporting.xml,v $
Revision 1.3 2006/04/11 22:09:47 shalunov
Version 01: Wording changes based on discussion with Matt Zekauskas
(reordering, loss). Rewrite abstract a bit. Add TODO list.
Revision 1.2 2006/04/04 21:39:20 shalunov
Convert to xml2rfc 1.30 and RFC 3978 IPR statement.
Revision 1.1.1.1 2006/04/02 17:07:36 shalunov
Initial import into CVS.
Shalunov Expires October 13, 2006 [Page 12]
Internet-Draft Reporting IP Performance Metrics to Users April 2006
Author's Address
Stanislav Shalunov
Internet2
1000 Oakbrook Drive, Suite 300
Ann Arbor, MI 48104
US
Phone: +1-734-913-4260
Email: shalunov@internet2.edu
URI: http://www.internet2.edu/~shalunov/
Shalunov Expires October 13, 2006 [Page 13]
Internet-Draft Reporting IP Performance Metrics to Users April 2006
Intellectual Property Statement
The IETF takes no position regarding the validity or scope of any
Intellectual Property Rights or other rights that might be claimed to
pertain to the implementation or use of the technology described in
this document or the extent to which any license under such rights
might or might not be available; nor does it represent that it has
made any independent effort to identify any such rights. Information
on the procedures with respect to rights in RFC documents can be
found in BCP 78 and BCP 79.
Copies of IPR disclosures made to the IETF Secretariat and any
assurances of licenses to be made available, or the result of an
attempt made to obtain a general license or permission for the use of
such proprietary rights by implementers or users of this
specification can be obtained from the IETF on-line IPR repository at
http://www.ietf.org/ipr.
The IETF invites any interested party to bring to its attention any
copyrights, patents or patent applications, or other proprietary
rights that may cover technology that may be required to implement
this standard. Please address the information to the IETF at
ietf-ipr@ietf.org.
Disclaimer of Validity
This document and the information contained herein are provided on an
"AS IS" basis and THE CONTRIBUTOR, THE ORGANIZATION HE/SHE REPRESENTS
OR IS SPONSORED BY (IF ANY), THE INTERNET SOCIETY AND THE INTERNET
ENGINEERING TASK FORCE DISCLAIM ALL WARRANTIES, EXPRESS OR IMPLIED,
INCLUDING BUT NOT LIMITED TO ANY WARRANTY THAT THE USE OF THE
INFORMATION HEREIN WILL NOT INFRINGE ANY RIGHTS OR ANY IMPLIED
WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE.
Copyright Statement
Copyright (C) The Internet Society (2006). This document is subject
to the rights, licenses and restrictions contained in BCP 78, and
except as set forth therein, the authors retain all their rights.
Acknowledgment
Funding for the RFC Editor function is currently provided by the
Internet Society.
Shalunov Expires October 13, 2006 [Page 14]