IPFIX Working Group EDITORS: Ganesh Sadasivan
Internet Draft Cisco Systems, Inc.
Expiration Date: December 2003 Nevil Brownlee
CAIDA | U Auckland
June 2003
Architecture Model for IP Flow Information Export
draft-ietf-ipfix-arch-01.txt
Status of this Memo
This document is an Internet-Draft and is in full conformance with
all provisions of Section 10 of RFC2026.
Internet-Drafts are working documents of the Internet Engineering
Task Force (IETF), its areas, and its working groups. Note that other
groups may also distribute working documents as Internet-Drafts.
Internet-Drafts are draft documents valid for a maximum of six months
and may be updated, replaced, or obsoleted by other documents at any
time. It is inappropriate to use Internet-Drafts as reference
material or to cite them other than as "work in progress."
The list of current Internet-Drafts can be accessed at
http://www.ietf.org/ietf/1id-abstracts.txt.
The list of Internet-Draft Shadow Directories can be accessed at
http://www.ietf.org/shadow.html.
Abstract
This memo defines the architecture for the export of measured IP flow
information out of an IPFIX device to a Collector, per the
requirements defined in [IPFIX-REQS].
Conventions used in this document
The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT",
"SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this
document are to be interpreted as described in RFC 2119.
Sadasivan & Brownlee [Page 1]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
Table of Contents
1 Introduction ........................................... 3
2 Scope .................................................. 3
3 Terminology ............................................ 3
4 IPFIX reference Model .................................. 7
5 IPFIX Functional and Logical blocks .................... 10
5.1 Metering Process Functions ............................. 10
5.1.1 Flow Classification .................................... 10
5.1.2 Selection Criteria for Packets ......................... 10
5.1.3 Function on properties that determines a flow type (Fi) ....11
5.1.4 Sampling packets on a flow type (Si) ................... 11
5.2 Observation Domain ..................................... 12
5.3 Flow Recording Process ................................. 12
5.4 Exporting Process ...................................... 12
5.5 IPFIX protocol ......................................... 13
6 Encoding Control Information ........................... 13
7 Encoding Flow Data Information ......................... 14
8 Exporting Control Information .......................... 14
9 Flow Expiration and Export ............................. 15
10 Export Error Handling .................................. 16
10.1 Selection Criteria of flows for export ................. 16
11 The Selected IPFIX Protocol ............................ 16
12 Collecting Process ..................................... 20
12.1 IPFIX Protocol on Collecting Process ................... 20
12.2 Support for Applications ............................... 20
12.3 Export Models .......................................... 21
12.3.1 Export Model with Reliable Control Connection .......... 21
12.4 Collector Crash Detection and Recovery ................. 21
12.4.1 Export Model with Reliable Control Connection .......... 22
12.5 Collector Redundancy ................................... 22
13 Security Consideration ................................. 22
13.1 Data security .......................................... 23
13.1.1 No security ............................................ 23
13.1.2 Authentication only .................................... 23
13.1.3 Encryption ............................................. 24
13.2 IPFIX end point authentication ......................... 24
13.3 Denial of service (DoS) attack prevention .............. 24
13.3.1 Network under attack ................................... 25
13.3.2 Generic DoS attack on the IPFIX system ................. 25
13.3.3 IPFIX Specific DoS attack .............................. 25
14 IANA Considerations .................................... 25
15 References ............................................. 26
16 Acknowledgements ....................................... 26
17 Author's Addresses ..................................... 27
18 Full Copyright Statement ............................... 27
Sadasivan & Brownlee [Page 2]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
1. Introduction
There are several applications e.g., Usage-based Accounting, Traffic
Profiling, Traffic engineering, Attack/Intrusion Detection, QoS
Monitoring, that require flow-based IP traffic measurements. It is
hence important to have a standard way of exporting information
related to IP flows. This document defines architecture for IP
traffic flow monitoring, measuring and exporting. It provides a
high-level description of the key components and their functions.
2. Scope
This document defines architecture for IPFIX. The main objective of
this document is to:
* Describe the key architectural components of IPFIX.
* Define the architectural requirements, e.g., Recovery, Security,
etc. for the IPFIX framework.
* Describe the characteristics of IPFIX protocol.
3. Terminology
* IP Traffic Flow or Flow:
A flow is defined as a set of IP packets passing an observation
point in a network during a certain time interval. All packets
that belong to a particular flow have a set of common properties
derived from the data contained in the packet and from the packet
treatment at the observation point.
In the context of IPFIX a flow is defined as follows:
A 'flow' is a set of IP packets, or encapsulated IP packets,
passing an observation point in the network during a certain time
interval. All packets belonging to a particular flow have a set
of common properties. Each property is defined as the result of
applying a function to the values of:
1. One or more header fields of the actual packet, e.g.
destination IP address, or one of the fields in the packet's
encapsulation header, e.g. label for MPLS, tunnel end-points
for IP-in-IP, etc.
2. One or more properties of the packet itself (e.g. packet
length)
Sadasivan & Brownlee [Page 3]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
3. One or more of fields derived from packet treatment (e.g. AS
number)
A packet is defined to belong to a flow if it satisfies all the
defined properties of the flow. Each of the fields from 1., 2.
and 3. mentioned above are referred to as flow keys. This
definition covers the range from a flow containing all packets
observed at a network interface to a flow consisting of just a
single packet between two applications with a specific sequence
number. Note that the flow definition does not necessarily match
a general application-level end-to-end stream. Some examples of
flows are listed below:
Example 1: To create flows, the different fields to distinguish
flows are defined. The different combination of the field values
creates unique flows. If the keys are defined as {source IP
address, destination IP address, TOS}, then all of these are
different flows.
1. {192.1.40.1, 171.6.23.5, 4}
2. {192.1.40.23, 171.6.23.67, 4}
3. {192.1.40.23, 171.6.23.67, 2}
4. {198.20.9.200, 171.6.23.67, 4}
Example 2: To create flows, a match function can be applied to
all the packets that pass through an observation point, in order
to aggregate some values. This could be done by defining the keys
as {source IP address, destination IP address, TOS} as in the
example 1, and applying the function which masks the least
significant 8 bits of the source IP address and destination IP
address (i.e. the result is a /24 address). The 4 flows from
example 1 would now be aggregated into 3 flows, by merging the
flows 1. and 2. into a single flow.
1. {192.1.40.0/24, 171.6.23.0/24, 4}
2. {192.1.40.0/24, 171.6.23.0/24, 2}
3. {198.20.9.0/24, 171.6.23.0/24, 4}
Example 3: To create flows, a filter defined by some field
values can be applied on all packets that pass the observation
point, in order to select only certain flows. The filter is
defined by choosing fixed values for specific fields from the
packet.
All the packets that go from a customer network 192.1.40.0/24 to
another customer network 171.6.23.0/24 with TOS value of 4 define
a flow. All other combinations don't define a flow and are not
taken into account. The 3 flows from example 2 would now be
Sadasivan & Brownlee [Page 4]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
reduced to 1 flow, by filtering away the second and the third
flow. {192.1.40.0/24, 171.6.23.0/24, 4}.
The above example can be thought of as a function F taking as
input {source IP address, destination IP address, TOS}. The
function selects only the packets which satisfy all the 3
conditions which are:
* mask out the least significant 8 bits of source IP address,
compare against 192.1.40.0.
* mask out the least significant 8 bits of destination IP
address, compare against 171.6.23.0.
* tos value equal to 4.
Depending on the values of {source IP address, destination IP
address, TOS} of the different observed packets, the metering
process function F would choose/filter/aggregate different sets
of packets, which would create different flows. In other words,
based on various combination of values of {source IP address,
destination IP address, TOS}, F(source IP address, destination IP
address, TOS) would result in the definition of one or more
flows. The function F is referred to as Flow Type.
* Flow Key:
Each of the fields which belong to
1. Packet header (e.g. destination IP address)
2. Property of the packet itself (e.g. packet length)
3. Derived from packet treatment (e.g. AS number)
which is used to define a flow is termed as flow key.
* Flow Type:
A function F which would take input as a set of flow keys and
produce as output one or more flows depending on the combination
of values for the set of flow keys.
* Flow Record:
A flow record contains information about a specific flow that was
metered at an observation point. A flow record contains measured
properties of the flow (e.g. the total number of bytes of all
packets of the flow) and usually characteristic properties of the
flow (e.g. source IP address).
* Exporting Process:
The exporting process sends flow records to one or more
collecting processes. The flow records are generated by one or
more metering processes.
Sadasivan & Brownlee [Page 5]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
* IPFIX Device:
A device hosting at least an observation point, a metering
process and an exporting process. Typically, corresponding
observation point(s), metering process(es) and exporting
process(es) are co-located at this device, for example at a
router.
* Collecting Process:
The collecting process receives flow records from one or more
exportring processes. The collecting process might process or
store received flow record, but such actions are out of the scope
of this document.
* Collector:
The device which hosts one or more collecting processes.
* Observation Point:
The observation point is a location in the network where IP
packets can be observed. Examples are, a line to which a probe is
attached, a shared medium, such as an Ethernet-based LAN, a
single port of a router, or a set of interfaces (physical or
logical) of a router.
* Metering Process:
The metering process generates flow records. Input to the process
are IP packets observed at an observation point. The metering
process consists of a set of functions that includes packet
header capturing, timestamping, sampling, classifying, and
maintaining flow records.
* Observation Domain:
The set of observation points which is the largest aggregatable
set of flow information at the IPFIX Device is termed an
observation domain. The observation domain presents a unique ID
to the collecting process for identifying the export packets
generated by it. One or more Observation Domains can interface
with the same exporting process. Example: The observation domain
could be a router line-card, composed of several interfaces with
each interface being an observation point.
* Flow Recording Process: The flows generated from the metering
device(s) in an Observation Domain MAY be collected into one or
more database before exporting. This functional block in addition
to maintaining the flow database(s) MAY do flow aggregation,
maintain the aggregate statistics etc. This block is optional
for an IPFIX device.
Sadasivan & Brownlee [Page 6]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
* Template:
Template is an ordered n-tuple (e.g. <type,length>, TLV), used to
completely identify the structure and semantics of a particular
information that needs to be communicated from the IPFIX Device
to the collector. Each template is uniquely identifiable by some
means (e.g. by using a Template ID).
* Control Information, Data Stream:
The information that needs to be exported from the IPFIX device
can be classified into the following categories:
- Control Information :
This includes the flow type definition, selection criteria
for packets within the flow send by the exporting process and
any IPFIX protocol messages (e.g. Keepalives). This stream
carries all the information for the end-points to understand
the IPFIX protocol and specifically for the receiver to
understand and interpret the data sent by the sender.
- Flow record :
This includes data records corresponding to the information
on various observed flows at each of the observation point.
A sequence of such records may also be described as a Data
Stream.
The definitions in this section are intended be identical with that
of the terminology used in [IPFIX-REQS] with additional terms
introduced to help in defining the architecture model.
4. IPFIX reference Model
The figure below shows the reference model for IPFIX. This figure
covers the various possible scenarios that can exist in an IPFIX
system.
Sadasivan & Brownlee [Page 7]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
+----------------+ +----------------+
|[*Application 1]| ..|[*Application n]|
+--------+-------+ +-------+--------+
^ ^
~ ~
+~~~~~~~~~~+~~~~~~~~+
!
v
+------------------------+ +--------------------------+
|IPFIX Device(1) | | Collector(1) |
|[Exporting Process(es)] |<----------->| [Collecting Process(es)] |
| | | |
+------------------------+ +--------------------------+
.... ....
+------------------------+ +---------------------------+
|IPFIX Device(i) | | Collector(j) |
|[Obsv Point(s)] |<---------->| [Collecting Process(es)] |
|[Metering Process(es)] | +---->| [*Application(s)] |
|[Exporting Process(es)] | | +---------------------------+
+------------------------+ .
.... . ....
+------------------------+ | +--------------------------+
|IPFIX Device(m) | | | Collector(n) |
|[Obsv Point(s)] |<-----+---->| [Collecting Process(es)] |
|[Metering Process(es)] | | [*Application(s)] |
|[Exporting Process(es)] | +--------------------------+
+------------------------+
The various functional components are indicated within []. The
functional components within [*] are not part of the IPFIX framework.
The interfaces shown by "<-->" are defined by the IPFIX framework and
those shown by "<~~>" are not.
The figure below shows a typical IPFIX device.
Sadasivan & Brownlee [Page 8]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
+---------------------------------------------------+
| IPFIX Device |
| +------------------------+ (*) +-----+ |
| | Flow Recording Process +----+---------> | |
| | | | | E | |
| +------------------------+ | | | |
| ^ ^ | | x | |
| |(*) |(*) | | | |
| +---......--+------------+ | p | |
| | | | | |
| +----+----+ +----+----+ | o | |
| |Metering | |Metering | | | |
| |Process 1| |Process N| | r | |
| |(Packet | |(Packet | | | |
| | Level) | | Level) | | t | |
| +---------+ +---------+ | | |
| ^ ^ | i | |
| +-------+-----------------------+-------+ | | |
| | | Observation Domain 1 | | | n | |
| | +-----+------+ +-----+------+| | | |
| | |Obsv Point 1| ... |Obsv Point M|| | g | |
| | +------------+ +------------+| | | |
In | +-------^-------------------------^-----+ | | |Export
-------+---------+----------.....----------+ | | |Packet to
Packets| | ------>
| ........ | | |
| +------------------------+ (*) | P | |collector(s)
| | Flow Recording Process +----+---------> | |
| | | | | r | |
| +------------------------+ | | | |
| ^ ^ | | o | |
| |(*) | (*) | | | |
| +---......--+------------+ | c | |
| | | | | |
| +----+----+ +----+----+ | e | |
| |Metering | |Metering | | | |
| |Process 1| |Process N| | s | |
| +---------+ +---------+ | | |
| ^ ^ | s | |
| +-------+-----------------------+-------+ | | |
| | | Observation Domain K | | | | |
| | +-----+------+ +-----+------+| | | |
| | |Obsv Point 1| ... |Obsv Point M|| | | |
| | +------------+ +------------+| | | |
In | +-------^-------------------------^-----+ +-----+ |
-------+---------+----------.....----------+ |
Packets| |
+---------------------------------------------------+
Sadasivan & Brownlee [Page 9]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
In the above figure the IPFIX components are shown in rectangular
boxes. The interface shown by (*) is applicable only if the optional
flow recording process is present. Otherwise the metering process(es)
at the packet level interface directly with the exporting function.
Note that in case of multiple observation domains, a unique ID per
observation domain must be transmitted as a parameters to the
exporting function. The exporting process includes IPFIX protocol and
underlying transport layer.
5. IPFIX Functional and Logical blocks
5.1. Metering Process Functions
Every observation point in an IPFIX device, partcipating in flow
measurements, MUST be associated with at least one metering process.
The packet coming into an observation point goes into each of the
metering processes associated with the observation point. Broadly,
each metering process extracts the packet headers that come into an
observation point, does timestamping and classifies the packet into
flow(s) based on the selection criteria.
5.1.1. Flow Classification
The collecting process MUST be able to map the flow record to the
corresponding property types defined by the flow type. In addition to
flow type, the collector when it receives the flow records, MAY need
the following to interpret the flow records further:
a. Observation Point
b. Selection Criteria for Packets
A flow record can be better analyzed if the Observation Point from
which it is measured is known. As such it is recommended that the
flow record carry the Observation Point information along with the
flow records when exported. In cases where there is a single
observation point or where the observation point information is not
relevant, the metering process MAY choose not to add this to the flow
records.
5.1.2. Selection Criteria for Packets
The measurement device MAY define rules so that only certain packets
within a flow can be chosen for measurement at an observation point.
This MAY be done by one of the two methods defined below or a
combination of them. A combination of each of these ways can be
Sadasivan & Brownlee [Page 10]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
adopted to select the packets, i.e. one can define a set of methods
{F1, S1, F2, S2, S3} executed in a certain sequence at an observation
point to collect flows of a particular type.
5.1.3. Function on properties that determines a flow type (Fi)
Packets that satisfy a function on the fields defined by the packet
header fields or fields obtained while doing the packet processing or
the properties of the packet itself.
Example: Mask/Match of the fields that define a filter. The filter
may be defined as {Protocol == TCP, Destination Port between 80 and
120}.
Multiple such filters could be used in any sequence to select
packets.
5.1.4. Sampling packets on a flow type (Si)
Packets that satisfy the sampling criteria for this flow type.
Example: Sample every 100th packet that was received at an
observation point and collect the flow information for a particular
flow type. choosing all the packets is a special case where sampling
rate is 1:1.
The figure below shows the operations which MAY be applied as part of
a typical metering process.
packet header capturing
|
timestamping
|
v
+----->+
| |
| sampling Si (1:1 in case of no sampling)
| |
| classifying Fi (NULL when No criteria)
| |
+------+
|
|
v
Flows
Sadasivan & Brownlee [Page 11]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
5.2. Observation Domain
The Observation Domain is a logical block that presents a single
identity for a group of Observation Points within an IPFIX device.
Each {Observation point, Metering Process} MUST belong to a single
Observation Domain. An IPFIX device could have multiple Observation
Domains each of which has a subset of the total set of Observation
Points in it. Each Observation Domain MUST carry an unique ID within
the context of an IPFIX device. One exporting process MAY serve
multiple Observation Domains. In such a case the exporting process
uses this unique ID to distinguish export packets among the different
Observation Domains. The same concept is used at the collecting
process also to identify packets from different Observation Domains
from the same IPFIX device.
5.3. Flow Recording Process
The Flow Recording Process is a functional block, which manages all
the flows generated from an Observation Domain. The typical
functions of a Flow Recording Process MAY include:
* Maintain database(s) of all the flows from an Observation Domain.
This includes creating new records, updating existing ones,
computing flow statistics, deriving further flow properties,
adding non-flow specific information (in some cases fields like
AS numbers, router state etc.)
* Maintain aggregate statistics like flows generated, flows
exported etc.
It is not mandatory that every IPFIX device use a Flow Recording
Process. Instead the flows generated by the metering process can be
directly sent to the exporting process.
5.4. Exporting Process
The Exporting Process is the functional block that includes one or
more instances of IPFIX protocol. On one side it interfaces with
metering process/flow recording process to get flow records and on
the other side, talks to a collecting processs on the collector(s).
Sadasivan & Brownlee [Page 12]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
5.5. IPFIX protocol
At the IPFIX device, the protocol functionality resides in the
exporting process. The IPFIX protocol gets flows from flow recording
process or directly from the metering process, and carries them to
the collector(s).
At a high level, the IPFIX protocol at an IPFIX device does the
following:
Maintain rules for :
1. Picking and sending control information and flow records.
2. Encoding control and flow record information based on the IPFIX
Information Model [IPFIX-IMODEL].
3. Flow expiration.
4. IPFIX device overload handling.
5. Selective export of flow records if any.
Functions :
1. Encode the selected control information into templates.
2. Encode the flows observed at the observation points into flow
records.
3. Packetize the selected templates and flow records into IPFIX
export packets.
4. Use the underlying transport layer to send the export packets to
the collector.
5. Handle export errors and timeouts.
6. Handle IPFIX device overload.
7. Apply selective export filters if any to the flow records.
For details on IPFIX protocol, refer to [IPFIX-PROTO].
6. Encoding Control Information
The following rules provide guidelines to be followed while encoding
the control information.
- Per-flow control information SHOULD be encoded such that it can
capture the structure and semantics of the corresponding flow
data for each of the flows exported by the IPFIX device.
- Configuration control information SHOULD be encoded such that it
can capture the structure and semantics of the corresponding
configuration data. The configuration data which is also control
information, SHOULD carry additional information on the boundary
within which the configuration takes effect. Forexample, sampling
Sadasivan & Brownlee [Page 13]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
using the same sampling algorithm, say 1 in 100 packets is
configured on 2 observation points O1 and O2. The configuration
in this case MAY be encoded as <ID, boundary (O1,O2), sampling
algorithm, interval (1 in 100)> where ID uniquely identifies this
configuration.
- There SHOULD be provisions to encode fixed length and variable
length fields
- Should we mention anything about the order in which fields are
encoded, i.e. network order/host order? [Nevil's suggestion: all
fields MUST be encoded in network byte order]
Add text here.
7. Encoding Flow Data Information
The following rules provide guidelines to be followed while encoding
the flow data information.
- A flow data record SHOULD contain enough information so that the
collecting process can identify the corresponding <Per-flow
control information, Configuration control information>.
Add text here.
8. Exporting Control Information
The Control Information is used by the collecting process to :
- Decode and interpret flow records.
- Understand the state of the exporting process.
As such sending control information from exporting process in a
timely and reliable manner is critical to the proper
functionality of the IPFIX collecting process. The following
approaches MAY be taken for the export of control information.
1. Send all the control information pertaining to flow records
prior to sending the flow records themselves. This includes
any incremental changes that happens to the definition of
the flow records.
2. Notify on a near real time basis the state of the IPFIX
device to the collecting process. This includes all changes
such as a configuration change that affects the flow
behavior, changes to exporting process resources that alter
export rates, etc., which the collector needs to be aware
Sadasivan & Brownlee [Page 14]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
of.
3. Since it is vital that a collecting process maintains
accurate knowledge of the exprtoer's state, the export of
the control information SHOULD be done such that that it
reaches the collector reliably. One way to achieve this
would be to send the control information over a reliable
transport.
9. Flow Expiration and Export
A flow is considered to be inactive if no packets of this flow have
been observed at the observation point for a given timeout interval.
The flow MAY be expired and exported under the following conditions:
1. If the exporting process can deduce the end of a flow, it SHOULD
export the flow records when the end of the flow is detected.
For example: flow generated by TCP type of traffic where the FIN
or RST bits indicate the end of the flow.
2. If the flow has been inactive for a certain period of time. For
example: flow generated by UDP type of traffic.
3. For long-running flows, the exporting process MAY export the
flow records on regular basis. Some of the reasons for doing
this would be:
a. Report the flow records periodic accounting information to
the collecting process.
b. Avoid counter wrapping.
When a long-running flow is exported, the flow MAY still be
maintained in the IPFIX device so that for the incoming packets
that continue to come on the same flow, a new flow does not get
created in the flow recording data base.
4. In some cases flows MAY be exported as they are generated. This
can be useful when real time processing of flow records is
required.
5. If the IPFIX device experiences resource constraints, a flow MAY
be prematurely expired (example: memory)
6. In some cases flows the exporting process MAY choose not to
export the generated flow as is. For example, this happens if
the a set of flows are aggregated into more coarse flows.
Sadasivan & Brownlee [Page 15]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
10. Export Error Handling
This section describes some of the errors that may be encountered:
- In IPFIX protocol while doing export.
- Feedback received by IPFIX protocol from other entities in the
export path towards the collector.
1. Unavailability of resources e.g. packet buffers for IPFIX export
packets.
2. Error in transport layer.
The protocol MAY choose to do one or more of the following actions:
- Buffer the flow records until the error condition gets corrected.
- Drop flow records for one or more flows based on some rules. In
such a case a record of what action is taken MUST be maintained,
e.g. n flow records of a flow were dropped.
10.1. Selection Criteria of flows for export
There MAY be additional rules defined within the context observation
domain so that only certain flows records are picked up for export.
This MAY be done by either one or a combination of Si, Fi which is
described in the section on "Selection Criteria for Packets".
Example: Only the flow records which meet the following selection
criteria are exported.
1. All flow records whose destination IP address matches
{20.3.1.5}.
2. Every other (.i.e. sampling rate 1 in 2) flow record whose
destination IP address matches {160.0.1.30}.
11. The Selected IPFIX Protocol
There are existing standard practices in the area of flow export like
Netflow, CRANE, LFAP etc. The charter mentions to choose the protocol
among these existing practices that fits the IPFIX requirements the
most. There may be additions or modifications made to the chosen
protocol to fit it exactly into the IPFIX architecture.
The working group went through an extensive evaluation of the various
existing protocols that are available today weighing the level of
compliance with the requirements and architecture and finally
selected Netflow V9 with minor modification as the basis for the
Sadasivan & Brownlee [Page 16]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
IPFIX protocol. Following is a brief description of the chosen IPFIX
basis protocol; details of the IPFIX protocol proper are given in
[IPFIX-PROTO].
This protocol is template based. A template in terms of Netflow V9 is
a collection of fields with corresponding descriptions of their
structures and their semantics which is in strict conformance with
IPFIX architecture.
This approach provides the following advantages:
- Using the template mechanism, new fields can be added to IPFIX
flow records without changing the structure of the export record
format.
- Templates that are sent to the collecting process contain the
structural information about the exported flow record fields.
Therefore, if the collector does not understand the semantics of
new fields it can still interpret the flow record.
- Because the template mechanism is flexible, it allows the export
of only the required fields from the flows to the collecting
process. This helps to reduce the exported flow data volume and
possibly provide memory savings at the Exporting Process and
Collecting Process. Sending only the required information can
also reduce network load.
The figure below shows the functions performed in sequence by the
various functional blocks in an IPFIX device.
Sadasivan & Brownlee [Page 17]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
Packet(s) coming into Observation Point(s)
| |
v v
+-----------------+-------------------------+ +-----+------+
| Metering Process on an | | |
| Observation Point | | |
| packet header capturing | | |
| | | | Metering |
| timestamping | | Process |
| | | | on an |
| v | | Observation|
| +------+ | | Point |
| | | | | |
| | sampling Si (1:1 in case of no | | |
| | | sampling) | | |
| | classifying Fi (NULL when No criteria) | | |
| | | | | |
| +------+ | | |
| | | | |
+---------+---------------------------------+ +-----+------+
| |
Flows (identified by observation domain) Flows
+----... +--------------+...
| v
| +-------------------------------------+----------------+
| | Flow Recording Process(*) |
| | +----------------------+ +------------------+ |
| | | Flow data base |<----|Provide non-flow | |
| | | (includes flows | | information (e.g.| |
| | | from all obs. | | router state) | |
| | | points in an obs. | +------------------+ |.....
| | | domain) | |
| | +----------------------+<----+------------------+ |
| | +-------------------------+ |Maintain aggregate| |
| | |Aggregate flow records(*)| | statistics | |
| | +-------------------------+ +------------------+ |
| +----------------------------------+-------------------+
| |
| Flow Database (identified by observation domain)
| +----------------------....
| |
| |
| |
| |
| |
| |
| |
| |
Sadasivan & Brownlee [Page 18]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
| |
| |
| |
| |
| |
| |
| |
v v
+-----------+-------------------------------------+------------------------+
| | Exporting Process | |
| | +--------------------... |
|+----------+-----------------------------------------------------------+ |
|| v IPFIX Protocol | |
||+---------------------------------+ +-------------------------------+| |
||| Rules for | |Functions || |
||| - Picking & sending templates | |- Packetize selected control || |
||| - Picking & sending data records|->| & data information into || |
||| - Timing out flows | | IPFIX export packet. ||..|
||| - Encoding template & data | |- Handle export errors || |
||| - Selecting flows for export(*) | |- Handle timeouts & overloads || |
||+---------------------------------+ +-------------------------------+| |
|| | |
|+-----------------------------+----------------------------------------+ |
| | |
| +-----------------------------------------..|
| IPFIX exported packet |
| | |
|+-----------------------------+----------------------------------------+ |
|| Anonymize export packet(*) | |
|+-----------------------------+----------------------------------------+ |
| | |
|+-----------------------------+----------------------------------------+ |
|| Transport Protocol | |
|+-----------------------------+----------------------------------------+ |
| | |
+------------------------------+-------------------------------------------+
|
v
IPFIX export packet to collector.
(*) indicates that the block is optional.
Sadasivan & Brownlee [Page 19]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
12. Collecting Process
A Collecting Process is a subsystem that interacts with one or more
IPFIX devices. The functions of the collecting process MAY include:
* Identifying, accepting and decoding export packets from different
{Exporting Process, Observation Domain} pairs .
* Running the IPFIX protocol.
* Storing the control information and flow records received from
IPFIX device.
* Notifying the IPFIX device its status and problems.
At a high level, IPFIX protocol at the collecting process is
responsible for the following:
1. Receive and store the control information.
2. Decode and store the flow records using the control information.
3 Optionally monitor the status of the collecting process and
execute a fail over in case of problem.
12.1. IPFIX Protocol on Collecting Process
1. Receive and decode the flow records from the IPFIX devices.
2. Ability to indicate flow record losses to the exporting IPFIX
device and/or IPFIX users.
3. Optionally notify the status and overload conditions to the
IPFIX device.
Once the selection is made from the set of candidate protocols, this
section would be replaced by the chosen protocol.
12.2. Support for Applications
Applications that use the information collected by IPFIX may be
Billing, Intrusion Detection sub-systems, etc. These applications may
be an integral part of the collecting process or collocated with the
collecting process. The way by which these applications interface
with IPFIX system to get the desired information is out of this
document's scope.
Sadasivan & Brownlee [Page 20]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
12.3. Export Models
12.3.1. Export Model with Reliable Control Connection
As mentioned in the [IPFIX-REQS], the control information and data
stream MUST be transported over a congestion-aware transport
protocol. If the network in which the IPFIX device and collecting
process are located does not guarantee reliability, at least the
control information SHOULD be exported over a reliable transport.
There could be network security concerns between IPFIX device and
collecting process. To avoid re-inventing the wheel, and to reduce
the complexity of flow export protocol, one or a combination of the
following methods MAY be adopted as a solution to achieve security :
* IP Authentication Header MAY be used when the threat environment
requires stronger integrity protections, but does not require
confidentiality.
* IP Encapsulating Security Payload (ESP) MAY be used to provide
confidentiality and integrity.
* If the transport protocol used is TCP, optionally TCP MD5
signature option MAY be used to protect against spoofed TCP
segments.
* If the transport protocol used is TCP, optionally TLS MAY be used
to add integrity, authenticity and confidentiality.
The data stream MAY be exported over a reliable or unreliable
transport protocol.
As explained above the transport connection (in the case of a
connection oriented protocol) is pre-setup between the IPFIX device
and the collector. Once connected, the collector side receives the
control information and uses this information to interpret the flow
records. The IPFIX device SHOULD set the keepalive (e.g. keepalive
timeout in the case of TCP; the HEARTBEAT interval in the case of
SCTP; IPFIX protocol level Keepalive if any) to a sufficiently low
value so that it can quickly detect a collector crash.
12.4. Collector Crash Detection and Recovery
Collector crash refers to crash or restart of collecting process or
the collector itself.
Sadasivan & Brownlee [Page 21]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
12.4.1. Export Model with Reliable Control Connection
The collector crash is detected at the IPFIX device by the break in
control connection (depending on the transport protocol the
connection timeout mechanisms differ). On detecting a Keepalive
timeout, the IPFIX device SHOULD stop sending the flow export data to
the collector and try reconnecting the transport connection. This is
valid for a single collector scenario. If there are multiple
collectors for the same IPFIX device, the IPFIX device opens control
connections to each of the collectors. But data gets sent only to
one of the collectors which is chosen as the primary. There could be
one or more collectors configured as secondary and a priority
assigned to them. The primary collector crash is detected at the
IPFIX device by the break in control connection (depending on the
transport protocol the connection timeout mechanisms differ). On
detecting loss of connectivity, the IPFIX device opens data stream
with the secondary collector of the next highest priority. This
collector now becomes the primary. The maximum export data loss would
be the amount of data exported in the time between when the loss of
connectivity to the collector happened, and the time at which this
was detected by the IPFIX device.
12.5. Collector Redundancy
Since IPFIX protocol requires a congestion-aware transport, achieving
redundancy using multicast is not an option. Multiple <control
information, data stream> pairs could be setup, each to a different
collector from the same IPFIX device. The control and data
information are then replicated on each of the control information
and data stream. Add text here.
13. Security Consideration
IP flow information can be used for various purposes, such as usage
accounting, traffic profiling, traffic engineering, and intrusion
detection. For each application, the security requirement may differ
significantly from one to another. To be able to satisfy the security
needs of various IPFIX users, the architecture of IPFIX MUST provide
different levels of security protection.
Sadasivan & Brownlee [Page 22]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
13.1. Data security
IPFIX data consists of control information and data stream generated
by the IPFIX device.
The IPFIX data may exist in both the IPFIX device and the collector.
In addition, the data is also transferred on the wire from the IPFIX
device to the collector when it is reported. To provide security, the
data SHOULD be protected from adversary.
The protection of IPFIX data within the end system (IPFIX device and
collector) is out of the scope. It is assumed that the end system
operator will provide adequate security for the IPFIX data.
The IPFIX architecture MUST allow different levels of protection to
the IPFIX data on the wire. Where ever security functions are
required it is recommended to leverage to lower layers using either
IPsec or TLS, if they can successfully satisfy the security
requirement of IPFIX data protection.
To protect the data on the wire, three levels of granularity SHOULD
be supported:
13.1.1. No security
Security may not be required when the transport between the IPFIX
device and the collector is perceived as safe. This option allows the
protocol to run most efficiently without extra overhead and an IPFIX
solution MUST support it.
13.1.2. Authentication only
The authentication only protection provides the IPFIX users the
assurance of data integrity and authenticity. The data exchanged
between the IPFIX device and the collector is protected by
authentication signature. Any modification of the IPFIX data will be
detected by the recipient, resulting in discarding of the received
data. However, the authentication only option doesn't offer data
confidentiality. The IPFIX user SHOULD avoid use this option when
sensitive or confidential information is being exchanged. An IPFIX
solution SHOULD support this option. The authentication only option
SHOULD provide replay attack protection. Some means to achieve this
level of security are:
Sadasivan & Brownlee [Page 23]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
* TCP with MD5 options.
* IP Authentication Header
13.1.3. Encryption
Data encryption provides the best protection for IPFIX data. The
IPFIX data is encrypted at the sender and only the intended recipient
can decrypt and have access to the data. This option MUST be used
when the transport between the IPFIX device and the collector are
unsafe and the IPFIX data needs to be protected. It is recommended to
use the underlying security layer functions for this purpose. Some
means to achieve this level of security are:
* Encapsulating Security Payload.
* Transport Layer Security Protocol
The data encryption option adds overhead to the IPFIX data transfer.
It may limit the rate that an export can report its flow to the
collector due to the heavy resource requirement of running
encryption.
13.2. IPFIX end point authentication
It is important to make sure that the IPFIX device is talking to the
"right" collector instead of a masqueraded collector. The same logic
also holds true from the collector point of view that it want to make
sure it is collecting the flow information from the "right" IPFIX
device. The IPFIX architecture SHOULD allow the authentication
capability so that either one-way or mutual authentication can be
performed between the IPFIX device and collector.
The IPFIX architecture SHOULD use the existing transport protection
protocols such as TLS to fulfill the authentication requirement.
13.3. Denial of service (DoS) attack prevention
Since one of the potential usages for IPFIX is for intrusion
detection, it is important for the IPFIX architecture to support some
kind of DoS resistance.
Sadasivan & Brownlee [Page 24]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
13.3.1. Network under attack
The Network itself may be under attack, resulting in an overwhelming
number of IPFIX messages. The IPFIX SHOULD try to capture as much
information as possible. However, when large amount IPFIX messages
are generated in a short period of time, the IPFIX may become
overloaded.
13.3.2. Generic DoS attack on the IPFIX system
The IPFIX system may subject to generic DoS attacks, just as any
system on any open networks. These types of attacks are not IPFIX
specific. Preventing and responding to such types of attacks are out
of the scope of IPFIX WG.
13.3.3. IPFIX Specific DoS attack
There is a specific attack on the IPFIX portion of the IPFIX device
or Collector.
- The attacker could pound the Collector with spoofed IPFIX export
packets. One way to solve this problem is to periodically
synchronize the sequence numbers of the flow records between
exporting process and the collecting process.
- The attacker could provide false reports to the IPFIX device by
sending spoofed control packets.
The problems mentioned above can be solved to a large extent if the
control packets are encrypted both ways.
(To be added and discussed on the general list).
14. IANA Considerations
Need Port number assigned from IANA [more to be written]
Sadasivan & Brownlee [Page 25]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
15. References
[IPFIX-REQS] J. Quittek ,T. Zseby, B. Claise,"Requirements for IP
Flow Information Export", (work in progress) ,Internet Draft,
<draft-ietf-ipfix-reqs-11.txt>, June 2003.
[IPFIX-IMODEL] P. Calato, J. Meyer, J. Quittek, "IPFIX: Information
Model," work in progress) ,Internet Draft, <draft-ietf-ipfix-info-
00.txt>, June 2003.
[IPFIX-PROTO] M. Fulmer, P. Calato, B. Claise, R. Penno, "IPFIX:
Protocol," Internet Draft, <draft-ietf-ipfix-protocol-00.txt>, June
2003.
16. Acknowledgements
We wish to thank all the people contributing to the requirements
discussion on the mailing list, and the design teams for many
valuable comments.
Tanja Zseby
Paul Calato
Dave Plonka
Jeffrey Meyer
Benoit Claise
Ganesh Sadasivan
K.C.Norseth
Vamsi Valluri
Cliff Wang
Ram Gopal
Jc Martin
Carter Bullard
Juergen Quittek
Reinaldo Penno
Nevil Brownlee
Simon Leinen
Kevin Zhang
Sadasivan & Brownlee [Page 26]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
17. Author's Addresses
Ganesh Sadasivan
Cisco Systems, Inc.
170 W. Tasman Dr.
San Jose, CA 95134
USA
Phone: +1 (408) 527-0251
Email: gsadasiv@cisco.com
Nevil Brownlee
CAIDA | The University of Auckland
Phone: +64 9 373 7599 x8941
E-mail: n.brownlee@auckland.ac.nz
Benoit Claise
Cisco Systems
De Kleetlaan 6a b1
1831 Diegem
Belgium
Phone: +32 2 704 5622
Email: bclaise@cisco.com
Juergen Quittek
NEC Europe Ltd.
Adenauerplatz 6
69115 Heidelberg
Germany
Phone: +49 6221 90511-15
EMail: quittek@ccrle.nec.de
18. Full Copyright Statement
"Copyright (C) The Internet Society (date). All Rights Reserved. This
document and translations of it may be copied and furnished to
others, and derivative works that comment on or otherwise explain it
or assist in its implementation may be prepared, copied, published
and distributed, in whole or in part, without restriction of any
kind, provided that the above copyright notice and this paragraph are
included on all such copies and derivative works. However, this
document itself may not be modified in any way, such as by removing
the copyright notice or references to the Internet Society or other
Sadasivan & Brownlee [Page 27]
Internet Draft draft-ietf-ipfix-arch-01.txt June 2003
Internet organizations, except as needed for the purpose of
developing Internet standards in which case the procedures for
copyrights defined in the Internet Standards process must be
followed, or as required to translate it into.
Sadasivan & Brownlee [Page 28]