Network Working Group                                            H. Chen
Internet-Draft                                                M. McBride
Intended status: Standards Track                               Futurewei
Expires: September 5, 2022                                       R. Chen
                                                         ZTE Corporation
                                                               G. Mishra
                                                            Verizon Inc.
                                                                 A. Wang
                                                           China Telecom
                                                                  Y. Fan
                                                            Casa Systems
                                                                  L. Liu
                                                                 Fujitsu
                                                                  X. Liu
                                                          Volta Networks
                                                           March 4, 2022


             BIER-TE Encapsulation with Multiple BitStrings
                       draft-chen-bier-te-enc-00

Abstract

   This document describes a "Bit Index Explicit Replication Traffic
   Engineering" (BIER-TE) header, two levels of Bit Index Forwarding
   Tables (BIFTs) and a forwarding procedure for efficiently processing
   BIER-TE packets with the header.  For a multicast packet with an
   explicit point-to-multipoint (P2MP) path, which has multiple
   BitStrings, the packet with the header containing the BitStrings is
   replicated and forwarded statelessly along the path.

Requirements Language

   The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT",
   "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this
   document are to be interpreted as described in [RFC2119] [RFC8174]
   when, and only when, they appear in all capitals, as shown here.

Status of This Memo

   This Internet-Draft is submitted in full conformance with the
   provisions of BCP 78 and BCP 79.

   Internet-Drafts are working documents of the Internet Engineering
   Task Force (IETF).  Note that other groups may also distribute
   working documents as Internet-Drafts.  The list of current Internet-
   Drafts is at https://datatracker.ietf.org/drafts/current/.




Chen, et al.            Expires September 5, 2022               [Page 1]


Internet-Draft               BIER-TE Encaps                   March 2022


   Internet-Drafts are draft documents valid for a maximum of six months
   and may be updated, replaced, or obsoleted by other documents at any
   time.  It is inappropriate to use Internet-Drafts as reference
   material or to cite them other than as "work in progress."

   This Internet-Draft will expire on September 5, 2022.

Copyright Notice

   Copyright (c) 2022 IETF Trust and the persons identified as the
   document authors.  All rights reserved.

   This document is subject to BCP 78 and the IETF Trust's Legal
   Provisions Relating to IETF Documents
   (https://trustee.ietf.org/license-info) in effect on the date of
   publication of this document.  Please review these documents
   carefully, as they describe your rights and restrictions with respect
   to this document.  Code Components extracted from this document must
   include Simplified BSD License text as described in Section 4.e of
   the Trust Legal Provisions and are provided without warranty as
   described in the Simplified BSD License.

Table of Contents

   1.  Introduction  . . . . . . . . . . . . . . . . . . . . . . . .   2
     1.1.  Terminology . . . . . . . . . . . . . . . . . . . . . . .   3
   2.  Example BIER-TE Path with Multiple BitStrings . . . . . . . .   4
     2.1.  Example BIER-TE Topology  . . . . . . . . . . . . . . . .   4
     2.2.  BIER-TE Path with Multiple BitStrings . . . . . . . . . .   5
   3.  Extensions for Multiple BitStrings  . . . . . . . . . . . . .   7
     3.1.  BIER-TE Header with Multiple BitStrings . . . . . . . . .   7
     3.2.  Two Levels of BIFTs . . . . . . . . . . . . . . . . . . .   9
     3.3.  Forwarding Procedure  . . . . . . . . . . . . . . . . . .  14
   4.  Security Considerations . . . . . . . . . . . . . . . . . . .  15
   5.  IANA Considerations . . . . . . . . . . . . . . . . . . . . .  15
   6.  Acknowledgements  . . . . . . . . . . . . . . . . . . . . . .  15
   7.  References  . . . . . . . . . . . . . . . . . . . . . . . . .  15
     7.1.  Normative References  . . . . . . . . . . . . . . . . . .  15
     7.2.  Informative References  . . . . . . . . . . . . . . . . .  16
   Authors' Addresses  . . . . . . . . . . . . . . . . . . . . . . .  16

1.  Introduction

   [I-D.ietf-bier-te-arch] introduces Bit Index Explicit Replication
   (BIER) Traffic/Tree Engineering (BIER-TE).  It is an architecture for
   per-packet stateless explicit point to multipoint (P2MP) multicast
   path/tree.




Chen, et al.            Expires September 5, 2022               [Page 2]


Internet-Draft               BIER-TE Encaps                   March 2022


   A Bit-Forwarding Router (BFR) in a BIER-TE domain has a BIER-TE Bit
   Index Forwarding Tables (BIFT).  A BIER-TE BIFT on a BFR comprises a
   forwarding entry for a BitPosition (BP) assigned to each of the
   adjacencies of the BFR.  If the BP represents a forward connected
   adjacency, the forwarding entry for the BP forwards the multicast
   packet with the BP to the directly connected BFR neighbor of the
   adjacency.  If the BP represents a BFER (i.e., egress node) or say a
   local decap adjacency, the forwarding entry for the BP decapsulates
   the multicast packet with the BP and passes a copy of the payload of
   the packet to the packet's NextProto within the BFR.

   [RFC8296] defines the BIER header with one BitString with Default
   BitStringLength value of 256.  However, for a BIER-TE path from an
   ingress to multiple egresses (or say destinations), the bit positions
   representing the path may not be in one BitString.  The existing BIER
   header does not work for the BIER-TE path with more than one
   BitString.

   This document proposes a solution for a BIER-TE header to resolve
   this issue.  The BIER-TE header can contain all the bit positions of
   a BIER-TE path.  These bit positions are encoded in one or more
   BitStrings.  The document presents an enhanced forwarding procedure
   for efficiently processing the BIER-TE header with multiple
   BitStrings.

1.1.  Terminology

   BIER: Bit Index Explicit Replication.

   BIER-TE:  BIER Traffic Engineering.

   BFR:  Bit-Forwarding Router.

   BFIR: Bit-Forwarding Ingress Router.

   BFER: Bit-Forwarding Egress Router.

   BFR-id:  BFR Identifier.  It is a number in the range [1,65535].

   BFR-NBR:  BFR Neighbor.

   BFR-prefix:  An IP address (either IPv4 or IPv6) of a BFR.

   BIRT: Bit Index Routing Table.  It is a table that maps from the BFR-
         id (in a particular sub-domain) of a BFER to the BFR-prefix of
         that BFER, and to the BFR-NBR on the path to that BFER.

   BIFT: Bit Index Forwarding Table.



Chen, et al.            Expires September 5, 2022               [Page 3]


Internet-Draft               BIER-TE Encaps                   March 2022


   IGP:  Interior Gateway Protocol.

   LSDB: Link State DataBase.

   OSPF: Open Shortest Path First.

   IS-IS:  Intermediate System to Intermediate System.

   SI:   Set Identifier.

   BP:   Bit Position.

2.  Example BIER-TE Path with Multiple BitStrings

   This section illustrates an example BIER-TE domain topology and a
   BIER-TE paths across the domain.  The path has multiple sets of bit
   strings, i.e., multiple BitStrings with different SIs (or multiple
   BitStrings for short).  The packet to be transported by this path
   must contains the multiple BitStrings in the header of the packet.
   If the header can contain only one BitString, the packet to be
   transported by the path cannot be delivered to the egresses of the
   path.

2.1.  Example BIER-TE Topology

   An example BIER-TE topology for a BIER-TE domain is shown in
   Figure 1.  It has 9 nodes/BFRs A, B, C, D, E, F, G, H and I.  Nodes/
   BFRs D, F, E, H and A are BFERs and have local decap adjacency
   BitPositions 1, 2, 3, 4, and 5 respectively.  For simplicity, these
   BPs are represented by (SI:BitString), where SI = 0 and BitString is
   of 8 bits.  BPs 1, 2, 3, 4, and 5 are represented by 1 (0:00000001),
   2 (0:00000010), 3 (0:00000100), 4 (0:00001000) and 5 (0:00010000)
   respectively.


















Chen, et al.            Expires September 5, 2022               [Page 4]


Internet-Draft               BIER-TE Encaps                   March 2022


                                     6'      19'       20'   4
                             /----------( G )---------------( H )
                            /          18'\               16'/
                           /               \17'             /
                          /               ( I )____________/
                         /             14'/      15'
                        /                /
              8'   7'  /5'  3'     4'   /13'           12'
        ( A )--------( B )------------( C )-----------------( D ) 1
          5            \1'              \9'   11'            /24'
                        \                \                  /
                         \2'   21'   22'  \10'             /
                        ( E )------------( F )____________/
                          3                2   23'

                    Figure 1: Example BIER-TE Topology

   The BitPositions for the forward connected adjacencies are
   represented by i', where i is from 1 to 24.  In one option, they are
   encoded as (n+i), where n is a power of 2 such as 32768.  For
   simplicity, these BitPositions are represented by (SI:BitString),
   where SI = (6 + (i-1)/8) and BitString is of 8 bits.  BitPositions i'
   (i from 1 to 24) are represented by 1'(6:00000001), 2'(6:00000010),
   3'(6:00000100), 4'(6:00001000), 5'(6:00010000), 6'(6:00100000),
   7'(6:01000000), 8'(6:10000000), 9'(7:00000001), 10'(7:00000010), . .
   . , 24'(8:10000000).

   For a link between two nodes X and Y, there are two BitPositions for
   two forward connected adjacencies.  These two forward connected
   adjacency BitPositions are assigned on nodes X and Y respectively.
   The BitPosition assigned on X is the forward connected adjacency of
   Y.  The BitPosition assigned on Y is the forward connected adjacency
   of X.

   For example, for the link between nodes B and C in the figure, two
   forward connected adjacency BitPositions 3' and 4' are assigned to
   two ends of the link.  BitPosition 3' is assigned on node B to B's
   end of the link.  It is the forward connected adjacency of node C.
   BitPosition 4' is assigned on node C to C's end of the link.  It is
   the forward connected adjacency of node B.

2.2.  BIER-TE Path with Multiple BitStrings

   One BIER-TE path is the explicit multicast P2MP path from ingress A
   to egresses D and F, traversing from A to B to C, and from C to D and
   F.  This path is represented by BPs as {7', 4', 12', 10', 1, 2},
   which is {7'(6:01000000), 4'(6:00001000), 12'(7:00001000),
   10'(7:00000010), 1(0:00000001), 2(0:00000010)}.  These six bit



Chen, et al.            Expires September 5, 2022               [Page 5]


Internet-Draft               BIER-TE Encaps                   March 2022


   positions on the path are in three sets of bit strings with SI = 0, 6
   and 7.

   Bit positions 1 and 2 are in the set with SI = 0, which is
   (0:00000011).  Bit positions 7' and 4' are in the set with SI = 6,
   which is (6:01001000).  Bit positions 12' and 10' are in the set with
   SI = 7, which is (7:00001010).

   At ingress A, the packet to be transported by the path must be
   encapsulated in a BIER-TE header containing all three sets of bit
   strings.  These sets represent the bit positions {7', 4', 12', 10',
   1, 2} on the path.

   The packet with the BIER-TE header is delivered from ingress A to BFR
   B using bit position 7' with SI = 6 in the header.  BFR B forwards
   the packet to BFR C using bit position 4' with SI = 6 in the header.
   BFR C forwards a copy of the packet to BFER D using bit position 12'
   with SI = 7 in the header and another copy to BFER F using bit
   position 10' with SI = 7 in the header.  BFER D decapsulates the
   packet and sends the payload of the packet to the packet's nextproto
   within BFER D using bit position 1 with SI = 0 in the header.  BFER F
   decapsulates the packet and sends the payload of the packet to the
   packet's nextproto within BFER F using bit position 2 with SI = 0 in
   the header.

   If a BIER-TE header can contain only one set of bit strings, the
   packet to be transported by the path cannot be delivered to the
   egresses of the path.  At ingress A, three copies of the packet to be
   transported by the path are produced.  Each copy contains a header
   with a set of bit strings.  The first copy has a header with set of
   bit strings (0:00000011) for bit positions 1 and 2.  The second copy
   has a header with set of bit strings (6:01001000) for bit positions
   7' and 4'.  The third copy has a header with set of bit strings
   (7:00001010) for bit positions 12' and 10'.

   For the first copy, ingress A will drop it since bit positions 1 and
   2 are not any adjacency bit position of A.  Similarly, ingress A will
   the third copy since bit positions 12' and 10' are not any adjacency
   bit position of A.

   For the second copy, ingress A sends it to BFR B using bit position
   7' in the header.  After receiving the packet, BFR B sends the packet
   to BFR C using bit position 4' in the header.  After receiving the
   packet, BFR C drops it since there is no bit position of BFR C in the
   header of the packet.






Chen, et al.            Expires September 5, 2022               [Page 6]


Internet-Draft               BIER-TE Encaps                   March 2022


3.  Extensions for Multiple BitStrings

   This section describes a BIER-TE header containing multiple
   BitStrings with different SIs (or multiple BitStrings for short), two
   levels of BIFTs for efficient processing the packets with the BIER-TE
   header, and a forwarding procedure for handling the packets using the
   two levels of BIFTs.

3.1.  BIER-TE Header with Multiple BitStrings

   A BIER-TE header needs to contain multiple sets of bit strings (i.e.,
   multiple BitStrings with different SIs) for a BIER-TE path.  In one
   option, they are represented by n indicating the number of
   BitStrings, and a pair of SI and BitString for each of the n sets of
   bit strings: SI-1, BitString-1; SI-2, BitString-2; ...; SI-n,
   BitString-n.

   Figure 2 illustrates a format of a BIER-TE header having multiple
   BitStrings.

      0                   1                   2                   3
      0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |               BIFT-id                 |  TC |S|      TTL      |
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |Nibble |  Ver  |  BSL  |              Entropy                  |
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |OAM|M|R|    DSCP   |   Proto   |             BFIR-id           |
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |        n      |
     +-+-+-+-+-+-+-+-+
     |     SI-1      |
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |                    BitString-1                                ~
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     ~                                ......                         ~
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |     SI-n      |
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
     |                    BitString-n                                ~
     +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+

                   Figure 2: A Format of BIER-TE Header

   BIFT-id:  This field indicates a BIFT.

   TC:   The "Traffic Class" field in [RFC5462] has its usual meaning in
         an MPLS label stack entry.



Chen, et al.            Expires September 5, 2022               [Page 7]


Internet-Draft               BIER-TE Encaps                   March 2022


   S:    When a BIER packet is traveling through an MPLS network, the
         high-order 20 bits of the initial four octets of the BIER
         encapsulation contain an MPLS label in the BIFT-id field.
         These four octets are treated as the final entry in the
         packet's MPLS label stack.  Hence, the S bit (see [RFC3032])
         MUST be set to 1.  If there are any MPLS label stack entries
         immediately preceding the BIER encapsulation, the S bit of
         those label stack entries MUST be set to 0.

   TTL:  This is the usual MPLS "Time to Live" field in [RFC3032].  When
         a BIER packet is received, its "incoming TTL" (see below) is
         taken from this TTL field.  When a BIER packet is forwarded to
         one or more BFR adjacencies, the BIER-MPLS label carried by the
         forwarded packet MUST have a TTL field whose value is one less
         than that of the packet's incoming TTL.

   Nibble:  This field is set to the binary value 0101; this ensures
         that the MPLS ECMP logic will not confuse the remainder of the
         BIER header with an IP header or with the header of a
         pseudowire packet.  In an MPLS network, if a BFR receives a
         BIER packet with any other value in the first nibble after the
         label stack, it SHOULD discard the packet and log an error.

   Ver:  This 4-bit field identifies the version of the BIER header.
         [RFC8296] specifies version 0 of the BIER header.  If a packet
         is received by a particular BFR and that BFR does not support
         the specified version of the BIER header, the BFR MUST discard
         the packet and log an error.  The value 0xF is reserved for
         experimental use; that value MUST NOT be assigned by any future
         IETF document or by IANA.

   BSL:  This 4-bit field encodes the length in bits of the BitString.

   Entropy:  This 20-bit field specifies an "entropy" value that can be
         used for load-balancing purposes.  The BIER forwarding process
         may do equal-cost load balancing, in which case the load-
         balancing procedure MUST choose the same path for any two
         packets that have the same entropy value and the same
         BitString.

   OAM:  By default, these two bits are set to 0 by the BFIR and are not
         modified by other BFRs.  These two bits have no effect on the
         path taken by a BIER packet and have no effect on the quality
         of service applied to a BIER packet.

   M:    This one bit flag is set to 1 for the header containing
         multiple sets of bit strings, 0 for for the header not
         containing multiple sets of bit strings.



Chen, et al.            Expires September 5, 2022               [Page 8]


Internet-Draft               BIER-TE Encaps                   March 2022


   R:    This R bit is currently unused.  It SHOULD be set to 0 upon
         transmission and MUST be ignored upon reception.

   DSCP: By default, this 6-bit field is not used in MPLS networks.  The
         default behavior is that all six bits SHOULD be set to 0 upon
         transmission and MUST be ignored upon reception.

   Proto:  This 6-bit "Next Protocol" field identifies the type of the
         payload.  (The "payload" is the packet or frame immediately
         following the BIER header.)  IANA has created a registry called
         "BIER Next Protocol Identifiers".  This field is to be
         populated with the appropriate entry from that registry.

   BFIR-id:  By default, this is the BFR-id of the BFIR, in the SD to
         which the packet has been assigned.  The BFR-id is encoded in
         the 16-bit field as an unsigned integer in the range [1,65535].

   n:    It indicates the number of sets of bit strings in the header.

   SI-1: It is the set identifier of the first (1-th) bit string.

   BitString-1:  It is the first (1-th) bit string.  The length of the
         bit string is indicated by BSL.

   SI-n: It is the set identifier of the n-th bit string.

   BitString-n:  It is the n-th bit string.  The length of the bit
         string is indicated by BSL.

3.2.  Two Levels of BIFTs

   A BFR has two levels of BIFTs for BIER-TE.  At the top or first
   level, there is one BIFT.  The structure of this BIFT is shown in
   Figure 3.  This top level BIFT has an entry for every set identifier
   (SI).  The entry contains:

    o BitString:  The bit string (i.e., the adjacency bit positions) of
         the BFR in the set indicated by SI.

    o Pointer to 2nd Level BIFT:  Pointer to the second level BIFT for
         the bit string of the BFR in the set indicated by SI.  If the
         bit string is all zeros, there is no second level BIFT for it
         and the pointer is NULL.








Chen, et al.            Expires September 5, 2022               [Page 9]


Internet-Draft               BIER-TE Encaps                   March 2022


                          +--------------+--------------+
                    SI    |  BitString   |Pointer to    |
                  (Index) |(Adjacency BP)|2nd Level BIFT|
                          +==============+==============+
                     0    |  xxxxxxxxxx  | xxxxxxxx     |
                          +--------------+--------------+
                     1    |  xxxxxxxxxx  | xxxxxxxx     |
                     .    +--------------+--------------+
                     :                 . . . . . .

                   Figure 3: Structure of Top Level BIFT

   For example, the top level BIFT on BFR E is illustrated in Figure 4.
   There are 9 sets of bit strings in total in the BIER-TE network in
   Figure 1.  So, the BIFT has 9 entries.

                         +--------------+--------------+
                    SI   |  BitString   |Pointer to    |
                         |(Adjacency BP)|2nd Level BIFT|
                         +==============+==============+
                     0   |00000100 (3)  | ->BIFT4-SI-0 |
                         +--------------+--------------+
                     1   |00000000      | NULL         |
                         +--------------+--------------+
                     2   |00000000      | NULL         |
                         +--------------+--------------+
                     3   |00000000      | NULL         |
                         +--------------+--------------+
                     4   |00000000      | NULL         |
                         +--------------+--------------+
                     5   |00000000      | NULL         |
                         +--------------+--------------+
                     6   |00000001 (1') | ->BIFT4-SI-6 |
                         +--------------+--------------+
                     7   |00000000      | NULL         |
                         +--------------+--------------+
                     8   |00001000 (22')| ->BIFT4-SI-8 |
                         +--------------+--------------+

                     Figure 4: Top Level BIFT on BFR E

   The first entry is for the set of bit string (i.e., adjacency bit
   positions) with SI = 0.  It contains:

    o BitString =   00000100.  It indicates the local decap adjacency
         Bit Position 3 of BFR E.





Chen, et al.            Expires September 5, 2022              [Page 10]


Internet-Draft               BIER-TE Encaps                   March 2022


    o Pointer to 2nd Level BIFT =   ->BIFT4-SI-0.  It is a pointer to
         the second level BIFT for the bit string with SI = 0.

   The second entry is for the set of bit string (i.e., adjacency bit
   positions) with SI = 1.  It contains 00000000 and NULL for BitString
   and Pointer to 2nd Level BIFT respectively.  BitString = 00000000
   means that BFR E has no adjacency bit position in the set with SI =
   1.

   The 3-th to 6-th entries and the 8-th entry are similar to the second
   entry.

   The 7-th entry is for the set of bit string (i.e., adjacency bit
   positions) with SI = 6.  It contains:

    o BitString =   00000001.  It indicates the forward-connected
         adjacency Bit Position 1' of BFR E.

    o Pointer to 2nd Level BIFT =   ->BIFT4-SI-6.  It is a pointer to
         the second level BIFT for the bit string with SI = 6.

   The 9-th entry is for the set of bit string (i.e., adjacency bit
   positions) with SI = 8.  It contains:

    o BitString =   00001000.  It indicates the forward-connected
         adjacency Bit Position 22' of BFR E.

    o Pointer to 2nd Level BIFT =   ->BIFT4-SI-8.  It is a pointer to
         the second level BIFT for the bit string with SI = 8.

   A second level BIFT for the bit string identified by a SI contains
   the entries for the adjacency bit positions (or say bit string) in
   the set identified by the SI.  Its structure is shown in Figure 5.
   It is the same as the BIFT in [I-D.ietf-bier-te-arch].

               +--------------+--------------+------------+
               |  BitString   |    Action    |  BFR-NBR   |
               |(Adjacency BP)|              | (Next Hop) |
               +==============+==============+============+
               | xxxxxxxx     | xxxxxxxx     |  xxxxxxxx  |
               +--------------+--------------+------------+

              Figure 5: Structure of Second Level BIFT for SI

   For example, BFR E has three adjacency bit positions: 3, 1' and 22'.
   They are in the three sets of bit strings identified by SI = 0, 6 and
   8 respectively.  So, BFR E has three second level BIFTs: BIFT for SI




Chen, et al.            Expires September 5, 2022              [Page 11]


Internet-Draft               BIER-TE Encaps                   March 2022


   = 0, BIFT for SI = 6 and BIFT for SI = 8.  These BIFTs are
   illustrated in Figure 6, Figure 7 and Figure 8.

               +--------------+--------------+------------+
               |  BitString   |    Action    |  BFR-NBR   |
               |(Adjacency BP)|              | (Next Hop) |
               +==============+==============+============+
               |00000100 (3)  | local-decap  |            |
               +--------------+--------------+------------+

                    Figure 6: BIFT for SI = 0 on BFR E

               +--------------+--------------+------------+
               |  BitString   |    Action    |  BFR-NBR   |
               |(Adjacency BP)|              | (Next Hop) |
               +==============+==============+============+
               |00000001 (1') | fw-connected |     B      |
               +--------------+--------------+------------+

                    Figure 7: BIFT for SI = 6 on BFR E

               +--------------+--------------+------------+
               |  BitString   |    Action    |  BFR-NBR   |
               |(Adjacency BP)|              | (Next Hop) |
               +==============+==============+============+
               |00001000 (22')| fw-connected |     F      |
               +--------------+--------------+------------+

                    Figure 8: BIFT for SI = 8 on BFR E

   In another example, BFR B has four adjacency bit positions: 2', 4',
   6' and 8'.  They are in the same set of bit strings identified by SI
   = 6.  So, BFR B has one second level BIFT: BIFT for SI = 6.  This
   BIFT is illustrated in Figure 9.

















Chen, et al.            Expires September 5, 2022              [Page 12]


Internet-Draft               BIER-TE Encaps                   March 2022


               +--------------+--------------+------------+
               |  BitString   |    Action    |  BFR-NBR   |
               |(Adjacency BP)|              | (Next Hop) |
               +==============+==============+============+
               |00000010 (2') | fw-connected |     E      |
               +--------------+--------------+------------+
               |00001000 (4') | fw-connected |     C      |
               +--------------+--------------+------------+
               |00100000 (6') | fw-connected |     G      |
               +--------------+--------------+------------+
               |10000000 (8') | fw-connected |     A      |
               +--------------+--------------+------------+

                    Figure 9: BIFT for SI = 6 on BFR B

   The top level BIFT on BFR B is shwon in Figure 10.  There are 9 sets
   of bit strings in total in the BIER-TE network in Figure 1.  So, the
   BIFT has 9 entries.

                         +--------------+--------------+
                    SI   |  BitString   |Pointer to    |
                         |(Adjacency BP)|2nd Level BIFT|
                         +==============+==============+
                     0   |00000000      | NULL         |
                         +--------------+--------------+
                     1   |00000000      | NULL         |
                         +--------------+--------------+
                     2   |00000000      | NULL         |
                         +--------------+--------------+
                     3   |00000000      | NULL         |
                         +--------------+--------------+
                     4   |00000000      | NULL         |
                         +--------------+--------------+
                     5   |00000000      | NULL         |
                         +--------------+--------------+
                     6   |10101010      | ->BIFT4-SI-6 |
                         +--------------+--------------+
                     7   |00000000      | NULL         |
                         +--------------+--------------+
                     8   |00000000      | NULL         |
                         +--------------+--------------+

                    Figure 10: Top Level BIFT on BFR B

   The 7-th entry is for the set of bit string (i.e., adjacency bit
   positions) with SI = 6.  It contains:





Chen, et al.            Expires September 5, 2022              [Page 13]


Internet-Draft               BIER-TE Encaps                   March 2022


    o BitString =   10101010.  It indicates the forward-connected
         adjacency Bit Position 2', 4', 6' and 8' of BFR B.

    o Pointer to 2nd Level BIFT =   ->BIFT4-SI-6.  It is a pointer to
         the second level BIFT for the bit string with SI = 6.

   The other entries are for the sets of bit strings (i.e., adjacency
   bit positions) with SI other than 6.  Each of them contains 00000000
   and NULL for BitString and Pointer to 2nd Level BIFT respectively.
   BitString = 00000000 means that BFR B has no adjacency bit position
   in the set with SI other than 6.

3.3.  Forwarding Procedure

   For a packet with a BIER-TE header containing multiple BitStrings
   with different SIs, after receiving the packet, a BFR checks each
   BitString to see if it has any adjacency bit positions of the BFR.

   If a BitString contains an adjacency bit position of the BFR, the BFR
   processes the packet according to the adjacency bit position.  If the
   adjacency bit position is a forward-connected adjacency, the BFR
   forwards a packet copy to the adjacency.  If the adjacency bit
   position is a local decap adjacency, the BFR sends the packet payload
   to the packet's NextProto within the BFR.  This is the same as the
   existing behavior.

   For a BitString identified by SI-i and BitString-i, the BFR
   determines if it contains an adjacency bit position of the BFR using
   the top level BIFT.  The BFR gets its adjacency bit positions in the
   set SI-i from the BIFT and checks if BitString-i and the bit
   positions have the same bit with value 1.  This can be achieved by
   checking if BIFT[SI-i][0] AND BitString-i is not zero, where BIFT[SI-
   i][0] is the adjacency bit positions of the BFR in the set SI-i, AND
   is bit wise logical and.

   When BitString-i contains an adjacency bit position of the BFR, the
   BFR processes the packet using the second level BIFT for its
   adjacency bit positions in the BitString identified by SI-i.  The BFR
   gets the second level BIFT from the top level BIFT using SI-i.  The
   second collumn of the row with index SI-i in the top level BIFT
   (i.e., BIFT[SI-i][1]) stores a pointer to the second level BIFT.

   For each adjacency bit position of the BFR in the BitString, the BFR
   processes the packet using the second level BIFT pointed by BIFT[SI-
   i][1] in the same way as the existing one.

   The procedure for processing a BIER-TE packet is described in Pseudo
   code in Figure 11.



Chen, et al.            Expires September 5, 2022              [Page 14]


Internet-Draft               BIER-TE Encaps                   March 2022


   Packet = the packet received by BFR;
   FOR i = 1 to n {// n in header is number of BitStrings
      T = BIFT[SI-i][0] & BitString-i;
      IF (T) {//has an adjacency BP of BFR
          BIFT4-SI-i = BIFT[SI-i][1]; //Get second level BIFT
          get m; //m: number of adjacency BPs in set SI-i or BIFT4-SI-i
          FOR (j = 1; T && j < m; j++) {//for each BP of BFR in set SI-i
             IF (T & BIFT4-SI-i[j][0]) {//has adjacency BP at j
                IF (BIFT4-SI-i[j][1] == fw-connected){//fw-connected adj
                    send a packet copy to BIFT4-SI-i[j][2];
                } ELSE IF (BIFT4-SI-i[j][1] == local-decap) {//decap adj
                    send packet payload to multicast overlay;
                }
                T = T & ~(BIFT4-SI-i[j][0])//Clear T's corresponding bit
             }
          }
      }
   }

       Figure 11: Forwarding Procedure for Processing BIER-TE Packet

4.  Security Considerations

   TBD.

5.  IANA Considerations

   No requirements for IANA.

6.  Acknowledgements

   The authors would like to thank people for their comments to this
   work.

7.  References

7.1.  Normative References

   [I-D.ietf-bier-te-arch]
              Eckert, T., Menth, M., and G. Cauchie, "Tree Engineering
              for Bit Index Explicit Replication (BIER-TE)", draft-ietf-
              bier-te-arch-12 (work in progress), January 2022.

   [RFC2119]  Bradner, S., "Key words for use in RFCs to Indicate
              Requirement Levels", BCP 14, RFC 2119,
              DOI 10.17487/RFC2119, March 1997,
              <https://www.rfc-editor.org/info/rfc2119>.




Chen, et al.            Expires September 5, 2022              [Page 15]


Internet-Draft               BIER-TE Encaps                   March 2022


   [RFC8174]  Leiba, B., "Ambiguity of Uppercase vs Lowercase in RFC
              2119 Key Words", BCP 14, RFC 8174, DOI 10.17487/RFC8174,
              May 2017, <https://www.rfc-editor.org/info/rfc8174>.

7.2.  Informative References

   [RFC3032]  Rosen, E., Tappan, D., Fedorkow, G., Rekhter, Y.,
              Farinacci, D., Li, T., and A. Conta, "MPLS Label Stack
              Encoding", RFC 3032, DOI 10.17487/RFC3032, January 2001,
              <https://www.rfc-editor.org/info/rfc3032>.

   [RFC5462]  Andersson, L. and R. Asati, "Multiprotocol Label Switching
              (MPLS) Label Stack Entry: "EXP" Field Renamed to "Traffic
              Class" Field", RFC 5462, DOI 10.17487/RFC5462, February
              2009, <https://www.rfc-editor.org/info/rfc5462>.

   [RFC8296]  Wijnands, IJ., Ed., Rosen, E., Ed., Dolganow, A.,
              Tantsura, J., Aldrin, S., and I. Meilik, "Encapsulation
              for Bit Index Explicit Replication (BIER) in MPLS and Non-
              MPLS Networks", RFC 8296, DOI 10.17487/RFC8296, January
              2018, <https://www.rfc-editor.org/info/rfc8296>.

Authors' Addresses

   Huaimo Chen
   Futurewei
   Boston, MA
   USA

   Email: Huaimo.chen@futurewei.com


   Mike McBride
   Futurewei

   Email: michael.mcbride@futurewei.com


   Ran Chen
   ZTE Corporation

   Email: chen.ran@zte.com.cn









Chen, et al.            Expires September 5, 2022              [Page 16]


Internet-Draft               BIER-TE Encaps                   March 2022


   Gyan S. Mishra
   Verizon Inc.
   13101 Columbia Pike
   Silver Spring  MD 20904
   USA

   Phone: 301 502-1347
   Email: gyan.s.mishra@verizon.com


   Aijun Wang
   China Telecom
   Beiqijia Town, Changping District
   Beijing  102209
   China

   Email: wangaj3@chinatelecom.cn


   Yanhe Fan
   Casa Systems
   USA

   Email: yfan@casa-systems.com


   Lei Liu
   Fujitsu
   USA

   Email: liulei.kddi@gmail.com


   Xufeng Liu
   Volta Networks
   McLean, VA
   USA

   Email: xufeng.liu.ietf@gmail.com












Chen, et al.            Expires September 5, 2022              [Page 17]