Skip to main content

Media over QUIC - Transfork
draft-lcurley-moq-transfork-02

The information below is for an old version of the document.
Document Type
This is an older version of an Internet-Draft whose latest revision state is "Expired".
Author Luke Curley
Last updated 2024-10-15 (Latest revision 2024-09-23)
RFC stream (None)
Formats
Stream Stream state (No stream defined)
Consensus boilerplate Unknown
RFC Editor Note (None)
IESG IESG state I-D Exists
Telechat date (None)
Responsible AD (None)
Send notices to (None)
draft-lcurley-moq-transfork-02
moq                                                            L. Curley
Internet-Draft                                                   Discord
Intended status: Informational                           15 October 2024
Expires: 18 April 2025

                      Media over QUIC - Transfork
                     draft-lcurley-moq-transfork-02

Abstract

   MoqTransfork is designed to serve a broadcast to an unbounded number
   of viewers with different latency and quality targets: the entire
   spectrum between real-time and VOD.  MoqTransfork itself is a media
   agnostic transport, allowing relays and CDNs to forward the most
   important content under degraded networks without knowledge of
   codecs, containers, or even if the content is fully encrypted.
   Higher level protocols specify how to use MoqTransfork to encode and
   deliver video, audio, messages, or any form of live content.

Discussion Venues

   This note is to be removed before publishing as an RFC.

   Discussion of this document takes place on the Media Over QUIC
   Working Group mailing list (moq@ietf.org), which is archived at
   https://mailarchive.ietf.org/arch/browse/moq/.

   Source for this draft and an issue tracker can be found at
   https://github.com/kixelated/moq-transfork.

Status of This Memo

   This Internet-Draft is submitted in full conformance with the
   provisions of BCP 78 and BCP 79.

   Internet-Drafts are working documents of the Internet Engineering
   Task Force (IETF).  Note that other groups may also distribute
   working documents as Internet-Drafts.  The list of current Internet-
   Drafts is at https://datatracker.ietf.org/drafts/current/.

   Internet-Drafts are draft documents valid for a maximum of six months
   and may be updated, replaced, or obsoleted by other documents at any
   time.  It is inappropriate to use Internet-Drafts as reference
   material or to cite them other than as "work in progress."

   This Internet-Draft will expire on 18 April 2025.

Curley                    Expires 18 April 2025                 [Page 1]
Internet-Draft                    moqtf                     October 2024

Copyright Notice

   Copyright (c) 2024 IETF Trust and the persons identified as the
   document authors.  All rights reserved.

   This document is subject to BCP 78 and the IETF Trust's Legal
   Provisions Relating to IETF Documents (https://trustee.ietf.org/
   license-info) in effect on the date of publication of this document.
   Please review these documents carefully, as they describe your rights
   and restrictions with respect to this document.  Code Components
   extracted from this document must include Revised BSD License text as
   described in Section 4.e of the Trust Legal Provisions and are
   provided without warranty as described in the Revised BSD License.

Table of Contents

   1.  Conventions and Definitions . . . . . . . . . . . . . . . . .   4
   2.  Fork  . . . . . . . . . . . . . . . . . . . . . . . . . . . .   4
   3.  Concepts  . . . . . . . . . . . . . . . . . . . . . . . . . .   4
     3.1.  Session . . . . . . . . . . . . . . . . . . . . . . . . .   5
     3.2.  Broadcast . . . . . . . . . . . . . . . . . . . . . . . .   5
     3.3.  Track . . . . . . . . . . . . . . . . . . . . . . . . . .   6
     3.4.  Group . . . . . . . . . . . . . . . . . . . . . . . . . .   6
     3.5.  Frame . . . . . . . . . . . . . . . . . . . . . . . . . .   6
     3.6.  Liveliness  . . . . . . . . . . . . . . . . . . . . . . .   7
   4.  Workflow  . . . . . . . . . . . . . . . . . . . . . . . . . .   7
     4.1.  Connection  . . . . . . . . . . . . . . . . . . . . . . .   7
     4.2.  Termination . . . . . . . . . . . . . . . . . . . . . . .   7
     4.3.  Handshake . . . . . . . . . . . . . . . . . . . . . . . .   8
     4.4.  Bidirectional Streams . . . . . . . . . . . . . . . . . .   8
       4.4.1.  Session . . . . . . . . . . . . . . . . . . . . . . .   9
       4.4.2.  Announce  . . . . . . . . . . . . . . . . . . . . . .   9
       4.4.3.  Subscribe . . . . . . . . . . . . . . . . . . . . . .  10
       4.4.4.  Fetch . . . . . . . . . . . . . . . . . . . . . . . .  10
       4.4.5.  Info  . . . . . . . . . . . . . . . . . . . . . . . .  10
     4.5.  Unidirectional  . . . . . . . . . . . . . . . . . . . . .  11
       4.5.1.  Group . . . . . . . . . . . . . . . . . . . . . . . .  11
   5.  Encoding  . . . . . . . . . . . . . . . . . . . . . . . . . .  11
     5.1.  Types . . . . . . . . . . . . . . . . . . . . . . . . . .  11
     5.2.  SESSION_CLIENT  . . . . . . . . . . . . . . . . . . . . .  12
     5.3.  SESSION_SERVER  . . . . . . . . . . . . . . . . . . . . .  12
     5.4.  SESSION_UPDATE  . . . . . . . . . . . . . . . . . . . . .  12
     5.5.  ANNOUNCE_INTEREST . . . . . . . . . . . . . . . . . . . .  12
     5.6.  ANNOUNCE  . . . . . . . . . . . . . . . . . . . . . . . .  13
     5.7.  SUBSCRIBE . . . . . . . . . . . . . . . . . . . . . . . .  13
     5.8.  SUBSCRIBE_UPDATE  . . . . . . . . . . . . . . . . . . . .  14
     5.9.  INFO  . . . . . . . . . . . . . . . . . . . . . . . . . .  14
     5.10. INFO_REQUEST  . . . . . . . . . . . . . . . . . . . . . .  15

Curley                    Expires 18 April 2025                 [Page 2]
Internet-Draft                    moqtf                     October 2024

     5.11. FETCH . . . . . . . . . . . . . . . . . . . . . . . . . .  15
     5.12. FETCH_UPDATE  . . . . . . . . . . . . . . . . . . . . . .  16
     5.13. GROUP . . . . . . . . . . . . . . . . . . . . . . . . . .  16
     5.14. GROUP_DROP  . . . . . . . . . . . . . . . . . . . . . . .  16
     5.15. FRAME . . . . . . . . . . . . . . . . . . . . . . . . . .  17
   6.  Appendix: Changelog . . . . . . . . . . . . . . . . . . . . .  17
     6.1.  moq-transfork-02  . . . . . . . . . . . . . . . . . . . .  17
     6.2.  moq-transfork-01  . . . . . . . . . . . . . . . . . . . .  17
     6.3.  moq-transfork-00  . . . . . . . . . . . . . . . . . . . .  18
       6.3.1.  Bikeshedding  . . . . . . . . . . . . . . . . . . . .  18
       6.3.2.  Stream per Group  . . . . . . . . . . . . . . . . . .  18
       6.3.3.  Subscriber's Choice . . . . . . . . . . . . . . . . .  18
       6.3.4.  Control Streams . . . . . . . . . . . . . . . . . . .  18
       6.3.5.  Unambiguous Delivery  . . . . . . . . . . . . . . . .  18
       6.3.6.  Fetch via Offset  . . . . . . . . . . . . . . . . . .  19
       6.3.7.  Track INFO  . . . . . . . . . . . . . . . . . . . . .  19
   7.  Appendix: Media Use-Cases . . . . . . . . . . . . . . . . . .  19
     7.1.  Video . . . . . . . . . . . . . . . . . . . . . . . . . .  19
       7.1.1.  Group of Pictures . . . . . . . . . . . . . . . . . .  19
       7.1.2.  Layers  . . . . . . . . . . . . . . . . . . . . . . .  20
       7.1.3.  Non-Reference Frames  . . . . . . . . . . . . . . . .  21
     7.2.  Audio . . . . . . . . . . . . . . . . . . . . . . . . . .  21
       7.2.1.  Frames  . . . . . . . . . . . . . . . . . . . . . . .  21
       7.2.2.  Groups  . . . . . . . . . . . . . . . . . . . . . . .  22
       7.2.3.  FEC . . . . . . . . . . . . . . . . . . . . . . . . .  22
     7.3.  Metadata  . . . . . . . . . . . . . . . . . . . . . . . .  22
       7.3.1.  Catalog . . . . . . . . . . . . . . . . . . . . . . .  22
       7.3.2.  Timeline  . . . . . . . . . . . . . . . . . . . . . .  23
       7.3.3.  Interaction . . . . . . . . . . . . . . . . . . . . .  23
     7.4.  Latency . . . . . . . . . . . . . . . . . . . . . . . . .  23
       7.4.1.  Real-Time . . . . . . . . . . . . . . . . . . . . . .  24
       7.4.2.  Unreliable Live . . . . . . . . . . . . . . . . . . .  25
       7.4.3.  Reliable Live . . . . . . . . . . . . . . . . . . . .  25
       7.4.4.  VOD / DVR . . . . . . . . . . . . . . . . . . . . . .  26
       7.4.5.  Upstream  . . . . . . . . . . . . . . . . . . . . . .  26
     7.5.  Broadcast . . . . . . . . . . . . . . . . . . . . . . . .  27
       7.5.1.  ABR . . . . . . . . . . . . . . . . . . . . . . . . .  27
       7.5.2.  SVC . . . . . . . . . . . . . . . . . . . . . . . . .  28
     7.6.  Conferences . . . . . . . . . . . . . . . . . . . . . . .  28
       7.6.1.  Discovery . . . . . . . . . . . . . . . . . . . . . .  29
       7.6.2.  Participants  . . . . . . . . . . . . . . . . . . . .  29
   8.  Security Considerations . . . . . . . . . . . . . . . . . . .  29
   9.  IANA Considerations . . . . . . . . . . . . . . . . . . . . .  30
   10. Normative References  . . . . . . . . . . . . . . . . . . . .  30
   Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . . .  30
   Author's Address  . . . . . . . . . . . . . . . . . . . . . . . .  30

Curley                    Expires 18 April 2025                 [Page 3]
Internet-Draft                    moqtf                     October 2024

1.  Conventions and Definitions

   The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT",
   "SHOULD", "SHOULD NOT", "RECOMMENDED", "NOT RECOMMENDED", "MAY", and
   "OPTIONAL" in this document are to be interpreted as described in
   BCP 14 [RFC2119] [RFC8174] when, and only when, they appear in all
   capitals, as shown here.

2.  Fork

   This draft is based on moq-transport-03 [moqt].  The concepts,
   motivations, and terminology are very similar on purpose.  When in
   doubt, refer to the upstream draft.

   I absolutely believe in the motivation and potential of Media over
   QUIC.  The layering is phenomenal and addresses many of the problems
   with current live media protocols.  I fully support the goals of the
   working group and the IETF process.

   But there are practical and conceptual flaws with MoqTransport that
   need to be addressed.  However it's been difficult to design such an
   experimental protocol via committee.  Despite years of arguments in
   person and on GitHub, we've yet to align on even the most critical
   property of the transport... how to utilize QUIC.  The result is
   inevitably an unwieldy "compromise", consisting of a modes for each
   party that make everything more difficult to support or explain.

   In our RUSH to standardize a protocol, the QUICR solutions have led
   to WARP in ideals.

   This fork is meant to be a constructive, alternative vision.  I would
   like to lead by example, demonstrating that you can support real
   media use-cases while simplifying the protocol.  The working group
   will keep making progress and hopefully many of these ideas will be
   incorporated.

   The appendix contains a list of high level differences between
   MoqTransport and MoqTransfork.

3.  Concepts

   MoqTransfork consists of:

   *  *Session*: An established connection between a client and server
      used to transmit any number of Broadcasts.

Curley                    Expires 18 April 2025                 [Page 4]
Internet-Draft                    moqtf                     October 2024

   *  *Broadcast*: A collection of Tracks from a single producer
      (client).  This is primarily used for routing, but Tracks within a
      Broadcast may be correlated.

   *  *Track*: An append-only series of Groups, each of which can be
      delivered and decoded independently.

   *  *Group*: An append-only series of Frames, each of which are
      delivered and decoded in order

   *  *Frame*: A sized payload of bytes, intended to represent a single
      moment in time.

   The application determines how to split data into broadcasts, tracks,
   groups, and frames.  MoqTransfork only is responsible for the
   networking and deduplication by utilizing rules encoded in headers.
   This provides robust and generic one-to-many transmission, even for
   latency sensitive applications.

3.1.  Session

   A Session consists of a connection between a QUIC client and server.

   A session is established after the necessary QUIC, WebTransport, and
   MoqTransfork handshakes.  The MoqTransfork handshake consists of
   version and extension negotiation.

   The intent is that sessions are chained together via relays.  A
   broadcaster could establish a session with an CDN ingest edge while
   the viewers establish separate sessions to CDN distribution edges.  A
   MoqTransfork session is hop-by-hop, but the application should be
   designed end-to-end.

3.2.  Broadcast

   A Broadcast is a collection of tracks from a single producer
   identified by a unique path within the session.  A MoqTransfork
   session may be used to publish and subscribe to multiple, potentially
   unrelated, broadcasts.

   A broadcast path is an a UTF-8 string which may be discovered using a
   prefix.  Correlated broadcasts should utilize this and share a path,
   for example: meeting.1234.alice and meeting.1234.bob A subscriber
   could then discover all broadcasts starting with meeting.1234.

Curley                    Expires 18 April 2025                 [Page 5]
Internet-Draft                    moqtf                     October 2024

   The application determines if tracks within a broadcast are
   correlated.  For example, a "video" track and "audio" track could
   share timestamp domains.  This is possible as a broadcast is created
   by a single publisher, avoiding the need for clock synchronization.

   A publisher can advertise available broadcasts via an ANNOUNCE
   message.  This allows a subscriber to dynamically discover available
   broadcasts.  Alternatively, the application can discover broadcasts
   via an out-of-band mechanism.

3.3.  Track

   A Track is a series of Groups within a Broadcast, identified by a
   unique name within the Broadcast.

   Each subscription is scoped to a single Track.  A subscription will
   always start at a Group boundary, either the latest group or a
   specified sequence number.  A subscriber chooses the ordering and
   priority of each subscription, hinting to the publisher which Track
   should arrive first during congestion.  This is critical for a decent
   user experience during network degradation and the core reason why
   QUIC can offer real-time latency.

   There is currently no way to discover tracks within a broadcast; it
   must be negotiated out-of-band.  This is often done with a named
   "catalog" track that lists all available tracks and their properties.
   An application may choose to use static and/or dynamic track names.

3.4.  Group

   A Group is an ordered stream of Frames within a Track.

   A group is served by a dedicated QUIC stream which may be closed on
   completion, reset by the publisher, or cancelled by the subscriber.
   An active subscription involves delivering multiple potential
   concurrent groups.  The Frames within a Group will arrive reliably
   and in order thanks to the QUIC stream.  However, Groups within a
   Track can arrive in any order or not at all, and which the
   application should be prepared to handle.

   A subscriber may FETCH a specific group starting at a given byte
   offset.  This is similar to a HTTP request and may be used to recover
   from partial failures among other things.

3.5.  Frame

   A Frame is a payload of bytes within a Group.

Curley                    Expires 18 April 2025                 [Page 6]
Internet-Draft                    moqtf                     October 2024

   A frame is used to represent a chunk of data with a known size.  A
   frame should represent a single moment in time and avoid any
   buffering that would increase latency.

3.6.  Liveliness

   A media protocol can only be considered "live" if it can handle
   degraded network congestion.  MoqTransfork handles this by
   prioritizing the most important media while the remainder is starved.

   The importance of each broadcast/track/group/frame is signaled by the
   subscriber and the publisher will attempt to obey it.  This is done
   via the Track Priority and the Group Order.  Any data that is
   excessively starved may be dropped (by either endpoint) rather than
   block the live stream.

   A publisher that serves multiple sessions, commonly a relay, should
   prioritize on a per-session basis.  Alice may want real-time latency
   with a preference for audio, while Bob may want reliable playback
   while audio is muted.  A relay MAY forward subscriber preferences
   upstream, but when there is a conflict (like the above example), the
   publisher's preference should be used as a tiebreaker.

4.  Workflow

   This section outlines the flow of messages within a MoqTransfork
   session.  See the section for Messages section for the specific
   encoding.

4.1.  Connection

   MoqTransfork runs on top of WebTransport.  WebTransport is a layer on
   top of QUIC and HTTP/3, required for web support.  The API is nearly
   identical to QUIC, however notably lacks stream IDs and has fewer
   available error codes.

   How the WebTransport connection is established is out-of-scope for
   this draft.  For example, a service MAY use the WebTransport
   handshake to perform authentication via the URL.

4.2.  Termination

   QUIC bidirectional streams have an independent send and receive
   direction.  Rather than deal with half-open states, MoqTransfork
   combines both sides.  If an endpoint closes the send direction of a
   stream, the peer MUST also close the send direction.

Curley                    Expires 18 April 2025                 [Page 7]
Internet-Draft                    moqtf                     October 2024

   MoqTransfork contains many long-lived transactions, such as
   subscriptions and announcements.  These are terminated when the
   underlying QUIC stream is terminated.

   To terminate a stream, an endpoint may: - close the send direction
   (STREAM with FIN) to gracefully terminate (all messages are flushed).
   - reset the send direction (RESET_STREAM) to immediately terminate.

   After resetting the send direction, an endpoint MAY close the recv
   direction (STOP_SENDING).  However, it is ultimately the other peer's
   responsibility to close their send direction.

4.3.  Handshake

   After a connection is established, the client opens a Session Stream
   and sends a SESSION_CLIENT message, to which the server replies with
   a SESSION_SERVER message.  The session is active until either
   endpoint closes or resets the Session Stream.

   This session handshake is used to negotiate the MoqTransfork version
   and any extensions.  See the Extension section for more information.

4.4.  Bidirectional Streams

   Bidirectional streams are primarily used for control streams.  The
   first byte of each stream indicates the Stream Type.

   The second column in this table indicates which endpoint or role will
   create a stream.

                     +=====+===========+============+
                     |  ID | Type      | Role       |
                     +=====+===========+============+
                     | 0x0 | Session   | Client     |
                     +-----+-----------+------------+
                     | 0x1 | Announced | Subscriber |
                     +-----+-----------+------------+
                     | 0x2 | Subscribe | Subscriber |
                     +-----+-----------+------------+
                     | 0x3 | Fetch     | Subscriber |
                     +-----+-----------+------------+
                     | 0x4 | Info      | Subscriber |
                     +-----+-----------+------------+

                                 Table 1

Curley                    Expires 18 April 2025                 [Page 8]
Internet-Draft                    moqtf                     October 2024

4.4.1.  Session

   The Session stream contains all messages that are session level.

   The client MUST open a single Session Stream immediately after
   establishing the QUIC/WebTransport session.  The client sends a
   SESSION_CLIENT message and the server replies with a SESSION_SERVER
   message.

   Afterwards, both endpoints SHOULD send SESSION_UPDATE messages, such
   as after a significant change in the session bitrate.

   The session remains active until the Session Stream is closed or
   reset by either endpoint.

4.4.1.1.  Versions

   The SESSION_CLIENT and SESSION_SERVER messages are used to negotiate
   versions.  This draft's version is combined with the constant
   0xff0bad00.

   For example, moq-transfork-draft-03 is identified as 0xff0bad03.

   A client may advertise support for multiple versions.  The server
   chooses one of the supported versions, or errors if none of the
   listing versions are supported.

4.4.2.  Announce

   A subscriber can open a Announce Stream to discover broadcasts
   matching a prefix.  This is OPTIONAL and the application can
   determine broadcast paths out-of-band.

   The subscriber MUST start the stream with a ANNOUNCE_INTEREST
   message.  The publisher MAY reply with any number of ANNOUNCE message
   to indicate when a broadcast has started or stopped.  Both sides may
   close/reset the stream at any point.

   The publisher SHOULD send an ANNOUNCE message for each broadcast path
   that matches the prefix.  There MAY be multiple Announce Streams,
   potentially containing overlapping prefixes, that get their own copy
   of each ANNOUNCE.  The publisher MAY choose to not ANNOUNCE matching
   streams, such as when they are private or the prefix is too
   expansive.  The publisher SHOULD close the stream with an error code
   when this happens.

Curley                    Expires 18 April 2025                 [Page 9]
Internet-Draft                    moqtf                     October 2024

   When a broadcast has ended, the publisher sends an ANNOUNCE message
   with an identical name.  This will toggle the availability of the
   broadcast and avoids the need for a dedicated UNANNOUNCE message.

4.4.3.  Subscribe

   A subscriber can open a Subscribe Stream to request a named track
   within a broadcast.

   The subscriber MUST start a Info Stream with a SUBSCRIBE message
   followed by any number SUBSCRIBE_UPDATE messages.  The publisher MUST
   reply with an INFO message followed by any number of GROUP_DROPPED
   messages.  A publisher MAY reset the stream at any point if it is
   unable to serve the subscription.

   The publisher MUST transmit a complete Group Stream or a
   GROUP_DROPPED message for each Group within the subscription range.
   This means the publisher MUST transmit a GROUP_DROPPED if a Group
   Stream is reset.  The subscriber SHOULD close the subscription when
   all GROUP and GROUP_DROP messages have been received, and the
   publisher MAY close the subscription after all messages have been
   acknowledged.

4.4.4.  Fetch

   A subscriber can open a Fetch Stream to receive a single Group at a
   specified offset.  This is primarily used to recover from an abrupt
   stream termination, causing the truncation of a Group.

   The subscriber MUST start a Fetch Stream with a FETCH message
   followed by any number of FETCH_UPDATE messages.  The publisher MUST
   reply with the contents of a Group Stream, except starting at the
   specified offset _after_ the GROUP message.  Note that this includes
   any FRAME messages.

   The fetch is active until both endpoints close the stream, or either
   endpoint resets the stream.

4.4.5.  Info

   A subscriber can open an Info Stream to request information about a
   track.  This is not often necessary as SUBSCRIBE will trigger an INFO
   reply.

   The subscriber MUST start the stream with a INFO_REQUEST message.
   The publisher MUST reply with an INFO message or reset the stream.
   Both endpoints MUST close the stream afterwards.

Curley                    Expires 18 April 2025                [Page 10]
Internet-Draft                    moqtf                     October 2024

4.5.  Unidirectional

   Unidirectional streams are used for subscription data.

                       +=====+========+===========+
                       |  ID | Stream | Role      |
                       +=====+========+===========+
                       | 0x0 | Group  | Publisher |
                       +-----+--------+-----------+

                                 Table 2

4.5.1.  Group

   A publisher creates Group Streams in response to a Subscribe Stream.

   A Group Stream MUST start with a GROUP message and MAY be followed by
   any number of FRAME messages.  An application MAY use an empty GROUP
   and/or FRAME to signal gaps.

   Both the publisher and subscriber MAY reset the stream at any time.
   When a Group stream is reset, the publisher MUST send a GROUP_DROP
   message on the corresponding Subscribe stream.  A future version of
   this draft may utilize reliable reset instead.

5.  Encoding

   This section covers the encoding of each message.

   Note that these message do not currently contain a type identifier.
   The message type is determined by the stream type and the current
   state.

5.1.  Types

   Unless otherwise indicated, all types are big-endian (network order).

   (i): A QUIC VarInt with a maximum size of 62-bits.  The highest two
   bits in the first byte indicate the total size; 1 bytes, 2 bytes, 4
   bytes or 8 bytes.  This value is unsigned unless otherwise indicated.

   (b): VarInt size followed by that many indicated bytes.

   (s): A VarInt size followed by that many indicated bytes.  The bytes
   MUST be a valid UTF-8 string.

Curley                    Expires 18 April 2025                [Page 11]
Internet-Draft                    moqtf                     October 2024

5.2.  SESSION_CLIENT

   The client advertises supported versions and any extensions.

   SESSION_CLIENT Message {
     Supported Versions Count (i)
     Supported Version (i)
     Extension Count (i)
     [
       Extension ID (i)
       Extension Payload (b)
     ]...
   }

5.3.  SESSION_SERVER

   The server responds with the selected version and any extensions.

   SESSION_SERVER Message {
     Selected Version (i)
     Extension Count (i)
     [
       Extension ID (i)
       Extension Payload (b)
     ]...
   }

5.4.  SESSION_UPDATE

   SESSION_UPDATE Message {
     Session Bitrate (i)
   }

   *Session Bitrate*: The estimated bitrate of the QUIC connection in
   bits per second.  This SHOULD be sourced directly from the QUIC
   congestion controller.  A value of 0 indicates that this information
   is not available.

5.5.  ANNOUNCE_INTEREST

   A subscriber sends an ANNOUNCE_INTEREST message to indicate it wants
   any cooresponding ANNOUNCE messages.

   ANNOUNCE_INTEREST Message {
     Broadcast Prefix (s),
   }

Curley                    Expires 18 April 2025                [Page 12]
Internet-Draft                    moqtf                     October 2024

   *Broadcast Prefix*: Indicate interest for any broadcasts that start
   with this prefix.  The publisher SHOULD reply with an ANNOUNCE
   message for any matching broadcasts.

5.6.  ANNOUNCE

   A publisher sends an ANNOUNCE message to advertise a broadcast.

   ANNOUNCE Message {
     Broadcast Path (s),
   }

   *Broadcast Path* The broadcast path.  This MUST start with the
   requested prefix.

5.7.  SUBSCRIBE

   SUBSCRIBE is sent by a subscriber to start a subscription.

   SUBSCRIBE Message {
     Subscribe ID (i)
     Broadcast Name (b)
     Track Name (b)
     Track Priority (i)
     Group Order (i)
     Group Expires (i)
     Group Min (i)
     Group Max (i)
   }

   *Subscribe ID*: A unique idenfier chosen by the subscriber.  A
   Subscribe ID MUST NOT be reused within the same session, even if the
   prior subscription has been closed.

   *Broadcast Name*: The name of the broadcast.  A zero-sized name is
   valid but not recommended.

   *Track Name*: The name of the track.  A zero-sized name is valid but
   not recommended.

   *Track Priority*: The transmission priority of the subscription
   relative to all other active subscriptions within the session.  The
   publisher SHOULD transmit _higher_ values first during congestion.

   *Group Order*: The transmission order of the Groups within the
   subscription.  The publisher SHOULD transmit groups based on their
   sequence number in default (0), ascending (1), or descending (2)
   order.

Curley                    Expires 18 April 2025                [Page 13]
Internet-Draft                    moqtf                     October 2024

   *Group Expires*: A duration in milliseconds that applies to all
   Groups within the subscription.  The group SHOULD be dropped if this
   duration has elapsed after group has finished, including any time
   spent cached.  The publisher's Group Expires value (via INFO) SHOULD
   be used instead when smaller.

   *Group Min*: The minimum group sequence number plus 1.  A value of 0
   indicates the latest Group Sequence as determined by the publisher.

   *Group Max*: The maximum group sequence number plus 1.  A value of 0
   indicates there is no maximum and the subscription continues
   indefinitely.

5.8.  SUBSCRIBE_UPDATE

   A subscriber can modify a subscription with a SUBSCRIBE_UPDATE
   message.

   SUBSCRIBE_UPDATE Message {
     Track Priority (i)
     Group Order (i)
     Group Expires (i)
     Group Min (i)
     Group Max (i)
   }

   *Track Priority*: The new track priority; see SUBSCRIBE.  The
   publisher SHOULD use the new priority for any blocked streams.

   *Group Order*: The new group order; see SUBSCRIBE.  The publisher
   SHOULD use the new order for any blocked streams.

   *Group Min*: The new minimum group sequence, or 0 if there is no
   update.  This value MUST NOT be smaller than prior SUBSCRIBE and
   SUBSCRIBE_UPDATE messages.

   *Group Max*: The new maximum group sequence, or 0 if there is no
   update.  This value MUST NOT be larger than prior SUBSCRIBE or
   SUBSCRIBE_UPDATE messages.

   If the Min and Max are updated, the publisher SHOULD reset any
   blocked streams that are outside the new range.

5.9.  INFO

   The INFO message contains the current information about a track.

Curley                    Expires 18 April 2025                [Page 14]
Internet-Draft                    moqtf                     October 2024

   INFO Message {
     Track Priority (i)
     Group Latest (i)
     Group Order (i)
     Group Expires (i)
   }

   *Track Priority*: The priority of this track within the _broadcast_.
   Note that this is slightly different than SUBSCRIBE, which is scoped
   to a session not broadcast.  The publisher SHOULD transmit
   subscriptions with _higher_ values first during congestion.

   *Group Latest*: The latest group as currently known by the publisher.
   A relay without an active subscription SHOULD forward this request
   upstream

   *Group Order*: The publisher's intended order of the groups within
   the subscription: none (0), ascending (1), or descending (2).

   *Group Expires*: A duration in milliseconds.  The group SHOULD be
   dropped if this duration has elapsed after group has finished,
   including any time spent cached.  The Subscriber's Group Expires
   value SHOULD be used instead when smaller.

5.10.  INFO_REQUEST

   The INFO_REQUEST message is used to request an INFO response.

   INFO_REQUEST Message {
     Broadcast Name (b)
     Track Name (b)
   }

5.11.  FETCH

   A subscriber can request a byte offset within a Group with a FETCH
   message.

   FETCH Message {
     Broadcast Name (b)
     Track Name (b)
     Track Priority (i)
     Group Sequence (i)
     Group Offset (i)
   }

Curley                    Expires 18 April 2025                [Page 15]
Internet-Draft                    moqtf                     October 2024

   *Track Priority*: The priority of the group relative to all other
   FETCH and SUBSCRIBE requests within the session.  The publisher
   should transmit _higher_ values first during congestion.

   *Group Offset*: The requested offset in bytes _after_ the GROUP
   message.

5.12.  FETCH_UPDATE

   A subscriber can modify a FETCH request with a FETCH_UPDATE message.

   FETCH_UPDATE Message {
     Track Priority (i)
   }

   *Track Priority*: The priority of the group relative to all other
   FETCH and SUBSCRIBE requests within the session.  The publisher
   should transmit _higher_ values first during congestion.

5.13.  GROUP

   The GROUP message contains information about a Group, as well as a
   reference to the subscription being served.

   GROUP Message {
     Subscribe ID (i)
     Group Sequence (i)
   }

   *Subscribe ID*: The corresponding Subscribe ID.  This ID is used to
   distinguish between multiple subscriptions for the same track.

   *Group Sequence*: The sequence number of the group.

5.14.  GROUP_DROP

   A publisher transmits a GROUP_DROP message when it is unable to serve
   a group for a SUBSCRIBE.

   GROUP_DROP {
     Group Start (i)
     Group Count (i)
     Group Error Code (i)
   }

   *Group Start*: The sequence number for the first group within the
   dropped range.

Curley                    Expires 18 April 2025                [Page 16]
Internet-Draft                    moqtf                     October 2024

   *Group Count*: The number of additional groups after the first.  This
   value is 0 when only one group is dropped.

   *Error Code*: An error code indicated by the application.

5.15.  FRAME

   The FRAME message is a payload at a specific point of time.

   FRAME Message {
     Payload (b)
   }

   *Payload*: An application specific payload.  A generic library or
   relay MUST NOT inspect or modify the contents unless otherwise
   negotiated.

6.  Appendix: Changelog

   Notable changes between versions of this draft.

6.1.  moq-transfork-02

   *  Document version numbers.

   *  Added ANNOUNCE_INTEREST to opt-into ANNOUNCE messages.

   *  Remove ROLE extension.

6.2.  moq-transfork-01

   *  Removed datagram support

   *  Removed native QUIC support

   *  Moved Expires from GROUP to SUBSCRIBE

   *  Added FETCH_UPDATE

   *  Added ROLE=Any

   *  Track Priority is now descending.

   Datagram and native QUIC support may be re-added in a future draft.

Curley                    Expires 18 April 2025                [Page 17]
Internet-Draft                    moqtf                     October 2024

6.3.  moq-transfork-00

   Based on moq-transport-03.  The significant changes have been broken
   into sections.

6.3.1.  Bikeshedding

   *  Renamed Track Namespace to Broadcast

   *  Renamed Object to Frame

6.3.2.  Stream per Group

   The MoQ WG couldn't agree on how to utilize QUIC streams, so the
   compromise was to support multiple modes and let the application
   choose.  This is a headache for too many reasons to list.
   MoqTransfork only "supports" a stream per group.

6.3.3.  Subscriber's Choice

   MoqTransfork moves most decision making to the subscriber, so a
   single publisher can support multiple diverse subscribers.  The
   publisher provides a default value to resolve conflicts when
   deduplicating.

6.3.4.  Control Streams

   Transactions like Announce and Subscribe use their own control
   stream, inheriting the stream state machine for error handling.

   This replaces excessive message types in MoqTransport: - Removed
   ANNOUNCE_ERROR - Removed ANNOUNCE_DONE - Removed UNANNOUNCE - Removed
   SUBSCRIBE_OK - Removed SUBSCRIBE_ERROR - Removed SUBSCRIBE_DONE -
   Removed UNSUBSCRIBE

6.3.5.  Unambiguous Delivery

   With MoqTransfork, the subscriber knows if a group/frame will be
   delivered or was dropped.

   *  Group Sequences are sequential

   *  All sequences within the SUBSCRIBE range are delivered or dropped.

   *  GROUP_DROP when a group is dropped.

Curley                    Expires 18 April 2025                [Page 18]
Internet-Draft                    moqtf                     October 2024

6.3.6.  Fetch via Offset

   A reconnecting subscriber can request the retransmission of a group/
   stream at a given byte offset.  Resumption in MoqTransport is more
   complicated and can only occur at object/group boundaries.

6.3.7.  Track INFO

   Added a mechanism to request information about the current track
   state.

   *  Added INFO_REQUEST and INFO

   *  Replaced SUBSCRIBE_OK with INFO

7.  Appendix: Media Use-Cases

   These are some recommended ways to use MoqTransfork for media
   delivery.

7.1.  Video

   Video encoding involves complex dependencies between frames/slices.
   The terminology in this section stems from H.264 but is applicable to
   most modern codecs.

   Each frame of video is encoded as one or more slices but to simplify
   the discussion, we'll refer to a slice as a frame.  There are three
   types of frames:

   *  *I-Frame*: A frame that can be decoded independently.

   *  *P-Frame*: A frame that depends on previous frames.

   *  *B-Frame*: A frame that depends on previous or future frames.

7.1.1.  Group of Pictures

   A simple application can ignore the complexity of P/B frames and
   focus on I-Frames.  This is the optimal approach for many encoding
   configurations.

   Each I-Frame begins a Group of Pictures (GoP).  A GoP is a set of
   frames that MAY depend on each other and MUST NOT depend on other
   GoPs.  Each frame has a decode order (DTS) and a frame MUST NOT
   depend on frames with a higher DTS.

Curley                    Expires 18 April 2025                [Page 19]
Internet-Draft                    moqtf                     October 2024

   This perfectly maps to a QUIC stream, as they too are independent and
   ordered.  The easiest way to use MoqTransfork is to send each GoP as
   a GROUP with each frame as a FRAME, hence the names.

   Each SUBSCRIBE starts at a Group to ensure that it starts with an
   I-Frame.  Each Group is delivered in decode order ensuring that all
   frames are decodable (no artifacts).

   A subscriber can choose the Group Order based on the desired user
   experience:

   *  SUBSCRIBE order=DESC: Transmits new Groups first to allow
      skipping, intended for low-latency live streams.

   *  SUBSCRIBE order=ASC: Transmits old Groups first to avoid skipping,
      intended for VOD and reliable live streams.

   A publisher or subscriber can skip the remainder of a Group by
   resetting a Group Stream or by issuing a SUBSCRIBE_UPDATE.  A FETCH
   can be used to recover any partial groups.

7.1.2.  Layers

   An advanced application can subdivide a GoP into layers.

   The most comprehensive way to do this is with Scalable Video Coding
   (SVC).  There is a base layer and one or more enhancement layers that
   depend on lower layers.  For example, a 4K stream could be broken
   into 4K, 1080p, and 360p (base) layers.  However, SVC has limited
   support and is complex to encode.

   Another approach is to use temporal scalability via something like
   B-pyramids.  The frames within a GoP are sub-divided based on their
   dependencies, intentionally creating a hierarchy.  For example, even
   frames could be prevented from referencing odd frames, creating a
   base 30fps layer and an enhancement 60fps layer.  This is effectively
   a custom SVC scheme however it's limited to time and doesn't require
   special decoder support.

   The purpose of these layers is to support degrading the quality of
   the broadcast.  A subscriber could limit bandwidth usage by choose to
   only receive the base layer or a subset of the enhancements layers.
   During congestion, the base layer can be prioritized while the
   enhancement layers can be deprioritized or dropped.  However, the
   cost is a small increase in bitrate (10%) as limiting potential
   references can only hurt the compression ratio.

Curley                    Expires 18 April 2025                [Page 20]
Internet-Draft                    moqtf                     October 2024

   When using MoqTransfork, each layer is delivered as a separate Track.
   This allows the subscriber to choose which layers to receive and how
   to prioritize them in SUBSCRIBE.  It also enables layers to be
   prioritized within the layer application, for example Alice's base
   layer is more important than Bob's enhancement layer.

   The application is responsible for determining the relationship
   between layers, since they're unrelated tracks as MoqTransport is
   concerned.  The application could use a catalog to advertise the
   layers and how to synchronize them, for example based on the Group
   Sequence.

7.1.3.  Non-Reference Frames

   While not explicitly stated, I believe the complexity in MoqTransport
   stems almost entirely from a single use-case: the ability to drop
   individual non-reference frames in the middle of a group.

   In theory, transmitting enhancement layers as tracks like mentioned
   above could introduce head-of-line blocking depending on the
   encoding.  This would occur when enhancement layers are not self-
   referential, a rare configuration which also hurts the compression
   ratio.  And in practice, there's no discernable user impact given the
   disproportionate size difference between base and enhancement layers.

   The ability to drop individual non-reference frames in the middle of
   a group is an explicit non-goal for MoqTransfork.

7.2.  Audio

   Unlike video, audio is simple and yet has perhaps more potential for
   optimization.

7.2.1.  Frames

   Audio samples are very small and for the sake of compression, are
   grouped into a frame.  This depends on the codec and the sample rate
   but each frame is typically 10-50ms of audio.

   Audio frames are independent, which means they map nicely to
   MoqTransfork Groups.  Each audio frame can be transmitted as a GROUP
   with a single FRAME.

Curley                    Expires 18 April 2025                [Page 21]
Internet-Draft                    moqtf                     October 2024

7.2.2.  Groups

   Audio FRAMEs can also be combined into periodic GROUPs to reduce
   overhead at the cost of some introducing head-of-line blocking.  This
   won't increase latency except under significant congestion as each
   FRAME is still streamed.

   For example, an application could then subscribe to video and audio
   starting at group X for both tracks, instead of trying to maintain a
   mapping between the two based on timestamp.  This is quite common in
   HLS/DASH as there's no reason to subdivide audio segments at frame
   boundaries.

7.2.3.  FEC

   Real-time audio applications often use Forward Error Correction (FEC)
   to conceal packet loss.  Audio frames are a good candidate for FEC
   given that they are small and independent.

   In an ideal world, FEC would be performed by QUIC based on the
   properties of the hop.  However this is not currently not supported
   and FEC is left to the application.

   In MoqTransfork, each FEC packet is transmitted as a separate GROUP
   with a single FRAME.  A real-time subscriber issues a SUBSCRIBE with
   an aggressive Group Expires value in the milliseconds range.  The
   publisher will drop any Groups that have not been transmitted or
   acknowledged within this time frame, potentially causing them to be
   lost.

   Normally, FEC is performed by transmitting individual packets once as
   datagrams.  However, QUIC streams are useful as they allow
   retransmissions when Group Expires is smaller than the RTT.  If the
   RTT is too high, then the RESET_STREAM frame adds some overhead but
   it's inconsequential (~10 more bytes).  This enables retransmitting
   lost packets on short hops and otherwise relying on FEC for long
   hops.

7.3.  Metadata

   There's a number of non-media use cases that can be served by
   MoqTransfork.

7.3.1.  Catalog

   Originally part of the transport itself, the catalog is a list of all
   tracks within a broadcast.  It's since been delegated to the
   application and is now just another track with a well-known name.

Curley                    Expires 18 April 2025                [Page 22]
Internet-Draft                    moqtf                     October 2024

   The proposed MoQ catalog format supports live updates.  It does this
   by encoding a base JSON blob and then applying JSON patches over
   time.  If the number of deltas becomes too large, the producer can
   start over with a new base JSON blob.

   In MoqTransfork, the base and all deltas are a single GROUP.  The
   base is the first FRAME and all deltas are subsequent FRAMEs.  The
   producer can create a new GROUP to start over, repeating the process.

7.3.2.  Timeline

   Another track that is commonly pitched is a timeline track.  This
   records the presentation timestamp of each Group, giving a VOD viewer
   to seek to a specific time.

   The timeline track is a single Group containing a Frame for each
   timestamp.  The live nature of the timeline track is great for DVR
   applications while being concise enough for VOD.  Timed metadata
   would use a similar approach or perhaps leverage this track.

7.3.3.  Interaction

   Another common use-case is to transmit user interactions, such as
   controller inputs or chat messages.  It's up to the application to
   determine the format and encoding of these messages.

   Let's take controller input as an example.  The application needs to
   determine its loss vs latency tolerance, as reordering or dropping
   inputs will lead to a poor user experience.

   *  If you don't want loss, then use a single GROUP with a FRAME per
      input.

   *  If you don't want latency, then use a GROUP per input with a
      single FRAME.

   *  If you want a hybrid, then use form of clustering inputs into
      GROUPs and FRAMEs based on time.

   A publisher could monitor the session RTT or stream acknowledgements
   to get a sense of the latency and create Groups accordingly.
   However, this only applies to the first hop and won't be applicable
   when relays are involved.

7.4.  Latency

   One explicit goal of MoqTransfork is to support multiple latency
   targets.

Curley                    Expires 18 April 2025                [Page 23]
Internet-Draft                    moqtf                     October 2024

   This is accomplished by using the same Tracks and Group for all
   viewers, but slightly changing the behavior based on the
   subscription.  This is driven by the subscriber, allowing them to
   choose the trade-off between latency and reliability.  This may be
   done on the fly via SUBSCRIBE_UPDATE, for example if a high-latency
   viewer wishes to join the stage and suddenly needs real-time latency.

   The below examples assume one audio and one video track.  See the
   next section for more complicated broadcasts.

7.4.1.  Real-Time

   Real-time latency is accomplished by prioritizing the most important
   media during congestion and skipping the rest.

   This is slightly different from other media protocols which instead
   opt to drop packets.  The end result is similar, but prioritization
   means utilizing all available bandwidth as determined by the
   congestion controller.  A subscriber or publisher can reset groups to
   avoid wasting bandwidth on old data.

   A real-time viewer could issue:

   SUBSCRIBE track=audio priority=1 order=DESC group_expires=100ms
   SUBSCRIBE track=video priority=0 order=DESC group_expires=100ms

   In this example, audio is higher priority than video, and newer
   groups are higher priority than older groups.  Suppose a viewer fell
   behind after a burst of congestion and has to decide which groups to
   deliver next.  This configuration would result in the transmission
   order:

   GROUP track=audio sequence=102
   GROUP track=audio sequence=101
   GROUP track=audio sequence=100
   GROUP track=video sequence=5
   GROUP track=video sequence=4

   The user experience depends on the amount of congestion:

   *  If there's no congestion, all audio and video is delivered.

   *  If there's moderate congestion, the tail of the old video group is
      dropped.

   *  If there's severe congestion, all video will be late/dropped and
      some audio groups/frames will be dropped.

Curley                    Expires 18 April 2025                [Page 24]
Internet-Draft                    moqtf                     October 2024

   The value of group_expires is optional.  In this example it means
   that the publisher automatically resets each group 100ms after they
   are no longer the latest.  It's recommended to use the maximum jitter
   buffer size.

7.4.2.  Unreliable Live

   Unreliable live is a term I made up.  Basically we want low latency,
   but we don't need it at all costs and we're willing to skip some
   video to achieve it.  This is useful for broadcasts where latency is
   important but so is picture quality.

   An unreliable live viewer could issue:

   SUBSCRIBE track=audio priority=1 order=ASC
   SUBSCRIBE track=video priority=0 order=DESC group_expires=3s

   This example is different from the real-time one in that audio is
   fully reliable and delivered in order.  Of course this is optional
   and up to the application, as it will result in buffering during
   significant congestion.  If the viewer goes through a tunnel and then
   comes back online, they won't miss any audio.

   A key difference is that our jitter buffer is much larger for video,
   3s in this example.  The player will tolerate up to 3s of latency
   before it starts skipping past video frames.  Note that the
   group_expires value can be increased during buffering by issuing a
   SUBSCRIBE_UPDATE.

7.4.3.  Reliable Live

   Reliable live is another term I made up.  This is when we have a live
   stream but primarily care about picture quality.  A good example is a
   sports game where you want to see every frame.

   A reliable live viewer could issue:

   SUBSCRIBE track=audio priority=0 order=ASC
   SUBSCRIBE track=video priority=0 order=ASC

   This will deliver both audio and video in order, and with the same
   priority.  The viewer won't miss any content unless the publisher
   resets a group.  However, this can result in buffering during
   congestion and provides a similar user experience to HLS/DASH.

Curley                    Expires 18 April 2025                [Page 25]
Internet-Draft                    moqtf                     October 2024

7.4.4.  VOD / DVR

   Video on Demand (VOD) and Digital Video Recorder (DVR) both involve
   seeking backwards in a live stream.  MoqTransfork can serve this use-
   case too, don't worry.

   A VOD viewer could issue:

   SUBSCRIBE track=audio priority=0 order=ASC start=345 end=396
   SUBSCRIBE track=video priority=0 order=ASC start=123 end=134

   The application is responsible for determining the group sequence
   numbers based on the desired timestamp.  This could be done via a
   timeline track or out-of-band.

   A subscriber will need a specific end or else it will download too
   much data at once, as old media is transmitted at network speed and
   not encode speed.  It will need to issue an updated SUBSCRIBE to
   expand the range as playback continues and the buffer depletes.  A
   subscriber could use SUBSCRIBE_UPDATE, however there are race
   conditions involved.

   A DVR player does the same thing but can automatically support
   joining the live stream.  It's perfectly valid to specify a end in
   the future and it will behave like reliable live viewer once it
   reaches the live playhead.

   Alternatively, a DVR player could prefetch the live playhead by
   issuing a parallel SUBSCRIBE at a lower priority.  This would allow
   playback to immediately continue after clicking the "Go Live" button,
   canceling or deprioritizing the VOD subscription.

   SUBSCRIBE track=video priority=1 order=ASC start=123 end=134
   SUBSCRIBE track=video priority=0 order=DESC

7.4.5.  Upstream

   All of these separate viewers could be watching the same broadcast.
   How is a relay supposed to fetch the content from upstream?

   MoqTransfork addresses this by providing the publisher's Track
   Priority and Group Order in the INFO message.  This is the intended
   behavior for the first hop and dictates which viewers are preferred.

   For example, suppose the producer chooses:

   INFO track=audio priority=1 order=DESC
   INFO track=video priority=0 order=DESC

Curley                    Expires 18 April 2025                [Page 26]
Internet-Draft                    moqtf                     October 2024

   If Alice is watching a VOD and issues:

   SUBSCRIBE track=audio priority=0 order=ASC
   SUBSCRIBE track=video priority=0 order=ASC

   If Bob is watching real-time and issues:

   SUBSCRIBE track=audio priority=1 order=DESC
   SUBSCRIBE track=video priority=0 order=DESC

   For any congestion on the first mile, then the relay will improve
   Bob's experience by following the producer's preference.  However any
   congestion on the last mile will always use the viewer's preference.

   A relay should use the publisher's priority/order only when there's a
   conflict.  If viewers have the same priority/order, then the relay
   should use the viewer's preference and it can always issue a
   SUBSCRIBE_UPDATE when this changes.

7.5.  Broadcast

   A broadcast is a collection of tracks from a single producer.  This
   usually includes an audio track and/or a video track, but there are
   reasons to have more than that.

7.5.1.  ABR

   Virtually all mass fan-out use-cases rely on Adaptive Bitrate (ABR)
   streaming.  The idea is to encode the same content at multiple
   bitrates and resolutions, allowing the viewer to choose based on
   their unique situation.

   MoqTransfork unsurprisingly supports this via multiple Tracks, but
   relies on the application to determine the relationship between them.
   This is often done via a catalog track that details each track's
   name, bitrate, resolution, and codec.  This includes how a group in
   one track corresponds to a group in another track.  A common approach
   is to use the same Group Sequence number for all tracks, or perhaps
   utilize a timeline track to map between Group Sequences and
   presentation timestamps.

   The viewer may limit the available tracks based on capabilities or
   preferences.  For example, the device may not support the 4K track
   since it uses AV1, or the screen size may be too small to justify the
   bandwidth.  This is easy enough to support; just ignore these tracks
   in the catalog.

Curley                    Expires 18 April 2025                [Page 27]
Internet-Draft                    moqtf                     October 2024

   The primary reason to use ABR is to adapt to changing network
   conditions.  The viewer learns about the estimated bandwidth via the
   SESSION_UPDATE message, or by measuring network traffic and can then
   choose the appropriate track based on bitrate.

   Transitioning between tracks can be done seamlessly by utilizing
   prioritization.  For example, suppose a viewer is watching the 360p
   track and wants to switch to 1080p at group 69.

   A real-time or unreliable live viewer could issue:

   SUBSCRIBE_UPDATE track=360p  priority=0 order=DESC end=69
   SUBSCRIBE        track=1080p priority=1 order=DESC start=69

   A reliable live or VOD viewer could issue:

   SUBSCRIBE_UPDATE track=360p  priority=1 order=ASC end=69
   SUBSCRIBE        track=1080p priority=0 order=ASC start=69

   The difference between them is whether to prioritize the old track or
   the new track.  In both scenarios, the subscription will seamlessly
   switch at group 69 even if it's seconds in the future.  The same
   behavior can be used to switch down.

7.5.2.  SVC

   We touched on SVC before, but it's worth mentioning as an alternative
   to ABR.  I want to see it used more often but I doubt it will be.

   Instead of choosing the track based on the bitrate, the viewer
   subscribes to them all:

   SUBSCRIBE track=360p  priority=2 order=DESC
   SUBSCRIBE track=1080p priority=1 order=DESC
   SUBSCRIBE track=4k    priority=0 order=DESC

   During congestion, the 4k enhancement layer will be deprioritized
   followed by the 1080p enhancement layer.  This is a more efficient
   use of bandwidth than ABR, but it requires more complex encoding.

7.6.  Conferences

   Some applications involve multiple producers, such as a conference
   calls or a live events.  Even though these are separate broadcasts
   from potentially separate origins, MoqTransfork can still serve them
   over the same session.

Curley                    Expires 18 April 2025                [Page 28]
Internet-Draft                    moqtf                     October 2024

7.6.1.  Discovery

   The first step to joining a conference is to discover the available
   broadcasts.

   There is currently no discovery mechanism in MoqTransfork.  However,
   an application can build one on top of a MoqTransfork track (of
   course!).

   For example, suppose we have a conference room called room.12345.  An
   index service could produce a room.12345 track that lists all
   broadcasts within the room.  When Alice joins and ANNOUNCES
   room.12345.alice, the index service could update the room.12345 track
   to add a new FRAME +alice.  The same can be done to remove her when
   she leaves.

7.6.2.  Participants

   Extending the idea that audio is more important than video, we can
   prioritize tracks regardless of the source.  This works because
   SUBSCRIBE priority is scoped to the session and not the broadcast.

   SUBSCRIBE broadcast=alice track=audio priority=3
   SUBSCRIBE broadcast=frank track=audio priority=3
   SUBSCRIBE broadcast=alice track=video priority=1
   SUBSCRIBE broadcast=frank track=video priority=1

   When Alice starts talking or is focused, we can actually issue a
   SUBSCRIBE_UPDATE to increase her priority:

   SUBSCRIBE_UPDATE broadcast=alice track=audio priority=2
   SUBSCRIBE_UPDATE broadcast=frank track=video priority=0

   Note that audio is still more important than video, but Alice is now
   more important than Frank. (poor Frank)

   This concept can further be extended to work with SVC or ABR:

   SUBSCRIBE broadcast=alice track=360p priority=4
   SUBSCRIBE broadcast=frank track=360p priority=3
   SUBSCRIBE broadcast=alice track=720p priority=2
   SUBSCRIBE broadcast=frank track=720p priority=1

8.  Security Considerations

   TODO Security

Curley                    Expires 18 April 2025                [Page 29]
Internet-Draft                    moqtf                     October 2024

9.  IANA Considerations

   This document has no IANA actions.

10.  Normative References

   [moqt]     Curley, L., Pugin, K., Nandakumar, S., Vasiliev, V., and
              I. Swett, "Media over QUIC Transport", Work in Progress,
              Internet-Draft, draft-ietf-moq-transport-06, 19 September
              2024, <https://datatracker.ietf.org/doc/html/draft-ietf-
              moq-transport-06>.

   [RFC2119]  Bradner, S., "Key words for use in RFCs to Indicate
              Requirement Levels", BCP 14, RFC 2119,
              DOI 10.17487/RFC2119, March 1997,
              <https://www.rfc-editor.org/rfc/rfc2119>.

   [RFC8174]  Leiba, B., "Ambiguity of Uppercase vs Lowercase in RFC
              2119 Key Words", BCP 14, RFC 8174, DOI 10.17487/RFC8174,
              May 2017, <https://www.rfc-editor.org/rfc/rfc8174>.

Acknowledgments

   TODO acknowledge.

Author's Address

   Luke Curley
   Discord
   Email: kixelated@gmail.com

Curley                    Expires 18 April 2025                [Page 30]