Skip to main content

Benchmarking Methodology for Stateful NATxy Gateways using RFC 4814 Pseudorandom Port Numbers
draft-ietf-bmwg-benchmarking-stateful-06

Revision differences

Document history

Date Rev. By Action
2024-04-12
06 Gábor Lencse New version available: draft-ietf-bmwg-benchmarking-stateful-06.txt
2024-04-12
06 (System) New version approved
2024-04-12
06 (System) Request for posting confirmation emailed to previous authors: Gabor Lencse , Keiichi Shima
2024-04-12
06 Gábor Lencse Uploaded new revision
2024-04-11
05 Warren Kumari Changed action holders to Keiichi Shima, Gábor Lencse (https://mailarchive.ietf.org/arch/msg/bmwg/nnud8ludhZtY9a6RctCm2hKxcNo/)
2024-02-29
05 Warren Kumari IESG state changed to AD Evaluation from Publication Requested
2024-02-29
05 Warren Kumari Changed consensus to Yes from Unknown
2024-02-29
05 Sarah Banks
# Document Shepherd Write-Up for Group Documents

*This version is dated 4 July 2022.*

Thank you for your service as a document shepherd. Among the …
# Document Shepherd Write-Up for Group Documents

*This version is dated 4 July 2022.*

Thank you for your service as a document shepherd. Among the responsibilities is
answering the questions in this write-up to give helpful context to Last Call
and Internet Engineering Steering Group ([IESG][1]) reviewers, and your
diligence in completing it is appreciated. The full role of the shepherd is
further described in [RFC 4858][2]. You will need the cooperation of the authors
and editors to complete these checks.

Note that some numbered items contain multiple related questions; please be sure
to answer all of them.

## Document History

1. Does the working group (WG) consensus represent the strong concurrence of a
  few individuals, with others being silent, or did it reach broad agreement?

  It reached broad agreement.

2. Was there controversy about particular points, or were there decisions where
  the consensus was particularly rough?

  There was strong consensus, with no controversy.

3. Has anyone threatened an appeal or otherwise indicated extreme discontent? If
  so, please summarize the areas of conflict in separate email messages to the
  responsible Area Director. (It should be in a separate email because this
  questionnaire is publicly available.)

  No threats to appeal and no indications of extreme discontent. Or discontent in general.


4. For protocol documents, are there existing implementations of the contents of
  the document? Have a significant number of potential implementers indicated
  plans to implement? Are any existing implementations reported somewhere,
  either in the document itself (as [RFC 7942][3] recommends) or elsewhere
  (where)?

  These are benchmarking documents, not protocol documents.


## Additional Reviews

5. Do the contents of this document closely interact with technologies in other
  IETF working groups or external organizations, and would it therefore benefit
  from their review? Have those reviews occurred? If yes, describe which
  reviews took place.

  It interacts with IP (v4/v6) in general, in that it's identifying solutions
  for pseudorandom port numbers that are out of scope explicitly by v4/v6
  drafts. While it wouldn't hurt to ask v6ops for a review, BMWG covers the v4
  and RFC2544 cases cited in the draft.

6. Describe how the document meets any required formal expert review criteria,
  such as the MIB Doctor, YANG Doctor, media type, and URI type reviews.

  There are no MIBs or YANG or associated information here that would require review.

7. If the document contains a YANG module, has the final version of the module
  been checked with any of the [recommended validation tools][4] for syntax and
  formatting validation? If there are any resulting errors or warnings, what is
  the justification for not fixing them at this time? Does the YANG module
  comply with the Network Management Datastore Architecture (NMDA) as specified
  in [RFC 8342][5]?

  This draft contains no YANG information.

8. Describe reviews and automated checks performed to validate sections of the
  final version of the document written in a formal language, such as XML code,
  BNF rules, MIB definitions, CBOR's CDDL, etc.

  This is out of scope - there is a small snippet of code for test results, and
  numerous test set up diagrams outlined in ASCII.

## Document Shepherd Checks

9. Based on the shepherd's review of the document, is it their opinion that this
  document is needed, clearly written, complete, correctly designed, and ready
  to be handed off to the responsible Area Director?

  Yes.

10. Several IETF Areas have assembled [lists of common issues that their
    reviewers encounter][6]. For which areas have such issues been identified
    and addressed? For which does this still need to happen in subsequent
    reviews?

    I found no areas that needed to be addressed.

11. What type of RFC publication is being requested on the IETF stream ([Best
    Current Practice][12], [Proposed Standard, Internet Standard][13],
    [Informational, Experimental or Historic][14])? Why is this the proper type
    of RFC? Do all Datatracker state attributes correctly reflect this intent?

    Informational - all BMWG drafts are published as Informational RFCs.

12. Have reasonable efforts been made to remind all authors of the intellectual
    property rights (IPR) disclosure obligations described in [BCP 79][7]? To
    the best of your knowledge, have all required disclosures been filed? If
    not, explain why. If yes, summarize any relevant discussion, including links
    to publicly-available messages when applicable.

    Yes.

13. Has each author, editor, and contributor shown their willingness to be
    listed as such? If the total number of authors and editors on the front page
    is greater than five, please provide a justification.

    There are 2 authors, and they are both willing to be listed as such.

14. Document any remaining I-D nits in this document. Simply running the [idnits
    tool][8] is not enough; please review the ["Content Guidelines" on
    authors.ietf.org][15]. (Also note that the current idnits tool generates
    some incorrect warnings; a rewrite is underway.)

    The guidelines for "Recommended content" don't apply, as the doc isn't a
    protocol specification or an implementation draft.


15. Should any informative references be normative or vice-versa? See the [IESG
    Statement on Normative and Informative References][16].

    No.

16. List any normative references that are not freely available to anyone. Did
    the community have sufficient access to review any such normative
    references?

    All normative references are published RFCs and are freely available to all.

17. Are there any normative downward references (see [RFC 3967][9] and [BCP
    97
][10]) that are not already listed in the [DOWNREF registry][17]? If so,
    list them.

    None.

18. Are there normative references to documents that are not ready to be
    submitted to the IESG for publication or are otherwise in an unclear state?
    If so, what is the plan for their completion?

    No.

19. Will publication of this document change the status of any existing RFCs? If
    so, does the Datatracker metadata correctly reflect this and are those RFCs
    listed on the title page, in the abstract, and discussed in the
    introduction? If not, explain why and point to the part of the document
    where the relationship of this document to these other RFCs is discussed.

    No.

20. Describe the document shepherd's review of the IANA considerations section,
    especially with regard to its consistency with the body of the document.
    Confirm that all aspects of the document requiring IANA assignments are
    associated with the appropriate reservations in IANA registries. Confirm
    that any referenced IANA registries have been clearly identified. Confirm
    that each newly created IANA registry specifies its initial contents,
    allocations procedures, and a reasonable name (see [RFC 8126][11]).

    NA - there are no requests of IANA made in this document.

21. List any new IANA registries that require Designated Expert Review for
    future allocations. Are the instructions to the Designated Expert clear?
    Please include suggestions of designated experts, if appropriate.

    NA - there are no requests of IANA made in this document.

[1]: https://www.ietf.org/about/groups/iesg/
[2]: https://www.rfc-editor.org/rfc/rfc4858.html
[3]: https://www.rfc-editor.org/rfc/rfc7942.html
[4]: https://wiki.ietf.org/group/ops/yang-review-tools
[5]: https://www.rfc-editor.org/rfc/rfc8342.html
[6]: https://wiki.ietf.org/group/iesg/ExpertTopics
[7]: https://www.rfc-editor.org/info/bcp79
[8]: https://www.ietf.org/tools/idnits/
[9]: https://www.rfc-editor.org/rfc/rfc3967.html
[10]: https://www.rfc-editor.org/info/bcp97
[11]: https://www.rfc-editor.org/rfc/rfc8126.html
[12]: https://www.rfc-editor.org/rfc/rfc2026.html#section-5
[13]: https://www.rfc-editor.org/rfc/rfc2026.html#section-4.1
[14]: https://www.rfc-editor.org/rfc/rfc2026.html#section-4.2
[15]: https://authors.ietf.org/en/content-guidelines-overview
[16]: https://www.ietf.org/about/groups/iesg/statements/normative-informative-references/
[17]: https://datatracker.ietf.org/doc/downref/


2024-02-29
05 Sarah Banks IETF WG state changed to Submitted to IESG for Publication from WG Consensus: Waiting for Write-Up
2024-02-29
05 Sarah Banks IESG state changed to Publication Requested from I-D Exists
2024-02-29
05 (System) Changed action holders to Warren Kumari (IESG state changed)
2024-02-29
05 Sarah Banks Responsible AD changed to Warren Kumari
2024-02-29
05 Sarah Banks Document is now in IESG state Publication Requested
2024-02-29
05 Sarah Banks
# Document Shepherd Write-Up for Group Documents

*This version is dated 4 July 2022.*

Thank you for your service as a document shepherd. Among the …
# Document Shepherd Write-Up for Group Documents

*This version is dated 4 July 2022.*

Thank you for your service as a document shepherd. Among the responsibilities is
answering the questions in this write-up to give helpful context to Last Call
and Internet Engineering Steering Group ([IESG][1]) reviewers, and your
diligence in completing it is appreciated. The full role of the shepherd is
further described in [RFC 4858][2]. You will need the cooperation of the authors
and editors to complete these checks.

Note that some numbered items contain multiple related questions; please be sure
to answer all of them.

## Document History

1. Does the working group (WG) consensus represent the strong concurrence of a
  few individuals, with others being silent, or did it reach broad agreement?

  It reached broad agreement.

2. Was there controversy about particular points, or were there decisions where
  the consensus was particularly rough?

  There was strong consensus, with no controversy.

3. Has anyone threatened an appeal or otherwise indicated extreme discontent? If
  so, please summarize the areas of conflict in separate email messages to the
  responsible Area Director. (It should be in a separate email because this
  questionnaire is publicly available.)

  No threats to appeal and no indications of extreme discontent. Or discontent in general.


4. For protocol documents, are there existing implementations of the contents of
  the document? Have a significant number of potential implementers indicated
  plans to implement? Are any existing implementations reported somewhere,
  either in the document itself (as [RFC 7942][3] recommends) or elsewhere
  (where)?

  These are benchmarking documents, not protocol documents.


## Additional Reviews

5. Do the contents of this document closely interact with technologies in other
  IETF working groups or external organizations, and would it therefore benefit
  from their review? Have those reviews occurred? If yes, describe which
  reviews took place.

  It interacts with IP (v4/v6) in general, in that it's identifying solutions
  for pseudorandom port numbers that are out of scope explicitly by v4/v6
  drafts. While it wouldn't hurt to ask v6ops for a review, BMWG covers the v4
  and RFC2544 cases cited in the draft.

6. Describe how the document meets any required formal expert review criteria,
  such as the MIB Doctor, YANG Doctor, media type, and URI type reviews.

  There are no MIBs or YANG or associated information here that would require review.

7. If the document contains a YANG module, has the final version of the module
  been checked with any of the [recommended validation tools][4] for syntax and
  formatting validation? If there are any resulting errors or warnings, what is
  the justification for not fixing them at this time? Does the YANG module
  comply with the Network Management Datastore Architecture (NMDA) as specified
  in [RFC 8342][5]?

  This draft contains no YANG information.

8. Describe reviews and automated checks performed to validate sections of the
  final version of the document written in a formal language, such as XML code,
  BNF rules, MIB definitions, CBOR's CDDL, etc.

  This is out of scope - there is a small snippet of code for test results, and
  numerous test set up diagrams outlined in ASCII.

## Document Shepherd Checks

9. Based on the shepherd's review of the document, is it their opinion that this
  document is needed, clearly written, complete, correctly designed, and ready
  to be handed off to the responsible Area Director?

  Yes.

10. Several IETF Areas have assembled [lists of common issues that their
    reviewers encounter][6]. For which areas have such issues been identified
    and addressed? For which does this still need to happen in subsequent
    reviews?

    I found no areas that needed to be addressed.

11. What type of RFC publication is being requested on the IETF stream ([Best
    Current Practice][12], [Proposed Standard, Internet Standard][13],
    [Informational, Experimental or Historic][14])? Why is this the proper type
    of RFC? Do all Datatracker state attributes correctly reflect this intent?

    Informational - all BMWG drafts are published as Informational RFCs.

12. Have reasonable efforts been made to remind all authors of the intellectual
    property rights (IPR) disclosure obligations described in [BCP 79][7]? To
    the best of your knowledge, have all required disclosures been filed? If
    not, explain why. If yes, summarize any relevant discussion, including links
    to publicly-available messages when applicable.

    Yes.

13. Has each author, editor, and contributor shown their willingness to be
    listed as such? If the total number of authors and editors on the front page
    is greater than five, please provide a justification.

    There are 2 authors, and they are both willing to be listed as such.

14. Document any remaining I-D nits in this document. Simply running the [idnits
    tool][8] is not enough; please review the ["Content Guidelines" on
    authors.ietf.org][15]. (Also note that the current idnits tool generates
    some incorrect warnings; a rewrite is underway.)

    The guidelines for "Recommended content" don't apply, as the doc isn't a
    protocol specification or an implementation draft.


15. Should any informative references be normative or vice-versa? See the [IESG
    Statement on Normative and Informative References][16].

    No.

16. List any normative references that are not freely available to anyone. Did
    the community have sufficient access to review any such normative
    references?

    All normative references are published RFCs and are freely available to all.

17. Are there any normative downward references (see [RFC 3967][9] and [BCP
    97
][10]) that are not already listed in the [DOWNREF registry][17]? If so,
    list them.

    None.

18. Are there normative references to documents that are not ready to be
    submitted to the IESG for publication or are otherwise in an unclear state?
    If so, what is the plan for their completion?

    No.

19. Will publication of this document change the status of any existing RFCs? If
    so, does the Datatracker metadata correctly reflect this and are those RFCs
    listed on the title page, in the abstract, and discussed in the
    introduction? If not, explain why and point to the part of the document
    where the relationship of this document to these other RFCs is discussed.

    No.

20. Describe the document shepherd's review of the IANA considerations section,
    especially with regard to its consistency with the body of the document.
    Confirm that all aspects of the document requiring IANA assignments are
    associated with the appropriate reservations in IANA registries. Confirm
    that any referenced IANA registries have been clearly identified. Confirm
    that each newly created IANA registry specifies its initial contents,
    allocations procedures, and a reasonable name (see [RFC 8126][11]).

    NA - there are no requests of IANA made in this document.

21. List any new IANA registries that require Designated Expert Review for
    future allocations. Are the instructions to the Designated Expert clear?
    Please include suggestions of designated experts, if appropriate.

    NA - there are no requests of IANA made in this document.

[1]: https://www.ietf.org/about/groups/iesg/
[2]: https://www.rfc-editor.org/rfc/rfc4858.html
[3]: https://www.rfc-editor.org/rfc/rfc7942.html
[4]: https://wiki.ietf.org/group/ops/yang-review-tools
[5]: https://www.rfc-editor.org/rfc/rfc8342.html
[6]: https://wiki.ietf.org/group/iesg/ExpertTopics
[7]: https://www.rfc-editor.org/info/bcp79
[8]: https://www.ietf.org/tools/idnits/
[9]: https://www.rfc-editor.org/rfc/rfc3967.html
[10]: https://www.rfc-editor.org/info/bcp97
[11]: https://www.rfc-editor.org/rfc/rfc8126.html
[12]: https://www.rfc-editor.org/rfc/rfc2026.html#section-5
[13]: https://www.rfc-editor.org/rfc/rfc2026.html#section-4.1
[14]: https://www.rfc-editor.org/rfc/rfc2026.html#section-4.2
[15]: https://authors.ietf.org/en/content-guidelines-overview
[16]: https://www.ietf.org/about/groups/iesg/statements/normative-informative-references/
[17]: https://datatracker.ietf.org/doc/downref/


2024-02-27
05 Sarah Banks Notification list changed to sbanks@encrypted.net because the document shepherd was set
2024-02-27
05 Sarah Banks Document shepherd changed to Sarah Banks
2024-01-29
05 Sarah Banks IETF WG state changed to WG Consensus: Waiting for Write-Up from WG Document
2024-01-29
05 Sarah Banks Intended Status changed to Informational from None
2024-01-23
05 Gábor Lencse New version available: draft-ietf-bmwg-benchmarking-stateful-05.txt
2024-01-23
05 Gábor Lencse New version accepted (logged-in submitter: Gábor Lencse)
2024-01-23
05 Gábor Lencse Uploaded new revision
2023-09-12
04 Gábor Lencse New version available: draft-ietf-bmwg-benchmarking-stateful-04.txt
2023-09-12
04 (System) New version approved
2023-09-12
04 (System) Request for posting confirmation emailed to previous authors: Gabor Lencse , Keiichi Shima
2023-09-12
04 Gábor Lencse Uploaded new revision
2023-06-27
03 Gábor Lencse New version available: draft-ietf-bmwg-benchmarking-stateful-03.txt
2023-06-27
03 (System) New version approved
2023-06-27
03 (System) Request for posting confirmation emailed to previous authors: Gabor Lencse , Keiichi Shima
2023-06-27
03 Gábor Lencse Uploaded new revision
2023-02-14
02 Gábor Lencse New version available: draft-ietf-bmwg-benchmarking-stateful-02.txt
2023-02-14
02 (System) New version approved
2023-02-14
02 (System) Request for posting confirmation emailed to previous authors: Gabor Lencse , Keiichi Shima
2023-02-14
02 Gábor Lencse Uploaded new revision
2022-10-19
01 Gábor Lencse New version available: draft-ietf-bmwg-benchmarking-stateful-01.txt
2022-10-19
01 (System) New version approved
2022-10-19
01 (System) Request for posting confirmation emailed to previous authors: Gabor Lencse , Keiichi Shima
2022-10-19
01 Gábor Lencse Uploaded new revision
2022-09-24
00 Al Morton This document now replaces draft-lencse-bmwg-benchmarking-stateful instead of None
2022-09-24
00 Gábor Lencse New version available: draft-ietf-bmwg-benchmarking-stateful-00.txt
2022-09-24
00 Al Morton WG -00 approved
2022-09-24
00 Gábor Lencse Set submitter to "Gabor Lencse ", replaces to draft-lencse-bmwg-benchmarking-stateful and sent approval email to group chairs: bmwg-chairs@ietf.org
2022-09-24
00 Gábor Lencse Uploaded new revision