Skip to main content

Benchmarking Methodology
charter-ietf-bmwg-08

Revision differences

Document history

Date Rev. By Action
2018-05-23
08 Cindy Morgan New version available: charter-ietf-bmwg-08.txt
2018-05-23
07-01 Cindy Morgan State changed to Approved from Internal review
2018-05-23
07-01 Cindy Morgan IESG has approved the charter
2018-05-23
07-01 Cindy Morgan Closed "Ready w/o external review" ballot
2018-05-23
07-01 Cindy Morgan WG action text was changed
2018-05-21
07-01 Deborah Brungard [Ballot comment]
Thanks for addressing my concern.
2018-05-21
07-01 Deborah Brungard [Ballot Position Update] Position for Deborah Brungard has been changed to No Objection from Block
2018-05-18
07-01 Amy Vezza New version available: charter-ietf-bmwg-07-01.txt
2018-05-18
07-00 Amy Vezza
Changed charter milestone "Draft on Network Service Layer Abstract Models applied to  Benchmarking to IESG Review", set description to "Draft on Selecting and Applying Model(s) …
Changed charter milestone "Draft on Network Service Layer Abstract Models applied to  Benchmarking to IESG Review", set description to "Draft on Selecting and Applying Model(s) for Benchmarking to IESG Review"
2018-05-10
07-00 Ignas Bagdonas [Ballot Position Update] New position, No Objection, has been recorded for Ignas Bagdonas
2018-05-10
07-00 Suresh Krishnan [Ballot Position Update] New position, No Objection, has been recorded for Suresh Krishnan
2018-05-09
07-00 Ben Campbell
[Ballot comment]
I am curious how the discussion around Deborah's block will go. Once that is resolved, I do not object to approval without external …
[Ballot comment]
I am curious how the discussion around Deborah's block will go. Once that is resolved, I do not object to approval without external review.

I agree with others that the milestone dates seem aggressive.
2018-05-09
07-00 Ben Campbell [Ballot Position Update] New position, No Objection, has been recorded for Ben Campbell
2018-05-09
07-00 Terry Manderson [Ballot Position Update] New position, No Objection, has been recorded for Terry Manderson
2018-05-09
07-00 Benjamin Kaduk [Ballot comment]
External review does not seem to be needed for this change.
2018-05-09
07-00 Benjamin Kaduk [Ballot Position Update] New position, No Objection, has been recorded for Benjamin Kaduk
2018-05-09
07-00 Deborah Brungard
[Ballot block]
I decided to do this as a block after doing a scan of the milestone document on "network service layer abstraction model".
It …
[Ballot block]
I decided to do this as a block after doing a scan of the milestone document on "network service layer abstraction model".
It is only an individual document (though with a milestone of Dec 2018), so it may be early to extrapolate what is the intention.
The document in its current state directly overlaps/conflicts with work on-going in both ccamp and teas as it is modeling services
and layered networks as an abstraction. It seems to go way beyond the charter of the bmwg, not only in the modeling, but also with
statements on requirements "SHALL be used for outline service requirements from customer perspective". There is nothing in
the charter text describing the intention of the work.

For both EVPN and this milestone, text needs to be added to the charter to describe this work's intended scope so as to clearly
scope it as bm. Listing the two documents as milestones is not sufficient. As Alvaro noted, a sentence needs to be added to say work will
be coordinated with appropriate working groups.
2018-05-09
07-00 Deborah Brungard [Ballot comment]
The milestones for documents existing today as individual documents seem overzealous as almost all items finish Dec 2018.
And nothing pass Dec 2018.
2018-05-09
07-00 Deborah Brungard [Ballot Position Update] New position, Block, has been recorded for Deborah Brungard
2018-05-09
07-00 Spencer Dawkins
[Ballot comment]
I'm good for approval without external review, but wonder whether you think it's worth letting other SDOs know that BMWG has added virtualization …
[Ballot comment]
I'm good for approval without external review, but wonder whether you think it's worth letting other SDOs know that BMWG has added virtualization to its charter.
2018-05-09
07-00 Spencer Dawkins [Ballot Position Update] New position, Yes, has been recorded for Spencer Dawkins
2018-05-09
07-00 Alvaro Retana
[Ballot comment]
I am ok with no external review for this charter.

I would love to see something in the charter about interaction with existing …
[Ballot comment]
I am ok with no external review for this charter.

I would love to see something in the charter about interaction with existing WGs (as applicable), specially for the cases where documents are being produced for IETF technology.  I see EVPN in the list of milestones, for example; it would be great if the bess WG was at least informed/made aware/given a heads up, etc. on the work.  I don't think there's a need to list the WGs, but a generic sentence such as "consult with/inform other WGs as appropriate" would be great!
2018-05-09
07-00 Alvaro Retana [Ballot Position Update] New position, No Objection, has been recorded for Alvaro Retana
2018-05-09
07-00 Martin Vigoureux [Ballot Position Update] New position, No Objection, has been recorded for Martin Vigoureux
2018-05-08
07-00 Adam Roach
[Ballot comment]
I'm good with this going forward without external review.

On the milestones: "Aug 2018 - Methodology for Next-Gen Firewall Benchmarking to IESG Review" …
[Ballot comment]
I'm good with this going forward without external review.

On the milestones: "Aug 2018 - Methodology for Next-Gen Firewall Benchmarking to IESG Review" seems pretty aspirational, given that the WG has not yet adopted an associated document.
2018-05-08
07-00 Adam Roach [Ballot Position Update] New position, No Objection, has been recorded for Adam Roach
2018-04-25
07-00 Warren Kumari [Ballot comment]
This new charter simply reflects what the WG is already doing...
2018-04-25
07-00 Warren Kumari [Ballot Position Update] New position, Yes, has been recorded for Warren Kumari
2018-04-09
07-00 Warren Kumari Telechat date has been changed to 2018-05-10 from 2018-04-19
2018-04-09
07-00 Cindy Morgan WG action text was changed
2018-04-09
07-00 Cindy Morgan WG review text was changed
2018-04-09
07-00 Cindy Morgan WG review text was changed
2018-04-09
07-00 Cindy Morgan Created "Ready w/o external review" ballot
2018-04-09
07-00 Cindy Morgan Closed "Approve" ballot
2018-04-09
07-00 Cindy Morgan State changed to Internal review from Informal IESG review
2018-04-09
07-00 Cindy Morgan State changed to Informal IESG review from IESG review
2018-04-09
07-00 Warren Kumari
[Ballot comment]
BMWG is rechartering - the charter changes are relatively minor, and simply update to reflect that the WG is already doing virtualized stuff: …
[Ballot comment]
BMWG is rechartering - the charter changes are relatively minor, and simply update to reflect that the WG is already doing virtualized stuff:
"The scope of BMWG has been extended to develop methods for virtual network functions (VNF) and their unique supporting infrastructure (such as SDN Controllers and vSwitches).
Benchmarks for platform capacity and performance characteristics of virtual routers, firewalls (and other security functions),  signaling control gateways, and other forms of gateways are included. 
The benchmarks will foster comparisons between physical and virtual network functions, and also cover unique features of  Network Function Virtualization systems. Also, with the emergence of virtualized test systems, specifications for test system calibration are also in-scope."

Full diff for yer viewing pleasure: https://gist.github.com/wkumari/3bb8f05b39f49708bcc0f43ca4dbfe95/revisions
2018-04-09
07-00 Warren Kumari [Ballot Position Update] New position, Yes, has been recorded for Warren Kumari
2018-04-09
07-00 Warren Kumari Created "Approve" ballot
2018-04-09
07-00 Warren Kumari State changed to IESG review from Informal IESG review
2018-04-09
07-00 Warren Kumari Added charter milestone "Considerations for Benchmarking Network Virtualization Platforms to IESG Review", due December 2018
2018-04-09
07-00 Warren Kumari Added charter milestone "Draft on General VNF Benchmarking Automation to IESG Review", due December 2018
2018-04-09
07-00 Warren Kumari Added charter milestone "Draft on Network Service Layer Abstract Models applied to  Benchmarking to IESG Review", due December 2018
2018-04-09
07-00 Warren Kumari Added charter milestone "Methodology for EVPN Benchmarking to IESG Review", due December 2018
2018-04-09
07-00 Warren Kumari Added charter milestone "Update to RFC2544 Back-to-back Frame Benchmarking to IESG Review", due December 2018
2018-04-09
07-00 Warren Kumari Added charter milestone "Methodology for Next-Gen Firewall Benchmarking to IESG Review", due August 2018
2018-04-03
07-00 Warren Kumari Telechat date has been changed to 2018-04-19 from 2014-05-29
2018-04-03
07-00 Warren Kumari This new charter text has received significant discussion within the WG, and also at the IETF100 (https://datatracker.ietf.org/meeting/100/materials/agenda-100-bmwg-03) and IETF101 (https://datatracker.ietf.org/meeting/101/materials/minutes-101-bmwg-00) meetings.
2018-04-03
07-00 Warren Kumari State changed to Informal IESG review from Approved
2018-04-03
07-00 Warren Kumari New version available: charter-ietf-bmwg-07-00.txt
2018-01-30
07 Amy Vezza Responsible AD changed to Warren Kumari from Joel Jaeggli
2015-10-14
07 (System) Notify list changed from bmwg-chairs@tools.ietf.org to (None)
2014-06-12
07 Cindy Morgan New version available: charter-ietf-bmwg-07.txt
2014-06-12
06-01 Cindy Morgan State changed to Approved from Internal review
2014-06-12
06-01 Cindy Morgan IESG has approved the charter
2014-06-12
06-01 Cindy Morgan Closed "Ready w/o external review" ballot
2014-06-12
06-01 Cindy Morgan WG action text was changed
2014-06-11
06-01 Joel Jaeggli Added milestone "Drafts on Data Center Benchmarking to IESG Review", due December 2015, from current group milestones
2014-06-11
06-01 Joel Jaeggli Added milestone "Draft on VNF Benchmarking Considerations to IESG Review", due August 2015, from current group milestones
2014-06-11
06-01 Joel Jaeggli Added milestone "Draft on In-Service Software Upgrade Benchmarking to IESG Review", due March 2015, from current group milestones
2014-06-11
06-01 Joel Jaeggli Added milestone "Draft on IPv6 Neighbor Discovery to IESG Review", due December 2014, from current group milestones
2014-06-11
06-01 Joel Jaeggli Added milestone "Draft on Traffic Management Benchmarking to IESG Review", due August 2014, from current group milestones
2014-06-11
06-01 Joel Jaeggli Added milestone "Methodology for SIP Device Benchmarking to IESG Review", due July 2014, from current group milestones
2014-06-11
06-01 Joel Jaeggli Added milestone "Terminology for SIP Device Benchmarking to IESG Review", due July 2014, from current group milestones
2014-06-11
06-01 Joel Jaeggli Added milestone "Basic BGP Convergence Benchmarking Methodology to IESG Review", due June 2014, from current group milestones
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Methodology for LDP Convergence Benchmarking to IESG Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Terminology for LDP Convergence Benchmarking to IESG Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Methodology for Content Aware Device Benchmarking to IESG"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Terminology for Content Aware Device Benchmarking to IESG Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Basic BGP Convergence Benchmarking Methodology to IESG Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Methodology for SIP Device Benchmarking to IESG Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Terminology for SIP Device Benchmarking to IESG Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Methodology for Data Center Bridging Benchmarking to IESG Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Methodology for Flow Export and Collection Benchmarking to IESG Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Methodology For Protection Benchmarking to IESG Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Networking Device Reset Benchmark (Updates RFC 2544) to IESG Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Methodology for MPLS Forwarding to AD Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Terminology For Protection Benchmarking to AD Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "IPsec Device Benchmarking Methodology to IESG Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "IPsec Device Benchmarking Terminology to IESG Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "IPv6 Benchmarking Methodology to AD Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Hash and Stuffing I-D to AD Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "IGP/Data-Plane Methodology and Considerations I-Ds to AD Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "IGP/Data-Plane Terminology I-D to AD Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Net Traffic Control Benchmarking Terminology to AD Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Resource Reservation Benchmarking Methodology to AD Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "EGP Convergence Benchmarking Terminology to AD Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "First I-D on IPsec Device Benchmarking Terminology"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Resource Reservation Benchmarking Terminology to AD Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Methodology for IP Multicast Benchmarking to AD Review."
2014-06-11
06-01 Joel Jaeggli Deleted milestone "First draft Net Traffic Control Benchmarking Methodology."
2014-06-11
06-01 Joel Jaeggli Deleted milestone "First Draft of Methodology for FIB related Router Performance Benchmarking."
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Firewall Benchmarking Methodology to AD Review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Terminology for FIB related Router Performance Benchmarking to AD review."
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Terminology for ATM ABR Benchmarking for AD review."
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Methodology for ATM Benchmarking for AD review."
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Progress Frame Relay benchmarking terminology draft to AD review."
2014-06-11
06-01 Joel Jaeggli Deleted milestone "First Draft of Router Benchmarking Framework"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "First Draft of Terminology for FIB related Router Performance Benchmarking."
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Submit first draft of Firewall Benchmarking Methodology."
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Submit Benchmarking Methodology for LAN Switching Devices draft for AD review."
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Progress ATM benchmarking terminology draft to AD review."
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Submit Benchmarking Terminology for Firewall Performance for AD review"
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Submit Terminology for IP Multicast Benchmarking draft for AD Review."
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Submit initial draft of Benchmarking Methodology for LAN Switches."
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Submit workplan for continuing work on the Terminology for Cell/Call Benchmarking draft."
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Submit workplan for initiating work on Benchmarking Methodology for LAN Switching Devices."
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Take controversial components of multicast draft to mailing list for discussion.  Incorporate changes to draft and reissue appropriately."
2014-06-11
06-01 Joel Jaeggli
Deleted milestone "Edit the LAN switch draft to reflect the input from BMWG. Issue a new version of document for comment.  If appropriate, ascertain consensus …
Deleted milestone "Edit the LAN switch draft to reflect the input from BMWG. Issue a new version of document for comment.  If appropriate, ascertain consensus on whether to recommend the draft for consideration as an RFC."
2014-06-11
06-01 Joel Jaeggli Deleted milestone "Expand the current Ethernet switch benchmarking methodology draft to define the metrics and methodologies particular to the general class of connectionless, LAN switches."
2014-05-29
06-01 Adrian Farrel [Ballot comment]
Thanks for addressing my concerns
2014-05-29
06-01 Adrian Farrel [Ballot Position Update] Position for Adrian Farrel has been changed to No Objection from Block
2014-05-29
06-01 Joel Jaeggli New version available: charter-ietf-bmwg-06-01.txt
2014-05-29
06-00 Kathleen Moriarty [Ballot Position Update] New position, No Objection, has been recorded for Kathleen Moriarty
2014-05-28
06-00 Richard Barnes [Ballot Position Update] New position, No Objection, has been recorded for Richard Barnes
2014-05-28
06-00 Alia Atlas [Ballot comment]
I support Adrian's block.
2014-05-28
06-00 Alia Atlas [Ballot Position Update] New position, No Objection, has been recorded for Alia Atlas
2014-05-28
06-00 Jari Arkko [Ballot Position Update] New position, No Objection, has been recorded for Jari Arkko
2014-05-28
06-00 Ted Lemon [Ballot Position Update] New position, No Objection, has been recorded for Ted Lemon
2014-05-28
06-00 Adrian Farrel
[Ballot block]
I'm not really opposed to the inclusion of the new VNF work item, but
I also note that the term "VNF" is attracting …
[Ballot block]
I'm not really opposed to the inclusion of the new VNF work item, but
I also note that the term "VNF" is attracting particular excitement at
the moment and I would appreciate some more clarity and focus in
this text so that we know what is in scope and what is for future
network theoreticians.

It reads as though there are some plans in BMWG to work on the
architecture for NFV ("the new task space will be considered"). I
think it would be a fine idea to understand the scenery, but I don't
think that the BMWG is the right place for that work.

There are two ways forward from this position and still keep the
work item in the charter:

1. BMWG focuses on a specific existing document for the definition
  of VNF and pointers to the things that can be measured.

2. This work item falls back from discussing VNF and limits itself
    to a work on specifics (benchmarks for platform capacity and
    performance characteristics of virtual routers and switches)
    although it may be necessary to explain why benchmarking a
    virtual router is any different from benchmarking a router.
2014-05-28
06-00 Adrian Farrel Ballot discuss text updated for Adrian Farrel
2014-05-28
06-00 Adrian Farrel
[Ballot block]
I'm not really opposed to the inclusion of the new VNF work item, but I also
note that the term "VNF" is attracting …
[Ballot block]
I'm not really opposed to the inclusion of the new VNF work item, but I also
note that the term "VNF" is attracting particular excitement at the moment
and I would appreciate some more clarity and focus in this text so that we
know what is in scope and what is for future network theoreticians.

It reads as though there are some plans in BMWG to work on the
architecture for NFV ("the new task space will be considered"). I think it
would be a fine idea to understand the scenery, but I don't think that the
BMWG is the right place for that work.

There are two ways forward from this position and still keep the work
item in the charter:

1. BMWG focuses on a specific existing document for the definition of
  VNF and pointers to the things that can be measured.

2. This work item falls back from discussing VNF and limits itself to a
    work on specifics (benchmarks for platform capacity and performance
    characteristics of virtual routers and switches) although it may be
    necessary to explain why benchmarking a virtual router is any different
    from benchmarking a router.
2014-05-28
06-00 Adrian Farrel [Ballot Position Update] New position, Block, has been recorded for Adrian Farrel
2014-05-27
06-00 Spencer Dawkins [Ballot Position Update] New position, No Objection, has been recorded for Spencer Dawkins
2014-05-27
06-00 Stephen Farrell [Ballot Position Update] New position, No Objection, has been recorded for Stephen Farrell
2014-05-27
06-00 Alissa Cooper [Ballot Position Update] New position, No Objection, has been recorded for Alissa Cooper
2014-05-27
06-00 Cindy Morgan Added milestone "Methodology for LDP Convergence Benchmarking to IESG Review", due December 2011, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Terminology for LDP Convergence Benchmarking to IESG Review", due December 2011, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Methodology for Content Aware Device Benchmarking to IESG", due December 2011, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Terminology for Content Aware Device Benchmarking to IESG Review", due December 2011, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Basic BGP Convergence Benchmarking Methodology to IESG Review", due July 2011, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Methodology for SIP Device Benchmarking to IESG Review", due June 2011, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Terminology for SIP Device Benchmarking to IESG Review", due June 2011, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Methodology for Data Center Bridging Benchmarking to IESG Review", due June 2011, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Methodology for Flow Export and Collection Benchmarking to IESG Review", due February 2011, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Methodology For Protection Benchmarking to IESG Review", due December 2010, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Networking Device Reset Benchmark (Updates RFC 2544) to IESG Review", due September 2010, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Methodology for MPLS Forwarding to AD Review", due April 2009, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Terminology For Protection Benchmarking to AD Review", due February 2009, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "IPsec Device Benchmarking Methodology to IESG Review", due September 2008, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "IPsec Device Benchmarking Terminology to IESG Review", due September 2008, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "IPv6 Benchmarking Methodology to AD Review", due March 2007, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Hash and Stuffing I-D to AD Review", due July 2006, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "IGP/Data-Plane Methodology and Considerations I-Ds to AD Review", due April 2006, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "IGP/Data-Plane Terminology I-D to AD Review", due April 2006, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Net Traffic Control Benchmarking Terminology to AD Review", due April 2005, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Resource Reservation Benchmarking Methodology to AD Review", due July 2003, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "EGP Convergence Benchmarking Terminology to AD Review", due April 2003, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "First I-D on IPsec Device Benchmarking Terminology", due March 2003, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Resource Reservation Benchmarking Terminology to AD Review", due March 2003, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Methodology for IP Multicast Benchmarking to AD Review.", due March 2003, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "First draft Net Traffic Control Benchmarking Methodology.", due February 2002, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "First Draft of Methodology for FIB related Router Performance Benchmarking.", due December 2001, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Firewall Benchmarking Methodology to AD Review", due November 2001, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Terminology for FIB related Router Performance Benchmarking to AD review.", due July 2001, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Terminology for ATM ABR Benchmarking for AD review.", due November 2000, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Methodology for ATM Benchmarking for AD review.", due September 2000, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Progress Frame Relay benchmarking terminology draft to AD review.", due September 2000, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "First Draft of Router Benchmarking Framework", due July 2000, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "First Draft of Terminology for FIB related Router Performance Benchmarking.", due July 2000, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Submit first draft of Firewall Benchmarking Methodology.", due July 2000, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Submit Benchmarking Methodology for LAN Switching Devices draft for AD review.", due December 1999, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Progress ATM benchmarking terminology draft to AD review.", due December 1999, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Submit Benchmarking Terminology for Firewall Performance for AD review", due December 1998, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Submit Terminology for IP Multicast Benchmarking draft for AD Review.", due August 1998, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Submit initial draft of Benchmarking Methodology for LAN Switches.", due August 1998, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Submit workplan for continuing work on the Terminology for Cell/Call Benchmarking draft.", due January 1998, from current group milestones
2014-05-27
06-00 Cindy Morgan Added milestone "Submit workplan for initiating work on Benchmarking Methodology for LAN Switching Devices.", due January 1998, from current group milestones
2014-05-27
06-00 Cindy Morgan
Added milestone "Take controversial components of multicast draft to mailing list for discussion.  Incorporate changes to draft and reissue appropriately.", due August 1997, from current …
Added milestone "Take controversial components of multicast draft to mailing list for discussion.  Incorporate changes to draft and reissue appropriately.", due August 1997, from current group milestones
2014-05-27
06-00 Cindy Morgan
Added milestone "Edit the LAN switch draft to reflect the input from BMWG. Issue a new version of document for comment.  If appropriate, ascertain consensus …
Added milestone "Edit the LAN switch draft to reflect the input from BMWG. Issue a new version of document for comment.  If appropriate, ascertain consensus on whether to recommend the draft for consideration as an RFC.", due August 1997, from current group milestones
2014-05-27
06-00 Cindy Morgan
Added milestone "Expand the current Ethernet switch benchmarking methodology draft to define the metrics and methodologies particular to the general class of connectionless, LAN switches.", …
Added milestone "Expand the current Ethernet switch benchmarking methodology draft to define the metrics and methodologies particular to the general class of connectionless, LAN switches.", due June 1996, from current group milestones
2014-05-27
06-00 Brian Haberman [Ballot Position Update] New position, No Objection, has been recorded for Brian Haberman
2014-05-27
06-00 Benoît Claise
[Ballot comment]
- I see the in charter:

    The BMWG will communicate with the operations community through
    organizations such as NANOG, …
[Ballot comment]
- I see the in charter:

    The BMWG will communicate with the operations community through
    organizations such as NANOG, RIPE, and APRICOT.

This sentence was added by Ron Bonica in the previous charter. However, this hasn't happened.
It's stil a good idea.

NEW:
    Ideally, BMWG should communicate with the operations community through
    organizations such as NANOG, RIPE, and APRICOT.
2014-05-27
06-00 Benoît Claise [Ballot Position Update] New position, No Objection, has been recorded for Benoit Claise
2014-05-27
06-00 Martin Stiemerling [Ballot Position Update] New position, No Objection, has been recorded for Martin Stiemerling
2014-05-26
06-00 Barry Leiba
[Ballot comment]
I realize that this phrasing is unchanged from the previous charter, but I'd like to see us change it:

  In addition to …
[Ballot comment]
I realize that this phrasing is unchanged from the previous charter, but I'd like to see us change it:

  In addition to its current work items, the BMWG is explicitly
  tasked to develop benchmarks and methodologies for the
  following technologies:

The charter is what *defines* the "current work items", so that wording is circular, and leads me to wonder what it's talking about -- what are those current work items.

What I *think* it's trying to say is "in addition to the work described above", yes?  If so, can we change it to say that?  If not, please educate me on what it means.
2014-05-26
06-00 Barry Leiba [Ballot Position Update] New position, No Objection, has been recorded for Barry Leiba
2014-05-25
06-00 Joel Jaeggli Notification list changed to bmwg-chairs@tools.ietf.org
2014-05-25
06-00 Joel Jaeggli Responsible AD changed to Joel Jaeggli
2014-05-24
06-00 Joel Jaeggli [Ballot comment]
Updated milestones will be forthcoming on this charter.
2014-05-24
06-00 Joel Jaeggli [Ballot Position Update] New position, Yes, has been recorded for Joel Jaeggli
2014-05-24
06-00 Joel Jaeggli WG action text was changed
2014-05-24
06-00 Joel Jaeggli WG review text was changed
2014-05-24
06-00 Joel Jaeggli Created "Ready w/o external review" ballot
2014-05-24
06-00 Joel Jaeggli State changed to Internal review from Informal IESG review
2014-05-04
06-00 Joel Jaeggli Placed on agenda for telechat - 2014-05-29
2014-05-04
06-00 Joel Jaeggli The Proposed charter represents the set of topics that BMWG intends to undertake moving forward.
2014-05-04
06-00 Joel Jaeggli State changed to Informal IESG review from Approved
2014-05-04
06-00 Joel Jaeggli New version available: charter-ietf-bmwg-06-00.txt
2010-11-11
06 (System) New version available: charter-ietf-bmwg-06.txt
2010-11-01
05 (System) New version available: charter-ietf-bmwg-05.txt
2009-08-29
04 (System) New version available: charter-ietf-bmwg-04.txt
2009-08-29
03 (System) New version available: charter-ietf-bmwg-03.txt
2009-08-29
02 (System) New version available: charter-ietf-bmwg-02.txt
1989-10-01
01 (System) New version available: charter-ietf-bmwg-01.txt