Benchmarking Methodology WG (bmwg) Wednesday, July 25, 2007 Afternoon Session I 1300-1500 Room Name: Salon 2 CHAIR(s): Al Morton Please help contribute to a successful meeting by reading the drafts and references *before* we meet. AGENDA: 0. Agenda bashing (if we need to shuffle a few items) See https://datatracker.ietf.org/public/meeting_materials.cgi?meeting_num=69 for Agenda updates and Slides Check the BMWG mail archive for comments: http://www.ietf.org/mail-archive/working-groups/bmwg/current/ 1. Working Group Status (Chair) Topics/Drafts not covered by presentations below: RFC 4814 Hash and Stuffing RFC 4883 to be, Benchmarking Resource Reservation Mechanisms Standard Introduction/Security Paragraph for BMWG memos 2. IGP Data plane convergence benchmark I-Ds - Publication Requested - IESG Review Discussion GOALS: Revisions address Publication Request write-up and AD Review. Does the WG agree with these changes? Revised I-Ds: http://www.ietf.org/internet-drafts/draft-ietf-bmwg-igp-dataplane-conv-term-13.txt http://www.ietf.org/internet-drafts/draft-ietf-bmwg-igp-dataplane-conv-meth-13.txt http://www.ietf.org/internet-drafts/draft-ietf-bmwg-igp-dataplane-conv-app-13.txt Presenter: Scott Poretsky 3. Techniques for Benchmarking Router Accelerated Stress Testing. Discussion GOALS: Review Last Call responses, updates to new revisions, and any open issues Draft URLs: http://www.ietf.org/internet-drafts/draft-ietf-bmwg-acc-bench-term-12.txt http://www.ietf.org/internet-drafts/draft-ietf-bmwg-acc-bench-meth-08.txt Presenter: Scott Poretsky 4. IPv6 Benchmarking Methodology Discussion GOALS: Review comments and resolution (Review template and others) Resolve remaining issues see: http://home.comcast.net/%7Eacmacm/BMWG/IPv6-meth-comment-resolution.pdf Draft URL: http://www.ietf.org/internet-drafts/draft-ietf-bmwg-ipv6-meth-02.txt Presenter: Gunter Van de Velde 5. Sub-IP Protection Mechanisms Discussion GOALS: Reach consensus on the definitions of Failover Time and Reversion Time (based on time stamps or loss alone or ???). Drafts: http://www.ietf.org/internet-drafts/draft-ietf-bmwg-protection-term-02.txt http://www.ietf.org/internet-drafts/draft-ietf-bmwg-protection-meth-02.txt if above link 404, then use: http://home.comcast.net/%7Eacmacm/BMWG/draft-ietf-bmwg-protection-meth-02temp.txt Presenter: Poretsky and Papneja 6. Terms and Methods for Benchmarking IPsec Devices (WG review and feedback is needed! Please read and comment...) http://www.ietf.org/internet-drafts/draft-ietf-bmwg-ipsec-term-09.txt http://www.ietf.org/internet-drafts/draft-ietf-bmwg-ipsec-meth-02.txt Presenter: Merike Kaeo 7. Milestone Status and New Proposal Summary (Chair) ******* New Work Proposals ********* 8. WLAN Switch Benchmarking TOPIC: Extending the current methodologies to cover wireless LAN switches GOALS: Present topic and Encourage comments At the 67th IETF last November, there was a presentation discussing a proposal on CAPWAP (WLAN) switch controller benchmarking. The presentation ended by soliciting help to submit some drafts. Help came, and two drafts have been submitted to the IETF I-D database Draft URLs: http://www.ietf.org/internet-drafts/draft-alexander-bmwg-wlan-switch-term-00.txt http://www.ietf.org/internet-drafts/draft-alexander-bmwg-wlan-switch-meth-00.txt PRESENTER: Tom Alexander 9. SIP Performance Benchmarking Discussion GOALS: Review changes to Terminology, review new Methodology. Ask working group if ready to be an official work item. Proposal TEXT: see http://www1.ietf.org/mail-archive/web/bmwg/current/msg01291.html Presenter: Scott Poretsky, Vijay Gurbani and Carol Davids Related Drafts: Draft URLs: http://www.ietf.org/internet-drafts/draft-poretsky-sip-bench-term-03.txt http://www.ietf.org/internet-drafts/draft-poretsky-bmwg-sip-bench-meth-01.txt 10. Benchmarking MPLS-TE Discussion GOALS: Introduce the topic to the WG, draft provides motivation Draft URL: http://www.ietf.org/internet-drafts/draft-vapiwala-bmwg-rsvpte-convergence-motivation-01.txt PRESENTER: Samir Vapiwala STATUS: a. Updates from version-00 of motivation draft i. Updated terms and fixed typo throughout the draft suggested by the list ii. Added 2 more test cases for refresh reduction section 4.5 and 4.6. iii. 4.8 and 4.9 sections text are updated for RSVP Authentication iv. Section 4.7 text is updated to remove confusion for fixed # of LSP re-signaling v. So far we have received comments from 5-6 folks (including - Andrey Kiselev, Raveesh Janardan, Aamer Akhter, Esa Salahuddin, Curtis Villamizar), which were incorporated in the latest version that was submitted b. Discussions with the classical RSVP benchmarking team i. A common team formed to discuss the possibility of merging the efforts under one umbrella ii. Handling of methodology draft for classical and MPLS-TE convergence work item iii. 8-member team created to ensure that all the contribution in the MPLS-TE convergence has been reviewed. Version-00 was submitted following the review from this team. The team comprised of authors of MPLS-TE and classical RSVP folks. iv. The workgroup leadership needs to agree on how to handle these two separate work items, and if the time is ripe for us to submit a separate terminology document for MPLS-TE convergence and a methodology document c. Possible collaboration with GMPLS LSP DPPM draft team i. The team of GMPLS LSP DPPM draft has shown interest to work with MPLS-TE convergence team ii. Bring LSP DPPM draft to BMWG and possibility of merging the two drafts under either CCAMP or BMWG – authors meeting at the IETF meeting to discuss all possible options of addressing this work. d. Seek support from the group and leadership to accept the MPLS-TE convergence as a work group item 11. Benchmarking LDP Convergence in the Dataplane Draft URLs http://www.ietf.org/internet-drafts/draft-eriksson-ldp-convergence-term-04.txt http://www.ietf.org/internet-drafts/draft-karthik-bmwg-ldp-convergence-meth-00.txt PRESENTER: Rajiv Papneja STATUS: a. New version -01 submitted b. Incorporated comments from the mailing list (so far we received comments from 3-4 members) c. Considering the significance and adoption of the protocol across the globe in which LDP is being used as the fundamental building block for applications like VPN, MVPN etc. d. We seek both group and BMWG leadership support and consensus to make this a work group item e. Discussion points i. Handling LDP convergence in the light of IGP data plane convergence work ii. Handling of traffic streams and agreeing on a number of streams that should be generated for a convergence test based on the number of prefixes. Please help contribute to a successful meeting by reading the above I-D(s) and references *before* we meet. To offer comments on BMWG work in progress or the agenda itself, please send email to: bmwg@ietf.org Alternatively, to offer potential agenda items, please email: acmorton@att.com