Benchmarking Methodology WG (BMWG) DRAFT as of July 16, 2017 !!! July 17, 2017 9:30-12:00 CEST (UTC-2) Monday Morning session I Room Karlin III OPS bmwg Remote Participation: http://www.ietf.org/meeting/99/index/index.html http://www.ietf.org/meeting/99/remote-participation.html -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- 0. Agenda Bashing 1. WG Status (Chairs) (Brief status below) The following drafts have all reached a state of completion: * IPv6 Neighbor Discovery * IPv6 Transition Benchmarking * VNF and Infrastructure Benchmarking Considerations * Benchmarking Virtual Switches in OPNFV * Data Center Benchmarking 2. Charter and Milestones (Chairs) 3. Benchmarking Methodology for SDN Controller Performance Presenter: Sarah Banks (or Bhuvaneswaran Vengainathan) Resolves comments from WGLC? http://tools.ietf.org/html/draft-ietf-bmwg-sdn-controller-benchmark-term-03.txt http://tools.ietf.org/html/draft-ietf-bmwg-sdn-controller-benchmark-meth-03.txt WG Actions: 4. Benchmarking Methodology for EVPN and PBB-EVPN Presenter: Sudhin Jacob Related Draft: https://tools.ietf.org/html/draft-kishjac-bmwg-evpntest-06 Proposals: 5. Benchmarking Methodology for Service Function Chain Presenter: Taekhee Kim Related Draft: https://tools.ietf.org/html/draft-kim-bmwg-sfc-benchmark-00 X. Considerations for Benchmarking Network Virtualization Platforms Presenter: (Canceled!) NEW-ish Draft with minimal exposure, lots of comments at IETF-98 Related Draft: https://tools.ietf.org/html/draft-skommu-bmwg-nvp-00 https://datatracker.ietf.org/doc/html/draft-skommu-bmwg-nvp NEW/First time: (None) 6. Re-chartering BMWG Chairs and AD Advisor WG Discussion: 7. Discussion Topic: Dataplane Performance: NFVI Benchmarking Measurements OPNFV Design Summit Presentation by Trevor Cooper, Sridhar Rao, and Al Morton Slides: https://wiki.opnfv.org/download/attachments/10293193/VSPERF-Dataplane-Perf-Cap-Bench.pptx?api=v2 https://wiki.opnfv.org/display/vsperf/Traffic+Generator+Testing General Summit info: https://www.opnfv.org/opnfv-summit-2017-event-recap Leader: Al Morton LAST. AOB -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Not presented at this meeting: ?. Discussion Topic: Outliers and how to handle them Leader: Stenio Fernandes 9. Benchmarking Methodology for Virtualization Network Performance Presenter: Lu Huang Related Draft: https://tools.ietf.org/html/draft-huang-bmwg-virtual-network-performance-02 ?. Considerations for Benchmarking Network Virtualization Platforms Presenter: Samuel Kommu NEW Draft Related Draft: https://tools.ietf.org/html/draft-bmwg-nvp-00 ?. VNF Benchmarking Methodology Presenter: Raphael Rosa/Robert Szabo New draft with reduced scope, presented at IETF-95 Related Draft: http://www.ietf.org/id/draft-rosa-bmwg-vnfbench-00.txt XXX. Benchmarking or Y.1731 Performance Monitoring on a DUT Presenter: Sudhin Jacob Liaison to ITU-T SG15 & SG11 proceeding Related Draft: https://tools.ietf.org/html/draft-jacpra-bmwg-pmtest-03