Agenda IETF106: bmwg
agenda-106-bmwg-02

Meeting Agenda Benchmarking Methodology (bmwg) WG
Title Agenda IETF106: bmwg
State Active
Other versions plain text
Last updated 2019-11-18

Meeting Agenda
agenda-106-bmwg

   Benchmarking Methodology WG (BMWG)

As of Nov 18, 2019

Wednesday, November 20, 2019 (UTC+08)
13:30-15:00     Wednesday Afternoon session I
Room  Hullet    ops     bmwg

Remote Participation:
https://www.ietf.org/how/meetings/106/Remote/

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
     P L E A S E    R E A D   T H E   D R A F T S  ! ! ! !
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

0. Agenda Bashing

1. WG Status  (Chairs)
   (Brief status below)
There are many proposals for new work...

1a. Benchmarking Methodology for EVPN and PBB-EVPN
   Presenter:  Chairs: WGLC Determination
   Related Draft:
   https://tools.ietf.org/html/draft-ietf-bmwg-evpntest-03

2. Charter and Milestones (Chairs)

3. Benchmarking Methodology for Network Security Device Performance
   Early SecDir Review comments
   Presenter: Tim Winters (Carsten Rossenhoevel is a remote participant)
   Related RFC:  https://tools.ietf.org/html/rfc3511
   Related Draft:
   https://tools.ietf.org/html/draft-ietf-bmwg-ngfw-performance-01
   Related Web page:
   https://www.netsecopen.org/
   https://www.netsecopen.org/about

4. Back-to-back Frame Benchmark & OPNFV Plugfest/VSPERF Testing
   WG Adoption, ***then several comments on-list (Maciek, Vratko, Tim)***
   Presenter: Al Morton
   Related Draft:
   https://tools.ietf.org/html/draft-ietf-bmwg-b2b-frame-01
   Background Slides with test results:
   https://wiki.opnfv.org/download/attachments/10293193/VSPERF-Dataplane-Perf-Cap-Bench.pptx?api=v2
   https://wiki.opnfv.org/display/vsperf/Traffic+Generator+Testing

Continuing Proposals (topics may be added):

5. Methodology for VNF Benchmarking Automation
   Presenter:  Raphael Rosa
   Comments on-list resolved(?)
   Related Draft:
   https://tools.ietf.org/html/draft-rosa-bmwg-vnfbench-05
   Related Work:
   [1] https://github.com/raphaelvrosa/vnf-bench-model/tree/master/vnf-br/yang
   [2] https://github.com/raphaelvrosa/vnf-bench-model/tree/master/experiments

   Related Publication:  (IEEE Comm Mag)
   https://www.dropbox.com/s/n9niziuhi648scj/2017-rosa-taking.pdf?dl=0

6. Considerations for Benchmarking Network Performance in Containerized
   Infrastructures
   Results from Hackathon, Updated Draft
   Presenter: Wangbong Lee
   Related Draft:
   https://tools.ietf.org/html/draft-dcn-bmwg-containerized-infra-03

7. A YANG Data Model for Network Interconnect Tester Management
   Author: Vladimir Vassilev
   First presentation and Results from Hackathon
   Related Draft:
   https://tools.ietf.org/html/draft-vassilev-bmwg-network-interconnect-tester-02.txt

8. Benchmarking Methodology for EVPN Multihoming Restor. & Mass Withdrawal
   Comments on-list resolved
   Presenter:  Al Morton
   Related Drafts:
   https://tools.ietf.org/html/draft-morton-bmwg-multihome-evpn-03
   https://tools.ietf.org/html/rfc8317

LAST. AOB

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

--- other candidates for agenda time follow ---

9. NFV Service Density Benchmarking
    Presenter: Maciek Konstantynowicz (remote) or Al standing-in
        Comments on the list
    Related Draft:
    https://tools.ietf.org/html/draft-mkonstan-nf-service-density-01

12. Benchmarking and the CNTT (Common NFVI Telco Taskforce)
   A key Industry Initiative where Benchmarking is part of the solution
   Presenter:  Al Morton

Not appearing this time:
5. Probabilistic Loss Ratio Search for Packet Throughput (PLRsearch)
   Presenter: Vratko Polak, Maciek Konstantynowicz (remote)
   Related Draft:
   https://tools.ietf.org/html/draft-vpolak-bmwg-plrsearch-02

6. Multiple Loss Ratio Search for Packet Throughput (MLRsearch)
    (includes test results from FD.io CSIT)
   Presenter: Vratko Polak, Maciek Konstantynowicz (remote)
   Related Draft:
   https://tools.ietf.org/html/draft-vpolak-mkonstan-bmwg-mlrsearch-02

10. Benchmarking Methodology for EVPN Multicasting
   date changed
   Presenter:  Sudhin Jacob
   Related Draft:
   https://tools.ietf.org/html/draft-vikjac-bmwg-evpnmultest-02

11.Benchmarking Methodology for EVPN VPWS
   not presented at -104, date changed
   Presenter:  Sudhin Jacob
   Related Draft:
   https://tools.ietf.org/html/draft-kishjac-bmwg-evpnvpwstest-02

NEW Proposals:

13. 5G transport network benchmarking
   Presenter: Luis M. Contreras
   Related Draft:
   https://tools.ietf.org/html/draft-contreras-bmwg-5g-00

x. Considerations for Benchmarking Network Virtualization Platforms
   (Presented this time?)
   Presenter: Samuel Kommu & Jacob Rapp
   Related Draft:
   https://tools.ietf.org/html/draft-skommu-bmwg-nvp-03