Benchmarking Methodology WG (BMWG)   

As of Nov 6, 2018 

THURSDAY, November 8, 2018
0900-1100 (UTC+7)  Morning Session I
Room    OPS     bmwg           

Remote Participation:
http://www.ietf.org/meeting/103/index/index.html
http://www.ietf.org/meeting/103/remote-participation.html

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

0. Agenda Bashing

1. WG Status  (Chairs)
   (Brief status below)
There are many proposals for new work...

2. Charter and Milestones (Chairs)

ETSI NFV GS on NFVI Benchmarking Normative Specification Published
https://docbox.etsi.org/ISG/NFV/Open/Drafts/TST009_NFVI_Benchmarks


3. Benchmarking Methodology for Network Security Device Performance
   Presenter: Samaresh Nair 
   Related RFC:  https://tools.ietf.org/html/rfc3511
   Related Draft:
   https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-05
   Related Web page:  
   https://www.netsecopen.org/
   https://www.netsecopen.org/about


4. Benchmarking Methodology for EVPN and PBB-EVPN
   Presenter:  Sudhin Jacob 
   Related Draft:
   https://tools.ietf.org/html/draft-ietf-bmwg-evpntest-00

Related NEW EVPN proposals:

5. Benchmarking Methodology for EVPN VPWS
   Presenter:  Sudhin Jacob 
   Related Draft:
   https://datatracker.ietf.org/doc/draft-kishjac-bmwg-evpnvpwstest/
   
6. Benchmarking Methodology for EVPN Multihoming Restor. & Mass Withdrawal  
   Presenter:  Al Morton
   Related Drafts:
   https://tools.ietf.org/html/draft-morton-bmwg-multihome-evpn-00
   https://tools.ietf.org/html/rfc8317
   

Continuing Proposals (topics may be added): 


7. Updates for Back-to-back Frame Benchmark & OPNFV Plugfest/VSPERF Testing
   Presenter: Al Morton
   Related Draft: 
   https://tools.ietf.org/html/draft-morton-bmwg-b2b-frame-03
   OPNFV Plugfest (Fraser Release) VSPERF Testing Slides 
   <see IETF-102 Meeting Materials>
   
   Background Slides: https://wiki.opnfv.org/download/attachments/10293193/VSPERF-Dataplane-Perf-Cap-Bench.pptx?api=v2
   https://wiki.opnfv.org/display/vsperf/Traffic+Generator+Testing

8. New Buffer assessment method for RFC 8239 Data Center Benchmarking
   Author: Yoshiaki Itou
   Mail List References: 
   https://mailarchive.ietf.org/arch/msg/bmwg/lKiImpq8RlNapD8CVRG1dRZlMZ8
   https://mailarchive.ietf.org/arch/msg/bmwg/elCgGpsB-TH1zCwaRhzM7B2mW4g
   
   
NEW Proposals:
   
9. New Adaptive Search Algorithm from FD.io CSIT 
   Presenter: Vratko Polak, Maciek Konstantynowicz 
   Related Draft:
   https://tools.ietf.org/html/draft-vpolak-mkonstan-mlrsearch-00
   
10.New Long-term tests for Loss characterization from FD.io CSIT 
   Presenter: Vratko Polak, Maciek Konstantynowicz
   Related Draft:
   https://tools.ietf.org/html/draft-vpolak-plrsearch-00

WG Communications:
11.Liaison from ITU-T SG 12: 
   Presenter: Al Morton
   https://datatracker.ietf.org/liaison/1602/ 
   

LAST. AOB 


-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Not presented at this meeting:

?. Methodology for VNF Benchmarking Automation
   Presenter:  Raphael Vicente Rosa
   Related Draft: 
   https://tools.ietf.org/html/draft-rosa-bmwg-vnfbench-02
   Related Publication:  (IEEE Comm Mag)
   https://www.dropbox.com/s/n9niziuhi648scj/2017-rosa-taking.pdf?dl=0
   
?. Considerations for Benchmarking Network Virtualization Platforms 
   Presenter: Samuel Kommu & Jacob Rapp
   Related Draft:
   https://tools.ietf.org/html/draft-skommu-bmwg-nvp-03.txt
   NEW-ish Draft with minimal exposure, lots of comments at IETF-98
   Comments on the list to address!   
   

?. Presentation on reliability and precision of software packet generators
   Presenter: Paul Emmerich
   <see meeting materials>


X. Benchmarking Methodology for Service Function Chain
   Presenter: Taekhee Kim
   Related Draft:
   https://tools.ietf.org/html/draft-kim-bmwg-sfc-benchmark-00


?. Proposal on Network Service Layer Abstract Model 
   Presenter: Sean Wu
   Related Draft: 
   https://tools.ietf.org/html/draft-xwu-bmwg-nslam-00
   Plan is to update to include NFV Considerations 
   
?. Benchmarking Methodology for Virtualization Network Performance
   Presenter: Lu Huang
   Related Draft:
   https://tools.ietf.org/html/draft-huang-bmwg-virtual-network-performance-02

   
  We've had some really good presentations on Benchmarking/testing.
x. Discussion Topic:  ANY MORE PROPOSALS ???
  Leader: Chairs