Benchmarking Methodology WG (BMWG)   

As of July 13, 2018 <some links may not work until drafts are submitted >

TUESDAY, July 17, 2018
1330-1530  Afternoon Session I
Saint-Paul/Sainte-Catherine    OPS     bmwg           

Remote Participation:
http://www.ietf.org/meeting/102/index/index.html
http://www.ietf.org/meeting/102/remote-participation.html

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

0. Agenda Bashing

1. WG Status  (Chairs)
   (Brief status below)
There are many proposals for new work...

2. Charter and Milestones (Chairs)

Successful Re-chartering of BMWG
   Chairs and AD Advisor
   New Charter (and Milestones):
   https://datatracker.ietf.org/group/bmwg/about/

ETSI NFV Liaison on NFVI Benchmarking Normative Specification
No comments from WG by the deadline.  Latest Draft available: 
https://docbox.etsi.org/ISG/NFV/Open/Drafts/TST009_NFVI_Benchmarks

Liaison from ITU-T SG 11:   *need a link for this*


3. Benchmarking Methodology for EVPN and PBB-EVPN
   Presenter:  Sudhin Jacob 
   Related Draft:
   https://tools.ietf.org/html/draft-kishjac-bmwg-evpntest-10


Continuing Proposals: 

4. Methodology for VNF Benchmarking Automation
   Presenter:  Raphael Vicente Rosa
   Related Draft: 
   https://tools.ietf.org/html/draft-rosa-bmwg-vnfbench-02
   Related Publication:  (IEEE Comm Mag)
   https://www.dropbox.com/s/n9niziuhi648scj/2017-rosa-taking.pdf?dl=0
   
5. Considerations for Benchmarking Network Virtualization Platforms 
   Presenter: Samuel Kommu & Jacob Rapp
   Related Draft:
   https://tools.ietf.org/html/draft-skommu-bmwg-nvp-03.txt
   NEW-ish Draft with minimal exposure, lots of comments at IETF-98 
   
6. Updates to Firewall Benchmarking for Modern Firewalls 
   Presenter: Tim Winters of UNH-IOL 
   Related RFC:  https://tools.ietf.org/html/rfc3511
   Related Draft:
   https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-03
   Related Web page:  
   https://www.netsecopen.org/
   https://www.netsecopen.org/about

7. Updates for Back-to-back Frame Benchmark & OPNFV Plugfest/VSPERF Testing
   Presenter: Al Morton
   Related Draft: 
   https://tools.ietf.org/html/draft-morton-bmwg-b2b-frame-02
   OPNFV Plugfest (Fraser Release) VSPERF Testing Slides <see Meeting Materials>
   
   Background Slides: https://wiki.opnfv.org/download/attachments/10293193/VSPERF-Dataplane-Perf-Cap-Bench.pptx?api=v2
   https://wiki.opnfv.org/display/vsperf/Traffic+Generator+Testing

8. Presentation on reliability and precision of software packet generators
   Presenter: Paul Emmerich
   <see meeting materials>




LAST. AOB 


-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Not presented at this meeting:

X. Benchmarking Methodology for Service Function Chain
   Presenter: Taekhee Kim
   Related Draft:
   https://tools.ietf.org/html/draft-kim-bmwg-sfc-benchmark-00


?. Proposal on Network Service Layer Abstract Model 
   Presenter: Sean Wu
   Related Draft: 
   https://tools.ietf.org/html/draft-xwu-bmwg-nslam-00
   Plan is to update to include NFV Considerations 
   
?. Benchmarking Methodology for Virtualization Network Performance
   Presenter: Lu Huang
   Related Draft:
   https://tools.ietf.org/html/draft-huang-bmwg-virtual-network-performance-02


??. ETSI NFV Liaison on NFVI Benchmarking Normative Specification
   Presenter: Al Morton
   Issues worked-out with omission from statements@ietf.org:
   https://datatracker.ietf.org/liaison/1565/
   Related message to the WG list:
   https://mailarchive.ietf.org/arch/msg/bmwg/1_jPsNUf9q1ObXRwF-_MlZKiE5w
Comments can be collected from BMWG and replied as a WG, or sent directly
to the chairs of ETSI NFV TST WG (see the liaison text). 

   
  We've had some really good presentations on Benchmarking/testing.
x. Discussion Topic:  ANY MORE PROPOSALS ???
  Leader: Chairs