Skip to main content

Agenda IETF102: bmwg
agenda-102-bmwg-02

Meeting Agenda Benchmarking Methodology (bmwg) WG
Title Agenda IETF102: bmwg
State Active
Other versions plain text
Last updated 2018-07-17

agenda-102-bmwg-02
Benchmarking Methodology WG (BMWG)

As of July 13, 2018 <some links may not work until drafts are submitted >

TUESDAY, July 17, 2018
1330-1530  Afternoon Session I
Saint-Paul/Sainte-Catherine    OPS     bmwg

Remote Participation:
http://www.ietf.org/meeting/102/index/index.html
http://www.ietf.org/meeting/102/remote-participation.html

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

0. Agenda Bashing

1. WG Status  (Chairs)
   (Brief status below)
There are many proposals for new work...

2. Charter and Milestones (Chairs)

Successful Re-chartering of BMWG
   Chairs and AD Advisor
   New Charter (and Milestones):
   https://datatracker.ietf.org/group/bmwg/about/

ETSI NFV Liaison on NFVI Benchmarking Normative Specification
No comments from WG by the deadline.  Latest Draft available:
https://docbox.etsi.org/ISG/NFV/Open/Drafts/TST009_NFVI_Benchmarks

Liaison from ITU-T SG 11:   *need a link for this*

3. Benchmarking Methodology for EVPN and PBB-EVPN
   Presenter:  Sudhin Jacob
   Related Draft:
   https://tools.ietf.org/html/draft-kishjac-bmwg-evpntest-10

Continuing Proposals:

4. Methodology for VNF Benchmarking Automation
   Presenter:  Raphael Vicente Rosa
   Related Draft:
   https://tools.ietf.org/html/draft-rosa-bmwg-vnfbench-02
   Related Publication:  (IEEE Comm Mag)
   https://www.dropbox.com/s/n9niziuhi648scj/2017-rosa-taking.pdf?dl=0

5. Considerations for Benchmarking Network Virtualization Platforms
   Presenter: Samuel Kommu & Jacob Rapp
   Related Draft:
   https://tools.ietf.org/html/draft-skommu-bmwg-nvp-03.txt
   NEW-ish Draft with minimal exposure, lots of comments at IETF-98

6. Updates to Firewall Benchmarking for Modern Firewalls
   Presenter: Tim Winters of UNH-IOL
   Related RFC:  https://tools.ietf.org/html/rfc3511
   Related Draft:
   https://tools.ietf.org/html/draft-balarajah-bmwg-ngfw-performance-03
   Related Web page:
   https://www.netsecopen.org/
   https://www.netsecopen.org/about

7. Updates for Back-to-back Frame Benchmark & OPNFV Plugfest/VSPERF Testing
   Presenter: Al Morton
   Related Draft:
   https://tools.ietf.org/html/draft-morton-bmwg-b2b-frame-02
   OPNFV Plugfest (Fraser Release) VSPERF Testing Slides <see Meeting Materials>

   Background Slides:
   https://wiki.opnfv.org/download/attachments/10293193/VSPERF-Dataplane-Perf-Cap-Bench.pptx?api=v2
   https://wiki.opnfv.org/display/vsperf/Traffic+Generator+Testing

8. Presentation on reliability and precision of software packet generators
   Presenter: Paul Emmerich
   <see meeting materials>

LAST. AOB

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Not presented at this meeting:

X. Benchmarking Methodology for Service Function Chain
   Presenter: Taekhee Kim
   Related Draft:
   https://tools.ietf.org/html/draft-kim-bmwg-sfc-benchmark-00

?. Proposal on Network Service Layer Abstract Model
   Presenter: Sean Wu
   Related Draft:
   https://tools.ietf.org/html/draft-xwu-bmwg-nslam-00
   Plan is to update to include NFV Considerations

?. Benchmarking Methodology for Virtualization Network Performance
   Presenter: Lu Huang
   Related Draft:
   https://tools.ietf.org/html/draft-huang-bmwg-virtual-network-performance-02

??. ETSI NFV Liaison on NFVI Benchmarking Normative Specification
   Presenter: Al Morton
   Issues worked-out with omission from statements@ietf.org:
   https://datatracker.ietf.org/liaison/1565/
   Related message to the WG list:
   https://mailarchive.ietf.org/arch/msg/bmwg/1_jPsNUf9q1ObXRwF-_MlZKiE5w
Comments can be collected from BMWG and replied as a WG, or sent directly
to the chairs of ETSI NFV TST WG (see the liaison text).

  We've had some really good presentations on Benchmarking/testing.
x. Discussion Topic:  ANY MORE PROPOSALS ???
  Leader: Chairs