Skip to main content

Agenda IETF104: bmwg
agenda-104-bmwg-04

Meeting Agenda Benchmarking Methodology (bmwg) WG
Date and time 2019-03-27 10:20
Title Agenda IETF104: bmwg
State Active
Other versions plain text
Last updated 2019-03-18

agenda-104-bmwg-04
Benchmarking Methodology WG (BMWG)

As of March 18, 2019

WEDNESDAY, March 27, 2019
1120-1320 (UTC+1)  Morning Session II
Room  Athens/Barcelona  OPS     bmwg

Remote Participation:
https://www.ietf.org/how/meetings/104/remote/

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
     P L E A S E    R E A D   T H E   D R A F T S  ! ! ! !
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

0. Agenda Bashing

1. WG Status  (Chairs)
   (Brief status below)
There are many proposals for new work...

1a. Benchmarking Methodology for EVPN and PBB-EVPN
   Presenter:  Chairs: WGLC Determination
   Related Draft:
   https://tools.ietf.org/html/draft-ietf-bmwg-evpntest-01

2. Charter and Milestones (Chairs)

3. Benchmarking Methodology for Network Security Device Performance
   **with validation test results**
   Presenter: Carsten Rossenhoevel
   Related RFC:  https://tools.ietf.org/html/rfc3511
   Related Draft:
   https://tools.ietf.org/html/draft-ietf-bmwg-ngfw-performance-00
   Related Web page:
   https://www.netsecopen.org/
   https://www.netsecopen.org/about

Continuing Proposals (topics may be added):

4. Updates for Back-to-back Frame Benchmark & OPNFV Plugfest/VSPERF Testing
   Presenter: Al Morton
   Related Draft:
   https://tools.ietf.org/html/draft-morton-bmwg-b2b-frame-05
   Call for WG Adoption resulted in many exchanges on-list
   with Yoshiaki Itou, resolved in ver 04 and 05

   Background Slides with test results:
   https://wiki.opnfv.org/download/attachments/10293193/VSPERF-Dataplane-Perf-Cap-Bench.pptx?api=v2
   https://wiki.opnfv.org/display/vsperf/Traffic+Generator+Testing

5. Methodology for VNF Benchmarking Automation
   Presenter:  Manuel Peuster
   Related Draft:
   https://tools.ietf.org/html/draft-rosa-bmwg-vnfbench-03
   Related Publication:  (IEEE Comm Mag)
   https://www.dropbox.com/s/n9niziuhi648scj/2017-rosa-taking.pdf?dl=0

6. Considerations for Benchmarking Network Virtualization Platforms
   *** with test results ***
   Presenter: Samuel Kommu & Jacob Rapp
   Related Draft:
   https://tools.ietf.org/html/draft-skommu-bmwg-nvp-03

7. Benchmarking Methodology for EVPN Multihoming Restor. & Mass Withdrawal
   Presenter:  Al Morton
   Related Drafts:
   https://tools.ietf.org/html/draft-morton-bmwg-multihome-evpn-01
   https://tools.ietf.org/html/rfc8317

8. Probabilistic Loss Ratio Search for Packet Throughput (PLRsearch)
   (includes test results from FD.io CSIT)
   Presenter: Vratko Polak, Maciek Konstantynowicz
   Related Draft:
   https://tools.ietf.org/html/draft-vpolak-plrsearch-01

9. Multiple Loss Ratio Search for Packet Throughput (MLRsearch)
    (includes test results from FD.io CSIT)
   Presenter: Vratko Polak, Maciek Konstantynowicz
   Related Draft:
   https://tools.ietf.org/html/draft-vpolak-mkonstan-mlrsearch-01

NEW Proposals:

10. Benchmarking Methodology for EVPN Multicasting
   Presenter:  Vikram Nagarajan (Remote)
   Related Draft:
   https://tools.ietf.org/html/draft-vikjac-bmwg-evpnmultest-01

11. Considerations for Benchmarking Network Performance in Containerized
   Infrastructures
   Presenter: Kyoungjae Sun
   Related Draft:
   https://tools.ietf.org/html/draft-dcn-bmwg-containerized-infra-00

12. NFV Service Density Benchmarking
    (includes test results from FD.io CSIT and CNCF CNF Testbed)
    Presenter: Maciek Konstantynowicz
    Related Draft:
    https://tools.ietf.org/html/draft-mkonstan-nf-service-density-00


13. FYI - A YANG Data Model for Network Interconnect Tester Management
   Author: Vladimir Vassilev
   Related Draft:
   https://tools.ietf.org/html/draft-vassilev-bmwg-network-interconnect-tester-00

14. FYI - Benchmarking Methodology for EVPN VPWS
   Presenter:  <not presented this time>
   Related Draft:
   https://tools.ietf.org/html/draft-kishjac-bmwg-evpnvpwstest-01

LAST. AOB

and then...
13:40-15:00     Wednesday Afternoon Collaboration Session  Congress Hall 3
https://datatracker.ietf.org/meeting/104/floor-plan?room=congress-hall-3#lower-lobby

WHO: Everyone interested in continuing discussions of
drafts and test results (mostly test results)
WHAT: Grab a To-Go Lunch and return for more informal BMWG!
WHEN: ASAP after the official BMWG session closes
WHERE: Congress 3 meeting room
with a projector and ideally tables to eat lunch comfortably.
END TIME: 1500

Notes: We will have to pack-up and move to Congress 3, but we
have to grab lunch somewhere, anyway, and we'll have plenty
of space. Our session room was already booked :-(
Also, this will be a face2face meeting, where presenters will
use their own laptops and collect comments on their work.

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-