Last Call Review of draft-ietf-bmwg-vswitch-opnfv-03
review-ietf-bmwg-vswitch-opnfv-03-opsdir-lc-romascanu-2017-05-11-00

This document describes describes the progress of the Open Platform for NFV
(OPNFV) project on virtual switch performance "VSPERF". That project reuses the
BMWG framework and specifications to benchmark virtual switches implemented in
general-purpose hardware. Some differences with the benchmarking of specialized
HW platforms are identified and they may become work items for BMWG in the
future. It's a well written and clear document, but I have reservations about
it being published as an RFC, and I cannot find coverage for it in the WG
charter. I also have concerns that parts of the methodology used by OPNFV break
the BMWG principles, especially repeatability and 'black-box', and this is not
clear enough articulated in the document.  As I was assigned both OPS-DIR and
Gen-ART reviews for this document, I detailed the concerns in my Gen-ART
review, they seem to belong better there.

From an OPS-DIR perspective this document has no issues. If the concerns in
section 6 are addressed and caution is taken to isolate the SUTs and
benchmarking environments from the Internet or operational intranets, there is
no operational impact. If approved it would be a useful tool for operators to
get some information about how benchmarking of OPNFV project products are being
designed.