[Search] [txt|pdfized|bibtex] [Tracker] [Email] [Nits]

Versions: 00 01                                                         
DECADE                                                          Z. Huang
Internet-Draft                                                   X. Chen
Intended status: Informational                       HUAWEI Technologies
Expires: April 21, 2011                                 October 18, 2010


                An integration example of DECADE system
               draft-huang-decade-integration-example-00

Abstract

   This document represents an integration experiment of DECADE.  In the
   experiment, we use Vuze as the application which uses DECADE server
   for content distribution.  This document describes the framework,
   message flow, environment settings and test steps.  We also analyze
   the performance benefit of the experiment.

Status of this Memo

   This Internet-Draft is submitted in full conformance with the
   provisions of BCP 78 and BCP 79.

   Internet-Drafts are working documents of the Internet Engineering
   Task Force (IETF).  Note that other groups may also distribute
   working documents as Internet-Drafts.  The list of current Internet-
   Drafts is at http://datatracker.ietf.org/drafts/current/.

   Internet-Drafts are draft documents valid for a maximum of six months
   and may be updated, replaced, or obsoleted by other documents at any
   time.  It is inappropriate to use Internet-Drafts as reference
   material or to cite them other than as "work in progress."

   This Internet-Draft will expire on April 21, 2011.

Copyright Notice

   Copyright (c) 2010 IETF Trust and the persons identified as the
   document authors.  All rights reserved.

   This document is subject to BCP 78 and the IETF Trust's Legal
   Provisions Relating to IETF Documents
   (http://trustee.ietf.org/license-info) in effect on the date of
   publication of this document.  Please review these documents
   carefully, as they describe your rights and restrictions with respect
   to this document.  Code Components extracted from this document must
   include Simplified BSD License text as described in Section 4.e of
   the Trust Legal Provisions and are provided without warranty as
   described in the Simplified BSD License.



Huang & Chen             Expires April 21, 2011                 [Page 1]


Internet-Draft    Integration example of DECADE system      October 2010


Table of Contents

   1.  Introduction . . . . . . . . . . . . . . . . . . . . . . . . .  3
   2.  Terminology  . . . . . . . . . . . . . . . . . . . . . . . . .  3
   3.  Vuze Client Design . . . . . . . . . . . . . . . . . . . . . .  4
     3.1.  DECADE-Enabled Vuze architecture Design  . . . . . . . . .  4
     3.2.  DECADE-Enabled Vuze Communication Procedure  . . . . . . .  5
   4.  Test Environment Setting . . . . . . . . . . . . . . . . . . .  6
     4.1.  Test Platforms . . . . . . . . . . . . . . . . . . . . . .  7
       4.1.1.  DECADE Server  . . . . . . . . . . . . . . . . . . . .  7
       4.1.2.  Vuze Client with DECADE Plugin . . . . . . . . . . . .  7
       4.1.3.  Remote Controller  . . . . . . . . . . . . . . . . . .  8
       4.1.4.  Tracker  . . . . . . . . . . . . . . . . . . . . . . .  8
       4.1.5.  PL Manager . . . . . . . . . . . . . . . . . . . . . .  8
       4.1.6.  HTTP Server  . . . . . . . . . . . . . . . . . . . . .  8
     4.2.  Benchmark Setting  . . . . . . . . . . . . . . . . . . . .  8
     4.3.  Test Steps . . . . . . . . . . . . . . . . . . . . . . . .  9
   5.  Performance Analysis . . . . . . . . . . . . . . . . . . . . .  9
   6.  Security Considerations  . . . . . . . . . . . . . . . . . . . 10
   7.  IANA Considerations  . . . . . . . . . . . . . . . . . . . . . 10
   8.  Acknowledgments  . . . . . . . . . . . . . . . . . . . . . . . 10
   9.  References . . . . . . . . . . . . . . . . . . . . . . . . . . 11
     9.1.  Informative References . . . . . . . . . . . . . . . . . . 11
     9.2.  References . . . . . . . . . . . . . . . . . . . . . . . . 11
     9.3.  references . . . . . . . . . . . . . . . . . . . . . . . . 11
     9.4.  References . . . . . . . . . . . . . . . . . . . . . . . . 11
     9.5.  References . . . . . . . . . . . . . . . . . . . . . . . . 11
   Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . . 11























Huang & Chen             Expires April 21, 2011                 [Page 2]


Internet-Draft    Integration example of DECADE system      October 2010


1.  Introduction

   DECADE [draft-ietf-decade-problem-statement-00]is an architecture
   that provides applications with access and resource control to in-
   network storage.

   This draft introduces an integration example of DECADE architecture.
   In our DECADE example system, the core component includes DECADE
   server and DECADE client.  DECADE server running at Linux platform is
   designed to support data reading and writing for DECADE clients.  For
   DECADE client, we choose an open source P2P client software named
   Vuze[Vuze] which supports the user defining plugin to extend software
   function.  We designed a plugin named DECADE plugin to realize the
   DECADE function.  Test Environment and performance of DECADE-Enable
   Vuze are described in the draft after introducing the system
   architecture and main message flow.

   Please note that Vuze presented in this draft is only one of many P2P
   applications.  DECADE can support other applications, for example
   live streaming.Certainly, we only show Vuze Integration experiment in
   the document.


2.  Terminology

   P2P:Peer-to-Peer computing or networking is a distributed application
   architecture that partitions tasks or work loads between peers.
   Peers are equally privileged, equipotent participants in the
   application.

   Vuze: An open source P2P application, which uses BitTorrent protocol
   for message and data exchanging.Vuze provides a set of interfaces
   which support users to develop particular extensions.

   DECADE Plugin:A plugin built into Vuze to realize DECADE functions
   including getting/putting data from/to DECADE server and redirection
   .

   DECADE-Enabled Vuze: A Vuze client that is compatible with DECADE by
   implementing DECADE plugin and DECADE plugin is enabled.

   Native Vuze: A Vuze client without DECADE plugin or with DECADE
   plugin but DECADE function is disabled.

   Remote Controller: An controller which can control every Vuze client
   to start or stop downloading tasks It also has the function of
   collecting statistics information of each Vuze client.It is a main
   operating platform.



Huang & Chen             Expires April 21, 2011                 [Page 3]


Internet-Draft    Integration example of DECADE system      October 2010


3.  Vuze Client Design

   Before showing the trial procedure we must illustrate Vuze Client
   design procedure first.

   Note that Vuze client is classified into two different kinds - Native
   Vuze and DECADE-Enabled Vuze.  When users run Native Vuze,it behaves
   as usual BitTorrent client.When using DECADE-Enabled Vuze, the
   communication and data exchange process is different.That is a very
   significant change,it means that uplink traffic can be reduced
   sharply and download performance can be improved.  It is beneficial
   for ISPs to save the last-mile uplink bandwidth.

3.1.  DECADE-Enabled Vuze architecture Design

   DECADE plugin is one core part of our demo system.  It has several
   interfaces with other components as following:

   Interface between DECADE plugin and DECADE server: DECADE plugin can
   upload and download the data from DECADE server.  It also includes
   other functions such as user registration, application registration
   etc.

   Interface between DECADE plugin and Vuze client: DECADE plugin can
   register the listener to intercept the BitTorrent message such as
   "BT_Request" message from or to Vuze client, encapsulate the data
   from DECADE server into "BT_Piece" message and put the "BT_Piece"
   message into incoming message queue, read the block/piece data from
   the disk when seeding (to upload the data to DECADE server), and
   start or stop the download task, all these functions are supported in
   the Plugin API provided by Vuze.

   Interface between DECADE plugins: When DECADE plugin intercepts the
   "BT_Request" message from other Vuze clients, local DECADE plugin
   sends "Redirect" message to remote DECADE plugin to authorize it to
   download the piece data from the DECADE server.

   Interface between DECADE plugin and Remote Controller: DECADE plugin
   registers with Remote Controller after starting up, Remote Controller
   can control all the Vuze clients to start, stop or resume the
   download task through DECADE plugins.

   The system architecture is as follow:








Huang & Chen             Expires April 21, 2011                 [Page 4]


Internet-Draft    Integration example of DECADE system      October 2010


   _____________                _____________
   |  DACADE    |               |  DECADE    |
   |  Server    |<------------->|  Server    |
   |____________|               |____________|
         ^                            ^
         |                            |
   ______|______                ______|______
   |     |      |               |     |      |
   | P2P | Peer |               | P2P | Peer |
   |     |      |               |     |      |                _____________
   | ____v____  |               | ____v____  |                | Remote     |
   | |DECADE  | |               | | DECADE | |                | Controller |
   | |Plugin  |<|-------------- |>| Plugin |<|----------------|____________|
   | |________| |               | |________| |                      |
   |     ^   ^  |               |     ^      |                      |
   |     |   |__|_______________|_____|______|______________________|
   | PluginAPI  |               | PluginAPI  |
   |     |      |               |     |      |
   | ____v____  |               | ____v____  |
   | |        | |               | |        | |
   | |  Vuze  |<|-------------- |>|  Vuze  | |
   | |________| |               | |________| |
   |____________|               |____________|

3.2.  DECADE-Enabled Vuze Communication Procedure

   A DECADE plugin can change the data path of BitTorrent download by
   using a "Redirect" message.

   The detailed communication procedure is as following:

   O When each client starts the download task ,it will try to connect
   the tracker to get peer list and then send "BT_Request" message to
   other peers in peer list;

   O If the DECADE plugin is enabled, then it will intercept the
   incoming "BT_Request" message from other Vuze clients, and then reply
   with a "Redirect" message which includes DDECADE server's address,
   authorization token,and etc to the requester.

   O When a DECADE plugin receives a "Redirect" message,it will connect
   to the DECADE server according to message context and send "Remote
   Get" message to the DECADE server to request the data,then wait for
   response;

   O When a DECADE server receives a "Remote Get" message, it will check
   the server IP address in the messge, Case 1: if the address equals to
   its own IP address, then it will send the data to the requester from



Huang & Chen             Expires April 21, 2011                 [Page 5]


Internet-Draft    Integration example of DECADE system      October 2010


   its local disk/memory; Case 2: if the address is not equal to its own
   IP address, then it will send the "Remote Get" message to that
   address, to fetch the data, and then send the data to the requester.
   The data will be cached in the server locally for use by other
   requesters.

   O When a DECADE plugin obtains the data,it will encapsulate the data
   into a standard "BT_Piece" message and send to Vuze client,then the
   client can write the data block into storage.

   The detailed communication diagram is as follow:
__________   __________           __________   _________          __________     __________
|         |  | DACADE  |          | DACADE  |  |        |         | DECADE  |    | DECADE  |
| Vuze1   |  | Plugin1 |          | Plugin2 |  | Vuze2  |         | Server  |    | Server  |
|_________|  |_________|          |_________|  |________|         |_________|    |_________|
     |            |                    |           |                   |              |
     |            |      HandShake     |           |                   |              |
     |<-----------|--------------------|---------->|                   |              |
     |            |  Azureus HandShake |           |                   |              |
     |<-----------|--------------------|---------->|                   |              |
     |            |     BT_BitField    |           |                   |              |
     |<-----------|--------------------|---------->|                   |              |
     |            |     BT_Request     |           |                   |              |
     |------------|------------------->|           |                   |              |
     |            |                    |           |                   |              |
     |            |     Redirect       |           |                   |              |
     |            |<-------------------|           |                   |              |
     |            |                   DACADE RemoteGet                 |              |
     |            |--------------------------------------------------->|              |
     |            |                    |           |                   |  DACADE Get  |
     |            |                    |           |                   |------------->|
     |            |                    |           |                   |  DACADE Data |
     |            |                    |           |                   |<-------------|
     |            |                     DACADE Data                    |              |
     |            |<---------------------------------------------------|              |
     |            |                    |           |                   |              |
     |  BT_Piece  |                    |           |                   |              |
     |<-----------|                    |           |                   |              |
     |            |                    |           |                   |              |


4.  Test Environment Setting

   Test environment includes Vuze client, tracker, DECADE Plugin, DECADE
   Servers and other supportive components such as HTTP Server, FTP
   Server and Remote Controller.  For performance comparison of Native
   Vuze and DECADE-Enabled Vuze, we set the same amount of total network
   bandwidth resource in these two test cases.  It means the total



Huang & Chen             Expires April 21, 2011                 [Page 6]


Internet-Draft    Integration example of DECADE system      October 2010


   uplink bandwidth of all the Vzue clients in the native Vuze test case
   is equal to the bandwidth of DECADE server in DECADE-Enabled Vuze
   test case.

4.1.  Test Platforms

          +-------------+        +-------------+
          |             |        |             |
          |DECADE Server|  ...   |DECADE Server|
          |             |        |             |
          +-------------+        +-------------+
                 /   \                    \
                /     \                    \
               /       \                    \
              /         \                    \
             /           \                    \
            /             \                    \
           /               \                    \
    +-------------+ +-------------+     +-------------+  +-------------+
    | Vuze client | | Vuze client |     | Vuze client |  |             |
    | with DECADE | | with DECADE | ... | with DECADE |--|  Tracker    |
    | plugin      | | plugin      |     | plugin      |  |             |
    +-------------+ +-------------+     +-------------+  +-------------+
                \           |             /
                 \          |            /
                  \         |           /
                   \        |          /
                    \       |         /
                     \      |        /
                      \     |       /
                       \    |      /
                        \   |     /
   +-------------+   +-------------+    +-------------+  +-------------+
   |             |   |   Remote    |    |             |  |             |
   | PL Manager  |   | Controller  |    | HTTP Server |  |  FTP Server |
   |             |   |             |    |             |  |             |
   +-------------+   +-------------+    +-------------+  +-------------+

4.1.1.  DECADE Server

   DECADE Server runs at Amazon EC2 [Amazon-EC2]small instances.

4.1.2.  Vuze Client with DECADE Plugin

   Vuze clients include seeding client and leechers.Leechers run at
   PlanetLab[PlanetLab] and the seeding client runs at Window 2003
   server.  DECADE Plugin will be automatically loaded and run after
   Vuze client starts up.



Huang & Chen             Expires April 21, 2011                 [Page 7]


Internet-Draft    Integration example of DECADE system      October 2010


4.1.3.  Remote Controller

   Remote controller can list all the Vuze clients in user interface and
   control them to download the specific BitTorrent file.  It runs at
   Window 2003 server.

4.1.4.  Tracker

   Vuze client provides tracker capability, so we did not deploy our own
   tracker.Vuze embedded tracker is enabled when making a torrent file,
   the seeding client is also the tracker.

4.1.5.  PL Manager

   PL Manager [PlanetLab-experiment-manager]is a tool developed by
   University of Washington, which presents a simple GUI to control
   PlanetLab nodes and perform common tasks such as:

      O Selecting nodes for your slice.

      O Choosing nodes for your experiment based on CoMon information
      about the nodes.

      O Reliably deploying you experiment files.

      O Executing commands / sets of commands on every node in parallel.

      O Monitoring the progress of the experiment as a whole, as well as
      viewing console output from the nodes.

4.1.6.  HTTP Server

   Torrent file will be put in the HTTP Server and the leechers will
   retrieve the torrent file from HTTP Server after receiving the
   download command from Remote Controller.  We use Apache Tomcat which
   is an open source software as HTTP Server.

4.2.  Benchmark Setting

   For the performance comparison of Native Vuze and DECADE-Enabled
   Vuze, the same system bandwidth is provided through some parameter
   settings.  In the Native Vuze, the system bandwidth is defined as the
   amount of the uplink bandwidth from all the Vuze clients.  The
   maximum upload bandwidth (Bu) is configured to every Vuze client
   before the test.  Suppose the number of the Vuze clients is N, the
   system bandwidth is Bu * N. In the DECADE-Enabled Vuze case, the same
   bandwidth (Bu * N) is configured to the corresponding Ethernet port
   of DECADE Server.



Huang & Chen             Expires April 21, 2011                 [Page 8]


Internet-Draft    Integration example of DECADE system      October 2010


4.3.  Test Steps

   Test steps of DECADE-Enabled Vuze is as follows:

      O Start DECADE Server, Remote Controller and all the Vuze clients.

      O One of DECADE Vuze clients seeds, generates the torrent file.
      DECADE Plugin automatically uploads the data to DECADE Server.

      O Manually put the torrent file into home directory of HTTP
      server.  If the default directory of torrent file in Vuze client
      is set to the home directory of HTTP server, this step can be
      ignored.

      O Remote Controller sends the download command to other DECADE-
      Enabled Vuze clients (leechers).

      O Leechers fetch torrent file from HTTP server.

      O Leechers request and get peer list from the tracker.

      O Leechers send BT_Request message to peers and get Redirect
      messages from peers.

      O Leechers get objects from DECADE Servers and finish the
      download.

      O Collecting and analyzing the log from all the Vuze clients.

   Test steps of Native Vuze is similar to DECADE-Enabled Vuze.The
   difference Is that Native Vuze client does not use DECADE server to
   put and get data.


5.  Performance Analysis

   Performance advantage is shown according to the test result of
   experiment:

   O There is no upload data traffic from Vuze clients in the DECADE-
   Enabled Vuze experiment, but in the Native Vuze experiment, the
   upload data traffic from Vuze clients is same as download data
   traffic.  Bandwidth resource is reduced in the last mile in the
   DECADE-Enabled Vuze experiment.

   O Higher system resource efficiency in the DECADE-Enabled Vuze
   experiment, system resource efficiency is defined as the ratio of
   system download rate to the total system bandwidth.  The test result



Huang & Chen             Expires April 21, 2011                 [Page 9]


Internet-Draft    Integration example of DECADE system      October 2010


   is illustrated in the following figure.


      |
      |
      |                          88%
      |
      |                        +-------+
      |                        |       |
      |         65%            |       |
      |                        |       |
      |      +-------+         |       |
      |      |       |         |       |
      |      |       |         |       |
      |      |       |         |       |
      |      |       |         |       |
      |      |       |         |       |
      |      |       |         |       |
      |      |       |         |       |
      |      |       |         |       |
      |      |       |         |       |
      |      |       |         |       |
      +------+-------+---------+-------+--------

            Native Vuze      DECADE-Enabled Vuze



6.  Security Considerations

   This draft does not introduce any security considerations.


7.  IANA Considerations

   This document does not have any IANA Considerations.


8.  Acknowledgments

   The authors would like to thank Haibin Song and Ning Zong for
   comments and contributions to this document, and also thanks Paul
   Gardner, Yudong Kang, Tao Jiang, Jinglong Liu and Cixiang Lei for
   programming support.


9.  References




Huang & Chen             Expires April 21, 2011                [Page 10]


Internet-Draft    Integration example of DECADE system      October 2010


9.1.  Informative References

   [draft-ietf-decade-problem-statement-00]
              Song, H., Zong, N., Yang, Y., and R. Alimi, "DECoupled
              Application Data Enroute (DECADE) Problem Statement",
              August 2010.

9.2.  References

   [PlanetLab]
              "PlanetLab", http://www.Planet-lab.org.

9.3.  references

   [PlanetLab-experiment-manager]
              Computer Science and Engineering, University of
              Washington, "PlanetLab experiment manager",
              http://www.cs.washington.edu/research/networking/cplane/.

9.4.  References

   [Amazon-EC2]
              Amazon, "Amazon Elastic Compute Cloud",
              http://aws.amazon.com/ec2/.

9.5.  References

   [Vuze]     "Vuze", http://www.vuze.com.


Authors' Addresses

   Z Huang
   HUAWEI Technologies

   Email: hpanda@huawei.com


   X Chen
   HUAWEI Technologies

   Email: chen.xiaohui@huawei.com









Huang & Chen             Expires April 21, 2011                [Page 11]