wiki:RunningCheckAPIBenchmarks

Running the CheckAPI Benchmarks



Setup

First it is necessary to Checkout the CheckAPI source from SVN. You can get information from this link: http://checkapi.poly.edu/projects/project/wiki/AccessCheckAPISource


Running the Benchmarks

Each type of benchmark has it's own script to initiate the benchmarks. Each benchmark file has some configurable settings that can be edited. For example, the number and type of security layers to benchmark with may be changed. This is done by changing the constants in the bash files.

  • To run the basic overhead tests, invoke ./benchmark.sh

Running the Allpairsping Benchmarks

  • To run the allpairsping test, invoke ./benchmark-allpairs.sh
  • To run the allpairsping test with CheckAPI, invoke ./benchmark-checkapi-allpairs.sh

Instructions for allpairspingv2.repy

The Allpairsping Benchmarks will call "test_fetch2.sh" to send requests to Allpairsping Server. Here is the script of "test_fetch2.sh":

#!/bin/bash

for TRY in {1..1000}
do
    curl http://127.0.0.1:12345/ > /dev/null 2>/dev/null
done

Running the Richards Benchmarks

  • To run the richards test, invoke ./benchmark-richards.sh
  • To run the richards test with CheckAPI, invoke ./benchmark-checkapi-richards.sh

Instructions for Richards.repy

Richards Benchmark


Running the Webserver-listfiles Benchmarks

  • To run the webserver tests, run ./benchmark-webserver-listfiles.sh
  • To run the webserver tests with CheckAPI, run ./benchmark-checkapi-webserver-listfiles.sh

Instructions for Webserver-listfiles.repy

The Webserver Benchmarks will call "test_fetch2.sh" to send requests to Webserver-listfiles Server. Here is the script of "test_fetch2.sh":

#!/bin/bash

for TRY in {1..1000}
do
    curl http://127.0.0.1:12345/ > /dev/null 2>/dev/null
done

Running the Webserver-meg Benchmarks

  • To run the webserver tests, run ./benchmark-webserver-meg.sh
  • To run the webserver tests with CheckAPI, ./benchmark-checkapi-webserver-meg.sh

Instructions for Webserver-meg.repy

The Webserver Benchmarks will call "test_fetch_small.sh" to send requests to Webserver-meg Server. Here is the script of "test_fetch2.sh":

#!/bin/bash

for TRY in {1..10}
do
    curl http://127.0.0.1:12345/ > /dev/null 2>/dev/null
done

Running the Blockstore Benchmarks

  • To run the blocking storage server tests, run ./benchmark-blockstore.py
  • To run the blocking storage server tests with CheckAPI, run ./benchmark-checkapi-blockstore.py

Instructions for benchmark-blockstore.py

Change the arguments of blockstore.py to the prefix of your public/private keys and a valid port number (e.g, 12345). For example, if your keys are my_name.publickey and my_name.privatekey, the first argument would be my_name.

Last modified 6 years ago Last modified on Mar 5, 2012 2:26:44 PM