Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

To remove all containers:
docker rm $(docker ps -a -q)

To remove all images:
docker rmi $(docker images -q)

>> To start the tests:

Run the test script

https://opensource.ncsa.illinois.edu/bitbucket/projects/BD/repos/benchmark-web/browse/dts_benchmark_file_atRate-no-sleep.py

>>python python dts_benchmark_file_atRate.py <num of testfiles>

>> Obtain the data from the database for analysis:

query_elas.js 

//print("# queue name,time,num_msgs,num_consumers,total_num_msgs_published,total_num_msgs_delivered, num_vms");
db = db.getSiblingDB('browndog_dev');
db.extr.find({"$and": [{"time": {"$gte": ISODate("2016-03-31T11:11:00.00Z")}}, {"time": {"$lte": ISODate("2016-03-31T11:40:00.000Z")}},{"name":"ncsa.image.ocr"}]}).sort({time:1}).forEach(function(jo){print(jo.time.getTime() + " "+ jo.num_msgs.toString() + " " + jo.num_consumers.toString() + " " + jo.hosts.length.toString());});

...

db = db.getSiblingDB('browndog_dev');
db.queues.find({"$and": [{"time": {"$gte": ISODate("2016-04-08T20:35:00.00Z")}}, {"time": {"$lte": ISODate("2016-04-08T21:45:00.000Z")}},{"name":"ncsa.cv.profiles"}]}).sort({time:1}).forEach(function(jo){print(jo.time.getTime() + " "+ jo.num_msgs.toString() + " " + jo.num_consumers.toString() + " " + jo.hosts.length.toString());});

>> Shell script to obtain number of consumers and hosts as queue length vary over time from the query results of database.

View file
namequeues_convert_time_final.sh
height250

>> Matlab plot script script : MATLAB script to plot the data

View file
nameprofile_queue_31stMarch16.m
height250