BBench

From gem5
Revision as of 20:54, 24 November 2011 by Atgutier (talk | contribs)
Jump to: navigation, search

BBench is a web-page rendering benchmark comprising 11 of the most popular sites on the internet today [Google]: Amazon, BBC, CNN, Craigslist, eBay, ESPN, Google, MSN, Slashdot, Twitter, and YouTube. The content for these sites was gathered using a tool called HTTrack. BBench automatically renders each of the aforementioned web-pages in an iterative fashion using a custom script written in JavaScript.

Running BBench

Since BBench is a collection of web-pages it consists of HTML, CSS, JavaScript, images etc. None of this code is compiled, instead it is interpreted by the browser as it renders the page. To run BBench download and untar the source, then, simply navigate to the BBench homepage in your browser. This is the index.html file in the top level directory of the BBench source. Opening the BBench homepage can usually be done by double clicking on the index.html file, or you can point your browser to this file manually by inserting the url into your browser, e.g., file:///path_to_bbench/index.html.

The start page allows you to configure several different options:

  • Number of iterations: This is the number of times the web-pages will be rendered.
  • Scroll delay: The number of milliseconds to wait before performing the next scroll operation.
  • Scroll size: The number of pixels to scroll by.

Bbench home.png

Results Page

The results page displays the run-time statistics for each of the pages in the page set. The Cold Start Time column in table reports the rendering time for each page the first time it is rendered. The remaining columns in the table report statistics related to rendering time after the first iteration, Warm Runs. The stats provided are the average page rendering time for each page in ms, the standard deviation of the rendering time, and the coefficient of variation of the rendering time as a percentage.

Bbench results.png

Source

A tarball of the BBench source can be found here:

BBench Source

Android Full-System Files

Get an Android kernel and disk image containing BBench here.

Other Benchmarks

Coming soon!

Publications

If you use BBench or any of our benchmarks in your work please cite our IISWC 2011 paper:

A. Gutierrez, R.G. Dreslinski, T.F. Wenisch, T. Mudge, A. Saidi, C. Emmons, and N. Paver. Full-System Analysis and Characterization of Interactive Smartphone Applications. IEEE International Symposium on Workload Characterization, pages 81-90, Austin, TX, November 2011.