User:Dria/Benchmarks May 2013

Timeline

May 20th

Current Estimate

60min: 1 run, 1 device, 1 browser

• JavaScript, Canvas, Hybrid/Multiple, and Compliance tests run on Fx 21 and Chrome on LG Nexus 4
• 30min of this is one run of Dromaeo

May 24th

• All tests run on Nightly on LG Nexus 4
• All tests run on Safari on iPhone5

May 31st

• All tests run on Nightly, GA & Chrome & Stock (where applicable) on
  • LG Nexus 4 (ARMv7)
  • Samsung S3 (ARMv7)
  • Asus x86 tablet (specific device TBD)

June 7th

• All tests run on Nightly, GA & Chrome & Stock (if applicable) on
  • Motorola Razr I (x86)

Devices

• LG Nexus 4 (ARMv7)
• Samsung S3 (ARMv7)
• Motorola Razr I (x86)
• an Asus x86 tablet (specific device TBD)
• plus: iPhone 5 for Safari

Tests

JavaScript

• Octane
• Kraken
• Sunspider
• Dromaeo DOM

Canvas

• C5 Bench
• FishIE Tank
• WebGL Aquarium
• Fish IE Ported to WebGL <== this tests bug 829747
• GuiMark 3 Vector
• GuiMark 3 Bitmap
• GuiMark 3 Bitmap (cached)
• GuiMark 3 Compute
• GuiMark 2 Vector Charting Test

Hybrid/Multiple

• BrowserMark
• FutureMark Peacekeeper
• Browserscope

Compliance

• HTML5Test
• CSS3 Selectors Test

Speed & Memory & Power Management

We may be able to utilize Eideticker for some of these, but you'll have to discuss with wlach

• Memory consumption (RAM usage)
• Page loading time (ie: NYT front page)
• Start time (whatever the default start page is for each, time from start 'til page is fully loaded & complete)
• Power management

Results

• Results for May 20th Run is Here