Mobile/Testing/09 17 14

Previous Action Items

• [bc] File bug to get DCOps to look at Autophone rack with regard to cooling and expansion. Filed bug 1065619
• [bc] Contact service desk and inquire about a company wide attempt to recover nexus s devices originally purchased for b2g for use in Autophone. There are 20 in stock and 70 over all scattered around the company. I requested all 20. RITM0029783
• [snorp] File bug on getting new video test into Autophone.

Status reports

Rel Eng

• kmoir enabled esr31 test jobs bug 1058888
• ripping out tegra code bug 1066823
• still iterating patches for Android single local on m-r and m-b bug 1019724 quite frustrating but making progress

A Team

• android2.3 Total failure rate: [1.81%]
  • last week 2.62%
  • total failure excluding retries 1.3%
• android4.0 Total failure rate: [16.78%]
  • last week 18.39%
  • total failure excluding retries 2.72%

Autophone

• Significant improvement in webappstart due to bug 1066619 - Accept Promise arguments in PromiseWorker?
• gbrown went through setup & first use of Autophone with an eye to improve it (bug 1037067) and fixed mostly documentation. bc continues to work on it in gbrown's absence.
• gbrown also blogged about his experience.
• Finally, gbrown questions making phonedash optional.
• bug 1065619 - Investigate improvements to Autophone rack in Mountain View QA lab.
  • Idea is to use laptop cooling pads to ventilate the devices.
  • Next step depends on our choice and number of devices.
• Devices
  • Nexus S
    • Replaced failing nexus-s-1 with new device nexus-s-3. It is a little faster than the older nexus-s devices especially on twitter tests.
    • Requested 20 nexus s devices from service desk RITM0029783. They are mostly flashed with b2g and will need to be flashed back to android. To be determined if service desk can do it or if they need to be shipped to bc. When I have them, I intend to put 2 more nexus s into the test pool so each device tests a single branch.
  • Tablets
    • Tablets take up much more space in the rack than phones.
    • Do we need to continue to test tablets since we are not testing WebGL/Skia?
    • Do we need them when we land the tablet UI?
    • The Nexus 7 jdq39 is the 2012 model and we only have one. Can we eliminate it?
  • Add 2 Nexus 4 and 2 Nexus 5 devices to allow one device per branch?
• bug 1037077 - Report run status to treeherder.
  • Have patch ready for review.
  • Issue with reporting error message in Job Info plugin panel.
  • Example Output
  • Choose Group and Test names: A(Sm app s1s2) where Sm is smoketest, app is webappstartup and s1s2 is the Throbber measurements or A(s w t) where s is smoketest, w is webappstartup and t is the Throbber measurements.
• Developer enhancements
  • Currently we can not check the twitter test into github since it is actual content from twitter.com.
    • Can we replace the twitter test with our own test page so we can check it in?
    • What kind of page should replace the twitter test?
    • [wlach] Let's consider using the same pageset for autophone and eideticker -- ep1 http://git.mozilla.org/?p=automation/ep1.git;a=summary (if something is missing / wanted, we can add it!)

Eideticker

• [wlach] mostly occupied with treeherder and talos-on-e10s
• Some progress on new, more scalable dashboard, still aiming to finish that + profiling support + another galaxy nexus by end of quarter (or by early next)

Action Items

• kbrosnan to flash android on Nexus Ss.