Mobile/Testing/07 17 13

Status reports

Dev team

• working on a new canvas perf talos test

Rel Eng

• Remaining mozharness/mozpool regressions from Bug 829211
  • landed Bug 894512 Split mozpool managed pandas away from talos (non mozpool) pandas
  • Landed Bug 891889 (robocop thinks it uses 3 chunks, but only is aware of 2, fixes missing tests)
  • TODO:
    • Set shutdown.stamp prior to requesting a device from mozpool (no bug yet)
    • Make verify.py pass prior-to-mozpool requesting if mozpool state is "ready" Bug 889967 (requires Bug 894512)

IT

• Tegra move - The plan is to move these into the Evelyn office.
• We fixed a majority of the bad pandas that were failing by swapping out the SD Card
  • 893998 also previously unknown bad pandas are now alerting now that we removed the 'locked_out' state on all the pandas in mozpool
  • Jake is looking into why the sdcards failed in such a hard way that the bootloader wasn't able to be read

A Team

Failure Rates

• tegra failure rate: [1.18%]
• panda failure rate: [31.51%]
  • as with last week, mostly due to a large number of retrys

Mobile Bugs in Orange Factor Top 10

• bug 835588 - Intermittent "BaseException: Failed to connect to SUT Agent and retrieve the device root."
  • according to bugzilla, pmoore had planned to look at this

Work in progress

• Clint filed project paper work and has requested 16 Ubuntu ix machines
• Working on bug 892569 to be able to run cppunittests from mozharness, including remote versions.
  • Added some functionality in bug 893085 to remotecppunittests.py to be able to work from apk
  • Can run the tests with a few unexpected results

x86 automation

• See bug 891959 [Tracking] Stand up x86 Automated Testing System using Emulators
  • Run-times for most tests determined
  • Can likely run 4 concurrent emulators
  • Concentrating on test failures now

Autophone

• Relocated router to be near phones 2013-07-17.
• Mochitest canvas tests with SkiaGL enabled started running 2013-07-17.
  • Results available at http://brasstacks.mozilla.com/autolog/?tree=mozilla-central&source=autolog
  • Initially excluding content/canvas/test/webgl/test_webgl_conformance_test_suite.html due to crash on Motorola Atrix.
  • Initial Results
    • Motorola Atrix known to complete green during initial development
    • Samsung Galaxy S3 completed green
    • LG Revolution crashed.
  • Issues
    • Initial runs failed due to a configuration error
    • Initially missing minidump_stackwalk but will fix asap.

Will blog announcement later today when things settle down.

Eideticker

• Working to re-enable profiling, using jchen's patches: bug 803616

Round Table

• [dminor] current status of turning reftests on for pandaboards
• [dividehex] solidify the process of identifying and fixing 'bad pandas'
• [blassey (on behalf of jmaher)] ETA on bug 893949 and bug 893081

Action Items

• [callek] follow up on current state of bug 882324
• [callek] send email outlining new "bad panda" process
• [callek] follow up on bug 893949 and bug 893081