Mobile/Testing/11 09 11

Previous Action Items

• RelEng to clear the bug queue that blocks a-team

Status reports

Dev team

• bug 700847 - Birch talos pageloader tests are all failing due to
• bug 700916 - running tests via adb don't work in Birch due to the way we build the adb command line
• (fixed) bug 700928 - aurora tests are failing

Rel Eng

android_tier_1

bug priorities:

• (armen) bug 697404 disable tp4m chrome for birch. This may be harder than it looks; is there a big downside if we just hide?
• bug 695351 manifest file for android tests
• bug 693352 stackwalk in automation
• bug 689625 please send an email when a mobile talos suite has not reported numbers in a 24 hour period

A Team

• with the hiding of R2 (no need to hide J1 anymore), we have 3.01% orange rate:
  • last week this was , 2.43%
  • [spreadsheet]
    • orange rate include R2 is 4.72%, last week was 5.97%
    • total failure rate is 7.22% (5.13% without R2)
  • disabled more browser-chrome tests (would bring us to 2.16% failure rate with R2 hidden)
  • should we split reftests into 3 chunks? this seemed to have fixed jsreftests and crashtests
  • should I start tracking the blue restarts we have?

• rss for talos collection is starting to come together bug 685632
  • pageloader patch is landed
  • talos patch should be finished this week

• native UI tests-
  • all non passing tests are hidden on tbpl/Birch; need to stop running these
  • bug 701076 - will move forward with Robotium

• QA Startup Test automation
  • all working with warm/cold starts
  • pending work is to get results uploaded automatically to a webserver

• future tests
  • bug 691349 - opengl for reftests on android
  • xpcshell

Round Table

• what is needed for Native UI reftests

Action Items

• jmaher to file bug to disable reftests, Tpan and Tzoom tests on Native UI
  • bug 699205