Mobile/Testing/11 16 11
From MozillaWiki
Contents
Previous Action Items
- jmaher to file bug to disable reftests, Tpan and Tzoom tests on Native UI
Status reports
Dev team
- bug 700916: New patch works for me: can run mochitest-remote via adb on birch
Rel Eng
in staging/land this week:
- bug 695351 manifest file for android tests
- bug 693352 stackwalk in automation
- bug 701476 - split reftest from 2 -> 3 chunks, landed - need reconfig?
other bugs:
- bug 689625 please send an email when a mobile talos suite has not reported numbers in a 24 hour period
mozharness:
- updates/status/ontrack for this quarter?
A Team
- with the hiding of R2, we have 4.13% orange rate:
- last week this was 3.01%, week before 2.43%
- spreadsheet]
- orange rate include R2 is 5.20%, 4.72% last week, week before 5.97%
- total failure rate is 7.34%, last week 7.22%
- new bug bug 702171 is causing a LOT of b-c failures, started yesterday
- new bug bug 702980 is causing a lot of crashtest failures
- I only track green, orange, infra now since blue is basically red/orange.
- rss for talos collection is starting to come together bug 685632
- pageloader, talos patch is landed
- need to get graph server patches landed, then a deployment
- native UI tests-
- all non passing tests are hidden on tbpl/Birch; need to stop running these
- bug 701076 - will move forward with Robotium
- patch to build robotium and generated .apk's install work work with a few caveats
S1/S2 Automation
- remaining work items
- Get graphs on a public server
- Working on a deadlock that comes up when the automation runs for a long time (> 8 hours)
- results
- Are looking good. Just need to be moved to public server.