Mobile/Testing/05 06 15
From MozillaWiki
Contents
Previous Action Items
Status reports
Dev team
- Are we working on being able to use our production emulators to run tests locally?
Rel Eng
- tested running Android 4.3 debug mochitests on c3.xlarge bug 1160183
A Team
- android-2-3-armv7-api9 Total failure rate: [2.21%]
- last week 1.35%
- total failure excluding retries 2.07%
- android-4-3-armv7-api11 Total failure rate: [3.59%]
- last week 3.57%
- total failure excluding retries 3.3%
Data fetched for: 2015-04-29 10:12 — 2015-05-05 21:51
- [gbrown] More test chunks needed, but out of builders. bug 1156425
Autophone
- Product Bugs
- Deployments
- bug 1161784 Autophone - unplanned downtime 2015-05-05
- Caused by update to Python 2.7.9. Partially resolved by installing Python 2.7.6 macport; updated to Python 2.7.8.
- bug 1160155 - Autophone next deployment
- bug 1150111 Autophone - Add nytimes to page load tests will be fixed.
- bug 1151882 Autophone - re-enable remote tests will be fixed.
- bug 1119654 - Autophone - remove sensitive information from autophone.ini under review
- Will finally check in production configurations. Will distribute mozilla-inbound across two devices where available and distribute others branches across remaining devices. Load on all devices will increase and we may have to adjust for stability and throughput.
- bug 1162022 Autophone - --close-when-done --autorun no longer supported in testing/mochitest/runtests.py patch under review
- bug 1161784 Autophone - unplanned downtime 2015-05-05
Eideticker
- Seems to be working a bit more reliably with a timeout set on jobs
- Potential startup regression -- waiting for more data to verify that it's sustained -- http://eideticker.mozilla.org/#/android/samsung-gn/mozilla-central/startup-abouthome-dirty/timetostableframe/7
Round Table
- [gbrown] bug 1159875 Revive the areweslimyet harness
- [gbrown] bug 1054648 seems stalled and frequently affects 4.3 Debug mochitests
Action Items
- kmoir will start running Android 4.3 debug mochitests on try on c3.xlarge
- gbrown to write up wiki article on mochitest on emulator
- snorp to look into GeckoView "kitchen sink"