Mobile/Testing/12 21 11
From MozillaWiki
Contents
Previous Action Items
- finkle to investigate automated test writer
- naoki to look at:
- killing the market process
- using more runs to smooth out data
- throw out any run that has a dalvik GC in it
- See the checklist section of https://etherpad.mozilla.org/fennec_perf_ts_take2
- joel/geoff to review/add to [how to write a robotium test]
Status reports
Dev team
- Adopted tfair's "core toolchain" robocop patch.
- New patch to tweak tests improves reliability dramatically...for me.
- Started to clean-up / enhance the "writing robocop tests" wiki.
Rel Eng
- moving new tegras to production, they have run green on staging
- added 2 masters for tegras only (to replace the aging old test master)
- working on landing bug 711367 (--nativeUI)
- working on bug 712422 (--bootstrap)
- ok to close bug 689625
A Team
- [XUL Orange rate]: 4.74%
- [Native UI Orange rate]: 0.45%
- joel/bear to figure out what to do about graph server
- bug 708346 - depends on graph server changes
- bug 711367 - r+, waiting for rollout today/tomorrow
- bug 708346 - depends on graph server changes
- reftests - landed, j1-3 are green on inbound and central
- bug 712422 - add bootstrap flag to reftest cli for android tests (in development on releng side)
- Robocop
- bug 701076 - initial reviews are done; final testing, starting to cleanup. Should have harness landed today/tomorrow
- 1 remaining patch needs cleanup/review- integration into build system
- bug 711591 - remaining bug to add more test driver like syntax to the tests
- bug 701076 - initial reviews are done; final testing, starting to cleanup. Should have harness landed today/tomorrow
S1/S2 Automation
- Automation
- Giant freaking mess. Elastic Search went down over the weekend.
- Gave up on elastic search, re-tooled backend to use mysql
- All phones now reporting against mysql.
- The web dashboard will be at: http://brasstacks.mozilla.com/testperf2/#/xbrowserstartup
- Should be re-loaded in a moment when I upload a fix for its current issues.
Round Table
- Meeting next week?
Action Items
- mfinkle to fix naoki's bugs