Auto-tools/B2GAutomation/Meetings/2014-01-09
From MozillaWiki
Contents
Etherpad
https://etherpad.mozilla.org/b2g-automation-meeting-notes
Previous Action Items
- jgriffin to bring up Gaia testability with devs
Status Reports
Marionette
In queue
- Create Marionette endurance tests to make sure Marionette and gaiatest don't create memory leaks or other performance problems - bug 931044
- Fix frequent intermittent failure in test_submit.py - bug 929939
- [ato] Wrap last exception from Marionette's Wait in a TimeoutException -- bug 958024
- [ato] WebDriver command end-point incompatibility fixes -- bug 941102, bug 941126, bug 941129, bug 941132, bug 941136, bug 941140, bug 941144, bug 941145, bug 941148
- Will preserve backwards compatibility in Marionette protocol until all dependents on both client bindings have been successfully migrated.
In progress
- [davehunt] Are we meant to be uplifting all Marionette changes to mozilla-aurora? We had a recent TBPL failure due to a missing uplift, and I can go through and make sure everything is up to date if needed.
- [jgriffin] No, let's keep our uplifts to branches that have a lot of ongoing B2G development.
Blocked
Completed
- [ato] Wait class to use Marionette's default time out if set to reduce boilerplate -- bug 957248
- [ato] Variety of expected conditions for Marionette that makes tests easier to write -- bug 948075
- [ato] The exception on timeout in Wait indicates timeout duration -- bug 957162
Eideticker
In queue
In progress
- [wlach] - Trying to account for camera noise so we can measure animation smoothness with pointgrey cameras -- bug 917404
- [davehunt] - Trying to get remote access to eideticker-london so I can update the CI instance and get it reporting to the dashboard -- bug 916989
Blocked
Completed
- [wlach] / [davehunt] - Move workload population to tests (bug 942826), should make eideticker more deterministic (almost ready to go pending a few revisions)
WebQA's Jenkins Automation (gaiatest, b2gperf)
In queue
In progress
- [davehunt] Discovered that we can't scroll using Marionette when APZ is enabled (it's now enabled by default in master) -- bug 958036
Blocked
- Add 128MB Hamachi runs for b2gperf - bug 950691
- blocked by lack of builds
Completed
Tests in TBPL
In queue
- Gaia-integration enhancements
- Frequent intermittent failure of gaia-integration tests due to npm install errors - bug 953309
- Gaia-integration harness needs to manage its own timeouts, rather than letting buildbot do it - bug 953212
- Gaia-integration harness needs crash handling, bug TBD
- Gaia-integration harness not reporting passed/failed tests in format needed by TBPL - bug 953319
- All of these need an owner, most likely gaye
- IPC mochitests run in parent process, bug TBD
In progress
- [jgriffin] Get debug B2G mochitests running on emulators on all trunk branches - bug 916359
- Still chasing frequent intermittents; will follow-up with gwagner to see where we are.
- [ahal] B2G desktop reftests running on cedar - bug 916350
- due to many failures, going to only run reftest-sanity for now
- [ahal] OSX B2G desktop Gu may be ready to go live across all branches soon
- [ahal] Working to reduce log size of b2g desktop mochitests as they are reaching the limit - bug 957768
- [ahal] Investigating lack of crash stacks in gaia ui tests - bug 949028
Blocked
Completed
Long-running Tests (endurance, MTBF, AWSY)
In queue
- [rwood] Help Taipei team implement crash/error detection routines for MTBF that can be used in other harnesses as well
- [rwood] Gaia-UI endurance test review
In progress
- [rwood] Get memory tests running per-commit and reporting to AWSY - bug 899194
Blocked
Completed
Round Table
- [jgriffin] populating items in the queue
- [davehunt] Can we start running the Gaia UI tests against emulator? -- bug 946649
Action Items
- [jgriffin] (carry over) discuss testability with Gaia devs
- [jgriffin] find owner for Service Now request regarding remote access to London Eideticker machine
- [jgriffin] figure out if we're ready to schedule gaia-ui-tests against emulators on cedar