B2G Automation
== Approach and Milestones ==* '''TODO:''' Add bugzilla bug queries to this by attaching proper [[Auto-tools/Projects/Bugzilla_Tracking|whiteboard flags]] to the relevant bugs that are filed. === Milestone 1 - 2 weeks (April 1 - 12) ===
* [jgriffin] {{miss|Get}} Gaia Unit tests running in TBPL (blocked by {{bug|855049}})
* [jgriffin] {{done|Triage}} all existing B2G failures and identify a concrete set of problems that need to be addressed
* [rwood] {{done|Finish}} integrating long running tests with datazilla
=== Milestone 2 - 2 weeks (April 22 - May 3) ===
* [jgriffin] {{done|Get}} Gaia Unit tests running in TBPL (scheduled on cedar)
* [jgriffin] {{done|Make}} mach runners for Marionette
* [rwood] {{done|Automate}} entire process via Jenkins
=== Milestone 3 - 2 weeks (May 13 - May 24) ===
* {{ok|Work}} on top B2G test stability problems and either fix or get them to a state where developers can take over
# {{done|test_click}} errors {{bug|838607}} - dburns looking at it.
* [wlach] {{miss|Get}} rid of debugger server dependency {{Bug|797529}}
=== Milestone 4 - 2 weeks (June 3 - June 14) ===
* (carry over) [wlach] {{done|Get}} rid of debugger server dependency {{Bug|797529}}
* [wlach] {{ok|Integrate}} JS client Pt 1: Get a simple JS Marionette test working locally with the JS Marionette client and the Python testrunner
* [rwood] {{done|Develop}} some heuristics to help determine when gaia-ui-test Jenkins failures are "real" or reproducible enough to warrant sending out an e-mail notification to engineering managers
=== Milestone 5 - 2 weeks (June 24 - July 5) ===
* [wlach] {{drop|Add}} JS client Pt 1: Get a simple JS Marionette test working locally with the JS Marionette client and the Python testrunner
* (ongoing) [mdas] Resolve blocking issues with tap
* [jgriffin + releng] {{miss|Get}} gaia-unit-tests scheduled on all branches (depends on gecko-gaia coupling)
* [jgriffin] {{done|Update}} mozharness script for gaia-ui-tests
* [jgriffin + releng] {{missdone|Get}} gaia-ui-tests on b2g desktop builds scheduled on cedar (depends on gecko-gaia coupling, gaia-ui-tests to gaia coupling, and gaia-ui-tests branch renaming)
* [jgriffin] {{defer|Identify}} current B2G top oranges
* [ahal] {{ok|Identify}} and fix issues with full-stack emulator builds
* [rwood] Write script to email/flag b2g memory spikes via gaia-ui endurance tests
=Goal 2013 Q3 =B2G Automation == Milestone 6 - 2 weeks (July 8 - July 19) ==* (carry over) [jgriffin + releng] Get gaia-unit-tests scheduled on all branches* [mdas, davehunt, webqa] Get gaia-ui-tests on cedar running stable green* [wlach] Implement get_active_frame command - {{bug|855327}} == Future milestones ===* Implement device test failure notification heuristics (depends on results being uploaded to TBPL)
* Add mach to B2G so we can build B2G mach targets
* Fix more top oranges
* Get gaia-ui-tests running on all branches(depends on gaia-ui-tests to gaia coupling, gaia try-server)
* {{drop|Add}} Finish integrating JS Marionette client into Python testrunner
* Get Gaia integration tests (JS UI tests) in TBPL(depends on Gaia devs)
* Write tests for new bluetooth support in emulator?