Auto-tools/Meetings/2012-08-06

From MozillaWiki
Jump to: navigation, search

Goals Progress

Below are our top level goals. Beneath each goal, note any progress made towards that goal this week.

  • [ON TRACK] Support the B2G and platform team by moving existing automation to that platform as well as expanding automation on B2G and B2G devices for basecamp deliverables.
    • [jgriffin] WebAPI and B2G mochitests running again on new VMs
    • [jgriffin] Mozharness script for Marionette tests landed; should be able to turn on Marionette tests in TBPL soonish
    • [ahal] B2G reftests running daily on real hardware in Toronto
  • [ON TRACK] Expand Mobile testing platforms for B2G and Fennec Native to include user devices, NEON Chipsets (panda boards), and ARMv6 (Beagle boards).
    • [jmaher] - Tegras are not rebooting randomly anymore, 39% failure rate to 13% as of Friday evening.
    • [mcote] New SUTAgent requirements finished; high-level design just about finished.
    • [mihneadb] SUTAgent/DeviceManager tests resurrected and committed to mozdevice.
  • [ON TRACK] Establish new Datazilla system as a useful tool for capturing and diagnosing talos performance regressions on a per-push basis, as well as capturing data for network and B2G performance tests.
    • NOTE: This is largely a change to the data harvesting and analysis side of the Talos system (even though some changes are required to the test harness and tests themselves). We will not be replacing existing Talos data harvesting system in Q3. By the end of Q3, we want to have the new performance data harvesting and analysis system Datazilla to a point at which it can shadow the old system and we can use Q4 to verify that the new approach captures just as many regressions as the old system does. Potential timeframe for conversion of the old system to the new Datazilla system is in Q1 2013 (earliest "thumb in the wind" estimate).
    • [jeads] Datazilla is in production https://datazilla.mozilla.org/test/
  • [ON TRACK] Upgrade BMO to 4.2, deploy tracking flags optimizations, UX improvements (comment tagging, mid-air resolution)
  • [ON TRACK] Make TBPL More Orange aware to make it easier to file intermittent orange bugs, and so that we can more adequately track (and therefore address) issues around android-related and memory leak intermittent failures
    • [edmorley] Initial plan for a TBPL intermittent failure bug filer [try saying that three times fast... :P] (bug 779529).
  • [ON TRACK] Enable QA and contributors to increase their skills and participation by crafting automated tests for B2G and desktop smoketests by providing examples, mentoring, and documentation

Check out Pivotal Tracker

Highlights

  • [glob] expect this thursday's bmo push to include a fix for interdiff [bug 779862]
  • [jmaher] - android tegras are not rebooting randomly. Big props to :wlach for finding the code in watcher which was doing this and for :Callek who deployed this during his work week.

In-Depth Project Discussion

Pick one project/presenter per week who will give a detail presentation on their project.

The Overview

Progress, notes, problems, and other statuses about current projects. Add any new projects to this template!

AutoPhone/Noah's Ark

  • [mcote] High-level design will be finished Monday.
  • [minheadb] resurrected and fixed up the SUTAgent/DeviceManager tests and moved them to mozdevice.

Bughunter

Bugzilla

  • pushes: http://globau.wordpress.com/2012/08/09/happy-bmo-push-day-8/
  • [glob] more work on bmo 4.2 search functionality
  • [glob+dkl] BMO administrative duties
  • [dkl] Worked on revamp of old code from past work at RH to become two new BMO dashboards
  • [dkl+glob] lots of upstream activity (reviews and patches)

Eideticker

  • [wlach] No luck so far finding an ARMv6 device with HDMI capture, even asked Mozilla China.
  • [wlach] Got the MK6513 working with Orangutan (allows testing ARMv6 Fennec without HDMI capture)

Firebug Testing

Jetperf

Marionette

  • [DBurns] Added Keys helper, as in Selenium, to Marionette

Mobile Automation

  • [mihneadb] Add SUT Agents test for the Android agent to mozdevice bug 778366
  • [mihneadb] Fixes/improvements to devicemanagerSUT and its tests bug 780245 bug 778363 bug 778329
  • [mihneadb] Got C++ code (including stdlib and STL) compiling and working on B2G (Android NDK is a [broken] mess!) https://github.com/mihneadb/NewAgent
  • [wlach] Mostly finished a smoke test for Pandaboards based on the autophone one

Mobile Evangelism Site-Scraping Tool

Mochitest

MozBase

  • [mihneadb] Moztest landed in Mozbase bug 774419
  • [mihneadb] Some first tests for Moztest bug 779664
  • [mihneadb] Mozbase uses Moztest to store test results bug 779665

Mozmill

  • mutt tests broken: bug 761564; we should do something about this

MozTrap

New Graphserver (Datazilla)

  • [jeads] Worked through lots of issues with IT and got datazilla into production https://datazilla.mozilla.org/test/
  • [jeads] Made some more headway on implementing the t-test and push log walking logic. This branch should be finished within the week.

Open Web Apps

Peptest

Powerball

Pulse

Signal From Noise

Speedtests

Systems

Talos

  • modernizing how talos uses counters
  • prep work for tresize, jstests and dirty talos changes are almost done.
  • prep work for xperf 2.0 talos is about halfway done.

Sheriffing & Trees

  • [edmorley] Day-to-day sheriffing of the trees.
  • [edmorley] Sheriffing issues of note:
    • Philor away 15th July-6th Aug.
    • Several spidermonkey build types busted for weeks - filed bugs & found regression ranges: https://bugzil.la/778460,778467,778469
    • Permanent Win7 failure on esr10 (bug 779159).
    • 30% Windows Ts regression since 1st March (bug 778718).
    • Discussions with Ehsan about a more suitable birch/profiling cron job frequency (for their pulls from m-c), in order to save load (was 30 mins, we've lowered to every 12 hours).
    • Following up on bug 773120 since OS X 10.5 tests are still running, even though it has landed+reconfig'd.
    • Switched off spidermonkey-nomethodjit builds on tinderbox since busted and deemed no longer necessary (bug 779150).
    • Spidermonkey builds are still scheduled with DONTBUILD (bug 779784).
    • Landed the patch to switch off non-OSX builds/tests on the birch branch, to save load (bug 775149).
    • Self-serve 'trigger pgo builds' sometimes triggers dep builds instead (bug 780468).
    • Hid android-xul builds+tests on all trees apart from {mozilla-central,mozilla-inbound,try} whilst we wait for bug 777037.
    • Recalculated failure rates for the hidden Android mochitest suites (bug 777436), now that bug 775227 disabled the worst OOM offenders. Filed dependent bugs for unhiding the rest.
    • Unhid all native/XUL Android test suites apart from native mochitest-3, once the reboot fixes resolved most of the problems! \o/

Treestatus

Tinderboxpushlog

  • [edmorley] Initial plan for a TBPL intermittent failure bug filer (bug 779529).
  • [edmorley] Requested adjustments to TBPL's push to prod script (bug 779752).
  • [edmorley] Patch for to remove disabled trees from TBPL's tree menu & move the less active repos lower down (bug 780116).

War on Orange

Web QA

Automation Development

Upcoming Events

Standing weekly meeting related to our projects should go here

Round Table

  • Goals - 1/3 through quarter
    • Aggressive ice-boxing at end of august

Take notes here and copy and paste them to this section afterwards.

Rob Wood newest A-Team member! Some progress on setting up production machine for Datazilla; not sure exactly where it was left. MC: jhammel

Notes

Holidays and Trips

Next week MC

  • Next week's MC: dkl
  • Project Talk: mcote covers Autophone!

Misc

Find something you think is cool, interesting, funny, or exciting and put it here

Retrieved from "https://wiki.mozilla.org/index.php?title=Auto-tools/Meetings/2012-08-06&oldid=460377"