Auto-tools/Meetings/2012-08-13

From MozillaWiki
Jump to: navigation, search

Goals Progress

Below are our top level goals. Beneath each goal, note any progress made towards that goal this week.

  • [ON TRACK] Support the B2G and platform team by moving existing automation to that platform as well as expanding automation on B2G and B2G devices for basecamp deliverables.
  • [ON TRACK] Expand Mobile testing platforms for B2G and Fennec Native to include user devices, NEON Chipsets (panda boards), and ARMv6 (Beagle boards).
    • [jmaher] - New image runs 90% of the tests. Appears we need to modify the robocop tests to work on panda/ics.
    • [jmaher] - beagle boards look to be ARMv7, need to find older revisions of those are different platform.
    • [wlach] - More work on Pandaboard smoketest (https://bugzilla.mozilla.org/show_bug.cgi?id=781341)
    • [mcote], [mihneadb] - Implementation of C++ SUTAgent underway.
  • [ON TRACK] Establish new Datazilla system as a useful tool for capturing and diagnosing talos performance regressions on a per-push basis, as well as capturing data for network and B2G performance tests.
    • NOTE: This is largely a change to the data harvesting and analysis side of the Talos system (even though some changes are required to the test harness and tests themselves). We will not be replacing existing Talos data harvesting system in Q3. By the end of Q3, we want to have the new performance data harvesting and analysis system Datazilla to a point at which it can shadow the old system and we can use Q4 to verify that the new approach captures just as many regressions as the old system does. Potential timeframe for conversion of the old system to the new Datazilla system is in Q1 2013 (earliest "thumb in the wind" estimate).
  • [ON TRACK] Upgrade BMO to 4.2, deploy tracking flags optimizations, UX improvements (comment tagging, mid-air resolution)
  • [ON TRACK] Make TBPL More Orange aware to make it easier to file intermittent orange bugs, and so that we can more adequately track (and therefore address) issues around android-related and memory leak intermittent failures
    • MOZ_ASSERT failures are now displayed in the TBPL annotated summary box, avoiding having to open the full log (bug 780579).
    • Continued discussions on orange bug filer implementation (bug 779529).
  • [ON TRACK] Enable QA and contributors to increase their skills and participation by crafting automated tests for B2G and desktop smoketests by providing examples, mentoring, and documentation

Check out Pivotal Tracker

Highlights

This is a place for people to put announcements or to describe activities that they'd like to highlight. It's not the responsibility of the MC to find things to put here.

In-Depth Project Discussion

Pick one project/presenter per week who will give a detail presentation on their project.

The Overview

Progress, notes, problems, and other statuses about current projects. Add any new projects to this template!

AutoPhone/Noah's Ark

  • [mcote] Basic design done.
  • [mcote], [mihneadb] Implementation started, building for linux & android.

Bughunter

Bugzilla

  • pushes: http://globau.wordpress.com/2012/08/09/happy-bmo-push-day-8/
  • [glob] more work on bmo 4.2 search functionality
  • [glob+dkl] BMO administrative duties
  • [dkl] Worked on revamp of old code from past work at RH to become two new BMO dashboards
  • [dkl+glob] lots of upstream activity (reviews and patches)

Eideticker

  • [mdas] landed html/js eideticker test support for b2g pandaboards (like the clock test)
  • [mdas] Need to get the actual gesture tests working
    • Got mouse support from mwu, so tests can work in the mean time, but orangutan support will be added later.

Firebug Testing

  • [ahal] Fixed merge conflict bug when Firebug version gets bumped

Jetperf

Marionette

  • [DBurns] Landed the ability to get source from DOM in marionette bug 738408
  • [DBurns] Landed the ability to get tag name from Element bug 759477
  • [DBurns] Landed the ability to get session data from the Browser bug 757069
  • [DBurns] Updated Marionette documentation on MDN

Mobile Automation

  • [jmaher] - working with edmorley to get all mobile automation green and unhidden
  • [jmaher] - working to figure out why the sutagent and adb fail to issue commands even though it they can connect. Top suspect is sdcard
  • [wlach] - More work on Pandaboard smoketest (https://bugzilla.mozilla.org/show_bug.cgi?id=781341)
  • [ahal] Have reftests running on a standalone desktop against B2G nightlies and reporting to autolog (http://brasstacks.mozilla.com/autolog/?tree=b2g&source=autolog)
  • [ahal] Landed reftest on B2G infrastructure (bug 777871)
  • [ahal] Working on various fixes to reftest harness to reduce number of errors on B2G

Mobile Evangelism Site-Scraping Tool

Mochitest

  • [jmaher] - Enableprivilege test mode is coming real soon. This requires a preference to be set in order to use enablePrivilege. A stop gap until the rest of the tests can be edited.

MozBase

Mozmill

MozTrap

New Graphserver (Datazilla)

Open Web Apps

Peptest

  • [ahal] Landed infrastructure to get peptests using talos' tp5n.zip
    • Unfortunately there is a python unicode error on windows when extracting one of the foreign websites within, so peptest got hidden again on windows

Powerball

Pulse

Signal From Noise

  • [jmaher] - having trouble bubbling this down. We have most pieces in place to auto detect a regression, now it is figuring out the right formula and tweaking thresholds.

Speedtests

Systems

Talos

  • tresize is now live
  • dirtypaint is now live
  • jstests are now live
  • xperf is about halfway developed, but coming online this month.

Sheriffing & Trees

Treestatus

Tinderboxpushlog

  • [edmorley] Patch for bug 781477 to make TBPL recognise the new talos dromaeojs.
  • [edmorley] Deployed to production:
    • bug 780579 - List MOZ_ASSERT failures in the annotated summary box (to avoid having to open the full log).
    • bug 780116 - Remove disabled trees from TBPL tree menu & re-order the rest.
    • bug 781477 - Make TBPL recognise dromaeojs.

War on Orange

Web QA

Automation Development

  • [dhunt] Gave a talk on how Mozilla uses Selenium at TechMeetup in Edinburgh
  • [rwood] Submitted first patch (two new WebTelephony tests)

Upcoming Events

Standing weekly meeting related to our projects should go here

Round Table

Put your questions and things to raise with the entire team here

  • [edmorley] Any news on the work week approval? :-)

Take notes here and copy and paste them to this section afterwards.

Notes

Holidays and Trips

  • [DBurns] Heading to London office to go asy hi to IT people during their workweek

Next week MC

Misc

Find something you think is cool, interesting, funny, or exciting and put it here

Retrieved from "https://wiki.mozilla.org/index.php?title=Auto-tools/Meetings/2012-08-13&oldid=460417"