Auto-tools/Meetings/2012-09-24

From MozillaWiki
Jump to: navigation, search

Goals Progress

Below are our top level goals. Beneath each goal, note any progress made towards that goal this week.

  • [DONE] Support the B2G and platform team by moving existing automation to that platform as well as expanding automation on B2G and B2G devices for basecamp deliverables.
    • [ahal] Doing work to get reftests (and consequently mochitests) running on pandaboards
      • Testing pandas with Negatus (new C Agent)
      • Moving b2gautomation.py to dmSUT instead of dmADB (though ideally supporting both)
    • [jgriffin] Doing work to enable WebQA to write automated Gaia tests using Marionette.
    • [jgriffin] Adding ability to Marionette to install an arbitrary gecko binary onto the emulator.
  • [DONE] Expand Mobile testing platforms for B2G and Fennec Native to include user devices and NEON Chipsets (panda boards).
    • [mcote] Several Autophone improvements have landed. Phones are occasionally still being disabled due to issues when rebooting, but several have been running for days straight without failures.
  • [DONE] Establish new Datazilla system as a useful tool for capturing and diagnosing talos performance regressions on a per-push basis, as well as capturing data for network and B2G performance tests.
    • NOTE: This is largely a change to the data harvesting and analysis side of the Talos system (even though some changes are required to the test harness and tests themselves). We will not be replacing existing Talos data harvesting system in Q3. By the end of Q3, we want to have the new performance data harvesting and analysis system Datazilla to a point at which it can shadow the old system and we can use Q4 to verify that the new approach captures just as many regressions as the old system does. Potential timeframe for conversion of the old system to the new Datazilla system is in Q1 2013 (earliest "thumb in the wind" estimate).
    • [jeads] Waiting for bug 792912. This rollout includes the new metrics methods and a comprehensive web service. Datazilla efforts are now shifted to UI development.
  • [MISSED] Upgrade BMO to 4.2, deploy tracking flags optimizations, UX improvements (comment tagging, mid-air resolution)
  • [DONE] Make TBPL More Orange aware to make it easier to file intermittent orange bugs, and so that we can more adequately track (and therefore address) issues around android-related and memory leak intermittent failures
  • [DONE] Enable QA and contributors to increase their skills and participation by crafting automated tests for B2G and desktop smoketests by providing examples, mentoring, and documentation

Check out Pivotal Tracker

Highlights

This is a place for people to put announcements or to describe activities that they'd like to highlight. It's not the responsibility of the MC to find things to put here.

In-Depth Project Discussion

Pick one project/presenter per week who will give a detail presentation on their project.

The Overview

Progress, notes, problems, and other statuses about current projects. Add any new projects to this template!

AutoPhone/Noah's Ark

  • [mcote] Several Autophone improvements have landed. Phones are occasionally still being disabled due to issues when rebooting, but several have been running for days straight without failures.

Bughunter

Bugzilla

Eideticker

  • [mdas] writing and testing out patch changes, using both Negatus and adb.
  • [wlach] work to support video-synced profiling: http://benoitgirard.wordpress.com/2012/09/21/video-synced-profiling/
  • [wlach] moved server to eideticker.wrla.ch
  • [wlach] various other fixes
  • [wlach] Initial discussions on eideticker for desktop for Q4 at Snappy meeting. Agreed to look into something called webpagetest (http://webpagetest.org) which seems to do some of what Eideticker does already.

Firebug Testing

Jetperf

Marionette

  • [DBurns] Landed 2/3 patches to get Marionette working with Firefox Mobile. Waiting for bug 787280

Mobile Automation

  • [ahal] Doing work to get reftests (and consequently mochitests) running on pandaboards
    • Testing pandas with Negatus (new C Agent)
    • Moving b2gautomation.py to dmSUT instead of dmADB (though ideally supporting both)
  • [ahal] Continuing to monitor/triage reftests on b2g

Mobile Evangelism Site-Scraping Tool

Mochitest

MozBase

  • [ahal] Cleaning up mozdevice

Mozmill

  • bug 791625 - Remove Mozmill IDE from the extension
  • bug 792412 - Multiple instances of LoggerListener are causing an infinite loop due to duplicated handlers attached

MozTrap

  • [:camd] helped work with some of the b2g folks on a strategy for test case importing / exporting with the current state of MozTrap features.

New Graphserver (Datazilla)

  • [jeads] Completed reference data retrieval web service branch.
  • [jeads] Completed metrics data retrieval web service branch.
  • [jeads] Polishing documentation and a few unit tests before moving on to UI development.
  • [jeads] Waiting for new branches along with a bunch of database changes to get pushed out to production bug 792912.

Open Web Apps

Peptest

  • [ahal] Spoke to snappy/graphics team. There is still interest, but I would need to spend a significant amount of time improving it/adding features

Powerball

Pulse

Signal From Noise

Speedtests

Systems

  • [DBurns] Will be setting up Puppet Master and helping with setting up scripts for people

Talos

Sheriffing & Trees

  • [edmorley] Was away Tues, Wed & Thurs at the "first aid in the workplace" course.
  • [edmorley] Day-to-day sheriffing of the trees.
  • [edmorley] Posted to dev.platform about the upcoming switch to use a keyword instead of [orange] to denote bugs for intermittent failures (to improve TBPL bug suggestion performance), and outlined POA in bug 791758 and its dependants.
  • [edmorley] Bisections to track down the spike in occurrence of bug 773255 - found cause and backed out.

Treestatus

Tinderboxpushlog

War on Orange

  • Bugzilla OrangeFactor extension now accurately reflecting OrangeFactor site: sparkline shows orange count for last week for trunk, along with a total count and a link. I wrote a short blog post about it.
  • [edmorley] Patch for bug 790571.
  • [edmorley] Backouts of newly introduced orange: https://bugzil.la/583890,769764,507578,347307

Web QA

Automation Development

  • [rwood] Developed a few more WebTelephony WebAPI tests
  • [rwood] Submitted patch for first set of WebSMS tests
  • [rwood] blogged about his attendance at MozCamp EU
  • [henrik] David Burns is continuing Owens work with the Mozmill Dashboard and let test results go into a MySQL database
  • [henrik] We got a high prio request to create mochitests for WebRTC
  • [henrik] New community members
    • Arky - L10n Mozmill Tests
    • Anas - L10n Mozmill Tests
    • mysyk - Mozmill and Mozmill Automation
    • abhishekp - Mozmill Tests
    • pranavrc - Mozmill Tests and Mozmill

Upcoming Events

Standing weekly meeting related to our projects should go here

Round Table

Put your questions and things to raise with the entire team here

Take notes here and copy and paste them to this section afterwards.

Notes

Holidays and Trips

Next week MC

Misc

Find something you think is cool, interesting, funny, or exciting and put it here

Retrieved from "https://wiki.mozilla.org/index.php?title=Auto-tools/Meetings/2012-09-24&oldid=473133"