Auto-tools/Meetings/2012-10-01

From MozillaWiki
Jump to: navigation, search

Goals Progress

Below are our top level goals. Beneath each goal, note any progress made towards that goal this week.

  • Ensure B2G has all test automation available to prepare for launch
    • [ON TRACK] Deploy B2G Test Automation into TBPL running on Emulator and Panda platforms.
      • [ahal] Got a pretty much stable subset of green reftests
      • [ahal] Several reftest bugs getting picked up by layout team
      • [ahal] Continuing work on Negatus with pandas/emulators and devicemanager cleanup
      • [jgriffin] Marionette now works with out-of-process frames.
    • [ON TRACK] Maintain B2G dog food update server as well as builds for development and QA while working to hand them off to releng
    • [ON TRACK] Ensure all webAPIs testable through the emulator have comprehensive automated tests
    • [ON TRACK] Continue to aid QA in creating automated tests for B2G
  • Expand and stabilize Test Automation on new and existing device platforms for NEON and ARMv6 support.
    • [ON TRACK] Have APC.io boards chassis-ready -- rooted, smoketested, and working for ARMv6 testing
    • [ON TRACK] Monitor deployment of large scale android and B2G panda board testing, aid with bug investigations
    • [ON TRACK] Implement a new pool-based approach for device management in automation to increase stability on all device testing
    • [ON TRACK] Deploy Autophone with 40 phones and 70% average phone uptime for 3 weeks
      • Uptime is calculated as number of days a given phone has reported proper results, over a certain date range
  • Create and deploy performance automation for desktop, fennec, and B2G product benchmarks
    • [ON TRACK] Create Eideticker tests for B2G on panda boards and run them once a day
    • [ON TRACK] Port Eideticker to win32 and run tests there once a day to measure win32 snappiness for desktop
    • [ON TRACK] Create pageload benchmark with networking shaper tests so that we can adequately track user-perceived performance across all devices and network types
    • [ON TRACK] Monitor Datazilla webservices and ensure our accuracy in detecting performance regressions on a per-push basis
    • [ON TRACK] Deploy Datazilla per-push UI to make it easier for developers to dig into the causes of performance regressions
  • Update our bugzilla instance to 4.2 providing many benefits from UI to helping people keep track of bugs/projects from within Bugzilla.
    • [ON TRACK] Complete the 'Sandstone' CSS update
    • [ON TRACK] Complete the REST API integration
    • [ON TRACK] Rework browserID <--> BMO integration
    • [ON TRACK] Deliver user and product dashboards
    • [ON TRACK] Deploy tracking flags extension database optimization
  • Make the process of sheriffing easier by updating TBPL and helping make it easier to handle the intermittent test problem
    • TBD
    • TBD
  • Expand and Modernize the QA Automation framework as well as make it easier and more clear how to write automated tests for QA.
    • [ON TRACK] Finish and deploy mozmill 2.0 changes to frameworks and existing QA tests
    • [ON TRACK] Update selenium grid to use ESX on-demand to improve web QA capacity
    • [ON TRACK] Re-organize and improve the automated testing documentation at MDN
    • [ON TRACK] Develop tests for WebRTC, B2G and other high profile projects

Highlights

This is a place for people to put announcements or to describe activities that they'd like to highlight. It's not the responsibility of the MC to find things to put here.

  • [hskupin] Great take off of the WebRTC automation project for an initial set of mochitest smoketests. Developers were amazed of our preparation work for the first meeting.

In-Depth Project Discussion

Pick one project/presenter per week who will give a detail presentation on their project.

The Overview

Progress, notes, problems, and other statuses about current projects. Add any new projects to this template!

AutoPhone/Noah's Ark

  • [mcote] - Been investigating autophone failures; notes in bug 793961.
    • Discovered that three phones were running an old SUT version (1.04). Upgraded them.
    • Removed three phones for further investigation: droid pro & sensation, which aren't rebooting, and a gs2, which has disk issues.
    • 6 phones running since Friday: http://mrcote.info/phonedash/
  • [mcote] - Improvements to phonedash; UI is a bit cleaner, and data loads much faster.

Bughunter

Bugzilla

  • no push last week; IT issues
  • [glob] lots of comment tagging work
  • [glob] normal bmo admin work
  • [dkl] family holiday!

Eideticker

  • [wlach] Various work on robustness
  • [mdas] getting patch reviews addressed and landed some related patches in mozbase

Firebug Testing

Jetperf

Marionette

  • [jgriffin] Marionette now works with out-of-process iframes.

Mobile Automation

  • [ahal] Got a pretty much stable subset of green reftests
  • [ahal] Several reftest bugs getting picked up by layout team
  • [ahal] Continuing work on Negatus with pandas/emulators and devicemanager cleanup
  • [wlach] Working on a big devicemanager cleanup to raise exceptions where there are problems (bug 795456)
  • [wlach] Patched over an issue with reftests and newer tegras (bug 792212), should let us use bring a bunch of new tegra hardware online soon (?)

Mobile Evangelism Site-Scraping Tool

Mochitest

MozBase

Mozmill

MozTrap

New Graphserver (Datazilla)

  • [jeads] Working on new developer UI
  • [jeads] Waiting for bug 792912

Open Web Apps

Peptest

Powerball

Pulse

Signal From Noise

Speedtests

Systems

Talos

Sheriffing & Trees

Treestatus

Tinderboxpushlog

War on Orange

Web QA

Automation Development

  • [rwood] WebSMS (marionette) tests
  • [rwood] WebRTC smoketests (mochitest)

Upcoming Events

Standing weekly meeting related to our projects should go here

Round Table

Put your questions and things to raise with the entire team here

Take notes here and copy and paste them to this section afterwards.

Notes

Holidays and Trips

Next week MC

Misc

Find something you think is cool, interesting, funny, or exciting and put it here

Retrieved from "https://wiki.mozilla.org/index.php?title=Auto-tools/Meetings/2012-10-01&oldid=475972"