Notices, Highlights, Roundtable

• A new quarter, a new format! <-- take this line out of template next week
• Next steps, updating the project links and the project links all over the wiki.
• Automation that needs to be moved on the MV office move

Goals

• Goal: Improve Developer/QA ergonomics around running and debugging automation by:
  • Add debugger support to B2G testrunners
    • [ON TRACK] Half way through milestone 1
  • Improve patch review experience on bugzilla/Make bugzilla more user-centric
    • [ON TRACK] Half way through milestone 1
  • Replace graph server with Datazilla for all desktop Talos tests
    • [ON TRACK] Half way through milestone 1?
  • Create a project branch view of B2G builds/tests that tracks commits per target, rather than per repo (all commits to any repo for unagi for instance) joint with releng
    • Not started: getting agreement from releng

• Goal: Improve stability, reliability, and scalability of automation platforms by:
  • Addressing all P1 B2G automation stability issues
    • [ON TRACK] Halfway through milestone 1
  • Complete native REST interface for Bugzilla
    • Not started (not in milestone 1)
  • Complete Mochitest to Mozbase port
    • Milestone 1 STARTS!
  • Create POC Microbenchmark suite to get feedback from developers for its usefulness - waiting on confirmation from perf team on this priority
    • Not started: planned start: April 22
    • working with :jimm in bug 859155
  • Reduce orange factor to 5 or lower (for the last three weeks of the quarter) by driving awareness among developers, following up with assignees, and fixing intermittent automation failures.
    • [ON TRACK] On track, following up on panda intermittent reboot issues
  • Update pulse so that its dependent (client side) libraries are current for its use in Tree Herder
  • Create a prototype and a specification for a rig to power cycle real phones. Have a vendor selected to build the rig by end of quarter.
    • [DONE] Milestone 1? Update?
• Goal: Build toward our future by:
  • Deploy a minimally viable TBPL replacement by end of quarter, aim to switch over mid-Q3
    • [DONE] Milestone 1? Update?
  • Release a mozmill 2 and work with contributor community to drive toward a 2.1
    • Milestone 1 starts!
  • Automate a scrolling fps test using camera Eideticker measurements for Contacts, Email, Settings, and Message apps
    • Milestone 1 starts!
  • Create and Deploy BMO user profile data for community building and education
    • Not started: not in milestone 1
  • Create a solid net and filter system to build a bugmaster community
    • [ON TRACK] Milestone 1 underway
  • Identify 5 things we can do to increase our infrastructure capacity by 10% through more streamlined usage and bringing new capacity online. (joint with releng)
    • Milestone 1 starts
  • Enable performance and test automation to run on Android x86 hardware, investigate Android 2.3.x support on Pandas.
    • Milestone 1 starts

Deep Dives

Mobile (1st Monday)

AutoPhone/Noah's Ark

• Continuing work on logging and ancillary bug fixes in bug 853961
• Have run historical runs from June 2012 to current using emulated 3G network connections.
• Will be moving production phonedash from http://mrcote.info/phonedash to an AWS instance soon.

B2G Automation

• Checktests for m-c desktop B2G builds will be enabled with the next RelEng reconfig \o/.
  • Will be enabling B2G ARM checktests on Cedar to see what their state is next.
• [ahal] mw22 landed a one line fix that speeds up b2g mochitests by 33% (bug 788866)
  • translates to 25 min per chunk or 3.75 hours per push

Mobile Evangelism Site-Scraping Tool

Android Automation

• panda robocop tests are the largest offenders for failures on pandaboards. experiments show that many tests are problematic, also that shorter runs are helpful.
• much work has been done to debug the random reboots on the panda boards. These boards require much less IT intervention than the tegras, but they have 2-3 times the failure rate of tegras. We are experimenting with the power supplies, fuse boxes, and higher guage wires to fix the majority of the problems we are seeing.
• by the end of the year we need to remove the tegras from Mountain View, this means we either need to rack these, or consider running android 2.3 on the panda boards. Investigation is underway to run android 2.3 on the panda boards by dminor

Tools (2nd Monday)

Bugzilla

• Lots of development and review work on the Tracking Flags work
• Diagnosed some issues with the SCL3 cluster (database corruption, service unavailable errors, ...)

Bughunter

• Spent some time last week filing bugs from crash reports. Still have a number of reports to investigate.
• Need to file bugs and land the outstanding patches.
• Patch Tuesday maintenance tomorrow April 9.

GoFaster

Pulse

• [jeads] Identified a new set of attributes to add to the build bot pulse stream. This will allow us to remove unreliable regular expressions and white labeling strategies from down stream pulse consumers.
• [jeads] Wrote a new pulse consumer for treeherder.

MozTrap

• [camd] pushed a new set of bug fixes to prod (1.4.5.2)
• [camd] helped Qa import some test cases from TEF
• [camd] providing tech support for some external users

Tinderboxpushlog

• [edmorley] New things in production: https://bugzil.la/857541,857535,857531,856004,841316
• [edmorley] Patches: https://bugzil.la/856004,857531,857535,857541
• [edmorley] Reviewed bug 857708.

War on Orange

• OrangeFactor on trunk for last 7 days: 6.86
• [edmorley], [mcote] Committed and deployed two fixes: bug 853635, bug 849951.
• [RyanVM] Ongoing efforts to engage developers and managers over top oranges.

TBPL Version 2

Performance (3rd Monday)

New Graphserver (Datazilla)

Signal From Noise

Speedtests

Eideticker

Talos

• [edmorley] Patch for bug 857039.

General Framework Support (4th Monday)

MozBase

In-tree Automation/Harnesses

• [edmorley] Patch to correct log parsing regex for crashes/leaks (bug 857636).

WebRTC Test Development

Process (4th Monday)

Sheriffing & Trees

• [edmorley] 4-day week due to public holiday.
• [edmorley] Made adjustments to Sheriffing/Job_Visibility_Policy in response to dev.tree-management discussions.
• [edmorley] Trychooser: Reviewed bug 855797, bug 855591.
• [edmorley] qimportbz: Patch for bug 858031.
• [edmorley] bzexport: Patch for bug 858053.

Treestatus

• [edmorley] Completed the switch to the Mozilla-controlled Github account (bug 823637).

Bugmasters

Holidays and Trips

• [edmorley] PTO today (Monday 8th) for house moving prep.
• [edmorley] Away from office/email Fri 12th for BACON conference.
• [mcote] out Tuesday, Wednesday, and Thursday for a funeral.
• [jgriffin] in Madrid the week of April 15th for a B2G work week.

Misc

• [bc] Does anyone know of a way to programatically format a phone's sdcard ?
• [jmaher] - we need to communicate our projects better