QA/StaffMeetings/QA-Staff-02-19-2014

From MozillaWiki
Jump to: navigation, search

Mozilla QA Meeting Feb 19, 2014 (Video Replay)

# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core 
#
# Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
# Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)
#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://irc.mozilla.org:6697/#qa

QA Org Items

QA Show and Tell

https://wiki.mozilla.org/QA/Show-and-Tell#Schedule

  • This week:
  • Next week:

New Hires & Interviews

  • Richard Pappalardo has joined Services QA! Yay!

Upcoming Events/Conferences

Notices

Travel / PTO

  • [dclarke] Tribes Training (Paris office), April 1- Apr 4
  • [tony] MWC 2/24-2/28, PTO 3/5-3/20
  • [mbrandt] 2/25 - 3/1 Posse Roundup Uncon - focus on CD and quality
  • [marcia] MWC February 18 - March 1
  • [nhirata] MWC February 18 (travel) - March 1
  • [geo] 2/28, 3/3 PTO
  • [mwobensmith] Working from London through 2/21
  • [henrik] 02/24 - 02/28 PTO

Last Meeting Action Items

  • [Geo] followup with Clint re: regression range criteria [In Progress]
    • Resolution: work in progress, will follow up with a completion
  • [Karl + others] get items for One and Done [carryover] [In Progress]
    • Resolution: initial items received, Karl is collating and will prompt individually as needed
  • [B2G team] Workweek rollup to rest of team/dev-quality [carryover] [In Progress]
  • [Marcia] Send out suggestions/requirements for contribution email.
  • [Clint] Figure out meeting invite, add recent hires, etc.
  • [Raymond] Check with Craig re: presenting proposed new QMO theme [Done he is going to let me know when he will be available so he can present at the meeting]

Roundtable/Discussion Items

QA Team Updates

Desktop (Juan)

  • Firefox
  • ESR (mwobensmith)
  • Stability (KaiRo)
    • Stability issues on Nightly (one of them with Macs and sites like Zimbra) should be fixed in today's Nightly builds.
    • 28 Beta 3 has a pretty bad crash (bug 973344) that apparently was caused by not testing a disabling patch before landing and shipping on beta. That should not happen.
  • Automation (ashughes)
  • Security (mwobensmith)
    • Safe Browsing API test
    • pkix cert validation compatibility test
    • X-CSP compat testing partially completed
    • New security contributor Nagasahas
  • Community

Mobile (Tony)

  • Firefox for Android (Kevin/Aaron)
    • 28.0b4 in progress
    • APK Factory stage server ready
    • Firefox Hub customization
    • Sync critical P1 bugs are being triaged daily
    • New progress bar
    • Stability (kbrosnan)
      • Crash rate for release is 1.8 per/100 ADU
  • B2G (Geo/jhammink)
    • Much ado about MWC device testing on four devices
    • 1.3+ is still trending at 31 blockers
    • team to complete buri testrun this week, l10n testrun run to follow
      • Burirun 13-3 coverage at ~94% as of today
    • 1.4 features have been heavily scaled back, goal is to stabilize what's on trunk for the next month
      • trunk build testrun starting ~March 1. TBD
    • Stability (nhirata)
      • some images in the wild are reporting no crash signatures, so data is not helpful.
    • Platform (Geo)
      • Mochitest on device ran into bug https://bugzilla.mozilla.org/show_bug.cgi?id=972628 , reconnect to network after reboot failing on Buri. Investigating.
      • dclarke experimenting with bringing up a small local harness using available devices to get an idea of stability over time.
      • Martijn has the mapping mostly done re: mochitest subtrees->module owners, touching up information, including quick doc of the opt in/out manifest for B2G, and sending emails this week.
      • QA closing out ownership of the compatibility testing project. ctalbert and jgriffin carrying it forward if info needed.
    • Performance (Geo)
      • Reviewing team goals with product, with an eye on getting our automated monitoring/measuring process launched asap.
      • Continuing to work on uniformity/fps measurement via both compositor instrumentation and eideticker
    • Metrics (Geo)
      • Functional team health report (geo/marcia) has been given an initial review by team, looks promising. Did not have a chance to update report last week. Geo will carry this forward during MWC.
  • Community Members Onboarding

Services (Edwin)

  • Identity/Persona
    • Blog post going out on state of Persona
  • FxA
    • Please stop! and setup sync on nightly (use a copy of your profile, unlink device if you have old sync, and 'setup sync' to try Firefox Accounts)
    • First Test Pass complete
    • Working on logging and monitoring for load testing
    • Trains running
  • Sync
    • Load testing - in bug fix cycles
  • Talkilla/Presence/Locations
    • Getting ready to get involved once products are final.
  • Where is My Fox -> Find My Device
    • Planning testing the web app piece
  • Community
    • Planning a test day for FxA, general FxA testing shock-and-awe

Web (Stephen)

  • Affiliates
  • B2G/Gaia testing:
    • Quickly caught the performance regression on Monday early
  • Despite v1.4 tree closure the device testing has been stable and reasonable builds (and fast)
  • Several solid fast builds on v1.3 branch
  • Bouncer
  • Engagement Projects
  • Firefox Health Report
    • Meeting with :laura Thursday, Feb 19 to discuss scope of release and create a detailed risk analysis. Previous release was dated last July
  • Firefox Marketplace
    • Weekly release went live on 02/18
    • APK factory landed
  • Mozilla.com
    • shipped FirefoxOS Chile CTA at 5.00AM today
    • shipped weekly release
  • Mozillians
    • 2 new and active contributors (father and son duo)
    • two small releases last week to fine tune the curated groups feature
  • MDN
    • no update; continuous deployment
  • Socorro
    • [qa+] no longer denotes needing a webqa to verify a change. Dev owners of bugs needing explicit verification will be responsible for reaching out to QA.
    • QA still maintains oversight of all feature work and bug movement and will interject on areas of high risk/needing QA attention.
  • SUMO
    • continuous deployment; nothing of note this week
  • Community Members Onboarding

Community (Marcia)

  • Projects
  • Upcoming Events
  • Testdays (ashughes)
  • Video Work
  • QMO.next (Raymond)
    • no update
  • Community Members Onboarding

Firefox Automation (Henrik)

  • General
  • Projects
    • Mozmill
      • Working hard to get Mozmill 2.0.6 with full Metro support released - as of now we are blocked on the the move of mozbase to mozilla-central (bug 949600), before we can land all of our patches
      • Andrei got Metro support added to the dashboard: https://github.com/mozilla/mozmill-dashboard/pull/82
      • Given the high number of Firefox crashes we see recently during Mozmill tests, Henrik adds support for mozcrash to Mozmill (bug 619204)
  • MozTrap (Cameron)
  • Community Members Onboarding
    • samgtr (Mozmill, Mozbase, Mochitests)

Action Items

  • [geo] Send out meeting email referenced in round table
  • [henrik] bugzilla re: crash reporting channel, loop in Stephen
  • [karl] report on one and done
  • [Review the survey :-)]
  • [clint] Review/dashboard? of survey results

Template available at: https://etherpad.mozilla.org/qa-staff-template

Retrieved from "https://wiki.mozilla.org/index.php?title=QA/StaffMeetings/QA-Staff-02-19-2014&oldid=932967"