QA/StaffMeetings/QA-Staff-11-14-2012

November 14, 2012

# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core 
#
# Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
# Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)
#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://irc.mozilla.org:6697/#qa

QA Org Items

   New Hires & Interviews 

   Upcoming Events/Conferences 

   Selenium Meetup on "The Future of Selenium Testing for Mobile Web and Native Apps" http://www.meetup.com/seleniumsanfrancisco/events/88722022/

   mozcampasia - anyone going?

   John Hammink on some panel at this conference  - http://mobilewebdevconference.com/san-francisco-2013/agenda.html (Thursday, January 31, '13)

   Notices

Travel / PTO

   19 (Kevin, PTO)

   16-26 (John away, PTO)

   22-27 (juanb in TX)

   Nov 30, Dec 25-26 and Jan 1,2 - All of Softvision

QA Team Updates Desktop (Juan)

   Firefox 

   Firefox 17.0 go-to-build later today, release on Tuesday

   Call-to-action: 

   If you can help with Firefox 17 security fix verification please contact ashughes immediately

   If you notice a hang with Social API turned on please contact ashughes immediately

   ESR (ashughes) 

   Firefox 10.0.11esr go-to-build on Friday, release on Tuesday

   Firefox 17.0esr go-to-build on Friday, release on Tuesday

   Stability (marcia) 

   Desktop Stability Report: https://wiki.mozilla.org/Platform/2012-11-13#Desktop

   Some Socorro issues late last week:

   Bugs related to this: 

   Original bug: https://bugzilla.mozilla.org/show_bug.cgi?id=810241

   Rollback: https://bugzilla.mozilla.org/show_bug.cgi?id=810298

   Root cause regression: https://bugzilla.mozilla.org/show_bug.cgi?id=792118

   Backfill: https://bugzilla.mozilla.org/show_bug.cgi?id=810313

   Automation (ashughes)

   Sync Client (Tracy) 

   2.0 into Fx20 nightlies by end of quarter

   Community Members Onboarding

   ashughes

    Jennifer Cappella (incoming bug triage -- via QA Contribute) 

    Kamil Jozwiak (security testing -- via Brian Bondy) 

    David Fern (incoming bug triage -- via QA Contribute) 

Mobile (Tony)

   Issues 

   Fennec: Respinning Firefox 17 b6, due to bug http://bugzil.la/802510 and working on bug http://bugzil.la/811763

   Likely mobile only beta 7 due to http://bugzil.la/811763

   B2G: ramping up on more outsourcing help with device testing

   Mozilla TPE and TEF are working directly with Moz US testing schedule

   stability and regressions still high

   see last week's summary below

   Fennec (Kevin/Aaron) 

    Stability (nhirata) 

   4.2 crasher as above ( bug 802510 )

   crash reporter not reporting as above ( bug 811763 )

   not much to talk about currently otherwise , see platform stability notes.

   Product marketing announcements to ride with Fx18 betas for release in January

   B2G (geo/tchung) 

   Last week's summary: https://intranet.mozilla.org/Program_Management/Firefox_OS/WeeklyStatus/20121109#Quality

   Current state of testcases in moztrap/testcase mapping:  http://bit.ly/U4qoCh  SV doing a great job!

   Already running suites for individual areas - vetting testcases

   We're starting a new process/triage with Gordon about handling UX, Polish, Performance issues

   TEF starting to use moztrap - export of testcases from Massimo arrived today.

   email/browser needs feedback from PM about use case questions

   email needs more test cases to cover coe path difference of imap/activesync

   Met w/ A-Team+Fabrice during workweek, came up with plan for mochitest framework to optionally run tests at a high privilege level to ease permissions concerns for functionality tests and centralize code for much easier maintenance.

   Refactored permissions testing approach into three separate suites to reduce dependencies on unstable system parts: https://wiki.mozilla.org/B2G/QA/API_Permissions_Test_Plan -- suite 1 and 3 tracked at https://bugzilla.mozilla.org/show_bug.cgi?id=811141, tracking bug + patch for suite 2 coming soon.

   Starting triage on existing mochitests to expand suite running on TBPL.

   Stability (nhirata)

   still need ADUs, still need symbols associated.  Reports should show correctly, but only some of them have.

   https://crash-analysis.mozilla.com/rkaiser/2012-11-13/2012-11-13.b2g.crashes.html

   Apps (Jason) 

   Pay & ID test plan being defined here - https://wiki.mozilla.org/Apps/ID_and_Payments/Test_Plan

   Preloaded apps planning discussion coming soon

   Planning on updating apps test plan on API updates

   Partial testing on-device of trusted UI and mozPay flows

   Looking into test definition updates for identity and apps

   Looking into more exploratory testing around new app changes on device

   Community Members Onboarding

Services (jrgm)

   Sync Server (jrgm) - https://wiki.mozilla.org/QA/Sync/

   BrowserID (jrgm) - https://wiki.mozilla.org/QA/BrowserID

   Working on train-2012.11.09 for production next week.

   Testing is somewhat blocked by an issue in stage env that is being worked on now

   Major load test run to analyze scaling issues (dialed up in stage to breaking point).

   stabilizing automation tests

   Hiring and Training 

   Phone screen with candidate last week

Web (Stephen)

   AMO

   Firefox 17 compatibility changes are landing this week.

   Firefox Health Report (FHR) - https://blog.mozilla.org/metrics/fhr-faq/

   the work and timeline is currently being scoped

   https://intranet.mozilla.org/Program_Management/FirefoxHealthReport

   Affiliates 

   no updates

   B2G/Gaia testing:

   we'll be able to check out the touch-event support in Marionette, tomorrow:

   https://bugzilla.mozilla.org/show_bug.cgi?id=809245

   this unblocks us from finishing Marketplace + almost all of the smoketests (sans ~2)

   A-team is busy working through our list of outright blockers or testability bugs:

   https://bugzilla.mozilla.org/show_bug.cgi?id=811053

   https://bugzilla.mozilla.org/show_bug.cgi?id=810376 (landed)

   https://bugzilla.mozilla.org/show_bug.cgi?id=811351 (landed, needs to land in aurora)

   they're cutting us a special build for today, so we can use the two "landed" bugs, above

   Bouncer 

   Sentry improvements verified and in the pipeline for the next release - https://bugzilla.mozilla.org/show_bug.cgi?id=804347#c13

   Engagement Projects 

   Firefox Flicks is in early project-kickoff state

   Firefox Marketplace 

   App signing is being set up. See https://bugzilla.mozilla.org/show_bug.cgi?id=797902 for more details

   We push as always on Thursdays. This week's changes are available at http://cl.ly/3K29001a3E2X

   Mozilla.com 

   http://scrumbu.gs/p/mozilla_org/

   Mozillians 

   Funkload performance benchmarking complete -https://bugzilla.mozilla.org/show_bug.cgi?id=795388#c7

   API release scheduled for next Monday

   MDN 

   http://scrumbu.gs/t/mdn/2012-11-20/

   PFS

   just got asked to help move PFS off of AMO:

   https://bugzilla.mozilla.org/show_bug.cgi?id=811841

   Socorro 

   Milestone 26 slated for release tomorrow

   https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced;target_milestone=26;product=Socorro;list_id=4964812

   team completed a postmortem for last week's release which needed to be rolled back due to https://bugzilla.mozilla.org/show_bug.cgi?id=792118 causing a regression

   Community Members Onboarding

   Firechemist/Jonah Ho has done some great MozTrap testing

   chrisculver701 joined IRC today and has looked at a few Marketplace tests

Community (Marcia)

   Projects 

   Upcoming Events 

   MozCamp Asia - Schedule is here: https://wiki.mozilla.org/MozCampAsia2012/Schedule

   Testdays (ashughes)

   Automation Testday: https://quality.mozilla.org/2012/11/automation-testday-get-ready-for-automated-webapi-and-webrtc-testing/

   Facebook Messenger for Firefox: https://quality.mozilla.org/2012/11/facebook-messenger-for-firefox-testday/

   Video Work

   QMO.next (Raymond)

   Community Members Onboarding

Automation Development (Henrik, Dave)

   General

   The WebRTC team wanted to have Henrik back to create automated tests

   Rob and Dave are working hard to get more WebAPI and Gaia tests written

   New ESX cluster in PHX will be available soon (network flow has already been setup)

   MozTrap (Cameron)

   Rebecca has been testing features.  Thanks Rbillings!

   MozTrap 1.2 going to staging tomorrow:

   Run Series

   Split-the-work while running tests

   Upgrade to Django 1.4.2 complete

   some int'l fixes

   MozTrap 1.2.5 in progress

   perf fixes for activating huge test runs

   links to lists with filters

   other small fixes

   Community Members Onboarding 

Basecamp Roundtable/Discussion Items

   [jsmith] External Reporting, Metrics, Validity, and Reliability

   (tony) pre-packaged 3rd party app testing strategy

Other Roundtable/Discussion Items

   Gmail PTO calendar up to date for the upcoming holidays?

   Even if your plans aren't solidified please add tentative dates to the calendar

   Coverage during the holidays for Firefox Desktop/Mobile/Firefox OS. Rel Management has a tracking sheet as to who is on point for coverage (https://docs.google.com/spreadsheet/ccc?key=0Ait_RA8Il0WWdFhxT2NBQXRBdm5NaWJOWFllOE5uS0E&pli=1#gid=0)

   Report from the Mozilla Festival

   One and Done Session led by Zac Campbell

   Poor turnout for variety of reasons but Reps/moderators did us proud and we went through the session structure anyway

   We spent 2hrs(!) discussing the personality of a contributor, their needs, drive, rewards and trying to understand how we can better deal with them

   A bit more time looking through Parul's wireframes

   Scans of the morning's work

   https://www.dropbox.com/sh/5xz4ze1s1kezgco/SN8X_kJ1qf

   http://careers.mozilla.org/en-US/position/oByUWfwJ

   Community Manager, Firefox Engineering

   We should begin a dialog about having a similar role for QA

   [mwobensmith] General question about how we intend to deal with B2G test media that is security-sensitive, as it is often host-dependent

Notes, Takeaways and Action Items

   Today 

   Notes

   Action Items

   Last Meeting 

   Action Items 

Template for this document is here: https://etherpad.mozilla.org/qa-staff-template