QA/StaffMeetings/QA-Staff-04-10-2013

April 10, 2013

# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core 
#
# Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
# Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)
#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://irc.mozilla.org:6697/#qa

QA Org Items

   New Hires & Interviews 
     

   Upcoming Events/Conferences 

   Jammink at SFHTML5 conference, April 25th; also invited to speak at MobileWebDevcon in Boston, July 16th

   B2G Workweek in Madrid (Apr 15-19)

   Notices

Travel / PTO

   [marcia] PTO April 12

   Firefox OS Work Week in Madrid April 15-19 - https://intranet.mozilla.org/FxOS_Madrid [bob, tchung, marcia, jsmith, zac) 

   jammink - april 8-16 in Chile for IOT (Interoperability Testing) 

   [juanb] PTO April 18, 19

   [edwong] possible jury duty April 22+

QA Team Updates

Desktop (Juan)

   Firefox 

   Firefox 21.0b2 released (featuring multiple Social providers and about:healthreport)

   Firefox 20.0.1 to be released tomorrow.

   New Funnelcake builds also in the works for this/next week.

   ESR (mwobensmith) 

   Stability (marcia) 

    https://wiki.mozilla.org/Platform/2013-04-09#Stability

   Automation (ashughes)

   WebRTC (jsmith)

   Notices

   Targeted for Fx22 ship - 7 blockers remaining

   Automation remote story debate - TURN & STUN server integration in mochitests

   Quality concerns - data channel automation needs improvement, audio latency

   Status - This Week

   More WebRTC Exploratory Testing - E2E Dogfooding + DOM API Analysis

   Investigate bug 859395 to diagnose call failure

   Status - Last Week

   Offer media constraint mochitests landed (bug 850275)

   Exploratory testing for Peer Connection & Data Channel DOM APIs

   First stab at checking media flow mochitests (bug 831789)

   Dogfood exploratory sessions with audio/video chat testing

   Misc automation development (bug 855796, bug 850587)

   Security (mwobensmith)

   CSP planning, IDN cleanup, assorted security bugs

   Community 

   [jsmith] Advertised WebRTC dogfooding and testing opportunities on various communication channels - https://quality.mozilla.org/2013/04/webrtc-testing-try-out-conversat-io-with-other-users-and-file-bugs/

Mobile (Tony)

   Issues 

   Fennec:

   Amid a cycle for Firefox for Android 20.0.1 containing promo removal and stability ride-alongs; targeting release tomorrow

   http://bugzil.la/858561 – Move BrowserDB.expireHistory from GeckoApp.onPause to GeckoApplication.onActivityPause

   http://bugzil.la/859425 – Move decoding/storing favicons to background thread

   http://bugzil.la/817775 – Marketplace promo is active on beta on about:home, but it shouldn't be

   B2G:

   Smoketest continue to fail on commercial RIL

   https://bugzilla.mozilla.org/show_bug.cgi?id=857632

   Workweek next week, focus involved v1.0.1 bug stomping

   IOT issues found this week in Chile and Spain for round 1.  See below for details

   Inari and Leo devices are ported with nightly builds.  Buri is next focus, has known driver issues

   Fennec (Kevin/Aaron)

   Working on a h264 device compatibility test plan

    Stability (nhirata) 

    https://wiki.mozilla.org/CrashKill/2013-04-08#Mobile

    bug 752828:

   mfinkle made a change on friday to help, please test around the following bugs 

    https://bugzilla.mozilla.org/show_bug.cgi?id=843005

    https://bugzilla.mozilla.org/show_bug.cgi?id=856739

   B2G (Geo/jhammink) 

   Stability (nhirata)

   https://wiki.mozilla.org/CrashKill/2013-04-08#B2G

   in need of LG device to test around geolocation crash

    bug 859915 - crash in [@ libqc_b2g_ril.so@0x41ba4]

   UX bugs (nhirata):  details:

   https://docs.google.com/spreadsheet/ccc?key=0ArdCjhGHWKX1dHd1U0hmTGl5b2FMTDhkWGNsUjlZUGc#gid=2

   TestRun 1.1a (camd, mbrandt)

   TestRun 1.1a has not been created yet - waiting for go-ahead from jammink

   jammink gives go-ahead; I'll be leaning on Barker to set up the breakdown and help dole out tasks

   camd created a script using Moztrap's API that can create new testruns based off of a list of testcase ids - https://moztrap-connect.readthedocs.org/en/latest/api.html

   IOT Testing

   Tracking bugs from Mozilla:

   https://bugzilla.mozilla.org/show_bug.cgi?id=855378 - Certification Blockers for Latam IOT (incomplete)

   https://bugzilla.mozilla.org/show_bug.cgi?id=855322 - Certification blockers for Spain IOT

   Whiteboards all bugs updated (IOT, <region>, Ikura). Combined Bugzilla Query for ALL IOT whiteboard bugs: http://bit.ly/10MocpA  PLEASE CHECK THIS QUERY!  I am seeing 56 bugs (Spain and Chile combined)

   Top issues (numbers as yet refer to vendor-specific bug tracker, not bugzilla):

   #43554 - Messaging delivery reports are received poorly decoded.

   #43555 - The DuT does not send messages to destinations of 8 digits

   #43257 - [BLOCKER] The links on the web pages do not work

   #NOT ENTERED YET - [BLOCKER] The DUT is unable to import the contacts from the SIM.

   Keypad for entering PUK, PIN and new PIN does not show any keys (not in (no issue in system yet)

   Other issues found in IOT (my rubbish translation, sorry)

   DUT displays options or bookmarks in English (no issue in system yet)

   Media player not paused when a call is recieved #43552

   Audio still present when volume set to 0 #43553

   Facebook does not allow you to upload a photo #43556

   Current IOT risks:

   ZTE and TEF are using their own system to log certification bugs  There seems to be quite a bit of disconnect as to how bugs are getting entered into Bugzilla and or handled on our side, and there is a risk that issues will get dropped

   I'm going to propose that we switch to either their system or ours.

   TEF has expressed some concern that bugs are not being bumped to P1.

   We have a scarcity of IKURA devices to which to repro bugs, collect logcats and screenshots.   I'm working with Gerald to fix this and get us a loaner device for the duration of the time I'm here; in the meantime, we've made a few visits already to certification facility to collect this info; we'll return to AT4 for next round this friday.

   AT4 (the certification facility) is testing on a very old build - which no one between TEF and ZTE can agree which it actually is.  David from TEF says it's 3/21; the phones I checked at AT4 today were on a 3/28 build.

   Other

   I've been asked by ZTE today to possibly stay for - or return immediately for- another week.  Certification testing is only just now getting underway, and there is much to do re: co-ordination

   Continuing to explore compatibility document/test suite for 1.0.1. Have list of documentation targets from engineering, going through estimation/scoping on what we have.

   Smoketest effort continues

   We have been testing with the Mozilla RIL the past few few days due to compatability issues

   Community Members Onboarding

Services (Edwin)

   Identity

   Sign In Beta 2 announcement and social media blitz

   AWS - jrgm - gene continuing buildout, have confirmed initially for keysigner and verifier; need readonly databases to get much further.

   working on fixing up automation - edwong/karl

   PiCL - jbonacci

   Prototypes and demos!

   Integrating SimplePush, MySQL, also

   Focus is on picl-server and marteau this week. Next week will probably shift to desktop and mobile

   Services

   Heka 0.1.2 for Sync is due to go out to Prod today (jbonacci)

   Heka 0.1.4 for Marketplace is due to go out to Prod today (Services QA spectating)

   Heka 0.2 release is getting ready for some QA effort (kthiessen)

Web (Stephen)

   Affiliates 

    No updates

   B2G/Gaia testing: 

   1 v1-train regression caught

   6 new tests added

   Some coverage gained, some lost due to Marionette changes

   Bouncer 

    working through https://bugzilla.mozilla.org/show_bug.cgi?id=860274 - Deploy bouncer redirect in support of 20.0.1 Firefox release

   brandon (dev) added tests for them in https://github.com/mozilla/bouncer-tests/pull/30/files

   Engagement Projects 

    nothing this week

   Firefox Health Report

   v1.0 shipped

   https://blog.mozilla.org/metrics/fhr-faq/

   https://twitter.com/lxt/status/320267073429311489

   Diagnosing STR for https://bugzilla.mozilla.org/show_bug.cgi?id=860477

   Firefox Marketplace 

    Krupa's been in apps/marketplace meetings; will have her update after the meetings

   Mozilla.org 

   mozilla.org test day last Friday April 5th, 2013  https://etherpad.mozilla.org/mozilla-org-testday-april-2013

   shipped https://mozilla.kanbanery.com/projects/33256/board/

   Mozillians 

    Milestone 04-04-2013 released this week

   https://wiki.mozilla.org/Mozillians/Releases/2013-04-04

   MDN 

    https://developer.mozilla.org/en-US/docs/Project:Changelog

   Socorro 

    Releases are blocked until stage is stood back up

   [tracker] Mo' stage, mo' problems: issues with backfilling and crontabber

   https://bugzilla.mozilla.org/show_bug.cgi?id=859931

   Community Members Onboarding

Community (Marcia)

    Grow Mozilla Meetings

   Notes from April 4 meeting - https://wiki.mozilla.org/Grow/Meeting_04_04_13

   Open Badges Presentation - May 2, 2013 at Noon in Ten Forward. Will be streamed on Air Mozilla.

   Please come prepared with questions and review this spreadsheet prior to the presentation:

   https://docs.google.com/spreadsheet/ccc?key=0AsHml-k4XnX7dG1tV0JLTE1yZjJlM2RqaVdfS24zX0E#gid=0

   Projects 

    One and Done

   Some discussion on the community-building mailing list regarding the scope of the project

   Delphine's feedback from her presentation at Mozilla Hispano Work Week (approx. 20 people attended): 

   People felt that this should be a tool oriented to newcomers only -  and not to people that are already Mozilla or Open Source contributors  

   They said that it would probably be difficult for people to judge how  much time a task could take, especially if they are new. This was said  for example when showing the mockup where there is a time line, and that  the contributor has to say where in the task he is 

   Some people present thought that the reward process was not  "rewarding" enough, or not something they would personally find  rewarding. This makes me wonder how successful Open Badges are going to  be in other countries than the US. 

   However I'd like to note that the people who thought that receiving a  badge or swag was not perceived as rewarding are old-time contributors,  who say that they already have too much Mozilla swag and don't care  about Badges. For newcomers though, this might be perceived as rewarding... 

   Some time ago, I remember some community members in Europe for example  saying that they did not feel interested by the badge rewarding system.  This may have changed since then, but maybe it's worth looking into? 

   Otherwise feedback was generally positive. People think this can be a  very useful tool to attract new contributors and are interested in seeing it develop more 

   Linden School

   Had a conference call with Mike Hoye, Liz Henry and Kat from the Linden School in Toronto. They are interested in integrating some Mozilla content into their curriculum for the fall semester and are willing to consider proposals that would be suitable for 15-17 year old young women

   Created https://mozqa.etherpad.mozilla.org/Linden-School-Ideas to track ideas

   Upcoming Events 

    Mozilla Summit - https://wiki.mozilla.org/Summit2013

   October 4th, 5th and 6th

   Awaiting word on how community nominations will be handled after they have registered in Mozillians

     High-Level Timeline as published on wiki:

   April 17th - Final day for volunteers to update their Mozillians.org profiles (add location and join "summit 2013" group). 

   April 30th - Summit invitation list (volunteers only) final. 

   By second week in May - Volunteers who will receive invitations will be contacted via email. 

   First weeks in June - Invitations sent to staff + volunteers. 

   June 14th - 16th - Summit Planning Assembly (Paris, France) 

   Remo - Mozilla Mexico - April 26 - 28

   https://etherpad.mozilla.org/remo-mozcamp-mexico

   Testdays (ashughes)

   Firefox 21 Beta testday this Friday, April 12, 2013:

   https://quality.mozilla.org/2013/04/firefox-21-0-beta-2-testday-march-12th/

   Video Work

    No update this week

   QMO.next (Raymond)

   waiting on  security review of plugin

   Community Members Onboarding

Automation Development (Henrik, Dave)

   General

   Overall A-team goals for Q2 2013: https://wiki.mozilla.org/Auto-tools/Goals/2013Q2

   Still no update yet for the mozqa.com move - not sure when IT will actually handle it (bug 811869) 

   Still a slow process by IT to get ready with our new Mac Minis (bug 853074) 

   Projects

   Mozmill CI [henrik]

   Henrik landed a patch (bug 857956) which drastically improved the robustness of the update tests (lets cross fingers that it will stick)

   Last blocker for pulsebuildmonitor has been fixed and we can most likely push it to production tomorrow

   Testing localized builds for beta and release candidate builds are on the way (bug 857980 for pulsetranslator needs to be fixed first)

   Gaia UI

   Lots of work going into making the Gaia UI tests run reliably on B2G desktop. A lot of fixes already landed for next Marionette release, and hopefully more soon.

   MozTrap (Cameron)

   [camd] - working on a few more small updates

   [camd] - created new suite for b2g of test cases in v1.1.0 that are not in v1.0.1

   https://moztrap.mozilla.org/manage/cases/?filter-suite=273

   Community Members Onboarding 

Roundtable/Discussion Items

   When do you want Q2 goals finalized by? [tony]

   Or generally, can we can update from each team on Q2 Goals?

   Do we have anyone in the pipeline for Director of QA? [mbrandt]

   Criteria for giving equipment to community members [marcia]

   Request for a contributor funneled over from David Boswell

Notes, Takeaways and Action Items

   Today 

   Notes

   Action Items

   Last Meeting 

   Action Items 

Template for this document is here: https://etherpad.mozilla.org/qa-staff-template