QA/StaffMeetings/QA-Staff-01-22-2014

QA Staff Meeting Wednesday January 22, 2014

# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core 
#
# Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
# Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)
#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://irc.mozilla.org:6697/#qa

QA Org Items

QA Show and Tell

https://wiki.mozilla.org/QA/Show-and-Tell#Schedule

• This week:
  • Michael Kelly will present One and Done Version 1 Milestone 1.
    • https://oneanddone.paas.allizom.org/
• Next week: Propose switching Show and Tell to volunteer basis?

Upcoming Events/Conferences

• Feb 1st/2nd: Henrik / Kairo / Delphine at FOSDEM ( https://wiki.mozilla.org/Fosdem:2014 )

Travel / PTO

• [tracy] PTO, Jan. 21-23
• [camd] Work week/DashCon in SF Jan 20-24
• [nhirata] temporarily working from Mi currently still
• [Tony] 1/11 - 1/24 - taiwan for 2 weeks (Productivity Workweek - 2nd week)
• [rbillings] TRIBE 1/22-23 in SF
• [ctalbert] paternity leave
• [delphine] Fosdem + working from Paris office, Jan 27- Feb 12

Roundtable/Discussion Items

• https://wiki.mozilla.org/QA/Desktop_Firefox/Work_Weeks/2014_Planning (ashughes)
  • 2014 Goals will be around increasing Fx usage by 10%, revenue by $25M, and accounts adoption by 25M
  • Firefox Desktop dev moving to two-week iterations starting in Fx30
  • Australis, FxA w/Sync, In-browser Translation pilot, First-run sponsored tiles, Plug-in whitelisting to be Q1 priorities

QA Team Updates

Desktop (Juan)

• Firefox
  • Metro on schedule to ride Fx28.
• ESR (mwobensmith)
• Stability (marcia)
  • https://bugzilla.mozilla.org/show_bug.cgi?id=962141 spiked on the trunk
  • Overall report: https://wiki.mozilla.org/Platform/2014-01-21#Stability_.28kairo.2Fbsmedberg.29
• Automation (ashughes)
• Security (mwobensmith)
  • Completed testing of TLS 1.1 and 1.2 compatibility
  • New contributor Nagasahas helped with cert UI bug 950268
• Community

Mobile (Tony)

• Firefox for Android (Kevin/Aaron)
  • beta 8 shipped today
  • doing an out of band beta 9 to pick up some Flash and stability bugs
  • Many Firefox for Android FE devs in SF next week for a sprint (FxAccounts, panels)
  • Stability (kbrosnan)
    • Focusing on 27 beta issues
• B2G (Geo/jhammink)
  • Burirun 1.3-2 results:
    • 3731 passed, 2295 failed, 0 blocked, 127 invalid / 4341 cases total. Coverage is at 95%
    • 49 passed, 2 failed, 2 blocked, 0 invalid / 282 cases total. Coverage is at 19%
      • need some help covering mozilla/TEF areas! Check the breakdown: http://bit.ly/1m5UJPL (Mozilla/TEF)
  • Collections testcases (e.me homescreen) in progress (jammink)
  • Ongoing work with 938062 (jammink)
  • Workweek in Taipei last week. A large number of presentations/discussions took place, along with a number of action items generated (still rolling up). See notes:
    • QA Strategy planning - https://etherpad.mozilla.org/b2g-qa-strategy-2014
    • QA Retrospective - https://etherpad.mozilla.org/2014-qa-retrospect
    • Gaia UI Tests - https://etherpad.mozilla.org/b2g-qa-workweek-gaia-ui-tests
    • Eideticker - https://etherpad.mozilla.org/2014-qa-eideticker
    • Gaia UI Tests Synergy (US + Taipei) - https://etherpad.mozilla.org/b2g-qa-workweek-gaia-ui-tests-synergy
    • Tools Convergence discussion - https://etherpad.mozilla.org/converging-tools-discussion
    • MTBF / Fuzzing discussion - https://etherpad.mozilla.org/mtbf-fuzzing-discussion
    • Bug Triage in Firefox OS - https://etherpad.mozilla.org/bugzilla-triage
    • External communication and reporting - https://etherpad.mozilla.org/external-communication
    • Moztrap usage and enhancements - https://etherpad.mozilla.org/b2g-qa-moztrap
    • Smoketesting / Bugzilla Standard Operating Procedures - https://etherpad.mozilla.org/Smoketesting-Bugzilla-SOP
    • Chrome vs Firefox Apps - https://docs.google.com/presentation/d/1eiAPGnztC0SW_4YjAsQlkcbZuRt-9Md79roz2Xe1IKs/edit?usp=sharing
    • Understanding TBPL and pushlog failures - http://slid.es/ahal/tbpl/
    • Community Strategy - https://etherpad.mozilla.org/Community-Strategy
    • Data Migration Testing (OTA) - https://etherpad.mozilla.org/data-migration-testing
    • Mochitest - https://etherpad.mozilla.org/2014-qa-mochitest (some is actually from earlier content, but covers the same ground)
    • QA Show and Tell - https://etherpad.mozilla.org/show-n-tell
  • Platform (geo)
    • dclarke has mochitest running on-device with very small test suites. Still some issues around memory usage and timeouts. Also need to triage and opt in tests, but this is a great step!
    • geo working with martijn to triage and raise remaining CSP mochitests
    • Anticipating new mochitest triage work with B2G Desktop OOP and on-device targets. geo and martijn working to understand importance of these targets, organize tasks and figure out if we can spread some of the responsibility across teams (notes: https://etherpad.mozilla.org/webapiqa-jan21)
  • Performance (geo)
    • Workweek last week, worked with Will Lachance on Eideticker to understand and validate camera-based tests. Did discover some issues with the sensitivity vs. LCD response time on FPS tests (ghosts/fadeouts causing false unique frames to be identified). However, we're very confident of load-time tests within a frame or two resolution.
    • Ordering parts (including LEGOs, thanks dhunt!) for Eideticker rig for MV this week. Will be exploring some different approaches on the imaging (different camera framerates at lower resolution, possible calibration step at the beginning to match refresh, filtering, etc.) to increase accuracy on FPS tests.
    • Also examining more areas where we can implement Eideticker-based load time tests, since those are solid.
  • Stability (nhirata)
    • 1.4
      • Bug 925819 - crash in js::jit::Assembler::bind(js::jit::Label*, js::jit::BufferOffset)
        • also in 1.3
      • Bug 945335 - crash in audioTrack_callBack_pullFromBuffQueue
        • also in 1.3
      • Bug 871574 - crash in mozilla::dom::indexedDB::PIndexedDBRequestChild::OnMessageReceived
        • also in 1.3
    • 1.3
      • Bug 945338 - crash in wpa_ctrl_attach_helper
  • Misc
    • [jsmith] Content media mochitests finally turned on non-debug emulators - https://bugzilla.mozilla.org/show_bug.cgi?id=916135
    • [jsmith] Smoketests - 45/48 tests passing on 1.3, 44/48 tests passing on 1.4
    • [jsmith] Gaia UI Automation very stable - 118/124 tests passing on recent run
    • [jsmith] Process Improvements Post Work Week In Progress
    • [nhirata] https://github.com/nhirata/fullflash/blob/master/fullflash_gecko_ril_gaia.sh
      • releng script modified; have not pushed, needs testing
    • [nhirata] backup/restore profile switch added to TW flash script, need code review
    • [nhirata] working on changing TW flash script to accomodate QAnalysts site.
• Community Members Onboarding

Services (Edwin)

• Identity/Persona
  • Train testing today - planning to go out this afternoon
• FxA
  • Targetting Fx29. Friday 1/24 is strings/api/UX Final
  • Target to turn on pref in Nightly soon (1-3 wks?)
  • Getting train schedule setup
• Sync and TokenServer
  • Staging servers for 1.5 are half way there.
• CampaignManager
  • Pushed out new CM - and Android Annoucement went out to nightly users today.

Web (Stephen)

• Badges!
  • we've blogged and tweeted about our new contributor badges!
    • QMO post: https://quality.mozilla.org/2014/01/get-involved-earn-a-new-webqa-automation-badge/
    • https://twitter.com/mozwebqa/status/425770624288432129
    • https://badges.mozilla.org/en-US/badges/badge/WebQA-1-pull-request-merged
    • https://badges.mozilla.org/en-US/badges/badge/WebQA-10-pull-requests-merged
    • https://badges.mozilla.org/en-US/badges/badge/WebQA-50-pull-requests-merged
• Marketplace Dashboard special preview :-)
  • http://bobsilverberg.github.io/mozwebqa-dashboard/marketplace_dashboard.html
    • we'll likely be extending this work to expose more results, publicly, with both our Firefox OS/Gaia UI Test + Selenium WebDriver automation (using Sauce Labs jobs)
    • should help greatly with visibility (inside/outside the org) + community collaboration
• Affiliates
  • QA Kick off meeting for the Affliates redesign took place 2014-01-21 - https://affiliates.etherpad.mozilla.org/qa-kickoff-2014-01-21
  • Prioritized features for this quarter- https://bugzilla.mozilla.org/buglist.cgi?list_id=9257820&classification=Other&query_format=advanced&component=affiliates.mozilla.org&product=Firefox%20Affiliates&target_milestone=5
  • This would be an excellent project for community members to collaborate on.
• B2G/Gaia testing:
  • lots of great discussions and collaboration during last week's work week
    • still rolling up the takeaways - will send out mail to gaia-ui-automation@mozilla.org by end of week
• Bouncer
  • No planned release this week
• Engagement Projects
• Firefox Health Report
  • No updates
• Firefox Marketplace
  • weekly release went live on 01/21
• Mozilla.com
  • couple of small pushes this week
• Mozillians
  • The first iteration of the new Curated Groups feature has landed on stage (mozillians.allizom.org).
    • https://bugzilla.mozilla.org/show_bug.cgi?id=936569 - [tracker] Allow users to create/manage groups ("Curated Groups")
  • Community feedback welcome as the team evolves the feature set and prepares for a dazzling release
• MDN
  • continuous deployment; no update this week
• Socorro
  • No release this week. Most of the team is in Canada at a conference
  • Milestone 72 slated to be released next week - https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&target_milestone=72&product=Socorro&list_id=9257790
• Community Members Onboarding
  • justinpotts - Mozillians - exploratory testing, refactoring webqa documentation, and automation
    • https://mozillians.org/u/justinpotts/

Community (Marcia)

• Upcoming meetings
  • Bi Weekly Grow Mozilla meeting: https://wiki.mozilla.org/Grow/Meeting_01_23_14
    • Working group updates planned: Systems and Data, Events, Contribution Paths, and Rewards/Recognition
    • Community building group panel discussion on air.mozilla: https://air.mozilla.org/community-building-panel/
• Projects
  • Community Champions met yesterday to work on Q1 Goals
    • Work in progress: https://etherpad.mozilla.org/2014-QA-Champion-Goals
  • One and Done
    • Show and Tell at the start of today's QA meeting
    • Waiting for security review before going live with Version 1 Milestone 1 https://bugzilla.mozilla.org/show_bug.cgi?id=956719 Yvan Boily is assigned.
    • Accessibility Testing requested by stephend from Marco Zehe, David Bolter, Trevor Saunders, Alexander Surkov and Eitan Isaacson.
    • Github activity https://github.com/mozilla/oneanddone/pulse
    • kthiessen will be asking for small test cases from B2G (Geo/Marcia), Fennec (Kevin), and Desktop (Juan). Send him mail if this will be difficult.
    • Tentative release date of Milestone 1 is Feb 5, 2014
  • Open Badges
    • Q1 Goal to make progress in awarding the QA badges for general participation
• Community Discussion at B2G Work Week in TPE
  • https://etherpad.mozilla.org/Community-Strategy
  • We also attended the MozCoffee with the Taiwan Community on Friday
    • Mozilla Reps Photo: https://twitter.com/irvinfly/status/424211241574227968
    • Group Photo: https://www.facebook.com/photo.php?fbid=10152144936053622&set=a.10150154456388622.305218.795413621&type=1
• Upcoming Events
  • FOSDEM - Mozilla Devroom: https://fosdem.org/2014/schedule/track/mozilla/
  • MWC in Barcelona
    • marcia working with Catalan community to host an event while we are there
• Testdays (ashughes)
  • No Testday scheduled for this week
• Video Work
  • No update this week
• QMO.next (Raymond)
• Community Members Onboarding

Automation Development (Henrik, Dave)

• General
• Projects
  • Mozmill
    • Ubuntu 13.04 nodes have been replaced with Ubuntu 13.10
    • We are currently doing system, flash, and java updates
    • A lot of work has still to be done for mozmill 2.0.4: https://bugzilla.mozilla.org/show_bug.cgi?id=960495
    • Henrik is working on a large mozrunner refactoring for making it more reliable on https://bugzilla.mozilla.org/show_bug.cgi?id=960084
    • The reason for Firefox zombie processes with Mozmill has been identified and a patch will land soon
    • Patch for metro libs is still under review - I hope we can get it in this week
    • SV team is working to get metro tests running in their local Mozmill CI instance this week
• Community Members Onboarding
  • Kai [:K] from Germany started to work on Mozmill

Notes, Takeaways and Action Items

Today

• Notes
• Action Items
  • Karl + others: get items for One and Done
  • Volunteers for Show and Tell
  • B2G team owes workweek rollup to rest of team/dev-quality

Last Meeting

• Action Items

Template available at: https://etherpad.mozilla.org/qa-staff-template