QA/StaffMeetings/QA-Staff-06-18-2014
Contents
Mozilla QA Meeting June 18, 2014 (Video Replay)
# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Room: QA # # Vidyo: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh # Phone: +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL) # +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free) # +1 416 848 3114 x92 Conf# 9245 (Canada) # IRC: irc://irc.mozilla.org:6697/#qa
Actions From Last Week
Discussion Zone
- [marcia] Need final consensus on whether QA Fair format proposed in dev.quality will be the "Test Event" for the Work week the week of July 28th
- Who will the leads be for each functional area?
- Final decision also needed about which day - learning toward either Tuesday or Thursday to give people time to settle in on Monday
- Stations in parallel
- Station List
- [henrik] Lowering risk of repeated regressions by actively checking for added tests on fixed bugs
- Right now it seems like we only verify fixed regression bugs but don't really pay attention if automated tests have been added
- If we could do the following checks and actions we could further improve the quality and reduce the risk of repeated regressions
- If a fix landed with a test but the in-testsuite flag has not been set, change it to in-testsuite+
- If a fix landed without tests, ask the assignee if an automated test is possible by also setting the in-testsuite? flag.
- If an automated test is not possible ask the QA Automation team by setting the in-qa-testsuite? flag for Henrik
- [kthiessen] Lively discussion of Github/Bugzilla swag-tagging happening in https://etherpad.mozilla.org/welldone-swag-comment --- thank you! to those involved. The discussion is getting a bit unwieldy for an etherpad, though -- where do people think we should move it to get more participation/consensus? Or do we have enough already?
One concern: No one outside of paid staff has commented yet, that I have seen. >> Look for a summary post in dev-quality either tonight PST or early tomorrow morning. [pragmatic] Seeking feedback on QMO (quality.mozilla.org) on the dev-quality mailing list https://groups.google.com/forum/?_escaped_fragment_=topic/mozilla.dev.quality/9AmeBMJNu8g#!topic/mozilla.dev.quality/9AmeBMJNu8g We got some feedback on the Community Building mailing list: https://mail.mozilla.org/pipermail/community-building/2014-June/001614.html [feedback from AaronMT] https://mail.mozilla.org/pipermail/community-building/2014-June/001637.html
- [ctalbert] Q3 Goals Draft: https://wiki.mozilla.org/QA/Goals/2014q3
- [tchung] Flames - did everyone get one? if not, please let me know. Next step, please start doing some B2G testing and dogfooding! (props to SydPolk this week for sending out some feedback to the team!)
- what B2G version should we use? i suggest Mozilla-Aurora (aka 2.0)
- Instructions to flash : https://intranet.mozilla.org/QA/B2G_Tips_and_Tricks#Reference_Phone_.28Flame.29
QA Show and Tell
https://wiki.mozilla.org/QA/Show-and-Tell#Schedule
- This week:
- Next week:
Milestones and Calls for Action
Achievements
- Kudos to AaronMT for candidly stating what's wrong with QMO https://mail.mozilla.org/pipermail/community-building/2014-June/001637.html
Upcoming Events/Conferences
- Intro to Web Testing event @SF Commons next Tuesday the 24th
- http://www.meetup.com/The-Mountain-View-Mozilla-Meetup-Group/events/188949632/?_af_eid=188949632&_af=event&a=uc1_vm
- FF 31 Beta 3 Test Day: https://quality.mozilla.org/2014/06/firefox-31-beta-3-testday-june-20th/rketpla
- Marketplace Test Day Thu June 26, 2014 https://etherpad.mozilla.org/marketplace-day
Community
- Q3 Goals in Progress
- Champions
- June 13th Meeting: https://etherpad.mozilla.org/community-champions-20140613
- Q3 goals brainstorming etherpad: https://etherpad.mozilla.org/2014Q3Goals-Community
- Meeting this Thursday at 11 AM Pacific to continue work on Q3 Goals
- Grow Mozilla Meeting
- Notes from Last Meeting: https://wiki.mozilla.org/Grow/Meeting_06_12_14
- Of note, see the community Goals on that page
- Stories of Community Growth: http://pierros.papadeas.gr/?p=377
- Next meeting June 26th: https://wiki.mozilla.org/Grow/Meeting_06_26_14
- Notes from Last Meeting: https://wiki.mozilla.org/Grow/Meeting_06_12_14
- Tools
- One and Done
- Reminder to please add contact info in your tasks
- Meeting next week Wed June 25th from 11-noon to discuss requirements for Q3 2014 https://etherpad.mozilla.org/oneanddone-2014q3
- This week's meeting https://etherpad.mozilla.org/oneanddone-06182014
- Baloo
- Events
- http://www.meetup.com/The-Mountain-View-Mozilla-Meetup-Group/events/188949632/ - Intro to Web Testing event in the San Francisco Mozilla office: Tuesday, June 24, 2014
Contributor Welcome
These are new contributors, if you see them around, say hello
- Firefox Automation
- Jay Rajput ( https://github.com/jayrajput )
- Yati Sagade ( https://github.com/yati-sagade )
- Ayrx ( https://github.com/Ayrx )
- Maria Grazia Alastra [:mga]
Contributor Honor Roll
For those that went above and beyond this week, we salute you here.
Updates
How To Find Us
Internal Goals
- Monthly Review: https://wiki.mozilla.org/QA/Goals/2014q2
- In-meeting review first meeting of every month
Detailed Updates
Below follows detailed updates on what each team is working on and toward. The leads highlighted in each section are the people you want to find if you're interested in helping out.
Desktop (Juanb)
- Firefox
- 31b2 is shipping today, 31b3 will ship on Friday
- ESR (mwobensmith)
- Stability (KaiRo)
- Different reasons for high crash rates on the different channels, see https://wiki.mozilla.org/CrashKill/2014-06-16 for details on bugs
- We are looking for someone with an Win7 machine and Intel Q57/H55 graphics to find STR for a major Beta 31 crasher, see Juan's email to qa-staff.
- OOM crashes have new signatures, see email to stability, dev-platform, and firefox-dev
- Different reasons for high crash rates on the different channels, see https://wiki.mozilla.org/CrashKill/2014-06-16 for details on bugs
- Automation (ashughes)
- Security (mwobensmith)
- Shumway pen testing
- Ongoing SSL cert compat testing
Mobile (Tchung)
- Firefox for Android (Kbrosnan/AaronMT)
- Stability (kbrosnan)
- Firefox OS (jsmith/nhirata)
- 1.3/1.3T smoketesting discontinued - standby support only
- 1.4 QA Wanted & smoketesting
- 1.4D - actively figuring out the plan here
- 2.0 QA Wanted, full test run, and smoketesting
- 2.0 Flame Test run 2 active
- 2.1 QA Wanted & smoketesting
- Stability (nhirata)
Platform (sydpolk)
Services (Edwong)
- Identity/Persona
- FxOS is having a problem with gmail/yahoo/mozilla emails - it's a CSP issue
- https://github.com/mozilla/persona/issues/4144
- FxA
- OAuth Stage is up - working on Prod
- OAuth testing in progress
- Sync
- infrastructure changes are happening
- Loop
- MSISDN is on schedule for 2.0 - need api and end to end test
- API testing
- FMD
- FxOS 2.0 at risk - due to unstable dev endpoint, working on getting testing endpoint locked down for testing
Web (Stephend)
- Affiliates
- No updates
- B2G/Gaia testing:
- automation on 2.1, 2.0, and 1.4 is going well
- thanks to Kate for 1.4 coverage
- Flame buildout starting soon; Mac Minis expected to arrive today
- found a reproducible case for https://bugzilla.mozilla.org/show_bug.cgi?id=1016821 - [Flame][V1.4][Message]Device suddenly appear white screen while editing one message. - we'll work on getting the developer the information they need to reproduce/fix, since our automation can be affected by this
- automation on 2.1, 2.0, and 1.4 is going well
- Bouncer
- Small but important release today for https://bugzilla.mozilla.org/show_bug.cgi?id=1014990
- Engagement Projects
- no updates
- Firefox Health Report
- No updates
- Firefox Marketplace
- App Days is happening (yesterday + today) in the Mountain View office
- Mozilla.com
- shipped weekly release
- Mozillians
- New mapbox + open streetmaps feature in /profile/edit is on stage and actively being tested
- Socorro
- Notes from today's meeting - https://wiki.mozilla.org/Breakpad/Status_Meetings/2014-06-18
- Automation caught an advanced search bug [blocker for this week's release] https://bugzilla.mozilla.org/show_bug.cgi?id=1026781
- Notes from today's meeting - https://wiki.mozilla.org/Breakpad/Status_Meetings/2014-06-18
Firefox Automation (Whimboo)
- General
- Projects
- Puppet
- OS X work has been stalled given the RelOps is focused on their own goals - Henrik will have to do some self-education here
- Ubuntu is in a good shape - final testing for mozauto user + X system
- Proxy work for UI remaining
- TPS-CI
- Initial patch for Jenkins will land soon
- Then appropriate jobs will be created, and plugins added
- Mozmill
- We are using wptserve as HTTP server and not mozhttpd
- Mozmill-CI has been updated to latest Jenkins CI + CPU cores bumped to 2 (you will see fantastic speed improvements!)
- Basic Mozmill tests for geolocation should be done soon
- Puppet
Travel / PTO
- [marcia] Tuesday 6/24 and working remotely/some PTO until 7/9
- [henrik] Maybe PTO June 30th - July 4th
- [nhirata] PTO 6/20
- [ashughes] PTO June 25 - July 2nd
- [Tchung][Jsmith] traveling June 26-27 (seattle)
- [Tchung] productivity ww week of july 18th (SF)
Action Items
- marcia to proceed with QA Fair idea, getting list of stations and leads
- kthiessen to send out swag/tag discussion to dev.quality
- whimboo to summarize rules for verification re: in-testsuite to dev.quality
- pragmatic to summarize atrain's commentary on QMO to dev.quality, continue that discussion
- rbillings to send out reminder to review One and Done contact info
Template available at: https://etherpad.mozilla.org/qa-mtg-template