QA/StaffMeetings/QA-Staff-06-26-2013

  June 28, 2013
# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core 
#
# Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
# Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)
#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://irc.mozilla.org:6697/#qa

QA Org Items

   New Hires & Interviews 

    Team changes: 

   Jason to B2G, Tracy to Desktop Firefox

   Upcoming Events/Conferences 

   Tuesday, July 16 - Mountain View Meetup with Zac Campbell at 6:30 PM in Ten Forward.  Topic: UI Testing of Firefox OS. http://www.meetup.com/The-Mountain-View-Mozilla-Meetup-Group/events/126786452/

   Volunteers needed to man the doors and lead people to Ten Forward - sign up here https://etherpad.mozilla.org/716-meetup-volunteers

   [Tony] B2G Productivity team workweek (Vancouver) - July 7-12 

   Notices

    Reminder: 

   Monday, July 1 is a Canadian Holiday

   Thursday July 4th is a US Holiday

Travel / PTO

   [mwobensmith] PTO 7/25-8/2

   [lots o' people] July 1st and 5

   Only Softvision is listed on Vacation calendar, so you might need to clarify lots' o people

   [Canada] PTO Monday July 1

   [bmoss] PTO 7/5-7/12

   [nhirata] training 6/26, 6/27

QA Team Updates

Desktop (Juan) Juan will be a few minutes late

   Firefox 

    Firefox 23 is now in Beta

   this cycle we'll be trial running two betas per week (ie. 10 betas per 6-weeks)

   week 1 & 6 will have a single beta as usual

   week 2-5 will have a beta ship on Tuesday and Friday

   next Beta goes to build Monday July 1st, ships Tuesday July 2nd

   https://wiki.mozilla.org/QA/Desktop_Firefox/Releases/Walkthrough#Rapid_Betas

   Click-to-Play Plug-in Blocklisting

   Quicktime <=7.7.3 (Windows)

   Quicktime <=7.7.0 (Mac)

   Flash <=11.7.700.169 (Windows & Mac)

   Java <=7u21 (Java 6 has reached EOL)

   Planning to block all JDK versions next week

   ESR (mwobensmith) 

    17.0.7 out the door

   Stability (marcia) 

   https://wiki.mozilla.org/Platform/2013-06-25#Stability_.28kairo.2Fbsmedberg.29

   Automation (ashughes)

   Security (mwobensmith)

   Continued work on mixed content and CSP

   Community 

Mobile (Tony) -- screaming baby duties friday, deferring to Geo and Kevin for updates

   Fennec: 

   Fx22 released this week, Fx23b1 also out

   x86 builds stay on beta for now

   WebRTC test-day from last week went well, lots of bugs that need followups now

   discussing a workweek in Sept

   B2G: 

   MMS bugs are still landing, and is a concern for executing testruns and rewriting testcases

   1.1 'leorun4' testrun in progress

   The Run:  https://moztrap.mozilla.org/users/login/?next=/runtests/run/1600/env/314/

   The Results: http://mzl.la/14yeGqm

   724 passed, 17 failed, 4 invalid/3675 cases total.  

   21% coverage at presstime

   The Breakdown: [spam filter issue]

   The Bugs: http://mzl.la/17msib5

   9 bugs whiteboarded at presstime

   Blockers, etc. TBD

   3rd party apps for Leo testing in progress

   1.1 HD device is still awaiting builds from releng (bug 885901)

   discussing QA's role within the 1.2 agile teams - continuing monday

   Currently started testplan for 1.2 (starting with Comms app)

   Firefox for Android (Kevin/Aaron) 

   Completed h264 testing on a wide variaty of devices

   shipped FxA 23 beta 1 on ARMv7/ARMv6/x86

   Stability (nhirata)

   overall  quite good

   to improve either need to tackle long tail or improve Flash stability

    investigating https://bugzilla.mozilla.org/show_bug.cgi?id=845867

   B2G (Geo/jhammink) 

   Stability (nhirata)

   https://wiki.mozilla.org/CrashKill/2013-06-24#B2G

   leo

   v08e needs to be pushed to releng

   v08h is out, there may be a new build next monday so we might just wait until then to push the new bits to that to the build structure.

   Apps (jsmith)

   1.1 Apps Customization Test Plan & Execution Beginning This Week

   [jsmith & swaroopa] Simple Push Client-Side Testing ongoing

   Daily sanity check (~9 tests) for 1.2 builds started to help with stability

   Compatibility Test Suite

   New CTS exercisers (ambient, proximity, vibration, orientation) checked in (temporarily) at https://github.com/geoelectric/apitest/ , code drop delivered to QC on Thursday.

   First draft of CTS test cases also written against exercisers, at https://docs.google.com/spreadsheet/ccc?key=0AnEJ45MnstYjdEVOS21QY1JqbUZGeGlSVm1kX2w3ZEE#gid=0 (still settling final delivery format/repo)

   Geo working on Battery Status exerciser and test cases

   David Clarke working on Web Payments and Web Activities analysis

   Martijn finishing up content/media mochitest porting to B2G suites

   David Clarke on Web Apps API testing working with packaged apps

   Smoketests

   Several regressions uncovered this week during smoketesting of V1 train

   Community Members Onboarding

Services (Edwin)

   Identity

   Lloyd Hilaiel is the new Director

   Yahoo Alias Pin Fix going live monday

   Moz idp still on deck

   Gmail bigtent go live 7/10

   Primariy idp fix is being tested on B2G

   Automated tests in progress for PiCL

   train-2013.06.19 going to stage today with updates; ship date TBD.

   Services

   Push server tests iterating, met with client testing to sync up.

   Loads (py load testing framework) testing setup

Web (Stephen)

Goals completed and updated:

    https://intranet.mozilla.org/QA/Q22013_QAgoals#Web_QA_Team_Goals

   B2G/Gaia testing:

   A-team and new contributor Mathieu Bultel (mbu) have been working in addressing Marionette stability:

   https://bugzilla.mozilla.org/show_bug.cgi?id=874599 - Marionette can die during setUp() if previous test had failed during tearDown()

   Lots of continued great effort into stabilizing tests:

   https://github.com/mozilla/gaia-ui-tests/pulse

   Now running on master and v1-train, and catching a lot of bugs, especially on master

   Bouncer

   Thx to Dave Hunt a couple weeks back for bolstering our tests to add in support for EdgeCast (CDN we occasionally fall back to) and for general cleanup goodness:

   https://github.com/mozilla/bouncer-tests/pull/34

   Engagement Projects 

   OS Newsletter Basket updates released yesterday

   OS pages under test

   shipped another round of Firefox Flicks 

   Reps Voting feature went out

   Firefox Health Report

   Improved Android FHR will be released on Monday

   https://bugzilla.mozilla.org/show_bug.cgi?id=887840

   Firefox Marketplace

   especially this week, our automation (desktop/mobile -- both Android and Firefox OS) is catching a lot of bugs that aren't being caught by unit-tests

   both on AMO and Marketplace

    Krupa is actively (furiously?) testing Payments  :-)

   Mozilla.com

   Our awesome automation found an IPv6/EV bug on blog.mozilla.org:

   https://bugzilla.mozilla.org/show_bug.cgi?id=887474 - Blog.mozilla.org has connection resets and server too busy errors

    Working on bugs for early release next week https://bugzilla.mozilla.org/show_bug.cgi?id=855791

   pushed weekly release to production https://github.com/mozilla/bedrock/compare/58b06ce85cc1994aa0a96bef0d9f06bd38dedb64...master#

   Mozillians 

    UX Redesign slated to be released on 2013-07-8

   https://bugzilla.mozilla.org/buglist.cgi?cmdtype=dorem&remaction=run&namedcmd=phonebook%20%3A%3A%2007%2F08&sharer_id=405534&list_id=6991716

   Socorro 

   It only took 14-months, crash-stats.mozilla.com now points to the Django app!

   The PHP version (old) is running in parellel and can be reached at crash-stats-php.mozilla.org

   The PHP version of the app will be shut off in 2-weeks

   0900 EDT- July 1st, Socorro prod cluster will be down for schedule mainenance for up to 5 hours

   Socorro Prod Cluster : Hadoop/HBase Upgrade to CDH4 - https://bugzilla.mozilla.org/show_bug.cgi?id=871980

   Non-LDAP accounts will not be able to access the admin functions - https://bugzilla.mozilla.org/show_bug.cgi?id=888128#c4

   Gabi (intern) is driving a test coverage discussion

   https://etherpad.mozilla.org/socorro-testing

   Community Members Onboarding

    as mentioned above,  Mathieu Bultel (mbu) has been contributing to Desktop Firefox builds of B2G for some time now, but has an Unagi and is contributing even more to Marionette stability/correctness!

   Two new contributors who have joined our mailing list and expressed interest (manual testing and automation); we're onboarding:

   Mihai Morar

   Venkat Kunta

Community (Marcia)

   Projects 

   Open Badges: Community contributions for Open Badges (General QA Participation Badge) now cross-posted to the Mozilla Creative team's blog: https://blog.mozilla.org/creative/2013/06/27/design-a-general-contributor-badge-for-mozilla-qa/

   One and Done: Completed evaluation of Elance API as a way to help with task-matching. Does not look suitable. https://etherpad.mozilla.org/OHRaC7tQpl

   Upcoming Events

   Mozilla Summit, October 

   Everyone should now know which location they are going to - please check the PDF sent out by Mardi Douglass to make sure your information is correct

   We still have plans to try to do a lightweight community event before the Summit in both Brussels and Toronto

   Guillermo Lopez is leading the effort in Brussels

   Marcia and others will try to lead the effort in Toronto

   Looking for volunteers for Santa Clara interested in coordinating at that venue

   Looking for Site Hosts: https://wiki.mozilla.org/SummitPlanningAssembly/participantguide/nextsteps#Site_Hosts

   Other information related to the Summit from Summit Assembly:

   http://www.flickr.com/photos/97819515@N03/

   https://etherpad.mozilla.org/summitassembly-capture

   https://etherpad.mozilla.org/summitassembly-OpenSpaceCapture

   https://etherpad.mozilla.org/summitassembly-designingmomentum

   Grow Mozilla Meeting was held Thursday, June 27th at 10 AM - https://wiki.mozilla.org/Grow/Meeting_06_27_13

   Notes: https://etherpad.mozilla.org/grow-mozilla-notes-06-27-13

   Vidyo replay: https://vreplay.mozilla.com/replay/showRecordingExternal.html?key=0Jj5noyV2Y5uWfP

   Testdays (ashughes)

   Monday July 1st: Mixed Content test day

   https://quality.mozilla.org/2013/06/mixed-content-blocking-test-day-july-1s/

   No one in Mozilla QA has signed up to moderate - can we change that? https://etherpad.mozilla.org/testday-mixed-content

   Friday July 5th: Firefox 23 Beta test day

   https://quality.mozilla.org/2013/06/firefox-23-0-beta-2-test  day-july-5th/

   Unconfirmed Bug Triage every Tuesday

   https://quality.mozilla.org/2013/06/unconfirmed-bugs-triage-day-every-tuesday-5/

   Fixed Bug Triage every Monday

   https://quality.mozilla.org/2013/06/bug-verification-day-every-monday-4/

   Video Work

   No update this week

   QMO.next (Raymond)

    no update

   Community Members Onboarding

Automation Development (Henrik, Dave)

   General

   Projects

   MozTrap (Cameron)

   Community Members Onboarding 

Roundtable/Discussion Items

   [item here]

Notes, Takeaways and Action Items

   Today 

   Notes

   Action Items

   Last Meeting 

   Action Items