QA/StaffMeetings/QA-Staff-09-04-2013

Wed September 4, 2013

# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core 
#
# Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
# Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)
#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://irc.mozilla.org:6697/#qa

QA Org Items

   QA Show and Tell

   This week: Juan - Firefox Metro

   https://wiki.mozilla.org/QA/Show-and-Tell#Schedule

   Next week: Edwin Wong - How to get rich quick or TBD! 

   New Hires & Interviews 

   Upcoming Events/Conferences 

   Firefox OS - Oslo Work Week - Sept 9-13 - https://wiki.mozilla.org/FxOS/Oslo_2013-09-06

   Notices

Travel / PTO

   [rbillings] PTO Sept 2-13 

   [tony] - PTO sept 5- 10 

   [tony] - in Taiwan, Sept 23-27

   [nhirata, jhammink, jsmith, zac] - Sep 7 to 14 Oslo work week

   [krupa] - working from India Sep 5-17th

   [mwobensmith] PTO 9/19-9/20

   [dclarke] PTO 9/25-10/2

   [aaron] - PTO Sept 5

   [kbrosnan] - PDX 9 -13th, Toronto 16 - 20th

   [nhirata] PTO .. Sept 20th?

   [camd] - Paternity leave watch.  She could pop at any minute!  :)

QA Team Updates

Desktop (Juan)

   Firefox 

    24, 25, 26 in route to shipping in two weeks

   Metro up in the air for shipping as a preview in 26. More likely 27.

   ESR (mwobensmith) 

    Ongoing bug verification

   Stability (marcia/twalker) 

   https://wiki.mozilla.org/Platform/2013-09-03#Stability_.28kairo.2Fbsmedberg.29 

   Automation (ashughes)

   Security (mwobensmith)

   CSP

   IPv6 SSL exception handling - bug #633001

   Community 

Mobile (Tony)

   Firefox for Android (Kevin/Aaron) 

   Redesigning/updating the Robocop API

   https://mail.mozilla.org/pipermail/mobile-firefox-dev/2013-September/000201.html

   https://mail.mozilla.org/pipermail/mobile-firefox-dev/2013-September/000203.html

   evaluating bug 860599 - new way to interface with libstagefright/h264 decoder

   may get uplifted all the way to 23 release

   WebRTC testing

   https://wiki.mozilla.org/QA/Fennec/WebRTC#WebRTC_Peer_to_Peer_Connection_Testing

   beta 8 has been delayed due to outstanding bugs

   bug 896350 - download notifications don't open the file when selected

   going to punt on it

   bug 848764 comment 20 - crashes on some devices due to on demand decompression

   Backed feature out of beta

   bug 860599 - noted above

   Stability (kbrosnan) 

   Efforts to help out with reproducing 24+ WebRTC crash bug 902431 on Nexus devices

   B2G (Geo/jhammink) 

   Device allocation: 

   Buri = 1.2 primary testing

   Helix = WVGA feature testing (we have 2)

   ZTE v970 = CDMA testing (Taiwan owned)

   Nexus 4 = JB features like NFC, BT  (we have 10, TW has some)

   Flatfish Tablet = no word yet

   Unagi = being discontinued for 1.2 and on

    Stability (nhirata)

   see b2g-meeting-notes https://etherpad.mozilla.org/b2g-meeting-notes

   concern about leo stability check for release, I will recheck with their build

   devices:

   [nhirata] helix gaia releng build seeing some issues which aren't seen on self build; investigating

   [nhirata] nexus-4 self-build successful; only using for JB features

   [nhirata] gave presentations to Qanalydocs

   http://people.mozilla.com/~nhirata/Presentation/

   exploratory testing and logcat

   [nhirata] Browser : 

   templates for search engines are needed; 1.1/1.0.1 had google search hard coded.

   customization is going to be ugly without this...

   scrolling/urlbar appear/disappear at risk for landing in koi

   [nhirata] CDMA Testing only in Taipei

   [nhirata] investigating BT testing in US to help Taipei team

   [tchung] productivity: notification bugs are resolved but not yet landed.  ETA friday.  testcases to be completed before then

   [jsmith] Media Recording & Web Notification API testing in progress

   [jsmith&jhammink] Prepping Oslo WW Presentation for QA & Ateam

   [jsmith] Problems with phone failing to boot up patches - 3 backouts last week from this

   [jsmith] Still blocked on 1.2 OTA/FOTA update testing

   [jsmith] Critical 1.2 Graphics Issues are making progress

   [jsmith] Concern over device info in UA might cause significant risk to 1.1 release - gathering data to confirm

   [jammink] doing comprehensive testcase cleanup to prepare for across-the-board-testrun during Oslo WW next week.  Please help!  sign up here: http://bit.ly/19WNiK6 --> Mozilla QA Breakdown page

   [jammink] reviewing comms, system front-end, productivity test cases

   [marcia] Smoketests

   Continue to perform smoketests on Leo 1.1 and Buri 1.2

   No more sanity checks on unagi 1.1

   Platform

   Martijn's b2g.json/mochitest work:

   bug  907995  - b2g.json cleanup and  reorder, part 2, removes the xbl/xul test files from the exclude list,  checked in

   Bug 909012 - Add 'remove' option to pushPermissions, checked in

   Bug 908439 - rewriting some tests to pushPrefEnv/pushPermissions to get them working i*n b2g, checked in

   bug 909043, bug 909036, bug 908912 all checked in

   bug 909452, geolocation_common.js needs rewrite to pushPrefEnv, checked in

   bug 766687 - specialpowers pushprefenv fails while trying to get the originalvalue if the pref doesn't exist,  checked in

   [dclarke] has Device Storage compatibility test suite under review; also working on dynamic signing certificate loading for app testing and camera mochitests.

   [dclarke] re-running the camera mochitests that wrote in q2 and get them checked in. (camera was unstable previously)

   [dclarke] apps signing mochitests now have a specialpowers api for adding / removing certificates (needs a bit more review before checkin ) 

   geo was in Perf work week last week, is currently refactoring compatibility test app to get rid of closure/handler leaks and global namespace pollution, alarms tests up next

   Community Members Onboarding

Services (Edwin)

   Identity

   browserid train-2013.08.28 in testing

   Mozilla IdP to be re-deployed tomorrow at 2pm (more security fixes)

   "new" Sync

    M1 testing of the Firefox Accounts (FxA for the IdP/Auth), the  Firefox Account Bridge (FAB), and the Scrypt-Helper are all in progress  right now. This includes functional testing of installs from github and testing our first ELM nightly build...

    REFs: 

    Test Plan: https://wiki.mozilla.org/QA/Services/SyncTestPlanV1

    https://github.com/mozilla/picl-idp  

    https://github.com/mozilla/scrypt-helper

    https://github.com/mozilla/restmail.net

    https://github.com/mozilla/firefox-account-bridge

    https://github.com/mozilla/picl-gherkin

    M1/V1 Meta bugs and dependency trees are now available in Bugzilla for the entire project: 

    Mobile (Android) Tree/Meta: https://bugzilla.mozilla.org/showdependencytree.cgi?id=799726&hide_resolved=0

    Desktop Tree/Meta: https://bugzilla.mozilla.org/showdependencytree.cgi?id=905997&hide_resolved=0

    Server-side Tree/Meta: https://bugzilla.mozilla.org/showdependencytree.cgi?id=907475&hide_resolved=0

    FF Accounts Meta bug: https://bugzilla.mozilla.org/show_bug.cgi?id=907494

    Sync Meta bug: https://bugzilla.mozilla.org/show_bug.cgi?id=907479 

    Across client/server Tree/Meta: https://bugzilla.mozilla.org/showdependencytree.cgi?id=895518&hide_resolved=0

    User Stories Tree/Meta: https://bugzilla.mozilla.org/showdependencytree.cgi?id=909322&hide_resolved=0

   Services

   Ongoing testing of SimplePush using Loads

   Loads/Loads.js work is coming along nicely for all of "new" Sync's load test needs...

   Campaign Manager working its way up to full scale testing (1M simultaneous connections)

Web (Stephen)

   Affiliates 

    Redesign potentially coming in Q4 2013/Q1 2014

   B2G/Gaia testing:

   Now have two (2) Hamachi devices

   10 more requested for our automation infrastructure

   Engineering build requested: https://bugzilla.mozilla.org/show_bug.cgi?id=912617

   Caught a clock failure, worked with devs:

   https://github.com/mozilla/gaia-ui-tests/pull/1300

   Caught the Activities bug quickly in yesterday's build bug 912065

   Caught the Email test failures but did not have time to file it before Manual team. Wish we could review things faster and make the Automation assist the Manual team.

   Coverage restored for Youtube/HTML5 test thanks to our contributor Sasha

   More coverage restored as crashes have been resolved: Bugs 902927, 902878, 900012

   Really want Plivo account, it will device coverage that nobody else can automate

   Preparing presentation on Gaia-ui-tests for Oslo work week

   Bouncer 

    No updates

   Engagement Projects 

   FirefoxFlicks - code complete by Sept. 6 for results/winner announcements on the 12th.

   Firefox Health Report

   No updates

   Firefox Marketplace 

    Weekly release went live 09/03

   Mozilla.com 

    shipped weekly release this week

   Mozillians 

   Mozillians-dev Elasticsearch indexing often fails on dev - https://bugzilla.mozilla.org/show_bug.cgi?id=906840

   Burning down the new feature list that is slated to land in time for Summit 2013

   https://mozilla.kanbanery.com/projects/23282/board/

   Currently bugs that need to be verified - https://bugzilla.mozilla.org/buglist.cgi?cmdtype=runnamed&namedcmd=phonebook%20%3A%3A%20resolved&list_id=7821330

   MDN 

    we'll soon be switching on automation for a pending, already-staged, redesign of MDN

   Socorro 

   Weekly meeting notes - https://wiki.mozilla.org/Breakpad/Status_meetings/2013-September-04

    Milestone 57 shipped last week - collectors went down for 20 minutes

   https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&target_milestone=58&product=Socorro&list_id=7820888

   https://etherpad.mozilla.org/socorro-release-57-postmortem

   Milestone 58 scheduled to ship tomorrow

   currently blocked by crash-stats.allizom.org returns a 500 error: BadStatusCodeError - https://bugzilla.mozilla.org/show_bug.cgi?id=912248

   Bugs slated for release - https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&target_milestone=58&product=Socorro&list_id=7820888

   SUMO 

   continuing to work with the Dev team on their Persona support/implementation, both through manual testing + automation

   Community Members Onboarding

    Nice write up from Rebecca on Ana Hristova!

   https://quality.mozilla.org/2013/08/contributor-spotlight-ana-hristova/

Community (Marcia)

   Projects 

    [Open Badges] If you haven't yet voted for your favorite General QA Participation Badge, do it today! http://www.surveymonkey.com/s/H5M95ZN

   Community contributed designs are showcased at  https://quality.mozilla.org/2013/08/vote-for-your-favorite-general-qa-participation-badge-design/

   126 votes so far. Voting will close on Sunday September 15 at 5 PM PST.

    Grow Mozilla Meeting - Tomorrow at 10 AM Pacific

   https://wiki.mozilla.org/Grow/Meeting_09_05_13

   Upcoming Events 

   Mozilla Summit - Brussels/Toronto/Santa Clara - October 4 -7

   https://wiki.mozilla.org/Summit2013

   Everyone should be registered and have booked their travel

   Volunteers needed on Thursday to help at all three Sites - if you are local or coming in early to any of the sites, please let Marcia know

   https://wiki.mozilla.org/Summit2013/Experiences has other volunteer opportunities

    https://etherpad.mozilla.org/mobile-2013-09-11 can I ask would someone attend from the B2G and the mobile team as would look better for our live event ask satdav for details or see michelle Luna if in sf office or roland in vancouver 

   Testdays (ashughes)

   Firefox Gaming Testday this Friday: https://quality.mozilla.org/2013/08/firefox-gaming-testday-on-september-the-6th-2013/ 

   Video Work

   No update this week

   QMO.next (Raymond)

   working with Craig on login security bug https://bugzilla.mozilla.org/show_bug.cgi?id=900563

   Community Members Onboarding

Automation Development (Henrik, Dave, Rob)

   General

   Automation Development report – week 35 2013:

   http://www.hskupin.info/2013/09/03/automation-development-report-week-35-2013/

   How to Run the Gaia-UI Endurance Tests

   https://woodrobert.wordpress.com/2013/09/03/how-to-run-the-gaia-ui-endurance-tests/

   Releases

   Mozdownload 1.9: http://www.hskupin.info/2013/08/29/mozdownload-1-9-released/

   mozmill-automation packages for mozmill 1.5.22 and 2.0rc5 on pypi for testing:

   https://pypi.python.org/pypi/mozmill-automation

   Projects

   [henrik] mozmill-ci

   Ubuntu 12.10 VMs have been replaced with Ubuntu 13.04

   Windows 8.1 nodes are online and in use by production

   Jenkins has been upgraded to latest LTS on production (Java related memory issues seem to be gone!)

   Added first batch of 10 locales for testing beta and release candidate builds

   [dave] Gaia

   Created a command line interface tool for Gaia:

   https://github.com/davehunt/gcli

   Gaia-UI Endurance tests are now located in the main Mozilla /gaia repository

   Endurance test results can be found in Datazilla:

   https://datazilla.mozilla.org/b2g/

   Any questions feel free to contact rwood

   MozTrap (Cameron)

   Community Members Onboarding 

Roundtable/Discussion Items

   can we possible start doing this weekly on air mozilla to contributors and staff only we have started the qa desktop and it was a good sucess last week i am sure part from the glitch - satdav

   [aaron]Confidential data not for public broadcasting is all to frequent; this would be too problematic I think 

   [geo] Does it have to be that way? Could split the meeting. This is technically supposed to be public-accessible, and it would be nice to be able to invite/include the community.

   [marcia] I thought the air mozilla broadcasts were only set up in 10 Forward?

   [juanb] Etherpad connection problems: who we gonna call?

   [marcia] For information, results of QA lab move meeting: https://etherpad.mozilla.org/QA-Lab-Move-Info

   There may be extra Mac minis and a Mac pro available for the taking

   If you are planning to put machines in the QA Lab we will need to know

   [marcia] You might want to check your Mozilla PB entry as my phone numbers changed on their own (both numbers defaulted to my B2G number)

Notes, Takeaways and Action Items

   Today 

   Notes

   Action Items

    Geo -- figure out how to record/broadcast meeting. Air Mozilla?

   Last Meeting 

   Action Items