B2G/QA/Meetings/2016-01-06

// For 2016/01/06 - W01 Happy new year!!! xin nien kwai ler!

Overview

• Meeting Name: B2G QA Roundtable
• Meeting Time (Taipei-EU): Wednesdays @ 3:30pm - 5:45pm CST
• Meeting Time (Taipei-MV/SF): Wednesdays @ 5pm - 5:45pm PDT
• Vidyo Room: QA-B2G Vidyo Room
• Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=A97nLDtY921vuLGRB1jv5S6OKs
• Dial in: 1-800-707-2533, #92, #9245
• Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings

Status Highlights

• v2.6 work is started. Check with your lead/manager if you have no idea
• v2.5 CC: December 14th
• Monday : will be the start the OTA branch one week off Mozilla Central gecko branch.

Off Plan

PTO plan

• nhirata - Jan 11 - 12, 2016 : Ubiquity summit Google : 1127 Market Street, 94103
• Uber: Dec 30-Jan 10
• William: Jan. 9 ~ Jan. 14
• marcia: Jan 7
• Teri: Jan 5 ~ Jan 8

Upcoming Holidays

• U.S. : January 18
• Spain: January 6th

This Week - Decisions & Action Items

• [nhirata] to send out an e-mail about test plans need to revise.
  • For everyone, please feel free to join the discussion :)
• [nhirata] - Aries Dogfood Whitelisting was silently released yesterday; if your dogfood device did not receive an update please email me to troubleshoot the issue.
• [nhirata] - Flame T2M FOTA build currently being worked on, hopefully release early next week.
• [gchang] Move detailed information of 2.6 status to another link
  • https://goo.gl/kGwHxB

Previous action items

• [Done][Naoki] We'll discuss solutions for old bugs on Thursday 3:45
• [Done][No-Jun] https://wiki.mozilla.org/B2G/QA_Overview#Team_Members Please check this team members page, and it lists your QA components correctly. Also, please send me any feedbacks on the new wiki by EOW
• [Done][No-Jun] Can we list the links to all the presentations and etherpad during the workweek below?

They're all here: https://public.etherpad-mozilla.org/p/QASlidesMozlando

Agenda

• [continued] [nhirata] Test plan discussion from Orlando: shall we get started on legacy areas while we wait until 2.6 features are finalized?
  • [njpark] there are some we found here: https://wiki.mozilla.org/B2G/QA/Process and https://wiki.mozilla.org/FirefoxOS/FeatureTesting
  • New example will be created by nhirata this week.
• [marcia - info only] Work Week Feedback will be captured here: https://docs.google.com/document/d/1cxybC2WPopEZEJHnfdPT0MeEFcckjPt_duKHvoZgw7g/edit. Email sent today with more information.

2.6 Status

2.6 Feature (NEW)

• feature list (Feel free to check the list. Don't modify it before talking with Pallavi/Al)
  • https://docs.google.com/spreadsheets/d/11IgQ6ErDEfJFEkKAFU32wTN2wruwCPbzgU-VDKbVc-o/edit?pli=1#gid=0

• 2.6 overall status
  • https://goo.gl/MxUKjL

• Detailed information
  • https://goo.gl/kGwHxB

• Continuous integration program [Johan]
  • Gip to Gij: Deadline pushed to end of January. Still ongoing.
  • On-device testing running on taskcluster: Reactivated. Back on investigating issues in the runs.

2.6 Spark/Aries-KK Smoketests

• Tester: QAnalysts (KevinT)
  • Health Status: Yellow, 1 new blocker, no existing blockers

New:

• http://bugzil.la/1237460 Calendar events cannot start on the day they were created
  • Fails [6118]

Severe Issues:

• https://bugzil.la/1234694 Sound settings reset to default after OTA update.
• https://bugzil.la/1234877 Browse URL bar does not collapse when scrolling the web page, hiding the bottom of the web page.
• https://bugzil.la/1232857 Time remaining for battery is incorrect at times
• https://bugzil.la/1232607 " X " and " import all" button can't work.viewfinder and hide the notification, the viewfinder is frozen.
• https://bugzil.la/1205809 [System] After updating latest OTA , keyboard did not automatically show up on SIM Pin Screen
• https://bugzil.la/1217928 [New Homescreen] Homescreen App order is not preserved during OTA when moving to the New Home Screen
  • Resolved Fixed but still occurring.
• https://bugzil.la/1228513 Turn on wifi and when it is searching aps, turn on "Airplane mode", the wifi will be toggled on/off alternately
• https://bugzil.la/1226307 [music] Fast*seeking to the end of the song skips over a song (goes from track 1 directly to 3)
• https://bugzil.la/1220812 After unlocking the device from the lockscreen there is a long pause until reaching the home screen
• https://bugzil.la/1224138 [Browser]Hard to find the new window button in browser's window manager view.
  • Resolved Fixed. Will verify tomorrow. Landed today.
• https://bugzil.la/1221482 [Contacts]The upper part of Duplicates found page cannot be seen, and buttons at Add contact view are unable to work.
• https://bugzil.la/1229321 [NFC]When using "NFC" to deliver files, the DUT's interface turns black with the prompt "swipe to share".
• https://bugzil.la/1234783 "Learn more" doesn't work normally and

background of home screen will become black.

• https://bugzil.la/1235533 Voicemail, FDN and Call Forwarding is not

available if user open call settings via dialer.

• • We cannot reproduce this in the US
• https://bugzil.la/1235751 APP interface does not appear after taping home

button.

• https://bugzil.la/1235753 Enable passcode and enter Camera from unlock

screen, recieve and end a call when video is recording, the video is recording all the time.

• https://bugzil.la/1172163 [Aries][Homescreen][OTA] Uninstalled apps are added back to the homescreen during an OTA System Update
• https://bugzil.la/1233243 [Aries] Zooming performance is poor and unresponsive in Camera Preview
• https://bugzil.la/1234568 Websites pinned as a page are missing the preview in their icons

2.6 Aries Dogfood

• Health Status: Aries: Red, 2 new blockesr, no existing blockers
  • Blocked: https://bugzil.la/1224357 - Fix Aries dogfood for mozilla central.

New:

• http://bugzil.la/1237460 Calendar events cannot start on the day they were created
  • Fails [16520][6118]
• https://bugzil.la/1234877 Browse URL bar does not collapse when scrolling the web page, hiding the bottom of the web page.
  • This issue does not directly fail any of the test cases, but severely impacts the end user's Browser experience.

Dogfood blockers not occurring:

• https://bugzil.la/1217490 [Aries] After OTA my dogfood-latest channel is sometimes reset to nightly or dogfood
  • This bug is still in New status, but is not reproducing on the tested build.

Severe issues are same as above.

=== 2.6 Flame === (Read Only)

• Health Status: Red, 2 new blockers, no existing blockers

New:

• https://bugzil.la/1237197 Brick test is failing ** IOError: Connection to Marionette server is lost.
  • Already resolved fixed by backout, Will verify in the next smoketest.
• http://bugzil.la/1237460 Calendar events cannot start on the day they were created
  • Fails [6118]

Severe Issues:  

• https://bugzil.la/1172163 [Aries][Homescreen][OTA] Uninstalled apps are added back to the homescreen during an OTA System Update
• https://bugzil.la/1233243 [Aries] Zooming performance is poor and unresponsive in Camera Preview
• https://bugzil.la/1234568 Websites pinned as a page are missing the preview in their icons
• https://bugzil.la/1232857 Time remaining for battery is incorrect at times
• https://bugzil.la/1232607 " X " and " import all" button can't work
• https://bugzil.la/1229321 [NFC] When using "NFC" to deliver files, the DUT's interface turns black with the prompt "swipe to share"
• https://bugzil.la/1226307 [music] Fast*seeking to the end of the song skips over a song (goes from track 1 directly to 3)
• https://bugzil.la/1205809 [System] After updating latest OTA , keyboard did not automatically show up on SIM Pin Screen
• https://bugzil.la/1228513 Turn on wifi and when it is searching aps, turn on "Airplane mode", the wifi will be toggled on/off alternately
• https://bugzil.la/1220812 After unlocking the device from the lockscreen there is a long pause until reaching the home screen
• https://bugzil.la/1224138 [Browser]Hard to find the new window button in browser's window manager view
  • Currently resolved Fixed but this issue is still occurring on this build.
• https://bugzil.la/1221482 [Contacts]The upper part of Duplicates found page cannot be seen, and buttons at Add contact view are unable to work
• https://bugzil.la/1234783 "Learn more" doesn't work normally and background of home screen will become black.
• https://bugzil.la/1235533 Voicemail, FDN and Call Forwarding is not available if user open call settings via dialer
  • We are unable to reproduce this issue with our US T*Mobile and AT&T SIM cards
• https://bugzil.la/1235751 APP interface does not appear after taping home button
• https://bugzil.la/1235753 [Camera] Enable passcode and enter Camera from unlock screen, receive and end a call when video is recording, the video is recording all the time

Notes: Bugs 1234694 and 1217928 do occur when updating from the RC4 build up to the 11/30 build, but were not seen to occur when performing the final update from the 11/30 build to the tested build.

=== 2.6 Exploratory === (Read Only)

• Tester: QAnalysts (KevinT)
  • http://mzl.la/1mDjIBI (Does not include Smoke and Automation issues)

Community Updates [marcia-read only]

• Contributor Spotlight
  • https://quality.mozilla.org/2016/01/jamie-charlton-a-versatile-and-engaged-contributor/

• One and Done project
  • https://public.etherpad-mozilla.org/p/OneandDoneTasks
  • Tasks on Line 22-30 of https://public.etherpad-mozilla.org/p/OneandDoneTasks are all assigned in the tool
  • We still need owners for the remaining tasks
• There is a request to add some B2G Droid tasks in One and Done
  • One and Done Hackathon meeting happened in Orlando - See Line 113 of https://public.etherpad-mozilla.org/p/QACommunityOrlandoWW

• Pin the Web Tiger Testing Team (Marko, Gaby and Yunito)
  • Awaiting updates on the feature.

• Firefox OS Participation Planning [marcia]
  • Weekly Meetings are held Thursdays at 10 AM PST.
  • Notes from the meeting: https://participation.etherpad.mozilla.org/fxosparismeeting
  • Participation Hub launched. See it live at https://firefoxos.mozilla.community/ and file any issues in Github.
• There is an upcoming sprint planned in London driven by the Participation Team, but a smaller group of people is invited.

• Porting Discussion
  • Notes from this week's discussion - https://docs.google.com/a/mozilla.com/document/d/1m-YpwyZE2BSOjLtm0hoFzwG-s3gCY3FszUZgqY5MiG0/edit?usp=sharing

• Work Week Community Discussion (2 Sessions Held)
  • Work Week Notes are here: https://public.etherpad-mozilla.org/p/QACommunityOrlandoWW

• Q1 Goals 2016
  • Coordinate presence at FOSDEM
  • Coordinate and assist Pin the Web Tiger Team

• Upcoming Events
  • Leadership Summit in Singapore - January 22
  • FOSDEM - January 30 and 31, Brussels, BE
  • Sessions have been selected for the Dev Room: https://fosdem.org/2016/schedule/track/mozilla/
    • Proposed QA Sessions
      • Automation Workshop - Martijn and Johan
• Joint l10n/QA events
  • Working on identifying some possible events and getting funding

Testing information (Read Only)

• View source is in: Dev option and enable view source, hold the power button and the menu will appear there.
• Vaani voice sampler, "MozSpeech" is in the dogfood; dogfood being blocked.
• FOTA white listing for IMEI not implemented yet
• Add-on from Marketplace : Search for :debug and use addons
• Taskcluster: use 0.99.22 image
• v2.5 Blockers: http://charts.mozilla.org/fxos/blockers.html#project=1.4,2.0,2.1,2.2,2.5
  • 179 blockers (update: 9/30)
• Newcomer QA Page: https://quality.mozilla.org/teams/firefox-os-qa/
• Daily Bulletin board (Feel free to post news here): https://wiki.mozilla.org/B2G/QA/Daily_Bulletin

• l10n Test Case Update [delphine] - Read only Update
  • https://docs.google.com/spreadsheets/d/19JrmYC47fBaaFu0hRL_yBwyuuCI1A-BOag8zVSCiuAo/edit#gid=1852340209
  • Latest diff and updates
    • New strings for this week -> https://pastebin.mozilla.org/8851087 (updated 11/4))
    • Updates for this week
      • New files:

https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/shared/firefox_sync/firefox_sync.properties https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/distros/b2gdroid/apps/ftu/ftu-droid.properties https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/distros/b2gdroid/apps/ftu/manifest.properties

- Firefox Sync strings will likely be covered by automation, but needs to be confirmed as it seems not everything is covered

• For flame updating, please use v18D_nightly_v4 as base build, update to the latest dogfood and then update to the newest build (nightly-latest). For now, you cannot update from any random build.

Reference Links

• Testrun Schedule: http://bit.ly/1jQzW79
• Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
• B2G dashboard: http://charts.mozilla.org/
• QA Roundtable Template: https://etherpad.mozilla.org/b2g-qa-roundtable-template (Clone this)
• Performance result: http://raptor.mozilla.org
• Mozlando Work Week
  • • Notes from various Work Week Sessions: https://public.etherpad-mozilla.org/p/QACommunityOrlandoWW
    • Flickr Pictures here: https://www.flickr.com/photos/marciamozilla/albums/72157661510078229