B2G/QA/Meetings/2015-01-21
From MozillaWiki
Contents
Overview
- Meeting Name: B2G QA Roundtable
- Meeting Time: Wednesdays @ 5pm - 5:45pm PDT
- Vidyo Room: QA Vidyo Room
- Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=0HHQN7SSNIkAxuJq04fq7uZk6J8
- Dial in: 1-800-707-25331
- Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
- Testrun Schedule: http://bit.ly/1jQzW79
- Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
- B2G dashboard: http://charts.mozilla.org/
- QA Roundtable Template: https://etherpad.mozilla.org/b2g-qa-roundtable-template (Clone this)
Status Highlights
[eric] Vidyo Room: QA Vidyo Room is gone, which one you guys are in right now? https://v.mozilla.com/flex.html?roomdirect.html&key=0HHQN7SSNIkAxuJq04fq7uZk6J8
2.1 Overall blockers
2.2 Release Update
2.2 Feature work
- Privacy (Gerry)
- Health: Red
- Test case coverage:
- Details: 3 blockers
- No dedicated & specific owner for this feature.
- https://bugzilla.mozilla.org/show_bug.cgi?id=1111992
- https://bugzilla.mozilla.org/show_bug.cgi?id=1118155
- https://bugzilla.mozilla.org/show_bug.cgi?id=1121232
- Bhavana to help get assignee here from DT
- Cut, Copy, and Paste (Gerry, Edward, Teri, Eric)
- Health: Green
- Test case coverage: 80%
- Details: WIP, bug bash on copy/paste this Friday in Taipei
- NFC (Alison)
- Health: Green
- Test case coverage: 100%
- Details: WIP
- Rocketbar refactor & search suggestion based on provider (Hermes)
- Health: Green
- Test case coverage: 90%
- Details: WIP, (De-scoped: Bug 1053747 Expand/collapse Rocketbar on home screen)
- App-grouping (Hermes)
- Health: Green
- Test case coverage: 95%
- Details: WIP
- Task Manager (Hermes)
- Health: Green
- Test case coverage: 95%
- Details: WIP
- L-porting (Hermes)
- Health: RED
- Details:
- L build still failed, so use build with workaround (Bug 1119980)
- A initial test: Most of components work (e.g.: WIFI, RIL, Camera, Video, and BT) Will perform more tests.
- CAF bugs (Eric)
- Health: Yellow
- Test case coverage: 66%
- Details: bug 1020757 no FDN sim, checked with TEF, they don't have that type of SIM either, I will do regression for this bug; bug 1016807: stk icon, TEF implements this, but they suggest CAF maybe can help.. will check
[Mike lee]
- TCL bugs (Alison, Eric)
- Health: Green
- Test case coverage: 100%
- Details:
- [bugs related to feature <bug 1091544>]
- one blocker: https://bugzilla.mozilla.org/show_bug.cgi?id=1123567
- one nominate: https://bugzilla.mozilla.org/show_bug.cgi?id=1123602
- bug 1096815 - TEF will test this(FDN).
- Bluetooth (Eric, Teri)
- Health: Green
- Test case coverage: 100% Regression
- Details: Some problem with building, but manually change binary component is okay, will wait for stable & official build from pvt.
- Metrics (Shing)
- Health: Yellow
- Test case coverage:50%
- Details: 1 Backed out
- follow up with Kevin Hu
- 256M RAM memory optimization for WFVGA, 5MP. (Teri)
- Health: Green?
- Test case coverage: Cancelled
- Details: Code backed out due to bug 1122119 white screen
https://bugzilla.mozilla.org/show_bug.cgi?id=1082290 ?
- Multicore performance (Edward)
- Health: Yellow
- Test case coverage:
- Details:
- So far we have not a build support.
- Study and setup new performance testing environment. https://github.com/mozilla-b2g/raptor (https://www.npmjs.com/package/gaia-raptor)
- Better performance on Multicore (App startup time for core apps is comparable to Android
Stability MTBF
- Tester: Alison
- Health Status:
- Details: Studying and setting up on flame-kk, not ready for report yet. Will try to run regularly after FL.
2.1 Smoketests
- Tester:
- Health Status:
- Details:
2.2 Smoketests
- Tester: Eric
- Health Status: Green
- Details: 5 Greens in a row; bug there is a bug 1122119 white screen issue.. another OTA issue from Peter; Gerry and I will follow 1124451 up
3.0 Smoketests
- Tester: Peter Bylenga
- Health Status: Red
- Details: 2 blockers, 2 severe issues
- https://bugzil.la/1124248 [Bluetooth] Bluetooth can not be enabled
- https://bugzil.la/1124139 Camera preview not visible
- https://bugzil.la/1122503 Flame: changing timezone bricks the device
- https://bugzil.la/1122119 [System] Device randomly white-screens, becomes unresponsive, and spams computer (if connected) with 6 device folders
Exploratory
- Tester: Peter Bylenga
- Health Status: Red
- Details: 31 bugs found
Agenda
- [eric] for feature-b2g 2.2+ but not in the agreed list
- for example: bug https://bugzil.la/825318 - email
- Before we will ask approval from Kevin & Thomas, if yes, then 2.2+.
- if no, then we do not test on those bugs, set 2.2-
- or test with minimum effort
- feature-b2g:2.2+ OPEN: http://mzl.la/14wfbr5
- feature-b2g:2.2+ RESOLVED FIXED : http://mzl.la/14wfDpl
- [pragmatic] QA Vidyo Room linked to Clint Talbert's LDAP account now https://v.mozilla.com/flex.html?roomdirect.html&key=0HHQN7SSNIkAxuJq04fq7uZk6J8
- [bajaj] Need owners for these areas for b2g v3.0 (master). Please write your names against the functional area if you are the owner:
Productivity - Teri, Edward
Media - No-Jun
System Front End - Naoki, Parul, Hermes
Communications - Johan, Eric
Performance - Geo
Telephony/Networking/Connectivity - Eric, Alison
System Platform - Gerry, Hermes
Multimedia Platform
Bluetooth - teri (Alison and Eric used to own this, we are transferring that to teri
MTP/UMS - Alison
Metrics
Stability - Naoki ( non MTBF / Crashstats )
Misc/HW/Gonk - Naoki, Hermes
- [bajaj] Organize a session on backing out commits that break master (smoketest blockers) from build sheriff (e.g. RyanVM)
Naoki
Peter
[Brian] Do we need to apply for all branches? [yes] Good suggestion to control the code quality.
Lets focus on 2.2 and 3.0 for now to start with
Brian to discuss with Josh and members to come out the plan or actions
- [pragmatic] Bug Bash on Tue Jan 27 in 5 locations: Taipei, Paris, Mountain View, San Francisco, Kirkland (3 pm to 5 pm PST for MTV/SFO/Kirk) https://etherpad.mozilla.org/b2g-qa-bug-bash-2015-01-27 https://quality.mozilla.org/event/bug-bash-on-firefox-os-v2-2/
- Build to test: b2g v2.2
- Topics to test: App Grouping, Task Manager, Privacy Panel, Everything.me re-factor, Calendar re-factor, Arabic RTL, L-porting (?), App permissions, Loop, Smart Collections