B2G/QA/Meetings/2014-11-12

Overview

• Meeting Name: B2G QA Roundtable
• Meeting Time: Wednesdays @ 5pm - 5:45pm
• Vidyo Room: QA Vidyo Room
• Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
• Dial in: 1-800-707-25331
• Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
• Testrun Schedule: http://bit.ly/1jQzW79
• Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
• B2G dashboard: http://charts.mozilla.org/

Status Highlights

• • Q4 Goals B2G (Draft)

2.1 Release Update

• 11/14 - QC CS
• 11/21 - 2.1 CC
• Are we hitting our CC acceptance criteria? https://wiki.mozilla.org/Release_Management/FirefoxOS/Release_Milestones#Code_Complete_Criteria
• Transitioning 2.1 work to devices QA team - 11/24

Features (Organized by Functional Team)

Overall Concerns

Remaining Tasks

Communications

• Tester: Johan, Eric, Shing (cost control)
• Cost Control
  • Status: Green, no blocker
• SMS, Contacts
  • Status Green, no blockers
• Dialer
  • Status: Yellow
  • 2 blockers caught last week
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1095503 in-moztrap added to catch this issue during the test run. Main dev of the feature is on it.
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1093862 Bad edge case, patch WIP

Media

• Tester: No-jun, Alison
• Ringtone: Green, no blockers
• Non-Ringtone: Yellow, 4 blockers
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1082938 => ongoing, devs have issue reproducing the bug
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1096520 => New issue
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1093797 => Fix is review+ ed
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1080912 => this is dependent on pvtbuild bug

Multimedia Platform

• Tester: Edward Chen
• Health: No new feature in v2.1

Productivity

• Tester: Edward Chen, Teri Wen
• Status: Green, no blocker

Systems Front End

• Tester: Marcia, Parul
• Status: Reddish
  • 2.1 Blockers: 8 -> https://wiki.mozilla.org/FirefoxOS/systemsfe/releasetracking#FxOS-Systems_Frontend_Blocker_2.1_Dashboard
  • Some Window Manager and SHB bugs
    • https://bugzil.la/1081365 [Notifications] The notification tray can get stuck partially open when quickly opening after transitioning between apps with edge gesture
    • https://bugzil.la/1088157 [Window Management] The user cannot return home in card view
    • https://bugzil.la/1088224 [Window Management] When the user taps on the new voicemail notification nothing happens
    • https://bugzil.la/1090152 Status bar is empty on lockscreen on full screen apps
    • https://bugzil.la/1090859 Race condition on startup with new Gecko, PIN code not asked on second SIM card with 2 SIMs
    • https://bugzil.la/1092391 [Clock][Lockscreen] Alarm pop-up appears very high on the lock screen after booting if phone is turned off at the time of the alarm.
    • https://bugzil.la/1095142 [SHB] Dialer screen does not fully cover lockscreen
    • https://bugzil.la/1096770 [SHB] Opening new tab in browser makes SHB overlap app window
  • 2.0 Blockers: 3 -> https://wiki.mozilla.org/FirefoxOS/systemsfe/releasetracking#FxOS-Systems_Frontend_Blocker_2.0_Dashboard
    • https://bugzil.la/1051083 [OTA update] Automatic OTA update not working
    • https://bugzil.la/1059650 [Browser]Back button stops working after clicking '+' icon multiple times
    • https://bugzil.la/1077595 [Window Management] After downloading pdf files then deleting them, the download icon in the status bar continues
  • 2.1 Nominations: 1 - > https://wiki.mozilla.org/FirefoxOS/systemsfe/releasetracking#FxOS-Systems_Frontend_Nomination_2.1_Dashboard

https://bugzil.la/1096704 [Window Management] Swiping up while edge gesturing causes the user to be stuck on a blank page

Systems Platform

• Tester: Gerry Chang
• Status: Green

Metrics Testing =

• Tester: Shing Lyu
• Status: Green, no blocker

Telephony/Networking

• Tester: Alison Shiue, Eric Chang
• NFC: Green, no blockers
• RIL: Green, no blockers

Devices

• Tester: Alison Shiue
• Bluetooth: Green, no blockers
• Storage: Yellow, 1 blocker: https://bugzilla.mozilla.org/show_bug.cgi?id=1073335 (full flash issue, blocked by bug 1085759)

Graphics

• Tester: No-jun park
• Status: Yellow
• the blocking bug number has dropped to 4, all bugs are currently being looked after
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1085593
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1042291
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1088452
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1091777

2.1 Smoketests

• Tester: Peter Bylenga
• Status: Green (5+ days passing)
• Only 2 full flash blockers open which need to be verified once we have v188 on pvt
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1092002
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1090813

2.2 Smoketests

• Tester: Peter Bylenga
• Status: Yellow
• 1 shallow flash blocker, currently Resolved Fixed will verify tomorrow
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1096603
• 3 full flash blockers which need to be verified once we have v188 on pvt
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1091659 (was 2.2 only)
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1092002
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1090813

Localization

• Tester: Delphine
• Status: Yellow
  • 1 late-l10n bug still needs verification
    • WEB RTC: https://bugzilla.mozilla.org/show_bug.cgi?id=1079543
  • 1 bug under investigation, because not finding strings that need to be verified. Not sure if it's a regression or feature change yet, pp on it.
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1057188

Performance

• Tester: Geo Mealer
• Status: YELLOW
  • Acceptance criteria page: https://wiki.mozilla.org/FirefoxOS/Performance/Release_Acceptance

Stability

• Tester: Walter Chen, Paul Yang
  • Status: RED
    • close to 70 hours uptime before b2g process gets killed

Exploratory

• Status: Red
  • team focused on Loop bugs this week
  • Switched focus from Loop to 3rd Party apps
  • Blockers filed during exploratory found mostly in Browser, Loop, And Window Management.
  • 12 Blockers currently open from QAnalyst exploratory:
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1081577
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1087490
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1088157
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1088224
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1093797
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1093862
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1095062
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1095617
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1095653
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1095716
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1095744
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1095767
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1096520

Agenda

• [Tony] first draft cut of QA ownership of 2.2 features. See spreadsheet and goto QA column N. I will discuss with individuals to confirm final ownership by next week.
  • https://docs.google.com/a/mozilla.com/spreadsheets/d/1_BothhkqSQLzUvzSZY8P8RFYgphLb_l0JYH32apoJmQ/edit#gid=623215577
• [marcia] bajaj asked if QA tests Daylight Savings Time or switching time zones - based on user feedback from clee's email https://useradvocacy.mozilla.org/reports/FirefoxOS/November2014/ this was one item that was called out. This was on a production phone that had been OTA'd.
  • bug was filed https://bugzil.la/1093430 OTA after changeover from Daylight Savings Time to Standard Time sets date back to Jan 6, 1970
    • Kyle Huey also filed this bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1097915
    • Here is the specific link: https://input.mozilla.org/en-US/dashboard/response/4679254
• [marcia] Do we need to get Nexus 5 devices for the next release - ref Android L thread
• [pragmatic] QMO blog post on Bug Bash statistics https://quality.mozilla.org/2014/11/results-of-the-firefox-os-v2-1-bug-bash/
• [pragmatic] Please sign into https://badges.mozilla.org/ using the same email address as your Bugzilla email and add a nice photo to your profile.
• [Tony] 2nd draft of portland Workweek topics: https://etherpad.mozilla.org/portland-qa-workweek
• [PBylenga] QAnalysts' Archive of builds, deleted all but 2.0, 2.1, 2.2, had to keep mozilla-inbound as it's needed for regression window work. Have 292 G left out of 3 T. We have not kept Full Flash assets in the past, should we?

This Week - Decisions & Action Items

• some bugs above that need verification after v188 full flash bug is resolved (3 smoke, 1 sdcard, 1 camera)
• [Kevin] in-moztrap? nom bug 1097915 for a testcase to add for 2.2.