B2G/QA/Meetings/2014-09-24

Overview

• Meeting Name: B2G QA Roundtable
• Meeting Time: Wednesdays @ 5pm - 5:45pm
• Vidyo Room: QA Vidyo Room
• Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
• Dial in: 1-800-707-25331
• Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
• Testrun Schedule: http://bit.ly/1jQzW79
• Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
• B2G dashboard: http://charts.mozilla.org/

Status Highlights

• Welcome Johan Lorenzo! Paris Office
• KK image is now public: https://developer.mozilla.org/en-US/Firefox_OS/Developer_phone_guide/Flame

2.1 Release Update

• 2.1 FC - Oct 10th
  • (also a national holiday in Taiwan)

Notes

• 2.1 Health Dashboard - https://wiki.mozilla.org/B2G/QA/2.1
• Each team should identify QA call outs & any blockers on a per team basis
• Provide a FC health assessment against the following criteria:
  • Have all features gone through a functional test run?
  • Did any risky feature areas get exploratory testing?
  • Were smoketests around your area green for 5+ days?
  • Did each outstanding FC signoff blocker get fixed?

Features (Organized by Functional Team)

Communications

• Health: Green
  • Usage App
    • Blocker: 1 https://bugzilla.mozilla.org/show_bug.cgi?id=1064491
    • Unsolved bugs: 1 https://bugzilla.mozilla.org/show_bug.cgi?id=1068454
    • Regression on startup: Bug 1072621 - [Cost Control] ~250ms regression in launch latency for 2.1 on 9/22

Media

• Health: Ringtones: GREEN
  • Blocker: 0
  • Unsolved bugs: 4
• Health: Other than Ringtones: GREEN
  • Blocker: 3
  • Nomination for 2.1: 1
  • Performance
    • Camera startup regression. compared logcat from 2.1 to master, about ~500ms delay. Datazilla has lots of noise in the graphs (https://bugzilla.mozilla.org/show_bug.cgi?id=1067865)
      • partner override values: https://www.codeaurora.org/cgit/quic/lf/b2g/build/tree/gaia_settings/distribution

Multimedia Platform

• Health: No update

Productivity

• Health: Green
  • Blocker: 8 https://wiki.mozilla.org/FirefoxOS/productivity/releasetracking#Productivity_Blocker_2.1_Dashboard
  • Non resolved bugs: (4)

http://tinyurl.com/kcavttn

Systems Front End

• Health: YELLOWish
  • 7 2.1 Blockers: https://wiki.mozilla.org/FirefoxOS/systemsfe/releasetracking#FxOS-Systems_Frontend_Blocker_2.1_Dashboard
  • Still one 2.0 blocker-> https://bugzilla.mozilla.org/show_bug.cgi?id=1071210
  • Still waiting on Removing Browser patch to land -> https://bugzilla.mozilla.org/show_bug.cgi?id=1043959
  • Feature work remaining - currently in backlog
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1054778
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1062326
  • Rocketbar and System Browser are in the midst of an exploratory test run
• Soft home button, 2 blockers waiting for approval for 2.1
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1071388
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1072231

Systems Platform

• Health: GREEN
  • no blocker
  • Non resolved bugs: 1
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1069132

Metrics Testing =

• Health: Yellow
  • Un-resolved bugs: 9

Telephony/Networking

• Health: RIL: GREEN
• Health: NFC: GREEN
  • Blocker: 2
  • Unsolved bugs: 10

Devices

• Health: YELLOW
  • Blocker: 1
  • Unsolved bugs: 8
  • note: Flame JB -> BlueZ(stable); Flame+ KK -> Bluedroid (new, buggy)
  • Bluetooth PTS certification (Bluedroid)
    • Couple blockers
    • Blockers https://bugzilla.mozilla.org/buglist.cgi?quicksearch=kitkat%20bluedroid&list_id=11238529
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1063066 - Smoketest Blocker
  • Need to be fixed by vendor
    • https://bugzilla.mozilla.org/buglist.cgi?quicksearch=kitkat%20bluedroid%20avrcp&list_id=11238535

Graphics

• Health: YELLOW
  • Unverified feature bug: 1 ( Bug 1016539, due to Bug 1066664)
  • Blocker: 4 (3 are Resolved/Fixed)
  • Unresolved Blocker: 1
  • 2.1 noms: 1
  • Graphics team seems to be in training/workweek session.

Smoketests

• Health: RED
  • BLOCKERS
  • Bug 1063066 - [Flame][KK] Bluetooth transfer does not work in Gallery App
  • Bug 1066128 - [Flame][KK] Cannot detect SD card
  • These are full flash KK only

Agenda

• [Tony] branch checks have too many iterations. limit it to 3 as a rule of thumb.
• [Tony] Kitkat changes and gotchas
  • if full flashing using ./flash.sh, update channel will be set to default. use the change-channel.sh script to update after flashing. (note, tw flash tool fixes this automatically)
  • to get root access on production builds, you will need to swap boot.img from v180, and run flash.sh. or just use -eng builds for Root access builds.
    • [Brian] Follow up this with TAM and partner
• [jlorenzo] Bugzilla: Who does handle the [lead-review+] done by Jason after [QAnalyst-Triage+] ?
• [Joshua_M] How are Gonk Changes Implemented / Is there a process to get a Gonk change regression window - namely is there a link to pull a gonk push-log?
• [njpark] during the exploratory testing, attention should be paid to memory pressure situation (i.e. running an app with several apps in the background)
• [marcia] Trunk only: Screenshot trigger changed -> since bug 1031560 has landed you now have to hold both volume down and the power button for 750ms before one is taken.
• [marcia] Asa asked about the fact that 2.1 builds are not on the public ftp (Master and 2.0

Flame builds are) -> https://developer.mozilla.org/en-US/Firefox_OS/Developer_phone_guide/Flame#Updating_your_Flame%27s_software

• [Kevin] outdated tag on moztrap. Please help fix the tests that kevin sends out to the team

This Week - Decisions & Action Items

• Marcia - email cmills about adding the missing 2.1 section on MDN