B2G/QA/Meetings/2015-03-18

// For 2015/03/18

Overview

• Meeting Name: B2G QA Roundtable
• Meeting Time: Wednesdays @ 5pm - 5:45pm PDT
• Vidyo Room: QA Vidyo Room
• Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
• Dial in: 1-800-707-2533, #92, #9245
• Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
• Testrun Schedule: http://bit.ly/1jQzW79
• Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
• B2G dashboard: http://charts.mozilla.org/
• QA Roundtable Template: https://etherpad.mozilla.org/b2g-qa-roundtable-template (Clone this)

Vacation plan

   Delphine works in South Africa for FxOS l10n events + SA FxOS launch: from March 22-April 6th. Working on different time zone. You may address any urgent RTL issues to Parul

2.2 Feature work

• RTL (Marigold)
  • Health: Yellow
  • Details: 18 blockers
    • http://mzl.la/1b2ddSG

• Privacy (Gerry)
  • Health: Yellow
  • Details: 4 blockers
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1135972
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1093688
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1136321
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1137083
• Cut, Copy, and Paste (Gerry, Edward, Teri, Eric)
  • Health: Yellow
  • Details: 3 blockers
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1140625
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1127529
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1021499
• NFC (Alison)
  • Health: Green
  • Details:
    • one blocker: https://bugzilla.mozilla.org/show_bug.cgi?id=1143528 (RESOLVED FIXED) .
• short_name support in manifest.webapp (Hermes)
  • Health: Green
  • Details: All 2.2 features were landed. Perform a test run for this feature this week.
• Search App (Hermes)
  • Health: Green
  • Details: 2 WIP blockers
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1140315
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1129701 (RTL)
• App-grouping (Hermes)
  • Health: Green
  • Details: No 2.2+ blockers for now
• Task Manager (Hermes)
  • Health: Green
  • Details: 2 WIP Blockers
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1107139
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1144054
• L-porting (Hermes)
  • Health: Green
  • Details: 1 WIP Blocker
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1120780
• CAF bugs (Eric)
  • Health: Green
  • Details: 1 WIP (1020757)
• TCL bugs (Alison, Eric)
  • Health: Green
  • Details: Regression checking
• Bluetooth (Eric, Teri)
  • Health: Green
  • Details: Completed PTS testing - 3 bugs

               Completed basic testing on BT APIv2 - 2 bugs

• Metrics (Shing)
  • Health: Yellow
  • Details: 2 Blockers http://mzl.la/1F21hgq
• 256M RAM memory optimization for WFVGA, 5MP. (Teri)
  • Health: Green
  • Details: In progress, no blocker
• Multicore performance (Edward)
  • Health:
  • Details:

bisect result: http://bit.ly/1MGOa59

2.2 Smoketests

• Tester: Marigold
• Health Status: Green (both Flame-KK & Nexus-5-L)
• Details: OTA working now. 1 automation issue with task cluster, unable to check-in code https://bugzil.la/1129019 https://github.com/mozilla-b2g/gaia/pull/28656#issuecomment-78429126

2.2 Full run

• Tester: Marigold
• Health Status:
• Details:
  • Flame-KK http://mzl.la/1wtR60Y 61% done 29 fail
  • RTL Flame-KK http://mzl.la/1EzHpRx 100% done, 76 fail
  • Nexus-5-L http://mzl.la/1EXfMQQ 97% done, 24 fail
  • [bhavana] overall blockers : 2.2+ ~92bugs : http://mzl.la/19APhFR
  • feature-b2g|blocking-b2g == 2.2?|+ [not resolved] http://mzl.la/1C4X1KT Check if code uplifted
  • feature-b2g|blocking-b2g == 2.2?|+ [resolved] http://mzl.la/1E5mQqM Need verification
  • status-b2g-v2.2 affected not blocking any bugs http://mzl.la/1E5ArOQ

2.2 Stability

• Tester: Paul, Alison
• Health Status: Red
• Details:
  • https://bugzil.la/1141418 Bug 1141418 - After 9 hours running, marionette server response incorrectly
  • https://bugzil.la/1141962 Bug 1141962 - [MTBF][Nexus5-L] MTBF testing aborted and found lots of "E MP-Decision: Error 1 setting online status to 1 forcpuX" error in logcat
  • N5L only https://bugzil.la/1144033 [Bug 1144033] [Nexus-5][gonk-l] Device stayed at Firefox OS screen and cannot boot up to home

CAF's result are failing:

• • https://bugzilla.mozilla.org/show_bug.cgi?id=1144699
    • there is not such WebRTC test cases in out MTBF suit. Need to discuss if we need to add this kind of test in the MTBF cases.
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1144267
  • Flame-kk: 11.12 hours https://docs.google.com/a/mozilla.com/spreadsheets/d/1QWOsLPiKlEJ0AamS8uvMd_l6f64Nh9CBnRNokkhJGJI/edit#gid=1251305406
  • Nexus5-L: Less than 10 hours

https://docs.google.com/a/mozilla.com/spreadsheets/d/1X1UtxmNmK87YofT9JWcGL4wT5jLp8YlQ3EKpuhLH5Bk/edit#gid=1251305406

Localization

• Tester: Delphine, localizers
• Health Status: green
• Details: 1 late-l10n blocker, patch got r+ed, needs to land
  • http://mzl.la/1xzocba

3.0 Smoketests

• Tester: Peter Bylenga
• Health Status: Red (3-13-2015 Friday was last passing)
• Details: 1 New Blocker
  • https://bugzil.la/1144567 [Marketplace]The Marketplace will exit directly when you launch it.
    • Resolved by backout

3.0 Exploratory

• Tester: Peter Bylenga
• Health Status: Red
• Details: 48 bugs, 12 nominations and blockers, 6 RTL
  • http://mzl.la/1zaHjY4

Agenda

• [Pbylenga] Discuss pointing to last known good build for OTA's instead of only disabling OTA's.
  •  :bajaj am favour of this and njpark mentioned we can do this :)
• [KTucker] https://bugzilla.mozilla.org/show_bug.cgi?id=1116732 - The regression window is correct. We have confirmed this by 3 testers. We have 100% steps and we are uploading a video on how to reproduce this.
• [eric] Flame-L will be late, not sure what do we do for signing off L porting & related bugs
• [nhirata] to be getting level 3 commit access soon; will be working on smoke test blockers.
  • please raise bugs like https://bugzilla.mozilla.org/show_bug.cgi?id=1144567 as smoke test blockers earlier

This Week - Decisions & Action Items

• [PBylenga] Gather information for running Automated Smoke Test Cases locally
  • https://wiki.mozilla.org/B2G/QA/Smoke_Tests#Test_Automation