B2G/QA/Meetings/2015-03-25

// For 2015/03/25

Overview

• Meeting Name: B2G QA Roundtable
• Meeting Time: Wednesdays @ 5pm - 5:45pm PDT
• Vidyo Room: QA Vidyo Room
• Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
• Dial in: 1-800-707-2533, #92, #9245
• Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
• Testrun Schedule: http://bit.ly/1jQzW79
• Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
• B2G dashboard: http://charts.mozilla.org/
• QA Roundtable Template: https://etherpad.mozilla.org/b2g-qa-roundtable-template (Clone this)

Vacation plan

   Taiwan holidays (Women’s and Children’s Day and Tomb sweeping day) - April 3, April 6(v2.2 FC)

   4-day long weekend

   Need help with v2.2 automation report on Fri April 3 for b2g 2.2

   French holiday on Mon April 6th too. ( Easter Monday / Lundi de Pâques )

   China holidays - Mon April 6 (marigold)

   Delphine works in South Africa for FxOS l10n events + SA FxOS launch: from March 22-April 6th. Working on different time zone. You may address any urgent RTL issues to Parul. For urgent l10n issues, please reach to l10n-drivers@mozilla.org

   Eric, Brian, Josh have the biz trip in China (3/31 to 4/2) Marigold

   Workflow of bugs/issues ( Regression window, QA 101, etc... ) 

   L10n test strategy

   Performance test and measurement

   Device testing

   Automation review

   Documentation review ( Test reports, HR, etc... ) 

   Brian PTO (4/7 to 4/12)

   Paul PTO (4/6 ~ 4/21)

2.2 Feature work

• General
  • Details: [eric] The FC milestone is feasible for Flame-KK, maybe we need a new schedule for the Lollipop.
• RTL (Marigold)
  • Health Status: Red
  • Details: 13 blockers (5 P1)
    • https://wiki.mozilla.org/RTL#RTL_blocking-b2g:2.2.2B

• Privacy (Gerry)
  • Health Status: Red
  • Details: 2 blockers
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1093688
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1137083
    • Both Pending Dave (No response since 3/18, Dave responded he will check it today)
• Cut, Copy, and Paste (Gerry, Edward, Teri)
  • Health Status: Yellow
  • Details: 3 blockers
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1140625 - reviewing
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1127529 - reviewing
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1021499
• System Platform (Gerry)
  • Health Status: Red
  • Details: 8 blockers
• NFC (Alison)
  • Health Status: Yellow
  • Details:
    • 2 blockers:
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1146220
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1146744
• Ringtones (Alison)
  • Health Status: Yellow
  • Details:
    • 1 blocker:
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1107534 - patch review-
• MTP/UMS (Alison)
  • Health Status: Green
  • Details: No blockers
• System Frontend bugs (Hermes)
  • Health Status: Yellow
  • Details: 8 blockers, 2 nominated (skipped RTL)
    • Components with 2.2 New features: 1 blockers (Search App), 1 nom
      • • https://bugzilla.mozilla.org/show_bug.cgi?id=1146825 patch waiting for review
    • Other Components: 7 blockers, 1 nom
      • • https://bugzilla.mozilla.org/show_bug.cgi?id=1146256 still wait for developer's response
• L-porting (Hermes)
  • Health Status: Yellow
  • Details: 3 blockers
    • Camera recording has been fixed, and already been verified on master.
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1143694 WebRTC
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1144512 (patch reviewing)
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1144515 (patch reviewing)
  • OTA for Nexus-5-L bug (3.0?)
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1139331
• RIL bugs (Eric)
  • Health Status: Yellow
  • Details: 3 blockers http://mzl.la/1G3DPhV
    • QCril issue https://bugzil.la/1142770
    • RD Bevis & I still try to reproduce, but behavior is not consistent, lots of change in r? patch https://bugzil.la/1136211
    • another WIP
• COMMS bugs (Eric)
  • Health Status: Red
  • Details: 5 blockers http://mzl.la/1Ck856K
    • [no patch][2.2+] a CDMA bug from CAF just opened yesterday, tracking https://bugzil.la/1147123
    • [no patch][2.2+] under discussion https://bugzil.la/1144610
    • [no patch][2.2?] a new regression https://bugzil.la/1146833
• Bluetooth (Eric, Teri)
  • Health Status: Yellow
  • Details:
  • 1 BT nominated

https://bugzilla.mozilla.org/show_bug.cgi?id=1143925

• • 2 BT blocker

https://bugzilla.mozilla.org/show_bug.cgi?id=1144610 https://bugzilla.mozilla.org/show_bug.cgi?id=1144604

• Metrics (Shing)
  • Health Status: Yellow
  • Details:
    • 1 WIP (risky!) https://bugzil.la/1134998
    • 2 waiting for uplift to 2.2 https://bugzil.la/1137063 https://bugzil.la/1141891
• 256M RAM memory optimization for WFVGA, 5MP. (Teri)
  • Health Status: Green
  • Details: No blocker

2.2 Smoketests

• Tester: Marigold, Eric
  • Health Status: Green
  • Details: Flame-KK
    • Current errors are from automation scripts, Edward is taking care of those.
• Tester: Marigold, Gerry
  • Health Status: Green
  • Details: Nexus-5-l
    • Pass except for OTA, FM, DSDS & Video

2.2 Full run

• Tester: Marigold, Eric
  • Details: Flame-KK, Full test - 85% done, bugs are in each component list, will finish soon.
  • Details: Nexus-5-L
    • NEXUS-5-L - Regression test [done][for 3 wks] bug http://mzl.la/18T1AMy - will start another round next week

2.2 Stability

• Tester: Paul, Alison
  • Health Status: red
  • Details:

flame-kk: 18.33 hours nexus-L: about 10 hours

• Bug 1141962 - devices disconnected in both flame-kk and nexus-L; randomly rebooting while executing.
• Power consumption can't be supplied by usb
• Bug 1146861, Bug 1145015 - two crash bugs found

flame-kk v2.2 https://docs.google.com/spreadsheets/d/1euwhyStKtg3yPy2D5rxuBndadGwKny8QI-YFb_FpyPI/edit?usp=sharing nexus-L v2.2 https://docs.google.com/spreadsheets/d/1zwy65eTWah7_3GWG7WI8fCNYxinxh26g_rlGXYchg7g/edit?usp=sharing

Localization

• Tester: Delphine, localizers
  • Health Status: Will start at mid April, just try run.
  • Details: Marigold is running try run for language “Basque”
    • Moztrap link: https://moztrap.mozilla.org/runtests/run/6756/env/27835/?pagenumber=1&pagesize=20&sortfield=order&sortdirection=asc&filter-tag=3365
    • Instructions for filing bugs https://etherpad.mozilla.org/l10n-fxos-testing-2-2
    • name of the entire Basque Test Run is Firefox OS 2.2 New Strings Run - Basque (eu)
    • Just go through newstrings2.2 test cases only (filter by this tag under the Filter bar)

3.0 Smoketests

• Tester: Peter Bylenga
  • Health Status: Green 5/5 days all passing
  • Details: No current blockers, still tracking root access
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1121045 - [b2g] we need root access on the b2g builds ( 3.0 & 2.2) for flame-kk

3.0 Exploratory

• Tester: Peter Bylenga
  • Health Status: Red
  • Details: 55 bugs, 12 blockers/nominations

Agenda

[Shing] New version of MozTrap UI! Try it:http://shinglyu.github.io/moztrap-new-ui/#/

This Week - Decisions & Action Items

[PBylenga/KTucker] email out automation report on Fri April 3 for b2g v2.2 http://mozilla-twqa.github.io/Gaiatest-Reports/2015/index.html [eric] new milestone for lollipop? to:qa-b2g-internal [eric] http://mzl.la/18T1AMy check if there is any bug without activity, ni those to kkuo