B2G/QA/Meetings/2015-11-25

From MozillaWiki
< B2G‎ | QA‎ | Meetings
Jump to: navigation, search

Overview

Status Highlights

  • US Holidays (Thanks giving ) tomorrow and day after; Marigold/Taipei to cover smoke test for aries dogfood, flame mozilla central and flame 2.5
  • v2.6 work is started. Check with your lead/manager if you have no idea
  • v2.5 CC: December 14th
  • Monday : will be the start the OTA branch one week off Mozilla Central gecko branch.

Off Plan

PTO plan

  • Taipei Q4 team building - Nov. 27
  • Thanksgiving: Nov. 26~27
  • mike Nov. 30
  • Gerry Dec. 3~4
  • William - Dec. 3~4
  • Marigold: Dec 4th - Dec 6th
  • nhirata - Dec 28 ~ Jan 4
  • jlorenzo: Dec 23rd - Jan 3rd
  • QAnalysts: Dec 24th - Jan 3rd

Upcoming Holidays

  • U.S.
    • November 26 and 27
    • December 24 and 25
  • France: December 25th


2.6 Status

2.6 Feature (NEW)

  • Continuous integration program [Johan]
    • Gip to Gij: Still moving forward. We keep checking the parity between the JS test and the python ones. If the parity is not full, we NI the test writer in the bug for more information. They've been pretty responsive.
    • On-device testing running on taskcluster: Currently deactivated.

2.6 Spark/Aries-KK Smoketests

  • Tester: QAnalysts (KevinT)
    • Health Status: Green, no blockers

- None Reported

Verified:

- https://bugzil.la/1225549 Users are not receiving notification when reaching data limit 

* Fails [8938]

Severe Issues:

- https://bugzil.la/1228056 Anniversary/birthday date is the day before selected in contacts - https://bugzil.la/1227295 Unable to modify password after entering an incorrect password for a WiFi network - https://bugzil.la/1225339 Browser history is not preserved after an OTA - https://bugzil.la/1217928 [New Homescreen] Homescreen App order is not preserved during OTA when moving to the New Home Screen - https://bugzil.la/1211266 Occasional missing icons after flashing homescreen - https://bugzil.la/1220812 After unlocking the device from the lockscreen there is a long pause until reaching the home screen - https://bugzil.la/1224138 [Browser]Hard to find the new window button in browser's window manager view. - https://bugzil.la/1221482 [Contacts]The upper part of Duplicates found page cannot be seen, and buttons at Add contact view are unable to work. - https://bugzil.la/1224497 [Dialer] The emergency number can't be dialed from contact detail page.

2.6 Aries Dogfood

Existing: - https://bugzil.la/1217490 [Aries] After OTA my dogfood-latest channel is sometimes reset to nightly or dogfood - https://bugzil.la/1222527 We can lose the "debug.performance_data.dogfooding" setting after OTA - https://bugzil.la/1225339 Browser history is not preserved after an OTA - https://bugzil.la/1227295 Unable to modify password after entering an incorrect password for a WiFi network

2.6 Flame

  • Health Status: Green, no blockers

- None Reported

Verified: - https://bugzil.la/1225549 Users are not receiving notification when reaching data limit 

* Fails [8938]

Severe Issues:

- https://bugzil.la/1228056 Anniversary/birthday date is the day before selected in contacts - https://bugzil.la/1227295 Unable to modify password after entering an incorrect password for a WiFi network - https://bugzil.la/1225339 Browser history is not preserved after an OTA - https://bugzil.la/1221316 [Flame KK] The time is changed after OTA which causes multiple issues - https://bugzil.la/1217928 [New Homescreen] Homescreen App order is not preserved during OTA when moving to the New Home Screen - https://bugzil.la/1211266 Occasional missing icons after flashing homescreen - https://bugzil.la/1220812 After unlocking the device from the lockscreen there is a long pause until reaching the home screen - https://bugzil.la/1222387 [Flame KK][Music]The Music app cannot work correctly when user plays the music by song list. - https://bugzil.la/1224138 [Browser]Hard to find the new window button in browser's window manager view. - https://bugzil.la/1221482 [Contacts]The upper part of Duplicates found page cannot be seen, and buttons at Add contact view are unable to work. - https://bugzil.la/1224497 [Dialer] The emergency number can't be dialed from contact detail page.

2.6 Exploratory

2.5 Status

2.5 Feature

  • Telemetry: Iris
    • No blocker
  • Replaceable Homescreen: Teri
    • No blocker
  • Late Customization: Teri
    • No blocker
  • Performance: Mike
    • No blocker
  • NGA: Isabel
    • 11/11: No code update since the branching out. There will be NGA retrospectives on Thursday and Friday. Isabel and I will attend.
  • Vaani : nhirata -
    • dropped for 2.5; work still being done, QA still needed. Will be an ongoing tweak of fuzzy logic
    • need vaani automatable: bug 1219450
    • please use the MozSpeech app in dogfood-latest build
  • Others

=== 2.5 fullrun (Marigold) === (William, update: 11/25)

  • ETA: 12/09
  • 1857 passed, 26 failed, 0 blocked, 53 invalid / 6628 test cases total. Completeness is at 34.76%
  • Regression bug in test run-4: 2 (https://goo.gl/5vDxjU)
  • New bug in test run-4: 13 (Link: https://goo.gl/L86tId)

=== 2.5 smoketest (Marigold) === (William, update: 11/25)

  • Aries
    • None
  • Flame
    • None
  • Severe Issue: (Aries and Flame)

2.5 MTBF

flame-kk 512MB avg. running hours: 48.12 Blocker: 

- [check-in needed for v2.5] https://bugzil.la/1206634  [MTBF] After 20 hours executing, test cases failed consequently
aries-kk 2GB running hours: 120

mtbf bugs in Q4 https://bugzilla.mozilla.org/show_bug.cgi?id=1182954

    • RA exit criteria: 100 hrs
    • CC exit criteria: 200 hrs

MCTS

  • 2.5 Status (current on track)

[DONE] Reran for comprehensive results [DOING] Fixing cert suite issues [DOING] Fixing bugs caused by webapi difference

  • TV Status (waiting for Panasonic's releasing of build)

[DONE] TV Presentation API protocol

This Week - Decisions & Action Items

  • [Kevin] Will need smoke test coverage for Aries and Flame Master on the 26th and 27th since QAnalysts will be on holiday.
    • [whsu] To coordinate Marigold to help on Aries, Flame Master for 26th and 27th.
  • [Kevin] Severe issues listed on smoke test reports. What should be included? Only severe issues encountered while smoking the build or all severe issues affecting the branch? We should decide on some kind of standard.

Previous action items

Agenda

Community Updates [marcia-read only]

Q4 Goal Status Update

  • Paris Hackathon Event - Complete
  • Documentation
  • Community Planning Strategy Document has been created and will be circulated soon for review
  • Upcoming Events
    • Leadership Summit in Singapore - end of January
      • marcia meeting with Planning team next week to discuss how we can potentially help
    • FOSDEM - January 30 and 31, Brussels, BE
      • Proposed QA Sessions
        • Automation Workshop - Martijn and Johan
        • Live Testing Session - Marcia (with help from others)
  • Documentation [Jamie]
  • will be starting on revamp of firefox OS QA pages soon, have to talk to some people about it.


Testing information (Read Only)

https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/shared/firefox_sync/firefox_sync.properties https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/distros/b2gdroid/apps/ftu/ftu-droid.properties https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/distros/b2gdroid/apps/ftu/manifest.properties

- Firefox Sync strings will likely be covered by automation, but needs to be confirmed as it seems not everything is covered

  • For flame updating, please use v18D_nightly_v4 as base build, update to the latest dogfood and then update to the newest build (nightly-latest). For now, you cannot update from any random build.

Reference Links

Retrieved from "https://wiki.mozilla.org/index.php?title=B2G/QA/Meetings/2015-11-25&oldid=1109077"