B2G/QA/Meetings/2015-02-11
From MozillaWiki
Contents
Overview
- Meeting Name: B2G QA Roundtable
- Meeting Time: Wednesdays @ 5pm - 5:45pm PDT
- Vidyo Room: QA Vidyo Room
- Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
- Dial in: 1-800-707-2533, #92, #9245
- Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
- Testrun Schedule: http://bit.ly/1jQzW79
- Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
- B2G dashboard: http://charts.mozilla.org/
- QA Roundtable Template: https://etherpad.mozilla.org/b2g-qa-roundtable-template (Clone this)
Vacation plan
- nhirata : 2/13 PTO
- Eric 2/16, 2/17
- Hermes 2/17 half day
- Chinese New Year 02/18~02/23 (Taipei office is closed)
- Marigold Chinese New Year: 02/18-02/25
- Taiwan Peace memorial day 2015/02/28 on Saturday (so we the have the adjustment day off on Friday 2/27) http://www.timeanddate.com/holidays/taiwan/
- US Holiday Mon, February 16 (Presidents' Day) (Also Holiday in Toronto, Canada)
- v2.2 Feature Landing 2/23
2.2 Feature work
- Privacy (Gerry)
- Health: Red
- Test case coverage:
- Details: 5 blockers
- https://bugzilla.mozilla.org/show_bug.cgi?id=1093688 - Got patches.
- https://bugzilla.mozilla.org/show_bug.cgi?id=1111992 - Can't recreate
- https://bugzilla.mozilla.org/show_bug.cgi?id=1120577 - Have pull request, wait for landing
- https://bugzilla.mozilla.org/show_bug.cgi?id=1120733 - Have fix.
- https://bugzilla.mozilla.org/show_bug.cgi?id=1121232 - Have fix.
- Compile time - pref off
- josh to talk to gerry on the compile time pref-off option
- RTL (Marigold)
- Health: Yellow
- Test case coverage: 50%
- Details:
- v2.2 WIP, Wiki: http://mzl.la/16VA7Zz
- 2.2 RTL Spec: http://bit.ly/1KKxkzD
- Cut, Copy, and Paste (Gerry, Edward, Teri, Eric)
- Health: Green
- Test case coverage:
- Details: WIP
- NFC (Alison)
- Health: Green
- Test case coverage: 100%
- Details:
- v2.2 WIP
- 1 blocker (regression): https://bugzilla.mozilla.org/show_bug.cgi?id=1120849 (patch r+)
- Search suggestion based on provider (Hermes)
- Health: Green
- Test case coverage: 90%
- Details: WIP
- App-grouping (Hermes)
- Health: Green
- Test case coverage: 100%
- Details: All landed, will start a test run to verify it.
- Task Manager (Hermes)
- Health: Green
- Test case coverage: 95%
- Details: All landed, will update test cases and then start a test run to verify it.
- L-porting (Hermes)
- Health: Green
- Details:
- PVT build can be downloaded for master. v2.2 WIP.
https://bugzilla.mozilla.org/show_bug.cgi?id=1111890
- Camera recording is WIP. (https://bugzilla.mozilla.org/show_bug.cgi?id=1120780)
- UICC Secure Element enablement (for NFC) is WIP (https://bugzilla.mozilla.org/show_bug.cgi?id=985892)
- smoketests running on L? [eric] planned but no v2.2 build yet
- AI: https://bugzilla.mozilla.org/show_bug.cgi?id=1111890 to help follow-up on L builds
- [nhirata] commented. KaiZhen already commented in 39. Asked if there's any blockers.
- AI: https://bugzilla.mozilla.org/show_bug.cgi?id=1111890 to help follow-up on L builds
- [gerry, eric] Automation trial run on master : 50+% fail rate
- [hermes] run tests manually on master and send out the L-report
- CAF bugs (Eric)
- Health: Green
- Test case coverage: 100%
- Details: Regression running
- Dialer regression, not related to CAF https://bugzil.la/1131938 TEF will try to land patch asap.
- TCL bugs (Alison, Eric)
- Health: Green
- Test case coverage: 100%
- Details:
- One blocker for feature [bug 1091544]: https://bugzilla.mozilla.org/show_bug.cgi?id=1123567 (patch reviewing)
- Bluetooth (Eric, Teri)
- Health: Green
- Test case coverage: 100%
- Details:
- BT team test in progress
- QA testing start on 3/2
- Metrics (Shing)
- Health: Red
- Test case coverage: 20%
- Details:
- 1 WIP: 1109422
- 4 NEW coming: 1037495, 1119009, 1021173, 1126524
- 256M RAM memory optimization for WFVGA, 5MP. (Teri)
- Health: Green
- Test case coverage: WIP
- Details:
- Code landed on mozilla-central, to be landed on V2.2
- its landed on 2.2 as well
- Identify testing scope with RD
- Multicore performance (Edward)
- Health:
- Test case coverage:
- Better performance on Multicore (App startup time for core apps is comparable to Android
- When and how can we get performance numbers (app launch latency times) for 2.2 using raptor ?
2.2 Smoketests
- Tester: Marigold
- Health Status: Green
- Suggest to modify/disable smoke test E.me case #5856 http://mzl.la/1AXBILM Contact: Hermes
2.2 Stability
- Tester: Alison, Paul
- Health Status: None
- Details: Setting up with nexus-L, wait for v2.2 build ready and stabilized
Localization
- Tester: Delphine/Localizers
- Health Status: Green
- Details: Zarro Boogs
3.0 Smoketests
- Tester: Peter Bylenga
- Health Status: Yellow, All passing for 3/5 days needed for Green
- Details: No blockers, 4 severe issues
- https://bugzil.la/1130035 [System] Device displays a white screen and becomes unresponsive while trying to load a webpage.
- https://bugzil.la/1121045 [b2g] we need root access on the b2g builds ( 3.0 & 2.2) for flame-kk
- https://bugzil.la/1124398 [Windows Management][Edge Swipe] Edge Swipe transitioning between apps will sometimes encounter a black screen when settings app is open.
- https://bugzil.la/1129344 Keyboard hides randomly at Rocketbar input
3.0 Exploratory
- Tester: Peter Bylenga
- Health Status: Red
- Details: 35 total, 11 Nominations/Blockers
- http://mzl.la/1KKWjEW
- RTL focus
- Systemsfe verifications
Last Week - Decisions & Action Items
- :bajaj to help send an email back to dave huseby about Privacy
- [bajaj] done and its moving
- Firefox Account and Marketplace: Loop Delphine with the mail from Catalin
- Josh send mail to EPMs with RTL bugs no owner
- Alison follows up on TCL bugs
- Naoki, Bajaj, Eric follow up on https://bugzil.la/1121045 [b2g] we need root access on the b2g builds ( 3.0 & 2.2) for flame-kk
- [bajaj] Also done :) naoki spoke to fabrice
- [pragmatic, PBylenga] Help Taipei team with v2.2 smoke & automation during their holiday
- Path for escalate major issues : Johan to help propose something
- [jlorenzo] https://wiki.mozilla.org/B2G/QA/Smoke_Tests#Escalation_Strategy Thanks for the notes Parul!
- In this regard [backout-needed] was a bit misunderstood by devs. Some of them were waiting for a sheriff to do it. We may need to change the whiteboard tag then. How about: [backout-asap]? [backout-required]? [backout-mandatory]? [backout-red-alert]?
Agenda
- [eric] CNY plan https://etherpad.mozilla.org/cny
- in short
- flame-kk manual smoke covered by Parul
- flame-kk automation covered by Johan Parul, Geo
- nexus-L manual smoke ? Parul
- nexus-L automation ?
- [delphine] Are any Full Runs on 2.2 features planned (ie like we did on previous branches)? If so, dates? If not, by when maximum should our features be entirely tested?
- [eric] we plan to run that on flame-kk after chinese new year, just added to calendar, will plan for nexus-l
- 2.2 QA wiki: https://wiki.mozilla.org/B2G/QA/2.2
- We will also update all the activities and schedule to it
- [njpark] Are we keeping tabs on start up time? I noticed recently that some apps may be suffering from memory pressure. (https://bugzilla.mozilla.org/show_bug.cgi?id=1129126, https://bugzilla.mozilla.org/show_bug.cgi?id=1131095)
- https://datazilla.mozilla.org/b2g/?branch=master&device=flame-319MB&range=90&test=startup_%3E_moz-app-visually-complete&app_list=calendar,camera,clock,communications/contacts,communications/dialer,email%20FTU,fm,gallery,music,settings,sms,video&app=gallery&gaia_rev=bc052c237e0371e8&gecko_rev=c4a040299b9e&plot=avg
- also to note there's a dev app called membuster; maybe we need to start looking into using some of the dev apps on the engineering builds?
- [pragmatic] https://developer.mozilla.org/en-US/Firefox_OS/Phone_guide/Flame/Updating_your_Flame#Updating_your_Flame%27s_software New base build does not have the earlier flexibility of being on the v2.2 build (forces 3.0 nightly channel)
- launch settings -> device info -> more info -> check Developer menu
- go back to settings -> developer -> change update channel to: nightly-b2g37
- reboot phone
- it will update for the build you don't have for the day : i.e. if you have today's build on nightly it won't change until the next day for the OTA.
- [bajaj] Traveling for a WoMoz event Feb 15 - Feb 23 https://reps.mozilla.org/e/girlhacks/
This Week - Decisions & Action Items
AI : taipei QA team to help send the final update on status of L 2.2 before going off for holidays AI: edchen *** When and how can we get performance numbers (app launch latency times) for 2.2 ? AI : Brian to help with https://bugzil.la/1130035 2/20/2015 Stand up action items [AI] Create a checklist of things to ask to contributors when they file bugs (like, "Are you on the latest build?") [AI] Dogfood suite: How much time do we want a dogfood blocker to be fixed? PBylenga proposed 72 hours (for the next dogfood run). bajaj, do you think it's worth it to make this time committed to the next drivers-meeting?
