Releases/Firefox 50/Test Plan/Beta/10
From MozillaWiki
« Firefox 50 Beta 9 | Firefox 50 Beta 10 | Firefox 50 Beta 11 »
Firefox 50.0 Beta 10 Test Plan
- Release Week: Oct 24th, 2016. Plan is to ship this build on Tuesday, Oct 25th 2016 (Release Calendar)
- QA Contacts: Florin Mezei; Andrei Vaida
- IRC: irc://irc.mozilla.org#qa ping FlorinMezei; avaida
- Build 1: 50.0b10-build1 | 38cfded170521 | (ID: 20161024172922)
QE recommendation regarding the quality of the build
- Recommendation based on results from manual testing:
| Build 1 | SHIP IT |
|---|
Manual Testing summary - Platform Coverage and Areas Tested
- Testing performed around: Download Protection, Sync & FxA (including the newly introduced features: Sign-in Unblock, Device Manager and Service/Apps Manager).
- [DONE] ⚠ Please note that we're currently waiting for test results on a specific Download Protection test case that requires a 12hrs wait time. We'll make sure to follow up on that, first thing tomorrow.
- Test Cases executed and results: report
Build 1
| Platform | Graphics | Build architecture | Assignee | Results: report |
|---|---|---|---|---|
| Windows 7 x86 | AMD Radeon HD 6450 | 32-bit | Camelia Badau | [DONE] |
| Windows 8.1 x64 | Intel HD Graphics | 64-bit | Ciprian Georgiu | [DONE] |
| Mac OS X 10.11 | NVIDIA GeForce GT 640M | 64-bit | Alexandru Simonca | [DONE] |
| Ubuntu 14.04 x86 | tbd | 32-bit | Iulia Cristescu | [DONE] |
| Tested Area | Testing Type | [testrail_link Results] |
|---|---|---|
| DOWNLOAD PROTECTION | Smoke Testing | PASS |
| SYNC & FXA | Smoke and Exploratory Testing | PASS |
Features
See the [1] gdoc for a general overview
| Feature | Owner | Status | Details | Test Plan |
|---|---|---|---|---|
| Windows Child Mode | Iulia Cristescu | [ON TRACK] | scheduled to release with Firefox 50; pre-release sign off is underway | Test Plan |
| Pointer Lock API | Alexandru Simonca | [ON TRACK] | scheduled to release with Firefox 50; pre-release sign off is underway | Test Plan |
| WebM EME support for Widevine | Ciprian Georgiu | [INVESTIGATION NEEDED] | scheduled to release with Firefox 50; at this point, our concerns revolve around the still unresolved bugs: 1298027, 1298030, 1301423 and the recent issue we noticed on the shaka player demo, under Ubuntu (the latter being currently investigated by Bryce Van Dyk); pre-release sign off is underway | Test Plan |
| Simplify page | Bogdan Maris | [AT RISK] | target milestone changed to Fx51, due to 1306294, 1306299, 1306295. | Test Plan |
Results
New bugs
Bugzilla query error
error, http-bad-status, Array
Known Issues - also seen in previous builds
Major issues also seen in previous builds
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Low impact issues also seen in previous builds
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 428378 | Synced tabs, bookmarks, and history entries don't have a favicon until the user re-visits that page again | REOPENED | |
| 616629 | "Remember Password?" dialog shows too early | RESOLVED | DUPLICATE |
| 1206736 | Firefox should not ask to save an incorrect Firefox Account credential | REOPENED | |
| 1238955 | The light themes are not synced | RESOLVED | DUPLICATE |
| 1238960 | Firefox Accounts preference pane won't close when Back button is pressed | RESOLVED | FIXED |
| 1246138 | The account picture is wrongly displayed when trying to upload a photo from the firstrun page | RESOLVED | FIXED |
| 1287748 | Syncing away from lwtheme updates internal state / add-on manager UI, but not the actual browser | RESOLVED | FIXED |
7 Total; 2 Open (28.57%); 5 Resolved (71.43%); 0 Verified (0%);
Branch Bug Fix Verifications
Full Query ID Summary Status Resolution 1214151 Async scroll adjustment wrong for position:fixed elements inside scrolling position:sticky elements VERIFIED FIXED 1301784 Pref-off Search Reset UI for 50 beta VERIFIED FIXED 1308418 Videos are not working on 32bit MacOS mode VERIFIED FIXED 3 Total; 0 Open (0%); 0 Resolved (0%); 3 Verified (100%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
