Releases/Firefox 49/Test Plan/Beta/49.0.2
From MozillaWiki
« Firefox 49.0.1 | Firefox 49.0.2 | Firefox 49.0.3 »
Contents
Firefox 49.0.2 Test Plan
- Release Week: Oct 17th, 2016. Plan is to ship this build on Wednesday, Oct 19th 2016 (Release Calendar)
- QA Contacts: Florin Mezei; Andrei Vaida
- IRC: irc://irc.mozilla.org#qa ping FlorinMezei; avaida
- Build 1: 49.0.2-build1 | ea6157b86ae2 | (ID: 20161018030522)
- Build 2: 49.0.2-build2 | 7356baae8e73 | (ID: 20161019084923)
QE recommendation regarding the quality of the build
- Recommendation based on results from manual testing:
| Build 1 | DON'T SHIP IT |
|---|
| Build 2 | SHIP IT |
|---|
Manual Testing summary - Platform Coverage and Areas Tested
- Build 1:
- Testing performed around Web compatibility, Plug-in compatibility (Async Plug-in Rendering) and Graphics (DirectX compatibility).
- Test Cases executed and results: report
- Build 2:
- Testing performed around Web compatibility.
- Test Cases executed and results: report
Build 1
| Platform | Graphics | Build architecture | Assignee | Results: report |
|---|---|---|---|---|
| Windows 7 x64 | NVIDIA GeForce 210 | 32-bit | Camelia Badau | [DONE] |
| Windows 10 x64 | Intel HD 4600 | 64-bit | Iulia Cristescu | [DONE] |
| Mac OS X 10.11.6 | Intel Iris Pro (1536 MB) | 64-bit | Mihai Boldan | [DONE] |
| Ubuntu 16.04 x64 | Intel HD 520 | 64-bit | Ciprian Georgiu | [DONE] |
| Tested Area | Testing Type | Results |
|---|---|---|
| Web compatibility | Smoke and Exploratory Testing | PASSED |
| Plug-in compatibility (Async Plug-in Rendering) | Smoke and Exploratory Testing | FAILED |
| Graphics (DirectX compatibility) | Smoke and Exploratory Testing | FAILED |
Build 2
| Platform | Graphics | Build architecture | Assignee | Results: report |
|---|---|---|---|---|
| Windows 7 x64 | NVIDIA GeForce 210 | 32-bit | Camelia Badau | [DONE] |
| Windows 10 x64 | Intel HD 4600 | 64-bit | Iulia Cristescu | [DONE] |
| Mac OS X 10.11.6 | Intel Iris Pro (1536 MB) | 64-bit | Mihai Boldan | [DONE] |
| Ubuntu 16.04 x64 | Intel HD 520 | 64-bit | Ciprian Georgiu | [DONE] |
| Tested Area | Testing Type | Results |
|---|---|---|
| Web compatibility | Smoke and Exploratory Testing | PASSED |
Features
See the [1] gdoc for a general overview
| Feature | Owner | Status | Details | Test Plan |
|---|---|---|---|---|
| Text to Speech on Desktop | Camelia Badau | [DONE] | Feature set to release with Firefox 49. Pre-release sign off completed. | Test Plan |
| Text to Speech in Reader View | Camelia Badau | [DONE] | Feature set to release with Firefox 49. Pre-release sign off completed. | Test Plan |
| Mac elevated updates | Bogdan Maris | [DONE] | Feature set to release with Firefox 49. Pre-release sign off completed. | Test Plan |
Results
New bugs
- Build 1:
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1311368 | Video content is not always loaded on NASA Television | VERIFIED | FIXED |
| 1311374 | Video fails to update after exiting full screen and scrolling the video in and out of view | RESOLVED | WORKSFORME |
| 1311381 | [Windows] Calls and Video Calls can't be initiated on https://web.skype.com/ | RESOLVED | WONTFIX |
3 Total; 0 Open (0%); 2 Resolved (66.67%); 1 Verified (33.33%);
- Build 2:
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Known Issues - also seen in previous builds
Major issues also seen in previous builds
- Build 1:
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
- Build 2:
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1311374 | Video fails to update after exiting full screen and scrolling the video in and out of view | RESOLVED | WORKSFORME |
1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);
Low impact issues also seen in previous builds
- Build 1:
10 Total; 2 Open (20%); 6 Resolved (60%); 2 Verified (20%);
- Build 2:
9 Total; 3 Open (33.33%); 4 Resolved (44.44%); 2 Verified (22.22%);
Branch Bug Fix Verifications
Full Query ID Summary Status Resolution 1301518 Opus 255 channel mapping family not playable VERIFIED FIXED 1305436 Firefox 49 won't start after installation RESOLVED FIXED 1306472 No load event for iframe with javascript: URI that doesn't return a string VERIFIED FIXED 3 Total; 0 Open (0%); 1 Resolved (33.33%); 2 Verified (66.67%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
