Releases/Firefox 41/Test Plan/Beta/4
From MozillaWiki
« Firefox 41 Beta 3 | Firefox 41 Beta 4 | Firefox 41 Beta 5 »
Firefox 41.0 Beta 4 (build 1) Test Plan
- Release Week: Aug 24th, 2015. Plan is to ship this build on Tuesday Aug 25th 2015 (Release Calendar)
- QA Contacts: Robert Kaiser; Florin Mezei; Andrei Vaida
- IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei; avaida
- Build 1: Firefox 41.0 Beta 4 build 1 | changeset | (ID: 20150824144923)
QE recommendation regarding the quality of the build
| Recommendation based on results from manual testing | GOOD FOR RELEASE |
|---|
Manual Testing summary - Platform Coverage and Areas Tested
- * Testing is performed around areas most affected by fixes since the previous Beta, or areas that are mandatory to test in the Beta cycle
- Test Cases executed and results: report
| Platform | Assignee | Results: report |
| Windows 8 x86 (Intel HD 2500) | Camelia Badau | [DONE] |
| Windows 10 x64 (AMD Radeon HD 3000) | Andrei Vaida | [DONE] |
| Mac OS X 10.6 (AMD Radeon HD 2400 XT) | Vasilica Mihasca | [DONE] |
| Ubuntu 13.04 x64 (Intel HD 2500) | Petruta Rasa | [DONE] |
| Tested Area | Testing Type | Results |
| PRINTING | Regression Testing | PASS |
| VIDEO COMPATIBILITY | Regression Testing | CONDITIONAL PASS |
| AUDIO COMPATIBILITY | Regression Testing | PASS |
| HELLO (BASIC CALL) | Regression Testing | CONDITIONAL PASS |
Features
See the Feature Release Tracking gdoc for a general overview
| Feature | Owner | Status | Details | Test Plan |
|---|---|---|---|---|
| Async plugin init | TBD (disabled in Fx 40 release) | [AT RISK] | Feature released in Beta 40, but disabled due to reported issues | - |
| New Add-on Signing | Vasilica Mihasca | [ON TRACK] | Feature dropped from Firefox 39 & 40 (not enough add-ons signed) - final QA sign-off at the end of Beta 41 | Test Plan |
| Hello - Text Chat | Bogdan Maris | [ON TRACK] | New feature targeted for Firefox 41 - final QA sign-off at the end of Beta 41 | Test Plan |
| Unified telemetry/FHR | Alexandra Lucinet / Andrei Vaida | [NOT STARTED] | New feature targeted for Firefox 41 - final QA sign-off at the end of Beta 41 | Test Plan |
Results
New bugs
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1198278 | Ugly artifacts when entering in Customize mode during tab sharing | RESOLVED | INCOMPLETE |
1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);
Known Issues - also seen in previous builds
Major issues also seen in previous builds
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1182438 | Editing the context URL should change/remove the favicon, as it's no longer relevant | RESOLVED | WONTFIX |
| 1182440 | Edited context does not update on the standalone page (link clicker) | RESOLVED | INVALID |
| 1194706 | Sharing controls no longer shown on detached Hello window | VERIFIED | FIXED |
3 Total; 0 Open (0%); 2 Resolved (66.67%); 1 Verified (33.33%);
Low impact issues also seen in previous builds
16 Total; 3 Open (18.75%); 11 Resolved (68.75%); 2 Verified (12.5%);
Branch Bug Fix Verifications
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1186842 | Unresponsive keyboard buttons using a PDF file | VERIFIED | FIXED |
1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
