Releases/Firefox 52/Test Plan/Beta/RC1
From MozillaWiki
« Firefox 52 Beta 9 | Firefox 52 RC 1 »
Firefox 52.0 Beta RC Test Plan
- Release Week: Mar 5th, 2017. Plan is to ship this build on Tue, March 7th 2017 (Release Calendar)
- QA Contacts: Florin Mezei; Andrei Vaida; Cornel Ionce
- IRC: irc://irc.mozilla.org#qa ping FlorinMezei; avaida; cornel_ionce
- Build 1: 52.0-build1 | 2183f7cb4f88 | (ID: 20170227080736)
QE recommendation regarding the quality of the build
- Recommendation based on results from manual testing:
| Build 1 | SHIP IT |
|---|
Manual Testing summary - Platform Coverage and Areas Tested
- Testing performed around Add-on Compatibility and Web Compatibility.
- Test Cases executed and results: report
Build 1
| Platform | GPU | Build architecture | Assignee | Results: report |
|---|---|---|---|---|
| Windows 10 x64 | ATI Radeon HD 3000 | 64-bit | Andrei Vaida | [DONE] |
| Windows 7 x64 | NVIDIA GeForce 210 | 32-bit | Camelia Badau | [DONE] |
| Mac OS X 10.11 | Intel Iris Pro | 64-bit | Emil Ghitta | [DONE] |
| Ubuntu 14.04 x64 | AMD Radeon R7 200 | 64-bit | Paul Silaghi | [DONE] |
| Tested Area | Testing Type | Results |
|---|---|---|
| Add-on compatibility | Smoke and Exploratory Testing | PASSED |
| Web compatibility | Exploratory Testing | PASSED |
Features
See the [1] gdoc for a general overview
| Feature | Owner | Testing | Sign off | Details | Test Plan |
|---|---|---|---|---|---|
| Touch events in APZ | Petruta Rasa | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is YELLOW. | Test Plan |
| New Responsive Design Mode | Mihai Boldan | [AT RISK] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is RED because there are 26 open bugs still affecting it | Test Plan |
| Partner Search | Paul Silaghi | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
| Device Permissions (Screen Sharing) | Cornel Ionce | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
| Skia Content for Windows (Compositor Process) | Mihai Boldan | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
| Ship DTMF support in Firefox | Cornel Ionce | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
| Restartless System Add-ons | Alexandru Simonca, Cristian Comorasu | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
| CSS Grid, CSS Grid Inspector | Bogdan Maris, Paul Silaghi | [AT RISK] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is RED because there are 2 bugs severely affecting it and several high impact issues were encountered during sign-off. | --- |
| mediaDevices.ondevicechange in MediaStream | Alexandru Simonca | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
| Improvements to <select> element | Petruta Rasa | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | --- |
| First-party isolation (Tor) | Bogdan Maris (assisting only) | [DONE] | --- | Feature set to release with Firefox 52. Will not be signed off by our team but a pre-Release test report for the parts our team tested was sent on Feb 27. | --- |
| Automatic Captive Portal detection | Camelia Badau | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is YELLOW. | Test Plan |
| Insecure Password Manager | Iulia Cristescu | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
| Introduce word (and sentence?) tracking in Narrate | Camelia Badau | [DONE] | --- | Feature set to release with Firefox 52. Release QA will not be signing off on this, as we've only got notice of it at the end of the cycle. We did make sure that the most basic functionality associated to it is intact, though (see results). | --- |
Results
New bugs
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Known Issues - also seen in previous builds
Major issues also seen in previous builds
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Low impact issues also seen in previous builds
12 Total; 2 Open (16.67%); 9 Resolved (75%); 1 Verified (8.33%);
Branch Bug Fix Verifications
Full Query ID Summary Status Resolution 1341521 Smearing with canvas VERIFIED FIXED 1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
