Releases/Firefox 52/Test Plan/Beta/RC2
From MozillaWiki
« Firefox 52.0 RC1 | Firefox 52,0 RC2 »
Contents
Firefox 52.0 RC2 Test Plan
- Release Week: Mar 6th, 2017. Plan is to ship this build on Tue, March 7th 2017 (Release Calendar)
- QA Contacts: Florin Mezei; Andrei Vaida; Cornel Ionce
- IRC: irc://irc.mozilla.org#qa ping FlorinMezei; avaida; cornel_ionce
- Build 2: 52.0-build2 | 44d6a57ab554 | (ID: 20170302120751)
QE recommendation regarding the quality of the build
- Recommendation based on results from manual testing:
Build 2 | SHIP IT |
---|
Manual Testing summary - Platform Coverage and Areas Tested
- Testing performed around Add-on Compatibility and Web Compatibility.
- Test Cases executed and results: report
Build 2
Platform | GPU | Build architecture | Assignee | Results: report |
---|---|---|---|---|
Windows 10 x64 | Intel HD 530 | 64-bit | Emil Ghitta | [DONE] |
Windows 7 x64 | NVIDIA GeForce 210 | 32-bit | Camelia Badau | [DONE] |
Mac OS X 10.11 | Intel Iris Pro (1536 MB) | 64-bit | Timea Zsoldos | [DONE] |
Ubuntu 16.04 x86 | AMD Radeon R7 200 | 64-bit | Paul Silaghi | [DONE] |
Tested Area | Testing Type | Results |
---|---|---|
Web compatibility | Exploratory Testing | PASSED |
Features
See the [1] gdoc for a general overview
Feature | Owner | Testing | Sign off | Details | Test Plan |
---|---|---|---|---|---|
Touch events in APZ | Petruta Rasa | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is YELLOW. | Test Plan |
New Responsive Design Mode | Mihai Boldan | [AT RISK] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is RED because there are 26 open bugs still affecting it | Test Plan |
Partner Search | Paul Silaghi | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
Device Permissions (Screen Sharing) | Cornel Ionce | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
Skia Content for Windows (Compositor Process) | Mihai Boldan | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
Ship DTMF support in Firefox | Cornel Ionce | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
Restartless System Add-ons | Alexandru Simonca, Cristian Comorasu | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
CSS Grid, CSS Grid Inspector | Bogdan Maris, Paul Silaghi | [AT RISK] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is RED because there are 2 bugs severely affecting it and several high impact issues were encountered during sign-off. | --- |
mediaDevices.ondevicechange in MediaStream | Alexandru Simonca | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
Improvements to <select> element | Petruta Rasa | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | --- |
First-party isolation (Tor) | Bogdan Maris (assisting only) | [DONE] | --- | Feature set to release with Firefox 52. Will not be signed off by our team but a pre-Release test report for the parts our team tested was sent on Feb 27. | --- |
Automatic Captive Portal detection | Camelia Badau | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is YELLOW. | Test Plan |
Insecure Password Manager | Iulia Cristescu | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
Introduce word (and sentence?) tracking in Narrate | Camelia Badau | [DONE] | --- | Feature set to release with Firefox 52. Release QA will not be signing off on this, as we've only got notice of it at the end of the cycle. We did make sure that the most basic functionality associated to it is intact, though (see results). | --- |
Results
New bugs
ID | Summary | Status | Resolution |
---|---|---|---|
1344157 | Wikipedia media viewer close needs about 3 seconds delay | RESOLVED | DUPLICATE |
1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);
Known Issues - also seen in previous builds
Major issues also seen in previous builds
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Low impact issues also seen in previous builds
ID | Summary | Status | Resolution |
---|---|---|---|
616629 | "Remember Password?" dialog shows too early | RESOLVED | DUPLICATE |
1191290 | Glitches after opening images in tumblr | RESOLVED | WORKSFORME |
1192204 | Scrollbar is overlapping the Quality entries via Youtube high resolution videos | RESOLVED | WORKSFORME |
1194214 | [HTML5] Several side effects using the context menu options on Youtube | NEW | |
1210769 | Glitches after opening images via flickr | RESOLVED | WORKSFORME |
1233359 | Glitches after opening images in facebook | NEW | |
1305744 | Twitter profile picture glitches when the page is scrolled in maximized window | RESOLVED | WORKSFORME |
1309534 | Glitches when zoom in .jpg files from Wikipedia | RESOLVED | WORKSFORME |
8 Total; 2 Open (25%); 6 Resolved (75%); 0 Verified (0%);
Branch Bug Fix Verifications
Full Query ID Summary Status Resolution 1336350 Some PDF crashes Firefox when using internal PDF Viewer VERIFIED FIXED 1342051 Grid highlighter can no longer be activated after Inspector close and page refresh VERIFIED FIXED 2 Total; 0 Open (0%); 0 Resolved (0%); 2 Verified (100%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed