Releases/Firefox 51/Test Plan/Beta/14
From MozillaWiki
« Firefox 51 Beta 11 | Firefox 51 Beta 12 | Firefox 51 Beta 13 »
Firefox 51.0 Beta 13 Test Plan
- Release Week: Jan 09, 2017. Plan is to ship this build on Fri, Jan 13th 2017 (Release Calendar)
- QA Contacts: Florin Mezei; Andrei Vaida; Cornel Ionce
- IRC: irc://irc.mozilla.org#qa ping FlorinMezei; avaida; ionce.cornel
- Build 1: 51.0b14-build1 | 09142d07fd73 | (ID: 20170112171116)
QE recommendation regarding the quality of the build
- Recommendation based on results from manual testing:
| Build 1 | SHIP IT, CONDITIONALLY (1330979) |
|---|
Manual Testing summary - Platform Coverage and Areas Tested
- Testing performed around Sync and Firefox Account.
- [DONE] Part of our efforts were also focused on making sure that Windows stub installers work as intended.
- Test Cases executed and results: report
Build 1
| Platform | GPU | Build architecture | Assignee | Results: report |
|---|---|---|---|---|
| Windows 7 x86 | AMD Radeon R7 200 | 32-bit | Paul Silaghi | [DONE] |
| Windows 10 x64 | Intel HD Graphics 5500 | 32-bit | Camelia Badau | [DONE] |
| macOS 10.12 | AMD Radeon HD 6750M (512 MB) | 64-bit | Bogdan Maris | [DONE] |
| Ubuntu 12.04 x86 | Intel HD 2500 | 32-bit | Mihai Boldan | [DONE] |
| Tested Area | Testing Type | Results |
|---|---|---|
| Web compatibility | Exploratory Testing | FAILED |
| Downloads | Smoke and Exploratory Testing | PASS |
Features
See the [1] gdoc for a general overview
| Feature | Owner | Testing | Sign off | Details | Test Plan |
|---|---|---|---|---|---|
| WebGL2 | Bogdan Maris | [ON TRACK] | IN PROGRESS | Feature set to release with Firefox 51, pre-Release sign off underway. | Test Plan |
| Indicator for Streaming or Permissions | Cornel Ionce | [DONE] | GREEN | Feature set to release with Firefox 51, pre-Release sign off completed. | Test Plan |
| Support for FLAC | Ciprian Georgiu | [DONE] | GREEN | Feature set to release with Firefox 51, pre-Release sign off completed. | Test Plan |
| Zoom Indicator | Iulia Cristescu | [ON TRACK] | IN PROGRESS | Feature set to release with Firefox 51, pre-Release sign off underway. | Test Plan |
| ICE candidate generation control and user authorization | Iulia Cristescu | [ON TRACK] | IN PROGRESS | Feature set to release with Firefox 51, pre-Release sign off underway. | Test Plan |
| Support VP9 for WebRTC | Iulia Cristescu | --- | --- | Feature set to release with Firefox 51, but won't be tracked by our team. | --- |
Results
New bugs
Bugzilla query error
error, http-bad-status, Array
Known Issues - also seen in previous builds
Major issues also seen in previous builds
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1330979 | Drag & drop files no longer works on onedrive.com | VERIFIED | FIXED |
1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);
Low impact issues also seen in previous builds
18 Total; 5 Open (27.78%); 9 Resolved (50%); 4 Verified (22.22%);
Branch Bug Fix Verifications
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
