Releases/Firefox 40/Test Plan/Beta/2
From MozillaWiki
« Firefox 40 Beta 1 | Firefox 40 Beta 2 | Firefox 40 Beta 3 »
Firefox 40 Beta 2 (build 1) Test Plan
- Release Week: July 6th, 2015. Plan is to ship this build on Tuesday July 7th 2015 (Release Calendar)
- QA Contacts: Robert Kaiser; Florin Mezei; Andrei Vaida
- IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei; avaida
- Build 1: Firefox 40 Beta 2 build 1 | changeset | (ID: 20150706172413)
QE recommendation regarding the quality of the build
| Recommendation based on results from manual testing | GOOD FOR RELEASE |
|---|
Manual Testing summary - Platform Coverage and Areas Tested
- Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
- Test Cases executed and results: report
| Platform | Assignee | Results: report |
| Windows 7 x64 (Intel HD Graphics 2500) | Petruta Rasa | [DONE] |
| Windows 8.1 x86 (ATI Radeon 3000) | Vasilica Mihasca | [DONE] |
| Mac OS X 10.10.4 (Intel Iris Pro 1024 MB) | Cornel Ionce | [DONE] |
| Ubuntu 14.04 x64 (ATI Radeon 3000) | Andrei Vaida | [DONE] |
| Tested Area | Testing Type | Results |
| BROWSER CUSTOMIZATION | Regression Testing | PASS |
| EME | Regression Testing | PASS |
Features
See the Feature Release Tracking gdoc for a general overview
| Feature | Owner | Status | Details | Test Plan |
|---|---|---|---|---|
| Async plugin init | Catalin Varga | [ON TRACK] | Feature is in Beta 40, but still disabled by default - potential final QA sign-off at the end of Beta 40 | - |
| First Run for 40 release | Catalin Varga | [NOT STARTED] | New feature targeted for Firefox 40 (not yet implemented) - final QA sign-off at the end of Beta 40 | - |
| Suggested tiles: Sponsored | Cornel Ionce | [ON TRACK] | Feature dropped from Firefox 39 - final QA sign-off at the end of Beta 40 | Test Plan |
| New Add-on Signing | Vasilica Mihasca | [ON TRACK] | Feature dropped from Firefox 39 (not enough add-ons signed) - final QA sign-off at the end of Beta 40 | - |
| Unified telemetry/FHR | - | [AT RISK] | New feature targeted for Firefox 40 (no testing details received yet) - potential final QA sign-off at the end of Beta 40 | - |
| OMTC by default on Linux | Alexandra Lucinet | [ON TRACK] | New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 | - |
| Hello - Context | Bogdan Maris | [ON TRACK] | New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 | - |
Results
New bugs
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1181059 | Intermittently, theme preview remains blocked | RESOLVED | WORKSFORME |
| 1181060 | Themes 2row titles are overlapped by the "+ Add" button on hover | VERIFIED | FIXED |
2 Total; 0 Open (0%); 1 Resolved (50%); 1 Verified (50%);
Known Issues - also seen in previous builds
Major issues also seen in previous builds
NONE
Low impact issues also seen in previous builds
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 962560 | Audio volume UI resets to full volume after toggling the screen size of a video | RESOLVED | FIXED |
| 972658 | Undo 'restore defaults' does not restore toolbar visibility (bookmarks / menu toolbar ) | NEW | |
| 1008178 | Intermittently, mouse-over on personas doesn't preview the themes | RESOLVED | INACTIVE |
| 1144722 | Hello button cannot be positioned at the top of Menu panel | RESOLVED | INCOMPLETE |
| 1177382 | Error is thrown by controller.jsm each time a URL is dragged onto the Bookmarks Toolbar | RESOLVED | FIXED |
| 1179739 | Errors are thrown in the Browser Console each time the user enters Customize | RESOLVED | DUPLICATE |
6 Total; 1 Open (16.67%); 5 Resolved (83.33%); 0 Verified (0%);
Branch Bug Fix Verifications
11 Total; 0 Open (0%); 0 Resolved (0%); 11 Verified (100%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
