Releases/Firefox 40/Test Plan/Beta/6
From MozillaWiki
« Firefox 40 Beta 5 | Firefox 40 Beta 6 | Firefox 40 Beta 7 »
Firefox 40 Beta 6 (build 1) Test Plan
- Release Week: July 20th, 2015. Plan is to ship this build on Tuesday July 21st 2015 (Release Calendar)
- QA Contacts: Robert Kaiser; Florin Mezei; Andrei Vaida
- IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei; avaida
- Build 1: Firefox 40 Beta 6 build 1 | changeset | (ID: 20150720220238)
QE recommendation regarding the quality of the build
Recommendation based on results from manual testing | CONDITIONAL PASS (multiple known issues) |
---|
Manual Testing summary - Platform Coverage and Areas Tested
- Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
- Test Cases executed and results: report
PLATFORM MATRIX
Platform | Assignee | Results: report |
Windows 8.1 x64 (NVIDIA GeForce 210) | Alexandra Lucinet | [DONE] |
Windows 10 x86 (AMD Radeon HD 7700 Series) | Cornel Ionce | [DONE] |
Mac OS X 10.10 (Intel Iris Pro 1536 MB) | Bogdan Maris | [DONE] |
Ubuntu 14.04 x86 (ATI Radeon 3000) | Vasilica Mihasca | [DONE] |
AREAS TESTED
Tested Area | Testing Type | Results |
ADD-ON COMPATIBILITY | Regression Testing | CONDITIONAL PASS |
HELLO CONTEXT | Regression Testing | CONDITIONAL PASS |
OS X SIGNING | Regression Testing | PASS |
OS X 32-BIT MODE | Regression Testing | PASS |
Features
See the Feature Release Tracking gdoc for a general overview
Feature | Owner | Status | Details | Test Plan |
---|---|---|---|---|
Async plugin init | Catalin Varga | [ON TRACK] | Feature is in Beta 40, but still disabled by default - potential final QA sign-off at the end of Beta 40 | - |
First Run for 40 release | Catalin Varga | [NOT STARTED] | New feature targeted for Firefox 40 (not yet implemented) - final QA sign-off at the end of Beta 40 | - |
Suggested tiles: Sponsored | Cornel Ionce | [ON TRACK] | Feature dropped from Firefox 39 - final QA sign-off at the end of Beta 40 | Test Plan |
New Add-on Signing | Vasilica Mihasca | DROPPED FROM 40 | Feature dropped from Firefox 39 & 40 (not enough add-ons signed) | - |
Unified telemetry/FHR | Stuart Philp | DROPPED FROM 40 | Testing performed is tracked in bug 1169037 | - |
OMTC by default on Linux | Alexandra Lucinet | [ON TRACK] | New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 | - |
Hello - Context | Bogdan Maris | [AT RISK] | New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 | - |
Windows 10 support | Andrei Vaida / Cornel Ionce | [AT RISK] | New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 | - |
Results
New bugs
ID | Summary | Status | Resolution |
---|---|---|---|
1185968 | [HiDPI] Hello conversation window is cut-off when several calls are listed | RESOLVED | INCOMPLETE |
1185977 | A Scroll Bar is displayed in Loop Panel for a long Conversation Name | RESOLVED | WORKSFORME |
2 Total; 0 Open (0%); 2 Resolved (100%); 0 Verified (0%);
Known Issues - also seen in previous builds
Major issues also seen in previous builds
9 Total; 0 Open (0%); 5 Resolved (55.56%); 4 Verified (44.44%);
Low impact issues also seen in previous builds
9 Total; 0 Open (0%); 9 Resolved (100%); 0 Verified (0%);
Branch Bug Fix Verifications
ID | Summary | Status | Resolution |
---|---|---|---|
1128238 | [e10s] Facebook's Flash video player does not respond to mouse input | VERIFIED | FIXED |
1144107 | crash in [@ stagefright::SampleTable::isValid() ] with h264 mp4 | RESOLVED | FIXED |
1151412 | Question mark icons in conversation window | VERIFIED | FIXED |
1170627 | Save Context button doesn't exit screen | VERIFIED | FIXED |
1172847 | 'Let’s Talk About' hard to see in conversation window after someone joins the conversation due to its color | VERIFIED | FIXED |
1174950 | NukeCrossCompartmentWrappers should nuke wrappers from expanded principals | RESOLVED | FIXED |
1178307 | Darker Hello icon needed for Windows 10 toolbar | VERIFIED | FIXED |
1181130 | Broken selection system inside of a nested contenteditable element | RESOLVED | FIXED |
1182444 | Volume option is displayed as disabled although is enabled | VERIFIED | FIXED |
1184333 | [EME] GMP loading fails if Chinese characters in GMP dir path | VERIFIED | FIXED |
10 Total; 0 Open (0%); 3 Resolved (30%); 7 Verified (70%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed