Releases/Firefox 40/Test Plan/Beta/3
From MozillaWiki
« Firefox 40 Beta 2 | Firefox 40 Beta 3 | Firefox 40 Beta 4 »
Firefox 40 Beta 3 (build 1) Test Plan
- Release Week: July 6th, 2015. Plan is to ship this build on Friday July 10th 2015 (Release Calendar)
- QA Contacts: Robert Kaiser; Florin Mezei; Andrei Vaida
- IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei; avaida
- Build 1: Firefox 40 Beta 3 build 1 | changeset | (ID: 20150709163524)
QE recommendation regarding the quality of the build
Recommendation based on results from manual testing | CONDITIONAL SIGN OFF |
---|
Manual Testing summary - Platform Coverage and Areas Tested
- Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
- Test Cases executed and results: report
PLATFORM MATRIX
Platform | Assignee | Results: report |
Windows 10 x86 (10158) (AMD Radeon HD 7700) | Andrei Vaida | [DONE] |
Windows 8.1 x64 (Intel HD Graphics 2500) | Camelia Badau | [DONE] |
Mac OS X 10.8.5 (AMD Radeon HD 6630M 256) | Florin Mezei | [DONE] |
Ubuntu 14.04 x86 (NVIDIA GeForce 210) | Alexandra Lucinet | [DONE] |
AREAS TESTED
Tested Area | Testing Type | Results |
VIDEO COMPATIBILITY | Regression Testing | CONDITIONAL PASS |
AUDIO COMPATIBILITY | Regression Testing | PASS |
HELLO | Regression Testing | CONDITIONAL PASS |
Features
See the Feature Release Tracking gdoc for a general overview
Feature | Owner | Status | Details | Test Plan |
---|---|---|---|---|
Async plugin init | Catalin Varga | [ON TRACK] | Feature is in Beta 40, but still disabled by default - potential final QA sign-off at the end of Beta 40 | - |
First Run for 40 release | Catalin Varga | [NOT STARTED] | New feature targeted for Firefox 40 (not yet implemented) - final QA sign-off at the end of Beta 40 | - |
Suggested tiles: Sponsored | Cornel Ionce | [ON TRACK] | Feature dropped from Firefox 39 - final QA sign-off at the end of Beta 40 | Test Plan |
New Add-on Signing | Vasilica Mihasca | [ON TRACK] | Feature dropped from Firefox 39 (not enough add-ons signed) - final QA sign-off at the end of Beta 40 | - |
OMTC by default on Linux | Alexandra Lucinet | [ON TRACK] | New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 | - |
Hello - Context | Bogdan Maris | [ON TRACK] | New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 | - |
Results
New bugs
ID | Summary | Status | Resolution |
---|---|---|---|
1182438 | Editing the context URL should change/remove the favicon, as it's no longer relevant | RESOLVED | WONTFIX |
1182440 | Edited context does not update on the standalone page (link clicker) | RESOLVED | INVALID |
1182444 | Volume option is displayed as disabled although is enabled | VERIFIED | FIXED |
3 Total; 0 Open (0%); 2 Resolved (66.67%); 1 Verified (33.33%);
Known Issues - also seen in previous builds
Major issues also seen in previous builds
ID | Summary | Status | Resolution |
---|---|---|---|
1151412 | Question mark icons in conversation window | VERIFIED | FIXED |
1170627 | Save Context button doesn't exit screen | VERIFIED | FIXED |
1171940 | Move the context views to the chat area inside conversations | VERIFIED | FIXED |
1172847 | 'Let’s Talk About' hard to see in conversation window after someone joins the conversation due to its color | VERIFIED | FIXED |
1174702 | Unnecessary scroll while editing context. | RESOLVED | FIXED |
1175841 | [Linux] Inconsistent font size in context edit screen | RESOLVED | WORKSFORME |
1180140 | The user is unable to join back the conversation after a crash | RESOLVED | FIXED |
1182064 | Make it obvious in context edit panel that an url/address is required, else comments won't be saved | RESOLVED | INVALID |
8 Total; 0 Open (0%); 4 Resolved (50%); 4 Verified (50%);
Low impact issues also seen in previous builds
ID | Summary | Status | Resolution |
---|---|---|---|
962560 | Audio volume UI resets to full volume after toggling the screen size of a video | RESOLVED | FIXED |
1010976 | Hitting the "Hide Controls" option twice causes the container area to disappear | VERIFIED | FIXED |
1089610 | Newtab page at minimum width causes cropped elements | RESOLVED | WONTFIX |
1122858 | The Firefox Hello window opens to the top left edge of the screen if the Hello icon is placed in the hamburger menu | RESOLVED | INCOMPLETE |
1142945 | Always deny fullscreen should not be a possible input | RESOLVED | FIXED |
1143988 | Make YouTube 360° videos work well | RESOLVED | WORKSFORME |
1159745 | Firefox says mp3 is corrupt, but it downloads and plays just fine | RESOLVED | WORKSFORME |
1168101 | Reader View icon is shown on some Youtube pages | RESOLVED | WORKSFORME |
8 Total; 0 Open (0%); 7 Resolved (87.5%); 1 Verified (12.5%);
Branch Bug Fix Verifications
ID | Summary | Status | Resolution |
---|---|---|---|
1177461 | [EME] EME plugin voucher still disappearing | RESOLVED | FIXED |
1178215 | Update libvpx to more recent git version (1.4.x) | RESOLVED | FIXED |
1180610 | [EME] EME plugin voucher disappearing after launch not handled | VERIFIED | FIXED |
3 Total; 0 Open (0%); 2 Resolved (66.67%); 1 Verified (33.33%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed