Releases/Firefox 45/Test Plan/Beta/3

From MozillaWiki
Jump to: navigation, search

«  Firefox 45 Beta 2 | Firefox 45 Beta 3 | Firefox 45 Beta 4  »

Firefox 45.0 Beta 3 (build 1) Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 CONDITIONAL SIGN OFF


Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around: Sync, Audio Compatibility and the Tab Sound Indicator feature.
  • Test Cases executed and results: report
Platform Build architecture Assignee Results: report
Windows 10 x86 (AMD Radeon HD 7700) 32-bit Mihai Boldan [DONE]
Windows 7 x64 (AMD Radeon HD 3000) 64-bit Ada Lucinet [DONE]
Mac OS X 10.8 (AMD Radeon HD 6630M) 64-bit Camelia Badau [DONE]
Ubuntu 12.04 x86 (nVIDIA GeForce 620) 32-bit Cornel Ionce [DONE]
Tested Area Testing Type Results
SYNC Regression Testing FAIL
AUDIO COMPATIBILITY Regression Testing CONDITIONAL PASS
TAB SOUND INDICATOR Regression Testing PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Text to Speech Camelia Badau [ON TRACK] Feature targeted for Firefox 45 - final QA sign-off at the end of Beta 45 Test Plan
Search Refactoring Petruta Rasa [ON TRACK] Feature targeted for Firefox 45 - final QA sign-off at the end of Beta 45 Test Plan
Tab Groups Migration Paul Silaghi [ON TRACK] Feature targeted for Firefox 45 - final QA sign-off at the end of Beta 45 Test Plan
Sync Tabs Menu Vasilica Mihasca [ON TRACK] Feature targeted for Firefox 45 - final QA sign-off at the end of Beta 45 Test Plan


Results

New bugs

Full Query
ID Summary Status Resolution
1246128 F11 displays the audio container in fullscreen instead of the browser VERIFIED FIXED
1246138 The account picture is wrongly displayed when trying to upload a photo from the firstrun page RESOLVED FIXED
1246147 Unexpected error displayed for a second when signing into FxA RESOLVED FIXED
1246148 A long e-mail address overlaps the designated area when a display name is set RESOLVED FIXED

4 Total; 0 Open (0%); 3 Resolved (75%); 1 Verified (25%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Low impact issues also seen in previous builds

Full Query
ID Summary Priority Status
428378 Synced tabs, bookmarks, and history entries don't have a favicon until the user re-visits that page again P2 REOPENED
1010976 Hitting the "Hide Controls" option twice causes the container area to disappear -- VERIFIED
1044586 F5 key breaks about:preferences -- RESOLVED
1124171 Video and audio play speed resets to normal after pausing and resuming a recording -- RESOLVED
1195569 First sync after creating a new account always creates an error log P3 REOPENED
1206736 Firefox should not ask to save an incorrect Firefox Account credential P3 REOPENED
1229749 "Show" button from the reset password page should only react on second press if the textarea is not in focus -- RESOLVED
1231244 Flash mute doesn't work with Flash Player 20 (Windows, Mac OSX) -- RESOLVED
1238940 Wrong link redirect when clicking Email Preferences from Firefox Accounts -- RESOLVED
1238955 The light themes are not synced P2 RESOLVED
1238959 Clicking show password on one filed will show both old and new -- RESOLVED
1238960 Firefox Accounts preference pane won't close when Back button is pressed -- RESOLVED
1238961 Browser becomes unresponsive when stressing the Firefox Accounts page -- RESOLVED
1238962 The FXA settings are overlapping the Add account picture screen -- RESOLVED

14 Total; 3 Open (21.43%); 10 Resolved (71.43%); 1 Verified (7.14%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1222171 "GraphicsCriticalError: |[0][GFX1]: Unknown cairo format 3" on startup on Linux machine with VNC "screen" VERIFIED FIXED
1244505 Firefox 44 no longer allows spaces in cookie names, breaking some apps VERIFIED FIXED

2 Total; 0 Open (0%); 0 Resolved (0%); 2 Verified (100%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed