Releases/Firefox 41/Test Plan/Beta/4

From MozillaWiki
Jump to: navigation, search

«  Firefox 41 Beta 3 | Firefox 41 Beta 4 | Firefox 41 Beta 5  »

Firefox 41.0 Beta 4 (build 1) Test Plan

QE recommendation regarding the quality of the build

Recommendation based on results from manual testing GOOD FOR RELEASE

Manual Testing summary - Platform Coverage and Areas Tested

  • * Testing is performed around areas most affected by fixes since the previous Beta, or areas that are mandatory to test in the Beta cycle
  • Test Cases executed and results: report
Platform Assignee Results: report
Windows 8 x86 (Intel HD 2500) Camelia Badau [DONE]
Windows 10 x64 (AMD Radeon HD 3000) Andrei Vaida [DONE]
Mac OS X 10.6 (AMD Radeon HD 2400 XT) Vasilica Mihasca [DONE]
Ubuntu 13.04 x64 (Intel HD 2500) Petruta Rasa [DONE]
Tested Area Testing Type Results
PRINTING Regression Testing PASS
VIDEO COMPATIBILITY Regression Testing CONDITIONAL PASS
AUDIO COMPATIBILITY Regression Testing PASS
HELLO (BASIC CALL) Regression Testing CONDITIONAL PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Async plugin init TBD (disabled in Fx 40 release) [AT RISK] Feature released in Beta 40, but disabled due to reported issues -
New Add-on Signing Vasilica Mihasca [ON TRACK] Feature dropped from Firefox 39 & 40 (not enough add-ons signed) - final QA sign-off at the end of Beta 41 Test Plan
Hello - Text Chat Bogdan Maris [ON TRACK] New feature targeted for Firefox 41 - final QA sign-off at the end of Beta 41 Test Plan
Unified telemetry/FHR Alexandra Lucinet / Andrei Vaida [NOT STARTED] New feature targeted for Firefox 41 - final QA sign-off at the end of Beta 41 Test Plan

Results

New bugs

Full Query
ID Summary Status Resolution
1198278 Ugly artifacts when entering in Customize mode during tab sharing RESOLVED INCOMPLETE

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Full Query
ID Summary Status Resolution
1182438 Editing the context URL should change/remove the favicon, as it's no longer relevant RESOLVED WONTFIX
1182440 Edited context does not update on the standalone page (link clicker) RESOLVED INVALID
1194706 Sharing controls no longer shown on detached Hello window VERIFIED FIXED

3 Total; 0 Open (0%); 2 Resolved (66.67%); 1 Verified (33.33%);


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
545940 Cannot set two-sided printing under Mac and Ubuntu NEW
962560 Audio volume UI resets to full volume after toggling the screen size of a video RESOLVED FIXED
1010976 Hitting the "Hide Controls" option twice causes the container area to disappear VERIFIED FIXED
1051834 screensharing allows the sharing indicator to be shared NEW
1122858 The Firefox Hello window opens to the top left edge of the screen if the Hello icon is placed in the hamburger menu RESOLVED INCOMPLETE
1142945 Always deny fullscreen should not be a possible input RESOLVED FIXED
1161952 [Ubuntu] Low quality when printing a pdf file RESOLVED WORKSFORME
1168101 Reader View icon is shown on some Youtube pages RESOLVED WORKSFORME
1176218 [Youtube][HTML5] 8K videos do not work at all, or Audio only VERIFIED FIXED
1180214 Wrong video duration when using GStreamer0.10 RESOLVED FIXED
1184497 Intermittently, SVG file is not correctly printed RESOLVED WORKSFORME
1185977 A Scroll Bar is displayed in Loop Panel for a long Conversation Name RESOLVED WORKSFORME
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos RESOLVED WORKSFORME
1194214 [HTML5] Several side effects using the context menu options on Youtube NEW
1194241 [Ubuntu] Pause option is not displayed in context menu while the audio sample is played RESOLVED WORKSFORME
1195438 YouTube's HTML player controls are not shown when Firefox enters full screen mode from "Full Screen" context menu command RESOLVED INVALID

16 Total; 3 Open (18.75%); 11 Resolved (68.75%); 2 Verified (12.5%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1186842 Unresponsive keyboard buttons using a PDF file VERIFIED FIXED

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed