Releases/Firefox 40/Test Plan/Beta/8

From MozillaWiki
Jump to: navigation, search

«  Firefox 40 Beta 7 | Firefox 40 Beta 8 | Firefox 40 Beta 9  »

Firefox 40 Beta 8 (build 1) Test Plan

QE recommendation regarding the quality of the build

Recommendation based on results from manual testing SIGN OFF

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
  • Test Cases executed and results: report

PLATFORM MATRIX

Platform Assignee Results: report
Windows 8 x64 (AMD Radeon HD 7700) Vasilica Mihasca 90% DONE
Windows 7 x86 (Intel HD Graphics 2500) Camelia Badau 90% DONE
Mac OS X 10.10 (Intel Iris Pro 1024 MB) Catalin Varga 100% DONE
Ubuntu 12.04 x86 (Intel HD Graphics 2500) Petruta Rasa 100% DONE

AREAS TESTED

Tested Area Testing Type Results
PLUG-IN COMPATIBILITY Regression Testing PASS
EME Regression Testing PASS
EME - NETFLIX Regression Testing PENDING
HELLO Regression Testing FAIL

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Async plugin init Catalin Varga [ON TRACK] Feature is in Beta 40, but still disabled by default - potential final QA sign-off at the end of Beta 40 -
First Run for 40 release Catalin Varga [NOT STARTED] New feature targeted for Firefox 40 (not yet implemented) - final QA sign-off at the end of Beta 40 -
Suggested tiles: Sponsored Cornel Ionce [ON TRACK] Feature dropped from Firefox 39 - final QA sign-off at the end of Beta 40 Test Plan
New Add-on Signing Vasilica Mihasca DROPPED FROM 40 Feature dropped from Firefox 39 & 40 (not enough add-ons signed) -
Unified telemetry/FHR Stuart Philp DROPPED FROM 40 Testing performed is tracked in bug 1169037 -
OMTC by default on Linux Alexandra Lucinet [ON TRACK] New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 -
Hello - Context Bogdan Maris [ON TRACK] New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 -
Windows 10 support Andrei Vaida / Cornel Ionce [AT RISK] New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 -

Results

New bugs

No bugs.

Known Issues - also seen in previous builds

Major issues also seen in previous builds

Full Query
ID Summary Status Resolution
928379 QuickTime controls bar is missing RESOLVED WORKSFORME
1146882 Starting tab sharing before the call will not show the tab when someone joins conversation RESOLVED WONTFIX
1175090 Cancel button from the calls made via hello does nothing RESOLVED DUPLICATE
1180655 Context shown for some about: pages RESOLVED INVALID
1182440 Edited context does not update on the standalone page (link clicker) RESOLVED INVALID

5 Total; 0 Open (0%); 5 Resolved (100%); 0 Verified (0%);


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
962560 Audio volume UI resets to full volume after toggling the screen size of a video RESOLVED FIXED
1051834 screensharing allows the sharing indicator to be shared NEW
1092166 Crash in [@ DeallocateCB ] caused by SetOutputType() RESOLVED WORKSFORME
1114846 Rooms store should update the local version immediately in cases where the action is unlikely to fail RESOLVED INCOMPLETE
1122858 The Firefox Hello window opens to the top left edge of the screen if the Hello icon is placed in the hamburger menu RESOLVED INCOMPLETE
1137602 Windows only - Global indicator does not call any pop-ups from Firefox RESOLVED INCOMPLETE
1142945 Always deny fullscreen should not be a possible input RESOLVED FIXED
1144722 Hello button cannot be positioned at the top of Menu panel RESOLVED INCOMPLETE
1171894 Reader View icon is shown for several apple.com trailers RESOLVED WORKSFORME
1173632 [EME] CDM host abort in mozilla::gmp::PGMPVideoDecoderChild::Write(mozilla::gmp::PGMPVideoDecoderChild*, IPC::Message*, bool) RESOLVED WONTFIX
1174702 Unnecessary scroll while editing context. RESOLVED FIXED
1180700 Favicon missing from StandaloneUI context, when comments field contains long word, more then 20 characters VERIFIED FIXED
1185977 A Scroll Bar is displayed in Loop Panel for a long Conversation Name RESOLVED WORKSFORME

13 Total; 1 Open (7.69%); 11 Resolved (84.62%); 1 Verified (7.69%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1164510 Context needs a default favicon for the panel room list VERIFIED FIXED
1170141 browser startup crashes in nprpffbrowserrecordext.dll or similar with Firefox 40+ VERIFIED FIXED
1173739 Update history dropdown and Reload/Stop/Go icons on Windows 10 VERIFIED FIXED
1176565 Update tree and list box styling for Windows 10 VERIFIED FIXED
1179295 Forward arrow is stretched vertically in Windows 10 theme VERIFIED FIXED
1179752 Location bar bottom border shouldn't be displayed next to the autocomplete pop-up VERIFIED FIXED
1182308 Windows 10 search rewrite should handle more Bing domains VERIFIED FIXED
1183932 Update onboarding for Fx 40 with single slide VERIFIED FIXED
1186886 Fullscreen browser has misplaced command button cutout VERIFIED FIXED
1187631 Reduce caption button height to normal native size RESOLVED FIXED

10 Total; 0 Open (0%); 1 Resolved (10%); 9 Verified (90%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_40/Test_Plan/Beta/8&oldid=1086886"