Releases/Firefox 38/Test Plan/38.0.5/RC/4

From MozillaWiki
Jump to: navigation, search

«  Firefox 38.0.5 RC build 3 | Firefox 38.0.5 RC build 4 | Firefox 39 Beta 1  »

Firefox 38.0.5 RC (build 4) Test Plan


QE recommendation regarding the quality of the build

Recommendation based on results from manual testing SIGN OFF

Drivers for this build

  • bug 1166183 - Back out the direct listener removal landed by mistake in bug 1141781
    • note: Paul Adenot confirmed that the fix pushed for this issue was verified by Nils and it doesn't require our attention
  • bug 1159973 - [secured bug]
    • note: we were unable to confirm the fix pushed for this bug. We tried to reproduce it on the affected builds using at least 5 different hardware configurations, with no success. At this point, the only thing we’re seeing on RC 38.0.5 (build4) is a short hang when opening the test case provided in the bug

Platform Coverage and Areas Tested

  • Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
Platform Assignee Result: report
Windows 7 x64 (Graphics: nVIDIA GeForce 620) Cornel Ionce [DONE]
Windows 8.1 x86 (Graphics: AMD Radeon HD 5450) Catalin Varga [DONE]
Mac OS X 10.9.5 (Graphics: Intel Iris Pro 1024 MB) Ada Lucinet [DONE]
Ubuntu 13.04 x64 (Graphics: Intel HD Graphics 2500) Petruta Rasa [DONE]
Tested Area Testing Type Results (test cases report)
Web Compatibility Smoke Testing PASS
WebRTC Smoke Testing PASS
Hello Screensharing Smoke Testing PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Pocket Integration Andrei Vaida [AT RISK] New feature in Firefox 38.0.5 Test Plan
Hello screensharing Bogdan Maris [AT RISK] New feature in Firefox 38.0.5 Test Plan
Reader View Andrei Vaida [AT RISK] New feature in Firefox 38.0.5 Test Plan

Results

New bugs

Full Query
ID Summary Status Resolution
1168377 Hello shouldn't let you attempt to join a room from different windows RESOLVED DUPLICATE

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Known Issues - also seen in previous builds

  • Major issues also seen in previous builds
Full Query
ID Summary Status Resolution
1146882 Starting tab sharing before the call will not show the tab when someone joins conversation RESOLVED WONTFIX
1154271 crash in nvwgf2um.dll@0x7fec13 RESOLVED WORKSFORME
1162520 crash in DrawingContext::FillRectangle(D2D_RECT_F const*, ID2D1Brush*) RESOLVED FIXED
1163999 Screensharing also stops when user selects 'Stop Sharing' from the camera/microphone permissions drop-down RESOLVED WORKSFORME

4 Total; 0 Open (0%); 4 Resolved (100%); 0 Verified (0%);

  • Low impact issues also seen in previous builds
Full Query
ID Summary Status Resolution
947079 Passive mixed content indicator (grey triangle) shows up on full HTTPS sites that have no mixed content RESOLVED FIXED
1096357 "Unable to run script because scripts are blocked internally" JS error appear in browser console while browsing facebook and youtube on MacOS RESOLVED INCOMPLETE
1137602 Windows only - Global indicator does not call any pop-ups from Firefox RESOLVED INCOMPLETE
1142992 Youtube video stops after some minutes (with 1080p) RESOLVED WORKSFORME
1143988 Make YouTube 360° videos work well RESOLVED WORKSFORME
1147363 [Youtube][HTML5] Settings set after having clicked "Next" are lost when exiting fullscreen RESOLVED WORKSFORME
1151863 Console error when switching youtube videos to fullscreen and back: NS_ERROR_FAILURE: Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsITaskbarTabPreview.invalidate] WindowsPreviewPerTab.jsm:406:0 RESOLVED DUPLICATE
1164000 Webcam windows are misplaced when joining a screenshared conversation with No Video selected RESOLVED WORKSFORME
1167572 [Linux] Youtube video content is not visible when tabs are shared RESOLVED WONTFIX
1167591 Wrong shared tab if dragged in/out of Firefox RESOLVED INCOMPLETE

10 Total; 0 Open (0%); 10 Resolved (100%); 0 Verified (0%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1164920 Pocket button not disabled on first load in menu VERIFIED FIXED
1165416 Update Pocket code to latest version (May 15th code drop) VERIFIED FIXED
1167096 Pocket Icon reappears in the toolbar after removal on a clean profile (or at least one with no saved state) VERIFIED FIXED

3 Total; 0 Open (0%); 0 Resolved (0%); 3 Verified (100%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed