Releases/Firefox 38/Test Plan/38.0.5/RC/1

From MozillaWiki
Jump to: navigation, search

«  Firefox 38.0.5 Beta 3 | Firefox 38.0.5 RC | Firefox 39 Beta 1  »

Firefox 38.0.5 RC (build 3) Test Plan


QE recommendation regarding the quality of the build

Recommendation based on results from manual testing CONDITIONAL SIGN OFF (many issues)

Risks with this Beta and ways to mitigate them through testing

Please list any risks related to the quality of this release.

  • 1. Pocket
    • Important feature for the 38.0.5 Release - the bulk of fixes in this build were for Pocket
    • Testing to ensure that Pocket integration works without major issues caused by the fixes landed in this build
    • Will be covered by Smoke and Exploratory testing
  • 2. Hello with Screensharing
    • Important feature for the 38.0.5 Release
    • Testing to ensure that Screensharing works without major issues caused by the fixes landed in this build
    • Will be covered by Smoke and Exploratory testing
  • 3. Reader View
    • Important feature for the 38.0.5 Release
    • Testing to ensure that Reader View works without major issues caused by the fixes landed in this build
    • Will be covered by Smoke and Exploratory testing

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Pocket Integration Andrei Vaida [AT RISK] New feature in Firefox 38.0.5 Test Plan
Hello screensharing Bogdan Maris [AT RISK] New feature in Firefox 38.0.5 Test Plan
Reader View Andrei Vaida [AT RISK] New feature in Firefox 38.0.5 Test Plan

Results

New bugs

Full Query
ID Summary Status Resolution
1167568 Reader View displays only the first part of specific articles from ehow.com RESOLVED FIXED
1167569 Missing gallery photos and text from wikipedia.org specific page RESOLVED WORKSFORME
1167572 [Linux] Youtube video content is not visible when tabs are shared RESOLVED WONTFIX
1167573 Reader View shows different content on Firefox for Android page in Google Play RESOLVED WORKSFORME
1167585 Different or no onboarding experience offered for users signing up with FxA instead of regular email RESOLVED INACTIVE
1167587 The welcome tour from getpocket.com cannot be dismissed RESOLVED WORKSFORME

6 Total; 0 Open (0%); 6 Resolved (100%); 0 Verified (0%);


Known Issues

  • Major issues
Full Query
ID Summary Status Resolution
806247 crash in _wcsicmp with randomly named DLL (malware) RESOLVED INCOMPLETE
1057757 Large OOM in mozilla::layers::BufferRecycleBin::GetBuffer (during video decoding) RESOLVED WONTFIX
1124397 crash in js::jit::AssemblerX86Shared::bind(js::jit::Label*) NEW
1137598 Reversed controls for videos that have a css transform flipping the video (no attribute/option to flip video output) RESOLVED INACTIVE
1162520 crash in DrawingContext::FillRectangle(D2D_RECT_F const*, ID2D1Brush*) RESOLVED FIXED
1163931 "View Pocket List" prevents going back to previous page due to server redirects NEW
1163999 Screensharing also stops when user selects 'Stop Sharing' from the camera/microphone permissions drop-down RESOLVED WORKSFORME
1164001 Webcam windows are misplaced when joining a screenshared conversation with muted video RESOLVED WORKSFORME
1166253 View Pocket List from Bookmarks toolbar icon opens Log In page in Private Browsing mode RESOLVED WORKSFORME
1166648 Type controls panel is not closed when page is added to Pocket via Sidebar icon RESOLVED DUPLICATE
1166687 Reader Mode produces different results on NY Times blog article based on real DOM vs. loading page via XHR (likely because of script-based changes to 'real' page if loaded first?) NEW

11 Total; 3 Open (27.27%); 8 Resolved (72.73%); 0 Verified (0%);

  • Low impact issues
Full Query
ID Summary Status Resolution
1057757 Large OOM in mozilla::layers::BufferRecycleBin::GetBuffer (during video decoding) RESOLVED WONTFIX
1124397 crash in js::jit::AssemblerX86Shared::bind(js::jit::Label*) NEW
1136265 Reading mode desktop images shouldn't be upscaled beyond their _originalWidth, even if they take more than half of the screen. RESOLVED WORKSFORME
1137602 Windows only - Global indicator does not call any pop-ups from Firefox RESOLVED INCOMPLETE
1137606 Background image from screen sharing while the webcam window of the person who is receiving the call is in fullscreen RESOLVED WORKSFORME
1151863 Console error when switching youtube videos to fullscreen and back: NS_ERROR_FAILURE: Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsITaskbarTabPreview.invalidate] WindowsPreviewPerTab.jsm:406:0 RESOLVED DUPLICATE
1157123 The bottom border of the Serif button displays an escaping pixel at its left side RESOLVED WORKSFORME
1160401 Tag text is selectable in Pocket door hanger NEW
1161057 Type controls panel vanishes when zooming out at the bottom of an article RESOLVED FIXED
1163534 AboutReader.jsm:248:0 throws an error in the console when closing an about:reader tab RESOLVED WORKSFORME
1163613 The panel shown when attempting to Save to Pocket in offline mode is dismissed too soon RESOLVED WORKSFORME
1164000 Webcam windows are misplaced when joining a screenshared conversation with No Video selected RESOLVED WORKSFORME
1164001 Webcam windows are misplaced when joining a screenshared conversation with muted video RESOLVED WORKSFORME
1165291 Pocket Social Api not removed if it was reinstalled in a downgrade RESOLVED WONTFIX
1166651 Pocket button from Reader View sidebar controls has no tooltip RESOLVED DUPLICATE
1166706 Clicking the empty space of Pocket's confirmation panel results in an error thrown by CustomizableUI.jsm:1536:10 RESOLVED FIXED

16 Total; 2 Open (12.5%); 14 Resolved (87.5%); 0 Verified (0%);


Github Issues

Regression Tests

  • There will be NO Regression Set for 38.0.5 BETA
  • Regression testing will be performed as needed for the new features in Firefox 38.0.5

Exploratory Testing

  • Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
Platform Assignee Result: report
Windows 7 x64 (Intel HD Graphics 2500) Camelia Badau [DONE]
Windows 8.1 x86 (AMD Radeon HD 3000) Vasilica Mihasca [DONE]
Mac OS X 10.9.5 (Intel Iris Pro 1024 MB) Petruta Rasa [DONE]
Ubuntu x64 (AMD Radeon HD 5450) Viorel Varga [DONE]
Tested Area Testing Type Results (report)
Pocket Smoke and Exploratory testing CONDITIONAL PASS
Hello screensharing Sanity testing CONDITIONAL PASS
Reader View spot check high-traffic websites for Readability issues CONDITIONAL PASS

Branch Bug Fix Verifications

  • Verified bugs
Full Query
ID Summary Status Resolution
1166240 Missing Pocket icon in reader view mode VERIFIED FIXED
1166771 pushstate for reader mode should reset browser.isArticle to false if the new page isn't readerable VERIFIED FIXED
1167096 Pocket Icon reappears in the toolbar after removal on a clean profile (or at least one with no saved state) VERIFIED FIXED

3 Total; 0 Open (0%); 0 Resolved (0%); 3 Verified (100%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed