Releases/Firefox 38/Test Plan/38.0.5/Beta/3

From MozillaWiki
Jump to: navigation, search

«  Firefox 38.0.5 Beta 2 | Firefox 38.0.5 Beta 3 | Firefox 38.0.5 RC 1  »

Firefox 38.0.5 Beta 3 (build 1) Test Plan


QE recommendation regarding the quality of the build

Recommendation based on results from manual testing GOOD FOR RELEASE

Risks with this Beta and ways to mitigate them through testing

Please list any risks related to the quality of this release.

  • 1. Pocket
    • Important feature for the 38.0.5 Release - the bulk of fixes in this build were for Pocket
    • Testing to ensure that Pocket integration works without major issues caused by the fixes landed in this build
    • Will be covered by Smoke and Exploratory testing
  • 2. Hello with Screensharing
    • Important feature for the 38.0.5 Release
    • Testing to ensure that Screensharing works without major issues caused by the fixes landed in this build
    • Will be covered by Smoke and Exploratory testing
  • 3. Reader View
    • Important feature for the 38.0.5 Release
    • Testing to ensure that Reader View works without major issues caused by the fixes landed in this build
    • Will be covered by Smoke and Exploratory testing

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Pocket Integration Andrei Vaida [AT RISK] New feature in Firefox 38.0.5 Test Plan
Hello screensharing Bogdan Maris [AT RISK] New feature in Firefox 38.0.5 Test Plan
Reader View Andrei Vaida [AT RISK] New feature in Firefox 38.0.5 Test Plan

Results

New bugs

Full Query
ID Summary Status Resolution
1166240 Missing Pocket icon in reader view mode VERIFIED FIXED
1166253 View Pocket List from Bookmarks toolbar icon opens Log In page in Private Browsing mode RESOLVED WORKSFORME

2 Total; 0 Open (0%); 1 Resolved (50%); 1 Verified (50%);

Known Issues

  • Major issues
Full Query
ID Summary Status Resolution
1145106 crash in atidxx32.dll@0x196f7 RESOLVED WORKSFORME
1163526 Reader View promo panel is automatically dismissed RESOLVED WORKSFORME
1163999 Screensharing also stops when user selects 'Stop Sharing' from the camera/microphone permissions drop-down RESOLVED WORKSFORME

3 Total; 0 Open (0%); 3 Resolved (100%); 0 Verified (0%);

  • Low impact issues
Full Query
ID Summary Status Resolution
1137594 Wrong context menu present for shared screen item and webcam window RESOLVED WORKSFORME
1137606 Background image from screen sharing while the webcam window of the person who is receiving the call is in fullscreen RESOLVED WORKSFORME
1146882 Starting tab sharing before the call will not show the tab when someone joins conversation RESOLVED WONTFIX
1161023 Unusable and very small conversation window notification after hello window is detached RESOLVED INCOMPLETE
1163526 Reader View promo panel is automatically dismissed RESOLVED WORKSFORME
1163534 AboutReader.jsm:248:0 throws an error in the console when closing an about:reader tab RESOLVED WORKSFORME
1163613 The panel shown when attempting to Save to Pocket in offline mode is dismissed too soon RESOLVED WORKSFORME
1163999 Screensharing also stops when user selects 'Stop Sharing' from the camera/microphone permissions drop-down RESOLVED WORKSFORME
1164000 Webcam windows are misplaced when joining a screenshared conversation with No Video selected RESOLVED WORKSFORME
1164001 Webcam windows are misplaced when joining a screenshared conversation with muted video RESOLVED WORKSFORME

10 Total; 0 Open (0%); 10 Resolved (100%); 0 Verified (0%);

Regression Tests

  • There will be NO Regression Set for 38.0.5 BETA
  • Regression testing will be performed as needed for the new features in Firefox 38.0.5

Exploratory Testing

  • Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
Platform Assignee Result: report
Windows 7 x86 (Intel HD Graphics 2500) Camelia Badau [DONE]
Windows 8.1 x64 (Intel HD Graphics 2500) Petruta Rasa [DONE]
Mac OS X 10.9.5 (Intel Iris Pro 1024 MBIntel Iris Pro 1024 MB) Vasilica Mihasca [DONE]
Ubuntu x64 (AMD Radeon HD 5450) Catalin Varga [DONE]
Tested Area Testing Type Results (report)
Pocket Smoke and Exploratory testing CONDITIONAL PASS
Hello screensharing Sanity testing CONDITIONAL PASS
Reader View spot check high-traffic websites for Readability issues PASS

Branch Bug Fix Verifications

  • Verified bugs
Full Query
ID Summary Status Resolution
1160407 Pocket's "Open Pocket" and "Sign In"/"Create Account" link won't work well with Private Browsing RESOLVED FIXED
1161793 Pocket: Race condition in onShow handling VERIFIED FIXED
1163917 The built-in Pocket is NOT completely disabled if Pocket is already installed and used as an add-on VERIFIED FIXED
1164253 Save request is sent twice for every button press VERIFIED FIXED
1164426 Build blocklist of sites where we do not want to offer reader mode into toolkit isProbablyReaderable invocation VERIFIED FIXED
1165135 distribution directory not removed on pave over install VERIFIED FIXED

6 Total; 0 Open (0%); 1 Resolved (16.67%); 5 Verified (83.33%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_38/Test_Plan/38.0.5/Beta/3&oldid=1075442"