Releases/Firefox 38/Test Plan/38.0.5/Beta/2

From MozillaWiki
Jump to: navigation, search

«  Firefox 38.0.5 Beta 1 | Firefox 38.0.5 Beta 2 | Firefox 38.0.5 Beta 3  »

Firefox 38.0.5 Beta 2 (build 1) Test Plan


QE recommendation regarding the quality of the build

Recommendation based on results from manual testing GOOD FOR RELEASE

Risks with this Beta and ways to mitigate them through testing

Please list any risks related to the quality of this release.

  • 1. Reading List disabling
    • The Reading List feature is no longer a part of the 38.0.5 release
    • Testing to make sure that the feature is not enabled
    • Will be covered by Sanity testing
  • 2. Suggested Tiles disabling
    • The Suggested Tiles feature was backed out into Firefox 39
    • Testing to make sure that the feature is not enabled
    • Will be covered by Sanity testing
  • 3. Pocket
    • Important feature for the 38.0.5 Release - the bulk of fixes in this build were for Pocket
    • Testing to ensure that Pocket integration works without major issues caused by the fixes landed in this build
    • Will be covered by Smoke and Exploratory testing

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Reader View Andrei Vaida [AT RISK] New feature in Firefox 38.0.5 Test Plan
Pocket Integration Andrei Vaida [AT RISK] New feature in Firefox 38.0.5 Test Plan
Hello screensharing Bogdan Maris [AT RISK] New feature in Firefox 38.0.5 Test Plan

Results

New bugs

Full Query
ID Summary Status Resolution
1165291 Pocket Social Api not removed if it was reinstalled in a downgrade RESOLVED WONTFIX

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);

New bugs to this Beta

    NONE

Known Issues

  • Major issues
Full Query
ID Summary Status Resolution
1163917 The built-in Pocket is NOT completely disabled if Pocket is already installed and used as an add-on VERIFIED FIXED

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);

  • Low impact issues
Full Query
ID Summary Status Resolution
1160407 Pocket's "Open Pocket" and "Sign In"/"Create Account" link won't work well with Private Browsing RESOLVED FIXED
1163577 Reader View button shouldn't be shown on Pocket website RESOLVED WORKSFORME
1163613 The panel shown when attempting to Save to Pocket in offline mode is dismissed too soon RESOLVED WORKSFORME
1163655 View Pocket List menuitem is not at top if Bookmarks button is moved to menu panel. VERIFIED FIXED

4 Total; 0 Open (0%); 3 Resolved (75%); 1 Verified (25%);


Regression Tests

  • There will be NO Regression Set for 38.0.5 BETA
  • Regression testing will be performed as needed for the new features in Firefox 38.0.5

Exploratory Testing

  • Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
Platform Assignee Result: report
Windows XP x86 (GPU: Intel HD Graphics 2500) Camelia Badau [DONE]
Windows 8 x64 (GPU: AMD Radeon HD 5450) Catalin Varga [DONE]
Mac OS X 10.8.5 (GPU: AMD Radeon HD 6630M) Florin Mezei [DONE]
Ubuntu 14.04 x86 (GPU: Intel HD Graphics 2500) Petruta Rasa [DONE]
Tested Area Testing Type Results (report)
Reading List disabling Sanity testing PASS
Suggested Tiles disabling Sanity testing PASS
Pocket Smoke and Exploratory testing PASS

Branch Bug Fix Verifications

  • Verified bugs
Full Query
ID Summary Status Resolution
1155517 Change Reader View to have a "Save Page to Pocket" button instead of "Add To Reader List" VERIFIED FIXED
1161245 Backout Suggested Tiles (bug 1120311) from 38.0.5 VERIFIED FIXED
1161654 Update Pocket code to latest version VERIFIED FIXED
1163111 Update Pocket code to latest version (May 7th code drop) VERIFIED FIXED
1163265 Update Pocket code to latest version (May 8th code drop) VERIFIED FIXED
1163360 Update Pocket code to latest version (May 9th code drop) VERIFIED FIXED

6 Total; 0 Open (0%); 0 Resolved (0%); 6 Verified (100%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_38/Test_Plan/38.0.5/Beta/2&oldid=1074841"