Releases/Firefox 40/Test Plan/Beta/4

From MozillaWiki
Jump to: navigation, search

«  Firefox 40 Beta 3 | Firefox 40 Beta 4 | Firefox 40 Beta 5  »

Firefox 40 Beta 4 (build 1) Test Plan

QE recommendation regarding the quality of the build

Recommendation based on results from manual testing GOOD FOR RELEASE

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
  • Test Cases executed and results: report

PLATFORM MATRIX

Platform Assignee Results: report
Windows 7 x86 (Intel HD Graphics 2500) Camelia Badau [DONE]
Windows 10 x64 (nVIDIA GeForce 620) Cornel Ionce [DONE]
Mac OS X 10.9.5 (Intel Iris Pro 1024 MB) Petruta Rasa [DONE]
Ubuntu 14.04 x64 (AMD Radeon HD 5450) Catalin Varga [DONE]

AREAS TESTED

Tested Area Testing Type Results
MIGRATORS Regression Testing PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Async plugin init Catalin Varga [ON TRACK] Feature is in Beta 40, but still disabled by default - potential final QA sign-off at the end of Beta 40 -
First Run for 40 release Catalin Varga [NOT STARTED] New feature targeted for Firefox 40 (not yet implemented) - final QA sign-off at the end of Beta 40 -
Suggested tiles: Sponsored Cornel Ionce [ON TRACK] Feature dropped from Firefox 39 - final QA sign-off at the end of Beta 40 Test Plan
New Add-on Signing Vasilica Mihasca DROPPED FROM 40 Feature dropped from Firefox 39 & 40 (not enough add-ons signed) -
Unified telemetry/FHR Stuart Philp [DONE] Testing performed is tracked in bug 1169037 -
OMTC by default on Linux Alexandra Lucinet [ON TRACK] New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 -
Hello - Context Bogdan Maris [AT RISK] New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 -

Results

New bugs

    NONE     

Known Issues - also seen in previous builds

Major issues also seen in previous builds

Full Query
ID Summary Status Resolution
1163644 [meta] Data importers/migrators for Microsoft Edge browser NEW

1 Total; 1 Open (100%); 0 Resolved (0%); 0 Verified (0%);


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
326701 Favicons should be imported from Safari VERIFIED FIXED
706005 Chrome migrator should handle when databases are locked VERIFIED FIXED
711995 Favicons should be imported from Chrome VERIFIED FIXED
712240 Safari migrator does not import cookies RESOLVED WONTFIX
735183 No Home Page Selection screen on first run import wizard RESOLVED INVALID
737861 New Safari Migrator: Thumbnails for Top Sites NEW

6 Total; 1 Open (16.67%); 2 Resolved (33.33%); 3 Verified (50%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
947854 Exiting DOM fullscreen also exits window fullscreen mode VERIFIED FIXED
1094876 Migrators should use new Bookmarks.jsm API VERIFIED FIXED
1138941 We should display a better string when we've failed to obtain the camera and video devices VERIFIED FIXED
1151318 Browser UI becomes unresponsive state when using Unity Web Player Plugin VERIFIED FIXED
1159366 youtube live stream: switching resolution causes high cpu & memory use VERIFIED FIXED
1160514 wow_helper.exe should be signed VERIFIED FIXED
1164264 [EME] Async shutdown hang in mozilla::gmp::GeckoMediaPluginService::Observe(...) - Don't wait if there are no plugins remaining VERIFIED FIXED
1167379 Timeline selections are offset when DevTools are zoomed in VERIFIED FIXED
1177185 Hidden titlebar appears when exiting DOM Fullscreen VERIFIED FIXED

9 Total; 0 Open (0%); 0 Resolved (0%); 9 Verified (100%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed