Releases/Firefox 51/Test Plan/Beta/2

From MozillaWiki
Jump to: navigation, search

«  Firefox 50 Beta 1 | Firefox 51 Beta 2 | Firefox 51 Beta 3 »

Firefox 51.0 Beta 2 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around Graphics and Crash reporter.
  • Test Cases executed and results: report

Build 1

Platform GPU Build architecture Assignee Results: report
Windows XP x86 AMD Radeon R7 200 32-bit Paul Silaghi [DONE]
Windows 8.1 x64 AMD Radeon HD 7700 Series 32-bit Mihai Boldan [DONE]
Mac OS X 10.12.1 Intel Iris Pro 1536 Mb 64-bit Cornel Ionce [DONE]
Ubuntu 14.04 x86 Intel HD 4600 32-bit Iulia Cristescu [DONE]
Tested Area Testing Type Results
Graphics Smoke and Exploratory Testing PASSED
Crash reporter Smoke and Exploratory Testing PASSED

Features

See the [1] gdoc for a general overview

Feature Owner Status Details Test Plan
WebGL2 Bogdan Maris [ON TRACK] Feature set to release with Firefox 51. Test Plan
Indicator for Streaming or Permissions Cornel Ionce [ON TRACK] Feature set to release with Firefox 51. Test Plan
Support for FLAC Ciprian Georgiu [ON TRACK] Feature set to release with Firefox 51. Test Plan
Zoom Indicator Iulia Cristescu [ON TRACK] Feature set to release with Firefox 51. Test Plan
ICE candidate generation control and user authorization Iulia Cristescu [ON TRACK] Feature set to release with Firefox 51. [n/a Test Plan]
Support VP9 for WebRTC Iulia Cristescu [ON TRACK] Feature set to release with Firefox 51. [n/a Test Plan]

Results

New bugs

Full Query
ID Summary Status Resolution
1319412 [WinXP] Skipping forward/backward doesn't work properly on Vimeo.com RESOLVED WONTFIX

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
1057858 <input type=number> should not fire extra focus/blur events when script focuses it immediately after inserting it into the document or making it visible by removing display:none RESOLVED FIXED
1176218 [Youtube][HTML5] 8K videos do not work at all, or Audio only VERIFIED FIXED
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos RESOLVED WORKSFORME
1194214 [HTML5] Several side effects using the context menu options on Youtube NEW
1230678 youtube shows black line 720p & 1080p videos in normal view mode VERIFIED FIXED
1298395 [testday-20160826] Monster Truck game Error NEW

6 Total; 2 Open (33.33%); 2 Resolved (33.33%); 2 Verified (33.33%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1286487 Arbitrary memory access in ConsoleCallData::Trace VERIFIED FIXED
1288558 Merge passwordManagerCommon.js into passwordManager.js VERIFIED FIXED
1288997 MOZ_CRASH(IPC message size is too large) with PContent::Msg_PBlobConstructor VERIFIED FIXED
1306314 Persistent CDM storage broken for Widevine VERIFIED FIXED
1306830 Screenshot --fullpage of large page takes 8 times longer VERIFIED FIXED

5 Total; 0 Open (0%); 0 Resolved (0%); 5 Verified (100%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed