Releases/Firefox 45/Test Plan/Beta/RC

From MozillaWiki
Jump to: navigation, search

«  Firefox 45 Beta 10 | Firefox 45.0 | n/a  »

Firefox 45.0 Release Candidate Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 GOOD FOR RELEASE
Build 2 GOOD FOR RELEASE


Manual Testing summary - Platform Coverage and Areas Tested

Build 1

Platform Build architecture Assignee Results: report
Windows 7 x64 (Intel HD 2500) 32-bit Camelia Badau [DONE]
Windows 10 x86 (Intel HD 2500) 32-bit Mihai Boldan [DONE]
Mac OS X 10.9.5 (Intel Iris Pro 1024 MB) 64-bit Petruta Rasa [DONE]
Ubuntu 14.04 x64 (AMD Radeon R7 200) 64-bit Paul Silaghi [DONE]
Tested Area Testing Type Results
Web Compatibility Smoke Testing PASS

Build 2

Platform Build architecture Assignee Results: report
Windows 7 x64 (Intel HD 2500) 32-bit Camelia Badau [DONE]
Windows 10 x64 (AMD Radeon HD 3000) 32-bit Andrei Vaida [DONE]
Mac OS X 10.9.5 (Intel Iris Pro 1024 MB) 64-bit Petruta Rasa [DONE]
Ubuntu 14.04 x64 (Intel HD 2500) 64-bit Mihai Boldan [DONE]
Tested Area Testing Type Results
Web Compatibility Smoke Testing PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Text to Speech Camelia Badau [DONE] Feature conditionally signed off, because of 1252048 and 1252051. Test Plan
Search Refactoring Petruta Rasa [DONE] Feature signed off, no blockers or major issues found. Test Plan
Tab Groups Migration Paul Silaghi [DONE] Feature signed off, no blockers or major issues found. Test Plan
Sync Tabs Menu Vasilica Mihasca [DONE] Feature signed off, no blockers or major issues found. Test Plan
Hello as a system add-on Bogdan Maris [DONE] Feature signed off, no blockers or major issues found. Test Plan

Results

New bugs

Bugzilla query error

error, http-bad-status, Array


Known Issues - also seen in previous builds

Major issues also seen in previous builds

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Low impact issues also seen in previous builds

Build 1

Full Query
ID Summary Priority Status
1168101 Reader View icon is shown on some Youtube pages -- RESOLVED
1194214 [HTML5] Several side effects using the context menu options on Youtube P5 NEW
1210769 Glitches after opening images via flickr -- RESOLVED
1222107 Yahoo.com offering a Yahoo Search engine that doesn't install -- VERIFIED
1233359 Glitches after opening images in facebook -- NEW
1240729 No favicon displayed for baidu.com in Search bar panel after adding the engine -- RESOLVED

6 Total; 2 Open (33.33%); 3 Resolved (50%); 1 Verified (16.67%);


Build 2

Full Query
ID Summary Priority Status
1096357 "Unable to run script because scripts are blocked internally" JS error appear in browser console while browsing facebook and youtube on MacOS -- RESOLVED
1168101 Reader View icon is shown on some Youtube pages -- RESOLVED
1176218 [Youtube][HTML5] 8K videos do not work at all, or Audio only P3 VERIFIED
1210769 Glitches after opening images via flickr -- RESOLVED
1233359 Glitches after opening images in facebook -- NEW
1240729 No favicon displayed for baidu.com in Search bar panel after adding the engine -- RESOLVED

6 Total; 1 Open (16.67%); 4 Resolved (66.67%); 1 Verified (16.67%);


Branch Bug Fix Verifications

Build 1

Full Query
ID Summary Status Resolution
1220450 global-buffer-overflow (write) at BufferSubData VERIFIED FIXED
1235129 Drag-n-drop url from location bar to a <tab> opens new tab instead of loading url in that tab VERIFIED FIXED
1240760 Second datachannel with id crashes in PR_Unlock | mozilla::DataChannelConnection::Close after navigation VERIFIED FIXED
1242322 Crash - Out of Bounds Write in Graphite setAttr Function VERIFIED FIXED
1243335 Write AV near NULL in AtomicBaseIncDec() / Heap UAF in nsAutoPtr<txAXMLEventHandler>::~nsAutoPtr() VERIFIED FIXED
1249377 ZDI-CAN-3574: nsHTMLDocument SetBody Use-After-Free RCE VERIFIED FIXED

6 Total; 0 Open (0%); 0 Resolved (0%); 6 Verified (100%);

Build 2

Full Query
ID Summary Status Resolution
1252168 Hulu triggers EME notification: "The audio or video on this page requires DRM software that Firefox does not support" RESOLVED FIXED

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed