Releases/Firefox 45/Test Plan/Beta/45.0.1

From MozillaWiki
Jump to: navigation, search

«  Firefox 45.0 | Firefox 45.0.1 | Firefox 45.0.2  »

Firefox 45.0.1 Release Candidate Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 AT RISK


Manual Testing summary - Platform Coverage and Areas Tested

  • Testing focused on Web Compatibility, Search and Privacy (history).
  • Test Cases executed and results: report.
Platform Build architecture Assignee Results: report
Windows 7 x64 (AMD Radeon HD 3000) 32-bit Alexandra Lucinet [DONE]
Windows 10 x86 (nVIDIA GeForce 620) 32-bit Cornel Ionce [DONE]
Mac OS X 10.9.5 (AMD Radeon HD 6630M) 64-bit Camelia Badau [DONE]
Ubuntu 14.04 x64 (AMD Radeon R7 200) 64-bit Paul Silaghi [DONE]
Tested Area Testing Type Results
Web Compatibility Regression Testing FAIL (due to 1257086)
Search Regression Testing PASS
Privacy (history) Regression Testing PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Text to Speech Camelia Badau [DONE] Feature conditionally signed off, because of 1252048 and 1252051. Test Plan
Search Refactoring Petruta Rasa [DONE] Feature signed off, no blockers or major issues found. Test Plan
Tab Groups Migration Paul Silaghi [DONE] Feature signed off, no blockers or major issues found. Test Plan
Sync Tabs Menu Vasilica Mihasca [DONE] Feature signed off, no blockers or major issues found. Test Plan
Hello as a system add-on Bogdan Maris [DONE] Feature signed off, no blockers or major issues found. Test Plan

Results

New bugs

Bugzilla query error

error, http-bad-status, Array


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Full Query
ID Summary Status Resolution
1257086 Some FlexEvent are not fully supported on new Firefox 45 RESOLVED WONTFIX

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Low impact issues also seen in previous builds

Full Query
ID Summary Priority Status
616629 "Remember Password?" dialog shows too early -- RESOLVED
1096357 "Unable to run script because scripts are blocked internally" JS error appear in browser console while browsing facebook and youtube on MacOS -- RESOLVED
1122470 The about:newtab search bar can be focused when the page is blank -- RESOLVED
1168101 Reader View icon is shown on some Youtube pages -- RESOLVED
1176218 [Youtube][HTML5] 8K videos do not work at all, or Audio only P3 VERIFIED
1191290 Glitches after opening images in tumblr -- RESOLVED
1192169 Search Panel suggestion flickers when the last search term is deleted P3 RESOLVED
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos -- RESOLVED
1194214 [HTML5] Several side effects using the context menu options on Youtube P5 NEW
1210769 Glitches after opening images via flickr -- RESOLVED
1211485 Default search engine can still be set as default using the contextual menu -- VERIFIED
1222107 Yahoo.com offering a Yahoo Search engine that doesn't install -- VERIFIED
1231380 Search suggestions are not the same in the URL bar and in the Search toolbar -- RESOLVED
1233359 Glitches after opening images in facebook -- NEW
1235967 YouTube error messages "An error occurred. Please try again later" for fix P2 VERIFIED
1240727 Capital letters keywords are not recognized when showing which of the search engine will be used in the next search P3 VERIFIED
1240729 No favicon displayed for baidu.com in Search bar panel after adding the engine -- RESOLVED
1241484 crash in mozilla::layers::TextureChild::WaitForCompositorRecycle | mozilla::layers::CanvasClientSharedSurface::Updated -- RESOLVED

18 Total; 2 Open (11.11%); 11 Resolved (61.11%); 5 Verified (27.78%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1220502 Firefox hang/delay when opening a youtube.com page, due to large list element VERIFIED FIXED
1249572 XSLTProcessor.importStylesheet fails when <import> is used VERIFIED FIXED
1254694 Search engines: keywords and order gone after upgrading from 44.0.2 to 45.0 with language pack active RESOLVED FIXED
1254856 Some Flash websites (forgeofempires.com, bet365.com) can't finish loading with "Accept third-party cookies: Never" checked VERIFIED FIXED
1255139 iNotes not working after upgrade to release 45.0 RESOLVED FIXED
1255605 Search bar broken on upgrade from 44 to 45. VERIFIED FIXED

6 Total; 0 Open (0%); 2 Resolved (33.33%); 4 Verified (66.67%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed