Releases/Firefox 44/Test Plan/Beta/RC
From MozillaWiki
« Firefox 44.0 Beta 9 | Firefox 44 RC
Contents
Firefox 44.0 RC Test Plan
- Release Week: Jan 18th, 2016. Plan is to ship this build on Friday, Jan 22nd 2016 (Release Calendar)
- QA Contacts: Robert Kaiser; Florin Mezei; Andrei Vaida
- IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei; avaida
- Build 1: 44.0-build1 | 0000b160918f | (ID: 20160118143821)
- Build 2: 44.0-build2 | 45a3e4181f46 | (ID: 20160120154102)
- Build 3: 44.0-build3 | 7eabe4d30cde | (ID: 20160123151951)
QE recommendation regarding the quality of the build
- Recommendation based on results from manual testing:
| Build 1 | GOOD FOR RELEASE |
|---|
| Build 2 | CONDITIONAL SIGN OFF |
|---|
| Build 3 | GOOD FOR RELEASE |
|---|
Manual Testing summary - Platform Coverage and Areas Tested
Build 1
- Testing performed around: Web Compatibility and the Location Bar.
- Test Cases executed and results: report
| Platform | Build architecture | Assignee | Results: report |
| Windows 7 x64 (AMD Radeon HD 3000) | 32-bit | Alexandra Lucinet | [DONE] |
| Windows 10 x86 (Intel HD 2500) | 32-bit | Mihai Boldan | [DONE] |
| Mac OS X 10.9.5 (Intel Iris Pro 1024 MB) | 64-bit | Petruta Rasa | [DONE] |
| Ubuntu 14.04 x86 (AMD Radeon HD 6450) | 32-bit | Bogdan Maris | [DONE] |
| Tested Area | Testing Type | Results |
| WEB COMPATIBILITY | Regression Testing | PASS |
| LOCATION BAR | Regression Testing | PASS |
Build 2
- Testing performed around: Web Compatibility and Default Browser Settings.
- Test Cases executed and results: report
| Platform | Build architecture | Assignee | Results: report |
| Windows 8.1 x64 (AMD Radeon HD 3000) | 32-bit | Alexandra Lucinet | [DONE] |
| Windows 10 x86 (Intel HD 2500) | 32-bit | Mihai Boldan | [DONE] |
| Mac OS X 10.9.5 (AMD Radeon HD 6630M) | 64-bit | Camelia Badau | [DONE] |
| Ubuntu 14.04 x86 (AMD Radeon HD 6450) | 32-bit | Bogdan Maris | [DONE] |
| Tested Area | Testing Type | Results |
| WEB COMPATIBILITY | Regression Testing | PASS |
| DEFAULT BROWSER SETTINGS | Regression Testing | FAIL |
Build 3
- Testing performed around: Web Compatibility.
- Test Cases executed and results: report
| Platform | Build architecture | Assignee | Results: report |
| Windows 7 x64 (Intel HD 2500) | 32-bit | Mihai Boldan | [DONE] |
| Windows 10 x86 (nVIDIA GeForce 620) | 32-bit | Cornel Ionce | [DONE] |
| Mac OS X 10.9.5 (Intel Iris Pro) | 64-bit | Andrei Vaida | [DONE] |
| Ubuntu 14.04 x86 (AMD Radeon HD 3000) | 32-bit | Alexandra Lucinet | [DONE] |
| Tested Area | Testing Type | Results |
| WEB COMPATIBILITY | Regression Testing | PASS |
Features
n/a
See the Feature Release Tracking gdoc for a general overview
Results
New bugs
Build 1
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1240695 | Flicker in Default Search Engine drop-down on deleting engines from about:preferences#search | RESOLVED | WORKSFORME |
| 1240727 | Capital letters keywords are not recognized when showing which of the search engine will be used in the next search | VERIFIED | FIXED |
| 1240729 | No favicon displayed for baidu.com in Search bar panel after adding the engine | RESOLVED | FIXED |
3 Total; 0 Open (0%); 2 Resolved (66.67%); 1 Verified (33.33%);
Build 2
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1241471 | [Ubuntu] Unable to make Firefox the default browser | RESOLVED | DUPLICATE |
| 1241484 | crash in mozilla::layers::TextureChild::WaitForCompositorRecycle | mozilla::layers::CanvasClientSharedSurface::Updated | RESOLVED | FIXED |
2 Total; 0 Open (0%); 2 Resolved (100%); 0 Verified (0%);
Build 3
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Known Issues - also seen in previous builds
Major issues also seen in previous builds
Build 1
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Build 2
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Build 3
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Low impact issues also seen in previous builds
Build 1
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1168101 | Reader View icon is shown on some Youtube pages | RESOLVED | WORKSFORME |
| 1176218 | [Youtube][HTML5] 8K videos do not work at all, or Audio only | VERIFIED | FIXED |
| 1192169 | Search Panel suggestion flickers when the last search term is deleted | RESOLVED | WORKSFORME |
| 1192204 | Scrollbar is overlapping the Quality entries via Youtube high resolution videos | RESOLVED | WORKSFORME |
| 1194214 | [HTML5] Several side effects using the context menu options on Youtube | NEW | |
| 1210769 | Glitches after opening images via flickr | RESOLVED | WORKSFORME |
| 1224552 | Awesome bar with search suggestions enabled flickers with some search engines | RESOLVED | WORKSFORME |
| 1233359 | Glitches after opening images in facebook | NEW | |
| 1234513 | Gif tweets not detaching from timeline properly at one click and comments are hidden | RESOLVED | FIXED |
9 Total; 2 Open (22.22%); 6 Resolved (66.67%); 1 Verified (11.11%);
Build 2
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1176218 | [Youtube][HTML5] 8K videos do not work at all, or Audio only | VERIFIED | FIXED |
| 1191290 | Glitches after opening images in tumblr | RESOLVED | WORKSFORME |
| 1192204 | Scrollbar is overlapping the Quality entries via Youtube high resolution videos | RESOLVED | WORKSFORME |
| 1209499 | Inactive sign in button on https://www.linkedin.com after credentials are autofilled | RESOLVED | WORKSFORME |
| 1210769 | Glitches after opening images via flickr | RESOLVED | WORKSFORME |
| 1218746 | Suppress "ERROR ClientID::getCachedClientID - invalid client id in preference" on fresh profiles | RESOLVED | FIXED |
| 1233359 | Glitches after opening images in facebook | NEW | |
| 1234513 | Gif tweets not detaching from timeline properly at one click and comments are hidden | RESOLVED | FIXED |
| 1240729 | No favicon displayed for baidu.com in Search bar panel after adding the engine | RESOLVED | FIXED |
9 Total; 1 Open (11.11%); 7 Resolved (77.78%); 1 Verified (11.11%);
Build 3
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1096357 | "Unable to run script because scripts are blocked internally" JS error appear in browser console while browsing facebook and youtube on MacOS | RESOLVED | INCOMPLETE |
| 1176218 | [Youtube][HTML5] 8K videos do not work at all, or Audio only | VERIFIED | FIXED |
| 1191290 | Glitches after opening images in tumblr | RESOLVED | WORKSFORME |
| 1210769 | Glitches after opening images via flickr | RESOLVED | WORKSFORME |
| 1234513 | Gif tweets not detaching from timeline properly at one click and comments are hidden | RESOLVED | FIXED |
5 Total; 0 Open (0%); 4 Resolved (80%); 1 Verified (20%);
Branch Bug Fix Verifications
Build 1
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1110511 | Implement about:tabcrashed spec | VERIFIED | FIXED |
| 1202696 | crash in _cairo_surface_get_extents | VERIFIED | FIXED |
| 1239015 | Stops working open a new tab from a search suggestion in locationbar(with Ctrl+click or with wheel mouse button) | VERIFIED | FIXED |
3 Total; 0 Open (0%); 0 Resolved (0%); 3 Verified (100%);
Build 2
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1240528 | Unable to read text on Linux notifications - blank, white bar displayed | VERIFIED | FIXED |
1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);
Build 3
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
