Releases/Firefox 55/Test Plan/Beta/RC1
From MozillaWiki
« Firefox 55 Beta 13 | Firefox 55 RC build 1 | Firefox 55 RC2 »
Firefox 55 Release Candidate Test Plan
Build information
- Release week: August 7th, 2017. Plan is to ship this build on Tuesday, August 8th, 2017 — Release Calendar.
- Build: 55.0-build1 | aa08b24ffb91 | 20170731093223 | bugs since previous changeset.
- QA contacts: Florin Mezei (:FlorinMezei), Andrei Vaida (:avaida), Cornel Ionce (:cornel_ionce) — online on #qa and #release-drivers, ⌚️UTC+02:00.
Manual QA'S recommendation for this build
Note: Recommendation based on results from manual testing.
BUILD | TESTING STATUS | RECOMMENDATION | REASON(S) |
---|---|---|---|
55.0-build1 | COMPLETED (100%) | SHIP IT | Several known issues encountered, but none of them severe enough to block. |
Manual testing summary
Note: Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/5402
PLATFORM | ASSIGNEE | BUILD | GPU | STATUS PER TEST SUITE | |||
---|---|---|---|---|---|---|---|
Web Compatibility | |||||||
Windows 7 x64 | Gabi Cheta | 32-bit | AMD 760G | GREEN | |||
Windows 10 x64 | Ciprian Georgiu | 64-bit | ATI Radeon HD 3000 | GREEN | |||
macOS 10.12 | Alexandru Simonca | 64-bit | Intel Iris Graphics 650 | GREEN | |||
Ubuntu 14.04 x64 | Cristian Comorasu | 64-bit | Intel HD Graphics 5500 | GREEN |
Features in Firefox 55
Note: Pre-Release feature sign offs are scheduled to be completed by July 21st.
Note: See https://goo.gl/lRb7yH for a general overview.
FEATURE NAME | TRACKING | QA CONTACTS | TESTING STATUS | PRELIMINARY REPORTING STATUS | SIGN OFF STATUS | ADDITIONAL NOTES | ||
---|---|---|---|---|---|---|---|---|
Bugzilla | Wiki | Trello | ||||||
One-off Searches from Awesomebar | 1180944 | Test Plan | Card | Petruta Rasa (Release QA) | [DONE] | [INVESTIGATION NEEDED] | [INVESTIGATION NEEDED] | Pre-Release sign off is YELLOW. |
Shutdown Video Decoder | 1293963 | Test Plan | Card | Bogdan Maris (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. |
Application Update UI | 893505 | Test Plan | Roxana Leitan (Engineering QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | |
Enable async scrolling via scrollbar dragging | 1333965 | Test Plan | Ovidiu Boca (Engineering QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | |
Shutdown ping | 1336360 | Test Plan | Petruta Rasa (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | |
Deny plugins from non-HTTP/HTTPS protocols | 1335475 | Stefan Georgiev (Engineering QA) | [DONE] | [MISSED] | [DONE] | Pre-Release sign off is GREEN. | ||
Windows Stub Installer | 797208 | Test Plan | Card | Camelia Badau (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. |
Separate Content Process for loading file:// URI pages | 1147911 | Test Plan | Card | Cristian Comorasu (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREENS. |
Graphics Stability | 1303736 | Test Plan | Card | Roxana Leitan (Engineering QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. |
Flash click-to-play enabled by default | 1365714 | Test Plan | Card | Stefan Georgiev (Engineering QA) | [DONE] | [MISSED] | [INVESTIGATION NEEDED] | Pre-Release sign off is YELLOW. |
Turning on Search Suggestions | 1344919 | Test Plan | Card | Simona Badau (Engineering QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. |
client-side stackwalking: client_crash_ID | 1322611 | Test Plan | Card | Petruta Rasa (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. |
Flash SHIELD Experiment | 1277346 | Test Plan | Stefan Georgiev (Engineering QA) | [ON TRACK] | [MISSED] | [NOT STARTED] | Pending assessment. | |
New Editor work | 1297414 | Bogdan Maris (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | ||
Direct3D v11 DirectX video acceleration | 1352442, 1352163 | Card | Timea Zsoldos (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | |
Simplify Print | 1362526 | Test Plan | Ciprian Georgiu (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | |
[Quantum] Compositor Process for unaccelerated Windows | 1356091 | Test Plan | Card | Anthony Hughes, Alexandru Simonca (Release QA) | [ON TRACK] | [MISSED] | [IN PROGRESS] | Pre-Release sign off is IN PROGRESS. |
Streamlined Stub Installer | Test Plan | Card | Camelia Badau (Release QA) | [DONE] | [DONE] | [DONE] | Pre-Release sign off is GREEN. | |
Preferences Performance | 1364070 | Card | Hani Yacoub (Engineering QA) | [AT RISK] | [DONE] | [AT RISK] | Pre-Release sign off is RED. | |
Flash Async Drawing 32bit | 1340934 | Test Plan | Card | Stefan Georgiev (Engineering QA) | [ON TRACK] | [MISSED] | [NOT STARTED] | Pending assessment. |
Firefox Screenshots system add-on | Test Plan | Card | Iulia Cristescu (Release QA) | [AT RISK] | [INVESTIGATION NEEDED] | [INVESTIGATION NEEDED] | Pre-Release sign off is YELLOW. | |
WebVR | 1250244 | Test Plan | Card | Cristian Comorasu (Release QA) | [AT RISK] | [AT RISK] | [INVESTIGATION NEEDED] | Pre-Release sign off is YELLOW. |
Detailed test results
Note: New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/5402
New bugs
Bugzilla query error
error, http-bad-status, Array
Known bugs
High-impact bugs also encountered in previous builds
Bugzilla query error
error, http-bad-status, Array
Low-impact bugs also encountered in previous builds
12 Total; 3 Open (25%); 8 Resolved (66.67%); 1 Verified (8.33%);
Bug fix verification
Note: All verified Firefox 55 bug fixes are listed in https://goo.gl/P4fVbx.
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed