Releases/Firefox 55/Test Plan/Beta/11

From MozillaWiki
Jump to: navigation, search

«  Firefox 55 Beta 10 | Firefox 55 Beta 11 | Firefox 55 Beta 12 »

Firefox 55 Beta 11 Test Plan

Build information

Manual QA'S recommendation for this build

Note: Recommendation based on results from manual testing.
BUILD TESTING STATUS RECOMMENDATION REASON(S)
55.0b11-build1 COMPLETED (100%) SHIP IT
  • bug 1371412 is a known and high-impact bug that we encountered on Linux, causing plug-in crashes when right-clicking Flash content.
  • Based on this issue's severity, how easily it can be reproduced and looking at the number of affected users (the bug is Linux only), we think this shouldn't block the release of this build, but it deserves engineering's attention.

Manual testing summary

PLATFORM ASSIGNEE BUILD GPU STATUS PER TEST SUITE
Bookmarks Search
Windows 7 x64 Gabi Cheta 32-bit AMD 760G GREEN GREEN
Windows 10 x86 Bogdan Maris 32-bit AMD Radeon HD 7700 GREEN GREEN
macOS 10.12 Camelia Badau 64-bit Intel Iris Pro (1536 MB) GREEN GREEN
Ubuntu 12.04 x86 Andrei Vaida 32-bit AMD Radeon HD 3000 RED (see bug 1371412) GREEN

Features in Firefox 55

Note: Pre-Release feature sign offs are scheduled to be completed by July 21st.
Note: See https://goo.gl/lRb7yH for a general overview.
FEATURE NAME TRACKING QA CONTACTS TESTING STATUS PRELIMINARY REPORTING STATUS SIGN OFF STATUS ADDITIONAL NOTES
Bugzilla Wiki Trello
One-off Searches from Awesomebar 1180944 Test Plan Card Petruta Rasa (Release QA) [ON TRACK] [INVESTIGATION NEEDED] [IN PROGRESS] Pre-Release sign off is IN PROGRESS.
Shutdown Video Decoder 1293963 Test Plan Card Bogdan Maris (Release QA) [DONE] [DONE] [DONE] Pre-Release sign off is GREEN.
Application Update UI 893505 Test Plan Roxana Leitan (Engineering QA) [DONE] [DONE] [DONE] Pre-Release sign off is GREEN.
Enable async scrolling via scrollbar dragging 1333965 Test Plan Ovidiu Boca (Engineering QA) [DONE] [DONE] [DONE] Pre-Release sign off is GREEN.
Shutdown ping 1336360 Test Plan Petruta Rasa (Release QA) [ON TRACK] [DONE] [IN PROGRESS] Pre-Release sign off is IN PROGRESS.
Deny plugins from non-HTTP/HTTPS protocols 1335475 Stefan Georgiev (Engineering QA) [AT RISK] [MISSED] [NOT STARTED] Pending assessment.
Windows Stub Installer 797208 Test Plan Card Camelia Badau (Release QA) [ON TRACK] [DONE] [IN PROGRESS] Pre-Release sign off is IN PROGRESS.
Separate Content Process for loading file:// URI pages 1147911 Test Plan Card Cristian Comorasu (Release QA) [ON TRACK] [DONE] [IN PROGRESS] Pre-Release sign off is IN PROGRESS.
Graphics Stability 1303736 Test Plan Card Roxana Leitan (Engineering QA) [DONE] [DONE] [DONE] Pre-Release sign off is GREEN.
Flash click-to-play enabled by default 1365714 Test Plan Card Stefan Georgiev (Engineering QA) [ON TRACK] [MISSED] [NOT STARTED] Pending assessment.
Turning on Search Suggestions 1344919 Test Plan Card Simona Badau (Engineering QA) [DONE] [DONE] [DONE] Pre-Release sign off is GREEN.
client-side stackwalking: client_crash_ID 1322611 Test Plan Card Petruta Rasa (Release QA) [DONE] [DONE] [DONE] Pre-Release sign off is GREEN.
Flash SHIELD Experiment 1277346 Test Plan Stefan Georgiev (Engineering QA) [ON TRACK] [MISSED] [NOT STARTED] Pending assessment.
New Editor work 1297414 Bogdan Maris (Release QA) [DONE] [DONE] [DONE] Pre-Release sign off is IN PROGRESS.
Direct3D v11 DirectX video acceleration 1352442, 1352163 Card Timea Zsoldos (Release QA) [DONE] [DONE] [DONE] Pre-Release sign off is GREEN.
Simplify Print 1362526 Test Plan Ciprian Georgiu (Release QA) [DONE] [DONE] [DONE] Pre-Release sign off is GREEN.
[Quantum] Compositor Process for unaccelerated Windows 1356091 Test Plan Card Anthony Hughes, Alexandru Simonca (Release QA) [ON TRACK] [MISSED] [IN PROGRESS] Pre-Release sign off is IN PROGRESS.
Streamlined Stub Installer Test Plan Card Camelia Badau (Release QA) [ON TRACK] [DONE] [IN PROGRESS] The feature is currently in testing in Beta.
Preferences Performance 1364070 Card Hani Yacoub (Engineering QA) [ON TRACK] [DONE] [IN PROGRESS] Pre-Release sign off is IN PROGRESS.
Flash Async Drawing 32bit 1340934 Test Plan Card Stefan Georgiev (Engineering QA) [ON TRACK] [MISSED] [NOT STARTED] Pending assessment.
Firefox Screenshots system add-on Test Plan Card Iulia Cristescu (Release QA) [ON TRACK] [INVESTIGATION NEEDED] [IN PROGRESS] Pre-Release sign off is IN PROGRESS.
WebVR 1250244 Test Plan Card Cristian Comorasu (Release QA) [AT RISK] [AT RISK] [IN PROGRESS] Pre-Release sign off is IN PROGRESS.

Detailed test results

New bugs

Bugzilla query error

error, http-bad-status, Array


Known bugs

High-impact bugs also encountered in previous builds

Full Query
ID Summary Status Resolution
1371412 Crash in gdk_window_get_window_type RESOLVED DUPLICATE

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Low-impact bugs also encountered in previous builds

Bugzilla query error

error, http-bad-status, Array


Bug fix verification

Note: All verified Firefox 55 bug fixes are listed in https://goo.gl/P4fVbx.

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed