Releases/Firefox 55/Test Plan/Beta/1

From MozillaWiki
Jump to: navigation, search

«  Firefox 54 Beta 13 | Firefox 55 Beta 1 | Firefox 55 Beta 2 »

Firefox 55 Beta 1 Test Plan

Build information

Manual QA'S recommendation for this build

Note: Recommendation based on results from manual testing.
BUILD TESTING STATUS RECOMMENDATION REASON(S)
55.0b1-build6 COMPLETED 100% SHIP IT
  • The known bugs encountered in this build are reproducible on older Firefox releases, we don't consider them blockers.
  • While we don't consider bug 1372528 a severe enough issue to block, it does have a moderate impact on Search user experience. We do suggest fixing this in the upcoming Beta builds.

Manual testing summary

Note: Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/4654.
PLATFORM ASSIGNEE BUILD GPU STATUS PER TEST SUITE
Simplify Page Customization Crash Reporter
Windows 7 x64 Timea Zsoldos 32-bit Intel HD 5500 GREEN GREEN GREEN
Windows 10 x64 Camelia Badau 64-bit NVIDIA GeForce 210 GREEN GREEN GREEN
macOS 10.12.5 Alexandru Simonca 64-bit Intel Iris Pro (1536 MB) GREEN GREEN GREEN
Ubuntu 16.04 x64 Iulia Cristescu 64-bit Intel HD 530 GREEN GREEN GREEN

Features in Firefox 55

Note: Pre-Release feature sign offs are scheduled to be completed by July 21st.
Note: See https://goo.gl/lRb7yH for a general overview.
FEATURE NAME TRACKING QA CONTACTS TESTING STATUS SIGN OFF STATUS ADDITIONAL NOTES
Bugzilla Wiki Trello
One-off Searches from Awesomebar 1180944 Test Plan Card Petruta Rasa (Release QA) [ON TRACK] [NOT STARTED] Engineering QA to Release QA handover process is underway.
Shutdown Video Decoder 1293963 Test Plan Card Bogdan Maris (Release QA) [ON TRACK] [NOT STARTED] Engineering QA to Release QA handover process is underway.
Application Update UI 893505 Test Plan Roxana Leitan (Engineering QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Enable async scrolling via scrollbar dragging 1333965 Test Plan Ovidiu Boca (Engineering QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Shutdown ping 1336360 Test Plan Petruta Rasa (Release QA) [ON TRACK] [NOT STARTED] Engineering QA to Release QA handover process is underway.
Deny plugins from non-HTTP/HTTPS protocols 1335475 Stefan Georgiev (Engineering QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Windows Stub Installer 797208 Test Plan Card Camelia Badau (Release QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Separate Content Process for loading file:// URI pages 1147911 Test Plan Card Cristian Comorasu (Release QA) [ON TRACK] [NOT STARTED] Engineering QA to Release QA handover process is underway.
Graphics Stability 1303736 Test Plan Card Roxana Leitan (Engineering QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Flash click-to-play enabled by default 1365714 Test Plan Card Stefan Georgiev (Engineering QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Turning on Search Suggestions 1344919 Test Plan Card Simona Badau (Engineering QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
client-side stackwalking: client_crash_ID 1322611 Test Plan Card Petruta Rasa (Release QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Flash SHIELD Experiment 1277346 Test Plan Stefan Georgiev (Engineering QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta, it may not ride 55.
New Editor work 1297414 Bogdan Maris (Release QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Direct3D v11 DirectX video acceleration 1352442, 1352163 Card Timea Zsoldos (Release QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Simplify Page (print preview) 1362526 Test Plan Ciprian Georgiu (Release QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
[Quantum] Compositor Process for unaccelerated Windows 1356091 Test Plan Card Anthony Hughes, Alexandru Simonca (Release QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Streamlined Stub Installer Test Plan Card Camelia Badau (Release QA) [ON TRACK] [NOT STARTED] Engineering QA to Release QA handover process is underway.
Preferences Performance 1364070 Card Hani Yacoub (Engineering QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Flash Async Drawing 32bit 1340934 Test Plan Card Stefan Georgiev (Engineering QA) [ON TRACK] [NOT STARTED] The feature is currently being assessed post merge to Beta.
Firefox Screenshots system add-on Test Plan Card Iulia Cristescu (Release QA) [ON TRACK] [NOT STARTED] Engineering QA to Release QA handover process is underway.

Detailed test results

Note: New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/4654.

New bugs

Full Query
ID Summary Status Resolution Keywords
1372528 Change search settings redirects to General section of about:preferences VERIFIED FIXED regression

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);


Known bugs

High-impact bugs also encountered in previous builds

Bugzilla query error

error, http-bad-status, Array


Low-impact bugs also encountered in previous builds

Full Query
ID Summary Status Resolution
538844 When the Bookmarks Toolbar is moved to the Menu line, its original space is left blank NEW
972658 Undo 'restore defaults' does not restore toolbar visibility (bookmarks / menu toolbar ) NEW
1202654 “Restart now” and “Undo” buttons should not appear for Default theme in about:addons RESOLVED INACTIVE
1253624 When you want to cut and paste a bookmark from Bookmarks Toolbar, it will remain selected RESOLVED DUPLICATE
1365601 Crash in nsPrintEngine::GetSeqFrameAndCountPagesInternal while switching from Landscape to Portrait mode or clicking rapidly the Simplify page button VERIFIED FIXED
1368158 Images are not displayed or blank spaces left in Simplify page if they are not fully loaded on the website NEW

6 Total; 3 Open (50%); 2 Resolved (33.33%); 1 Verified (16.67%);


Bug fix verification

Note: All verified Firefox 55 bug fixes are listed in https://goo.gl/P4fVbx.

Bugzilla query error

error, http-bad-status, Array




Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_55/Test_Plan/Beta/1&oldid=1173647"