Releases/Firefox 57/Test Plan/Beta/3
From MozillaWiki
« Firefox 57 Beta 3 | Firefox 57 Beta 4 »
Firefox 57 Beta 3 Test Plan
Build information
- Release week: Sep 25th, 2017. Plan is to ship this build on Tue, Sep 26th, 2017 — Release Calendar.
- Build: 57.0b3-build1 | c3f480fa9744 | 20170925150345| bugs since previous changeset | https://goo.gl/1oiMWA.
- QA contacts: Florin Mezei (:FlorinMezei), Andrei Vaida (:avaida), Cornel Ionce (:cornel_ionce) — online on #qa and #release-drivers, ⌚️UTC+02:00.
Manual QA's recommendation for this build
Note: Recommendation based on results from manual testing.
BUILD | TESTING STATUS | RECOMMENDATION | REASON(S) |
---|---|---|---|
57.0b3-build1 | COMPLETED (100%) | SHIP IT |
|
Manual testing summary
Note: Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/6418
PLATFORM | ASSIGNEE | BUILD | GPU | STATUS PER TEST SUITE | |||
---|---|---|---|---|---|---|---|
Web Compatibility | Video Compatibility | Activity Stream | |||||
Windows 7 x64 | Iulia Cristescu | 32-bit | Intel HD 520 | YELLOW | GREEN | YELLOW | |
Windows 10 x64 | Timea Zsoldos | 64-bit | AMD Radeon HD 3000 | YELLOW | GREEN | YELLOW | |
macOS 10.12 | Camelia Badau | 64-bit | Intel Iris Pro (1536 MB) | YELLOW | GREEN | YELLOW | |
Ubuntu 16.04 x86 | Emil Ghitta | 32-bit | Intel HD 530 | YELLOW | GREEN | YELLOW |
Features in Firefox 57
Note: See https://goo.gl/6KDDS4 for a general overview.
FEATURE NAME | PRIORITY | TRACKING | QA CONTACTS | TESTING STATUS | PRELIMINARY REPORTING STATUS | SIGN OFF STATUS | ADDITIONAL NOTES | |||
---|---|---|---|---|---|---|---|---|---|---|
Type | Level | Bugzilla | Wiki | Trello | ||||||
Async Places Transactions | bug 979280 | Test Plan | n/a | Hani Yacoub (EngQA) | [NOT STARTED] | [NOT STARTED] | [NOT STARTED] | Covered with automation testing. Please contact Panos (Panagiotis Astithas) for any info related to it. | ||
Date time Input Types | bug 888320,1283384 | Test Plan | n/a | Francis Lee (TpeQA) | [NOT STARTED] | [NOT STARTED] | [NOT STARTED] | Handled by TPE QA - please contact Francis Lee for questions | ||
TPE DOM - Storage | bug 1147820 | Test Plan | n/a | Wesley Huang (TpeQA) | [NOT STARTED] | [NOT STARTED] | [NOT STARTED] | Handled by TPE QA - please contact Wesley Huang for questions | ||
E10s with A11y | bug 1258839 | Test Plan | n/a | Grover Wimberly (EngQA) | [NOT STARTED] | [NOT STARTED] | [NOT STARTED] | Under assessment, post merge to beta. | ||
Photon Animation Improvements | bug 1349423 | Test Plan | n/a | Justin Williams (EngQA) | [NOT STARTED] | [NOT STARTED] | [NOT STARTED] | Under assessment, post merge to beta. | ||
Photon Performance | bug 1348289 | Test Plan | n/a | Adrian Florinescu (EngQA) | [NOT STARTED] | [NOT STARTED] | [NOT STARTED] | Under assessment, post merge to beta. | ||
Photon Visual Redesign | bug 1325171 | Test Plan | n/a | Brindusa Tot (EngQA) | [NOT STARTED] | [NOT STARTED] | [NOT STARTED] | Under assessment, post merge to beta. | ||
Photon Preferences | bug 1356269 | n/a | n/a | Hani Yacoub (EngQA) | [NOT STARTED] | [NOT STARTED] | [NOT STARTED] | Under assessment, post merge to beta. | ||
Photon Structure | bug 1349210 | Test Plan | n/a | Grover Wimberly (EngQA) | [NOT STARTED] | [NOT STARTED] | [NOT STARTED] | Under assessment, post merge to beta. | ||
Photon Onboarding Tour Notifications 2 | bug 1357008 | Test Plan | Card | Justin Williams (EngQA) | [NOT STARTED] | [NOT STARTED] | [NOT STARTED] | Under assessment, post merge to beta. | ||
Photon Onboarding Profile Refresh | bug 1268708 | Test Plan | Card | Justin Williams (EngQA) | [NOT STARTED] | [NOT STARTED] | [NOT STARTED] | Under assessment, post merge to beta. | ||
Photon Preferences Visual Refresh | bug 1357306 | Test Plan | Card | Hani Yacoub (EngQA) | [NOT STARTED] | [NOT STARTED] | [NOT STARTED] | Under assessment, post merge to beta. | ||
File read access restrictions (Ubuntu) | n/a | Test Plan | Card | Mihai Boldan (RelQA) | [NOT STARTED] | [NOT STARTED] | [NOT STARTED] | Under assessment, post merge to beta. | ||
Keyboard APZ & Autoscrolling | bug 1351783,1376525,1105109 | Test Plan | Card | Petruta Horea (Rasa) (RelQA) | [NOT STARTED] | [NOT STARTED] | [NOT STARTED] | Under assessment, post merge to beta. | ||
Form auto fill with credit card support (MVP) + Sync | bug 990176 | Test Plan | Card | Gabi Cheta (RelQA) | [NOT STARTED] | [NOT STARTED] | [NOT STARTED] | Under assessment, post merge to beta. | ||
Activity Stream | n/a | Test Plan | n/a | Ciprian Muresan (EngQA) | [NOT STARTED] | [NOT STARTED] | [NOT STARTED] | Under assessment, post merge to beta. |
Detailed test results
Note: New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/6418
New bugs
ID | Summary | Status | Resolution | Keywords |
---|---|---|---|---|
1403115 | Stylo: Black dots displayed in video's seekbar at the right and left side | VERIFIED | FIXED | regression |
1403118 | The lowest pixel of certain characters is cut off on Outlook Tasks | RESOLVED | FIXED | |
1403121 | New top site input fields are displayed outside the parent window after resizing the Firefox window | VERIFIED | FIXED | |
1403127 | Can't save an Mp4 video from context menu in full screen mode | VERIFIED | FIXED | multiprocess, regression |
4 Total; 0 Open (0%); 1 Resolved (25%); 3 Verified (75%);
Known bugs
High-impact bugs also encountered in previous builds
Bugzilla query error
error, http-bad-status, Array
Low-impact bugs also encountered in previous builds
16 Total; 7 Open (43.75%); 7 Resolved (43.75%); 2 Verified (12.5%);
Bug fix verification
Note: All verified Firefox 57 bug fixes are listed in https://goo.gl/CDJvYv.
Bugzilla query error
error, http-bad-status, Array
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed