Releases/Firefox 57/Test Plan/Beta/3

From MozillaWiki
Jump to: navigation, search

«  Firefox 57 Beta 3 | Firefox 57 Beta 4 »

Firefox 57 Beta 3 Test Plan

Build information

Manual QA's recommendation for this build

Note: Recommendation based on results from manual testing.
BUILD TESTING STATUS RECOMMENDATION REASON(S)
57.0b3-build1 COMPLETED (100%) SHIP IT
  • 4 new bugs uncovered, we believe none of them are severe enough to block the release of this build. Here's a breakdown:
    • bug 1403118 - low-impact issue, affects character display on Outlook Tasks, not a regression (Fx29 is affected)
    • bug 1403115 - low-impact issue, affects the seek bar display on specific videos, looks like a regression in Fx57 (Fx56 is unaffected)
    • bug 1403121 - medium-impact issue, affects Activity Stream UI on narrow-width browser windows, not a recent regression
    • bug 1403127 - low-impact issue, affects the "Save As" contextual option for videos, looks like a regression in Fx57 (Fx56 is unaffected)
  • Known (old) bugs encountered are low-impact.

Manual testing summary

PLATFORM ASSIGNEE BUILD GPU STATUS PER TEST SUITE
Web Compatibility Video Compatibility Activity Stream
Windows 7 x64 Iulia Cristescu 32-bit Intel HD 520 YELLOW GREEN YELLOW
Windows 10 x64 Timea Zsoldos 64-bit AMD Radeon HD 3000 YELLOW GREEN YELLOW
macOS 10.12 Camelia Badau 64-bit Intel Iris Pro (1536 MB) YELLOW GREEN YELLOW
Ubuntu 16.04 x86 Emil Ghitta 32-bit Intel HD 530 YELLOW GREEN YELLOW

Features in Firefox 57

Note: See https://goo.gl/6KDDS4 for a general overview.
FEATURE NAME PRIORITY TRACKING QA CONTACTS TESTING STATUS PRELIMINARY REPORTING STATUS SIGN OFF STATUS ADDITIONAL NOTES
Type Level Bugzilla Wiki Trello
Async Places Transactions bug 979280 Test Plan n/a Hani Yacoub (EngQA) [NOT STARTED] [NOT STARTED] [NOT STARTED] Covered with automation testing. Please contact Panos (Panagiotis Astithas) for any info related to it.
Date time Input Types bug 888320,1283384 Test Plan n/a Francis Lee (TpeQA) [NOT STARTED] [NOT STARTED] [NOT STARTED] Handled by TPE QA - please contact Francis Lee for questions
TPE DOM - Storage bug 1147820 Test Plan n/a Wesley Huang (TpeQA) [NOT STARTED] [NOT STARTED] [NOT STARTED] Handled by TPE QA - please contact Wesley Huang for questions
E10s with A11y bug 1258839 Test Plan n/a Grover Wimberly (EngQA) [NOT STARTED] [NOT STARTED] [NOT STARTED] Under assessment, post merge to beta.
Photon Animation Improvements bug 1349423 Test Plan n/a Justin Williams (EngQA) [NOT STARTED] [NOT STARTED] [NOT STARTED] Under assessment, post merge to beta.
Photon Performance bug 1348289 Test Plan n/a Adrian Florinescu (EngQA) [NOT STARTED] [NOT STARTED] [NOT STARTED] Under assessment, post merge to beta.
Photon Visual Redesign bug 1325171 Test Plan n/a Brindusa Tot (EngQA) [NOT STARTED] [NOT STARTED] [NOT STARTED] Under assessment, post merge to beta.
Photon Preferences bug 1356269 n/a n/a Hani Yacoub (EngQA) [NOT STARTED] [NOT STARTED] [NOT STARTED] Under assessment, post merge to beta.
Photon Structure bug 1349210 Test Plan n/a Grover Wimberly (EngQA) [NOT STARTED] [NOT STARTED] [NOT STARTED] Under assessment, post merge to beta.
Photon Onboarding Tour Notifications 2 bug 1357008 Test Plan Card Justin Williams (EngQA) [NOT STARTED] [NOT STARTED] [NOT STARTED] Under assessment, post merge to beta.
Photon Onboarding Profile Refresh bug 1268708 Test Plan Card Justin Williams (EngQA) [NOT STARTED] [NOT STARTED] [NOT STARTED] Under assessment, post merge to beta.
Photon Preferences Visual Refresh bug 1357306 Test Plan Card Hani Yacoub (EngQA) [NOT STARTED] [NOT STARTED] [NOT STARTED] Under assessment, post merge to beta.
File read access restrictions (Ubuntu) n/a Test Plan Card Mihai Boldan (RelQA) [NOT STARTED] [NOT STARTED] [NOT STARTED] Under assessment, post merge to beta.
Keyboard APZ & Autoscrolling bug 1351783,1376525,1105109 Test Plan Card Petruta Horea (Rasa) (RelQA) [NOT STARTED] [NOT STARTED] [NOT STARTED] Under assessment, post merge to beta.
Form auto fill with credit card support (MVP) + Sync bug 990176 Test Plan Card Gabi Cheta (RelQA) [NOT STARTED] [NOT STARTED] [NOT STARTED] Under assessment, post merge to beta.
Activity Stream n/a Test Plan n/a Ciprian Muresan (EngQA) [NOT STARTED] [NOT STARTED] [NOT STARTED] Under assessment, post merge to beta.

Detailed test results

New bugs

Full Query
ID Summary Status Resolution Keywords
1403115 Stylo: Black dots displayed in video's seekbar at the right and left side VERIFIED FIXED regression
1403118 The lowest pixel of certain characters is cut off on Outlook Tasks RESOLVED FIXED
1403121 New top site input fields are displayed outside the parent window after resizing the Firefox window VERIFIED FIXED
1403127 Can't save an Mp4 video from context menu in full screen mode VERIFIED FIXED multiprocess, regression

4 Total; 0 Open (0%); 1 Resolved (25%); 3 Verified (75%);


Known bugs

High-impact bugs also encountered in previous builds

Bugzilla query error

error, http-bad-status, Array


Low-impact bugs also encountered in previous builds

Full Query
ID Summary Status Resolution
558178 Only show password capture dialog if we're reasonably sure the password was correct and the login was successful RESOLVED WONTFIX
616629 "Remember Password?" dialog shows too early RESOLVED DUPLICATE
1182606 Context menu for video elements should check .mozHasAudio property NEW
1191290 Glitches after opening images in tumblr RESOLVED WORKSFORME
1194214 [HTML5] Several side effects using the context menu options on Youtube NEW
1230678 youtube shows black line 720p & 1080p videos in normal view mode VERIFIED FIXED
1233359 Glitches after opening images in facebook NEW
1277327 Video on gaming.youtube.com lags behind while scrolling RESOLVED INCOMPLETE
1282075 Selecting the "Hide Controls" option causes the container area to disappear (for audio files played inline) NEW
1305744 Twitter profile picture glitches when the page is scrolled in maximized window RESOLVED WORKSFORME
1306590 percent "text-indent" values resolve against the wrong container box, for overflow:hidden elements (causing stray character to be visible at reddit) RESOLVED INVALID
1309534 Glitches when zoom in .jpg files from Wikipedia NEW
1329386 BBCiPlayerTV HTML5 broken (again!) in Firefox-52+ VERIFIED FIXED
1360545 OGV Video remains stuck after forwarding the seekbar to an non-buffered zone NEW
1393811 The video can't be played if "Show Controls" is activated on dailymotion.com NEW
1402827 Video freezes after interacting with the seekbar RESOLVED WONTFIX

16 Total; 7 Open (43.75%); 7 Resolved (43.75%); 2 Verified (12.5%);


Bug fix verification

Note: All verified Firefox 57 bug fixes are listed in https://goo.gl/CDJvYv.

Bugzilla query error

error, http-bad-status, Array


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed