Releases/Firefox 41/Test Plan/Beta/41.0.1

From MozillaWiki
Jump to: navigation, search

«  Firefox 41.0 RC build3 | Firefox 41.0.1 build1

Firefox 41.0.1 Test Plan

QE recommendation regarding the quality of the build

Build 1 Recommendation based on results from manual testing GOOD FOR RELEASE
Build 2 Recommendation based on results from manual testing GOOD FOR RELEASE

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing is performed around areas most affected by fixes.

Build 1

  • Test Cases executed and results: report
Platform Assignee Results: report
Windows 7 x64 (AMD Radeon HD 3000) Vasilica Mihasca [DONE]
Windows 10 x86 (nVIDIA GeForce 620) Cornel Ionce [DONE]
Mac OS X 10.10.5 (Intel Iris Pro) Cornel Ionce [DONE]
Ubuntu 12.04 x86 (AMD Radeon HD 3000) Andrei Vaida [DONE]
Tested Area Testing Type Results
WEB COMPATIBILITY Smoke Testing PASS
PLACES: BOOKMARKS Smoke Testing PASS

Build 2

  • Test Cases executed and results: report
Platform Assignee Results: report
Windows 7 x64 (AMD Radeon HD 3000) Alexandra Lucinet [DONE]
Windows 10 x86 (nVIDIA GeForce 620) Cornel Ionce [DONE]
Mac OS X 10.10.5 (Intel Iris Pro) Bogdan Maris [DONE]
Ubuntu 12.04 x86 (AMD Radeon HD 3000) Vasilica Mihasca [DONE]
Tested Area Testing Type Results
PLUG-IN COMPATIBILITY Smoke Testing PASS


Features

See the Feature Release Tracking gdoc for a general overview

Feature Owner Status Details Test Plan
Async plugin init Petruta Rasa DROPPED FROM 41 Feature dropped from Firefox 41 due to a few unresolved bugs -
New Add-on Signing Vasilica Mihasca DROPPED FROM 41 Feature dropped from Firefox 39, 40, 41, and 42 (not enough add-ons signed) Test Plan
Hello - Text Chat Bogdan Maris [DONE] SIGNED OFF Test Plan
Unified telemetry/FHR Alexandra Lucinet / Andrei Vaida [DONE] SIGNED OFF Test Plan

Results

New bugs

  • Build 1:

Full Query

ID Summary Status Resolution
1209509 crash in js::CallObject::createForFunction(JSContext*, js::AbstractFramePtr) RESOLVED WORKSFORME
1209518 The pasted bookmark keeps the styling of a cut one VERIFIED FIXED

2 Total; 0 Open (0%); 1 Resolved (50%); 1 Verified (50%);

  • Build 2:

Full Query

ID Summary Status Resolution
1209940 crash in hang | WaitForMultipleObjectsEx | MsgWaitForMultipleObjectsEx | mozilla::widget::WinUtils::WaitForMessage(unsigned long) | base::MessagePumpForUI::DoRunLoop() RESOLVED INCOMPLETE

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);

Known Issues - also seen in previous builds

Major issues also seen in previous builds

  • Build 1:
    NONE 
  • Build 2:

Full Query

ID Summary Status Resolution
547647 crash [@ nsTObserverArray_base::AdjustIterators(unsigned int, int)] - [@ nsMsgDatabase::RemoveListener] RESOLVED WORKSFORME
791798 crash in mozilla::plugins::parent::_releaseobject VERIFIED FIXED
1186483 crash in IsMarkedInternalCommon<T> or @ IsAboutToBeFinalizedInternal<T> RESOLVED DUPLICATE

3 Total; 0 Open (0%); 2 Resolved (66.67%); 1 Verified (33.33%);

Low impact issues also seen in previous builds

  • Build 1:

Full Query

ID Summary Status Resolution
1043280 Bookmark animation not displayed when page is bookmarked from the Context Menu NEW
1043696 Enable Apple PlatformDecoderModule for HTML5 video playback (MP4 playback on OSX) RESOLVED FIXED
1096357 "Unable to run script because scripts are blocked internally" JS error appear in browser console while browsing facebook and youtube on MacOS RESOLVED INCOMPLETE
1142945 Always deny fullscreen should not be a possible input RESOLVED FIXED
1168101 Reader View icon is shown on some Youtube pages RESOLVED WORKSFORME
1176218 [Youtube][HTML5] 8K videos do not work at all, or Audio only VERIFIED FIXED
1177382 Error is thrown by controller.jsm each time a URL is dragged onto the Bookmarks Toolbar RESOLVED FIXED
1181437 Ctrl-D in about:newtab allows bookmarking the New Tab page, even though the bookmark star button is disabled RESOLVED WONTFIX
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos RESOLVED WORKSFORME
1194214 [HTML5] Several side effects using the context menu options on Youtube NEW

10 Total; 2 Open (20%); 7 Resolved (70%); 1 Verified (10%);

  • Build 2:

Full Query

ID Summary Status Resolution
928379 QuickTime controls bar is missing RESOLVED WORKSFORME
1014554 Random crashes with [@ js::NukeCrossCompartmentWrappers(JSContext*, js::CompartmentFilter const&, js::CompartmentFilter const&, js::NukeReferencesToWindow)] RESOLVED WORKSFORME
1156800 crash in hang | WaitForMultipleObjectsEx | RealMsgWaitForMultipleObjectsEx | MsgWaitForMultipleObjects | mozilla::ipc::MessageChannel::WaitForInterruptNotify() | mozilla::ipc::MessageChannel::Call(IPC::Message*, IPC::Message*) RESOLVED FIXED
1171894 Reader View icon is shown for several apple.com trailers RESOLVED WORKSFORME

4 Total; 0 Open (0%); 4 Resolved (100%); 0 Verified (0%);

Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1185639 Windows IPC message loop needs more frequent message pumping RESOLVED FIXED
1189709 Silverlight fails to run on 20150730030208 Nightly VERIFIED FIXED
1206376 Changing properties of a new bookmark while adding it acts on the last bookmark in the current container VERIFIED FIXED

3 Total; 0 Open (0%); 1 Resolved (33.33%); 2 Verified (66.67%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed