Releases/Firefox 4b9/Test Plan:Feature Area Testing

Fx 4b9 Test Plan

Firefox 4 Beta 9 BFTs

In addition to running all the Mozmill BFT automated tests, we'll run BFTs corresponding to areas of high priority using the following BFT test run in Litmus as a guide.

• Download builds: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b9-candidates/
• Use Litmus testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=251

Where there are no related Litmus testcases it is up to the feature owners to test their areas.

Focus Area	Tester	Status (detailed results at the bottom)
Sync	Andreea	WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete
Panorama (Private Browsing/Fullscreen interactions)	vlad, george, Andreea	WinXP: in progress/complete or Not Run Win7: in progress Mac OS 10.6: Complete Linux: Complete
Places (History and Bookmarks)	Andreea	WinXP: Not run Win7: Complete Mac OS 10.6: Complete Linux: Complete
Tabbed Browsing	George	WinXP: Not run Win7: Complete Mac OS 10.6: Not run Linux: Complete
App Tabs	Teodosia, George	WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete
Session Store	Teodosia	WinXP: ... Win7: Complete Mac OS 10.6: Complete Linux: Complete
Web Console	vlad	WinXP: complete Win7: complete Mac OS 10.6: Not run Linux: complete
WebGL	vlad	WinXP: complete Win7: complete Mac OS 10.6: Not run Linux: Not run
Plugins (Flash/Silverlght/Quicktime)	Smartware	WinXP: Complete Win7: Complete Mac OS 10.5: Complete Linux: Complete
Tabs on Top (Lightweight Themes interactions in Win7)	Smartware	WinXP: Complete Win7: Complete Mac OS 10.6: ... Linux: ...
Doorhanger Notificaions	Alex	WinXP: Complete Win7: Complete Mac OS 10.6: Not Run Linux: Complete
Identity (security tests that test Larry, the identity button)	George, Alex	WinXP: Not run Win7:Complete Mac OS 10.6: Not run Linux: Complete

Results Notes

Example Focus Area

• WinXP: Issues can be noted here, such as bugs filed in the area using this platform. Make notes of issues that you encountered but didn't lead to a bug being filed. If you file a bug please add [4b9] in the Whiteboard field.
• Mac OS 10.6: Issue...
• Linux 10.4: Issue...

Sync (Andreea)

• Win (7): PASS in Litmus with known issues
• Win XP :  PASS in Litmus with known issues
• Mac (10.6) : PASS in Litmus with known issues
• Linux (Ubuntu): PASS in Litmus with known issues

Panorama (and PB/Fullscreen interactions)

• Win (version): bug 624692, bug 624727
• Mac (10.6) : PASS in Litmus with known issues
• Linux (version): Pass

• Updated bugs:
  • bug 624102 - Other tabs in tab group hidden after exiting private browsing
  • bug 594644 - Return from Private Browsing Mode, Panorama forgets tab groups, until Panorama is manually re-launched

Places (History-Bookmarks)(Andreea)

• New issues:
  • bug 625077 - Tags are not properly updated in Library
  • bug 625083 - The position of the Library is not saved
  • bug 625317 - Folder icons missing on Bookmarks menu
• Win (7):
  • bug 624389 - Abnormal behavior when opening a bookmark in a new window from sidebar and them from toolbar.
  • bug 624676 - Browser doesn't add Javascript: url to the history.
• Mac (10.6) :
  • bug 625340 - Error Console shows error messages when deleting a tag from sidebar or Library
• Linux (Ubuntu):
  • bug 625025 - The content of the folder flickers when trying to drag and drop it on Bookmarks toolbar.
  • bug 625063 - Error while drag and drop bookmarks or history entry on desktop
• Found issues:
  • bug 484790 - Copying elements via Ctrl+D&D in trees duplicates the selected entry instead of the clicked one

Tabbed Browsing (George)

• New issues:
  • bug 624374 - Rendering issue in resized window having side-bar opened

• Updated issues:
  • bug 528289 - Minimized windows from session restore have partially drawn taskbar thumbnails/previews
  • bug 428843 - Unchecking "warn on close multiple tabs" also disables the Quit dialog (no longer offers to save tabs when quitting)
  • bug 485105 - improve tab-to-window experience
  • bug 465608 - pressing esc while dragging a tab should cancel the drag / detach operation (on windows)

• Win (7):
  • bug 624357 - Dragging tab over "Open new tab" button does not duplicate tab
  • bug 624363 - Reloading all tabs does not show progress in List all tabs pop-up
• Win XP: Not run
• Mac (10.5.8) : Not run
• Linux (Ubuntu): Complete

App Tabs (teodosia)

• New issues:
  • bug 623603 - Multiple App Tabs go outside the tab group in Panorama
  • bug 623878 - Rearranging App Tabs in tab bar is not reflected in Panorama
  • bug 623907 - Undo Close Tab reopens the tab in a new tab group
• Win (7): PASS in Litmus
• Win XP :  PASS in Litmus
• Mac (10.6.5) : PASS in Litmus
• Linux (Ubuntu): PASS in Litmus
• Results from App Tabs spreadsheet

Session Store (teodosia, alex, george)

• Win (7):
  • bug 624661 - Session restore does not retain form input data
  • bug 624667 - Session restore after a crash doesn't remember scrollbar position
• Mac (10.6.5) :
  • bug 624752 - Session restore should open a blank page if no browser window was opened at close on Mac
  • bug 625049 - Restore Session to Panorama view after crash
• Linux (Ubuntu):

• Found issues:
  • bug 345135 - Session restore shouldn't throw away form data even if there's no form on the page to restore the data into
  • bug 575861 - blank tabs without history should not be restored

Web Console (vlad)

• Win (7): PASS in Litmus
• Win XP: PASS in Litmus
• Mac (10.6) :
• Linux (Ubuntu): PASS in Litmus

• Results from summaries spreadsheet - please check 'updated tests'

• bug verifications

• New Issues
  • Bug 622537
  • Bug 623597

Webgl (vlad)

• Win (7): PASS with known issues
• Win XP: PASS with known issues
• Mac (10.5.8) :
• Linux (Ubuntu):

Results from spreadsheet

Plugins (Flash/Silverlight/Quicktime)

• Win (7): Pass
• Win (xp): Pass
• Mac (10.5): Pass
• Linux (10.10): Pass
  • New issues :
    • bug 624975 - Silverlight videos website loads 2 plugin containers
    • bug 625024 - Quicktime controls are visible even after killing the plugin container from windows task manager
    • bug 625034 - Unable to mute audio of quicktime video
    • bug 625036 - Unable to use back and forward controls for quicktime player
    • bug 625037 - Blank video player appears when firefox is minimized and maximized again
  • Repeat Bugs :
    • bug 614487 - Youtube videos looks weird after going in and out of full screen mode (F11)
    • bug 614965 - Context menu doesn't pop on right click with Quicktime video
    • bug 609003 - Quicktime videos don't play
    • Updated the results in Litmus and Plugins Matrix

Tabs on Top (Theming interactions in Win7)

• Win (version): Issues...
• Mac (version): Issues...
• Linux (version): Issues...

Doorhandle Notifications (Alex)

• New issues:
  • bug 624386 - Add-on downloading notification does not work properly after a canceled add-on is installed
  • bug 624391 - rendering issues when exiting Full Screen mode after a Firefox restart
• Win (7): PASS in spreadsheet
• Win XP :  PASS in spreadsheet
• Mac (10.6.5) :
• Linux (Ubuntu): PASS in spreadsheet

Results from spreadsheet

Identity - security (George, Alex)

• Win xp: Not run
• Win (7):Pass in Litmus
• Mac (10.6.5): Not run
• Linux (Ubuntu): Pass in Litmus