Releases/Firefox 4b1/Test Plan:Feature Area Testing
From MozillaWiki
< Releases
Contents
Firefox 4 Beta 1 BFTs
In addition to running all the Mozmill BFT automated tests, we'll run BFTs corresponding to areas of high priority using the following BFT test run in Litmus as a guide.
- Download builds: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/
- Use Litmus testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=180
Where there are no related Litmus testcases it is up to the feature owners to test their areas.
Focus Area | Tester | Status | |
---|---|---|---|
Theme work on Windows | juanb | Completed (Overall OK for beta. A few issues found. Look for [4b1] in quicksearch) | |
Theme work on Mac | marcia | Several blocker bugs on file, as work is still underway, including bug 562733 | |
Toolbar Customization | Ayan | Completed. Ran BFTs.Nothing major. | |
Firefox Menu | aravindm | Firefox Menu flickers when trying to open a New Window. Filed one bug | Build 2 : Firefox flicker still happening. |
Tab Strip | aravindm | Tabbed browsing covers the test cases of Tab strip | |
Tabbed Browsing | aravindm | Dragging a tab onto Desktop / dropping onto itself, sometimes does not open the page, just shows a blank page. | Build 2 : Able to reproduce. No major issues found |
Bookmarking | aravindm | Recent Tags item in Bookmarks menu does not show "Empty" dialog when a tag is deleted. Filed one bug. | Build 2 : No major issues found. |
Search | gmontagu | 4. Add an OpenSearch search engine: Does not display search results, just: "Search term was 'radio'" in the current tab (I typed "radio").
5. Autodiscovery of OpenSearch search engines: No glowing, same result as the previous test. All the other tests worked as expected. |
Build 2: 3. Check multiple search suggestion providers: No suggestions for Google,for Yahoo nor for any other search engine.
4. Add an OpenSearch search engine: Does not display search results, just: "Search term was 'radio'" in the current tab (I typed "radio"). 5. Autodiscovery of OpenSearch search engines: No glowing, same result as the previous test. All the other tests worked as expected. |
Session Restore | ashughes |
| |
Undo close window/tab | ashughes |
| |
Form and password manager | juanb | It has good automated tests, and a shallow pass showed no obvious problems. | |
Firefox Sync | tracy/tchung | Sync 1.4b2 is an extension that should work with fx4b1. Final integration will land post b1. | |
Feedback | tracy/aakash | Testing Completed: Crasher bug 576332 found on windows. Apparently it's a Fx bug not TP | |
Profile migration 3.6->4.0->3.6 | juanb | Completed. Ran a shallow pass on Win XP, Win 7, Mac and Linux, using common customizations, bookmarks, feeds, master passwd, extensions, tabs, windows and window sizes. In Windows it is noticeable that the bookmarks toolbar is gone in 4.0, but none of the information is lost. Needs a deeper look, but no major issues found on this pass. | |
Add-ons Manager | hskupin (needs testing on Windows and Linux) | Completed on Mac only. | |
OOPP | marcia | Completed testing on Mac. Visited various video sites and performed full screen testing, as well as explored the player controls. See wiki for one crash that happened while watching High Def videos. More testing coming on Windows and Linux. | |
WebM (googspreadsheet for crowdsoursing) | juanb | Completed (Overall OK. Filed an issue duped to a tab tear off problem. Look for [4b1] in quicksearch) | |
Fullscreen | juanb | Completed (Overall OK. Several issues filed. Look for [4b1] in quicksearch. All deal with Windows in fullscreen mode and theme) | |
d2d | marcia | Not enabled by default in B1, also somewhat broken due to theme landing. More focus on this feature in B2. | |
Personas (Lightweight Themes) | gmontagu | "Wearing", undoing, removing and enabling works as expected. While hovering from one to the other before a Persona fully shows sometimes a transparency occurs and the tabs turn gray and the horizontal space to the right of the Firefox button turns black. | Build 2: works as expected, less transparency issues but still happening. |
Notifications (Geo-location) | ashughes |
| |
Antivirus and firewall interactions | |||
Tab Matches in Awesomebar (aka Switch to Tab) | ashughes |
| |
Heads Up Display | juanb | Shallow pass across platforms. Focused on UI. No major issues found. Filed one bug (look for [4b1] in quicksearch). Needs functionality owner (Tomcat?). | |
Inspect | juanb | Shallow pass across platforms. Focused on UI. No major issues found. Needs functionality owner (Tomcat?). |
Windows XP(aravindm)
- Notes:
- Theme work on Windows: Make a not of the issues you found in this platform while testing the area you chose
- Firefox Menu:
- bug 575541 - "Go Button" is visible when cursor is not in the Location Bar
- bug 575958 - Firefox flickers when opening a new window
- bug 575963 - Recent Tags item in Bookmarks menu does not show "Empty" dialog when a tag is deleted
- Geolocation Notification: No problems found
- Session Store/Undo Close: No problems found
- Switch to Tab: No problems found
Windows 7
- Notes:
- Theme work on Windows: Make a not of the issues you found in this platform while testing the area you chose
- Firefox Menu:
- Geolocation Notification: No problems found
- Session Store/Undo Close: Problems with Undo Close
- Cannot undo tab/window closure from history menu (no option exists)
- Tests marked as broken, but is this a bug? How will users restore specific tabs/windows? If the feature still exists, it is not discoverable.
- See bug 577160 - Undo Close not discoverable in the new UI
- Switch to Tab: No problems found
- ...
Windows Vista (lower priority)
- Notes:
- Theme work on Windows: Make a not of the issues you found in this platform while testing the area you chose
- Firefox Menu:
- bug 574676
- Page Info Buttons are static when performing MouseOver() or MouseClick() event. Logged enhancement for win7(32-b)
Mac 10.5
- Notes:
- Theme work on Mac: Make a not of the issues you found in this platform while testing the area you chose
- Firefox Menu:
- Share Location Icon appears blurry. (in addition to retrieving Geolocation - known issue)
Mac 10.6 (marcia)
- Notes:
- Theme work on Mac: Make a not of the issues you found in this platform while testing the area you chose
- Firefox Menu:
- Feedback
- If you install the most recent version of Test Pilot from AMO, it overwrites the Feedback button. I confirmed with Jono that this is expected until they change the AMO version.
- Geolocation Notification: No problems found
- Session Store/Undo Close: No problems found
- Switch to Tab: No problems found
Linux (aravindm)
- Notes:
- Theme work on Windows: Make a not of the issues you found in this platform while testing the area you chose
- Firefox Menu:
- Firefox hangs in .ogv player full screen mode
- Dragging a tab onto Desktop / dropping onto itself, sometimes does not open the page, just shows a blank page.
- Geolocation Notification: No problems found
- Session Store/Undo Close: No problems found
- Switch to Tab: No problems found