Mozilla QA Community:BonEcho 2.0RC3prerelease Community Test Day
Contents
- 1 Welcome to the Bon Echo Community Test Day!
- 1.1 FAQ
- 1.1.1 Where do I start?
- 1.1.2 OK, I am in the channel, now what?
- 1.1.3 What build should I test?
- 1.1.4 What specifically will we be testing?
- 1.1.5 Testing Instructions
- 1.1.6 Where do I find Litmus?
- 1.1.7 Who will be moderating the #testday channel?
- 1.1.8 How do I file bugs?
- 1.1.9 How do I send feedback?
- 1.1.10 Rewards for this Test Day
- 1.2 Results
- 1.1 FAQ
Welcome to the Bon Echo Community Test Day!
Thank you for participating in this test day. The success of Firefox and Thunderbird is heavily dependent on community members like you. We appreciate your support!
When you are done, please send feedback to testday@mozilla.org or post significant findings to the Mozilla QA blog (http://weblogs.mozillazine.org/qa/). We are very interested to hear about how the test day went, any overall thoughts about Bon Echo, and roll up of issues found and bugs filed.
The official time for the test day is Friday, October 20, 2006, from 7am - 5pm PDT, but anyone can jump on Litmus at any time on any day!
For more information about this release, please check out the Bon Echo wiki. You will find the current schedule, test plan, and specific areas we can use help testing.
FAQ
Where do I start?
- Open up your favorite IRC client
- For more info on IRC visit How To IRC
- Connect to irc.mozilla.org
- Join the #testday channel
Another option if you don't use IRC:
- Use Instant Messenger - http://www.aim.com/. A moderator will be online under the screen name "MozillaTestDay". Please send your screenname to marcia@mozilla.org before the test day so you can be invited to the chatroom, or just message "MozillaTestDay" during the day to figure out what to do.
OK, I am in the channel, now what?
Let the moderators know if you have any questions or encounter any problems. If you are not familiar with our bugzilla bug tracking system, feel free to report your problems to a moderator and they can log any bugs for you.
What build should I test?
We will be testing the BonEcho 2.0RC3 candidate builds:
Firefox (Windows, Linux, Mac, all locales): http://ftp.mozilla.org/pub/mozilla.org/firefox/releases/2.0rc3/
What specifically will we be testing?
As we approach the final release of Firefox 2, we need to give these BonEcho RC3 builds a good workout on all types of websites to make sure things work. So let's test all of our favorite websites and make sure nothing is broken. We want to focus on these types of websites:
- AJAX-y/Web 2.0 sites:
- http://www.aventureforth.com/2005/09/06/top-10-ajax-applications/ - there are a lot of cool sites that you might find useful, so try them out!
- Popular Google apps (GMail, Maps, Picassa Web, etc.)
- DHTML heavy sites:
- http://www.schillmania.com/, http://slayeroffice.com, http://www.dhtmlcentral.com/, http://www.dynamicdrive.com/... and many others you can probably find, those were just a few I dug up.
- Sites that use Plugins:
- A lot of sites these days use plugins like Flash, Java, Quicktime for presenting content... so do a bit of exploring on your favorite sites to see if you can find where the plugins are used! Any type of video you see or interactive games are most likely using a plugin. :-)
If you get through all of your favorite sites and then some, you can also test some of our other new features:
- Safe Browsing - BonEcho should warn you when visiting suspected phishing sites. It should be able to check against a locally stored list of known phishing sites or by checking a list stored remotely.
- RSS Feeds - View Live Bookmarks, subscribe in external feed readers. Bon Echo should be able to handle all different kinds of feeds: ATOM, RSS 0.9.1, 1.0 and 2.0.
- Tab overflow - now when a lot of tabs are open, scroll buttons appear on the left and right side of the tab bar allowing you to scroll through tabs.
- All Tabs button - a button that shows on the right side of the tab bar that lists all open tabs.
- Close button on tabs - instead of having the close button on the right side of the tab bar, now close buttons are on each individual tabs.
- Warn if closing too many tabs - now if you try to open too many tabs at once (more than 15), you will be asked if you want to open those tabs.
- Tab focusing behavior - when you open a new tab from a link on a page and then close that tab, you will go back to the page the tab was opened from
- Tab history and clearing private data - make sure tab history is cleared
- Restore Session and tab history - make sure tab history is restored
- Restore Session with form data - make sure entered form data is restored
- Restore Session with multiple windows - make sure all windows are restored and that their tabs, size, position and order are the same; including other windows, like Downloads, Extensions, ...
Testing Instructions
Follow these instructions:
- Download the possible Firefox 2.0 RC3 build: http://ftp.mozilla.org/pub/mozilla.org/firefox/releases/2.0rc3/
- Visit your favorite websites with lots of dynamic content (see types of sites above) and see if everything works as expected.
- Go to Litmus and run FF2.0 Full Functional Tests that are interesting to you.
Some other ways you can help:
- Think of some test cases that aren't already included in Litmus (we love suggestions!). Feel free to experiment, if you find something that you think should be included, let us know. Send new ideas for testcases to [1].
Where do I find Litmus?
- Go to the Litmus start page.
- Log in or create an account if you don't already have one and then select run tests.
- Enter the appropriate information and click Submit.
- Choose a test group and then a subgroup and then click Submit to start testing!
Tips:
- Make sure you enter the correct information for your platform, version of Firefox, etc.
- Feel free to ask on IRC or AIM if you need help or have any questions.
Who will be moderating the #testday channel?
The moderator's nicks for this test day will be:
- jay
- tracy
- bc
- marcia
- juanb
- alice
- davel
- mw22
- robcee
- exciting surprise guests, you never know who could show up
How do I file bugs?
First of all, let one of the moderators know so they can check if it is already a known problem. Then they can guide you to either provide more details, update an existing bug or file a new bug.
If filing a new bug, please do a quick check to see if the bug already exists. This can easily be done by searching for the error message, window name, or some over identifing feature of the bug.
In the case of any testing endeavor, it is important to include the list of extensions that you have installed since they can often cause strange issues to crop up.
How do I send feedback?
Please use the testday@mozilla.org to send feedback about how the testday went, any overall thoughts about Bon Echo, and roll up of issues found and bugs filed. We really appreciate your help today and your feedback is very valuable.
Rewards for this Test Day
The top 5 testers who have not previously won $25 gift certificates or store credit for Community Day testing will be rewarded for this test day. If you reside outside of the U.S, you will be awarded a $25 gift certificate to the Mozilla Store.
Results
Total Test Results By Locale
Locale | # Results |
---|---|
cs | 35 |
en-GB | 3 |
en-US | 158 |
ko | 81 |
Total Test Results By Platform
Platform | # Results |
---|---|
Windows | 242 |
Linux | 35 |
Total Test Results By Result Status
Result Status | # Results |
---|---|
Pass | 276 |
Fail | 1 |
Total Test Results By Subgroup
Subgroup | # Results | # Testcases in Subgroup |
---|---|---|
Firefox:1.5 Full Functional Tests (FFTs):XMLHttpRequest | 3 | 2 |
Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Installation | 8 | 4 |
Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Menu Bar | 1 | 10 |
Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Help | 2 | 2 |
Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - General | 10 | 11 |
Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Tabbed Browsing | 18 | 18 |
Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Search | 15 | 12 |
Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Popup and annoyance blocking | 9 | 9 |
Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Find in Page | 8 | 6 |
Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Bookmarks | 14 | 14 |
Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - RSS | 8 | 8 |
Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Add-ons Manager | 12 | 12 |
Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Downloading | 11 | 11 |
Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Toolbar Customization | 6 | 6 |
Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Security and Certs | 4 | 4 |
Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Anti-phishing | 6 | 3 |
Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Technical Tools | 5 | 5 |
Firefox:2.0 Basic Functional Tests (BFTs):FX 2.0 - Uninstall | 3 | 3 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Installation | 16 | 8 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Menu Bar | 1 | 10 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Help | 8 | 8 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Options (Preferences) | 11 | 18 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - General | 7 | 13 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Location Bar & Autocomplete | 3 | 5 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Tabbed Browsing | 44 | 44 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Search | 28 | 19 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Popup and annoyance blocking | 12 | 12 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Find in Page | 13 | 11 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Bookmarks | 14 | 35 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Microsummaries | 12 | 7 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - RSS | 8 | 27 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Add-ons Manager | 12 | 20 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Downloading | 11 | 18 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Toolbar Customization | 6 | 11 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Security and Certs | 9 | 9 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Anti-phishing | 13 | 10 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Top Sites | 21 | 8 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - XMLHttpRequest | 9 | 3 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Technical Tools | 5 | 5 |
Firefox:2.0 Full Functional Tests (FFTs):FX 2.0 - Uninstall | 3 | 3 |
Firefox:2.0 Smoketests:FX 2.0 - Install and Startup | 8 | 5 |
Firefox:2.0 Smoketests:FX 2.0 - Functionality | 22 | 28 |
Firefox:2.0 Surf's Up - A Fun Smoketest!:Common Operations | 7 | 8 |
Firefox:Localization (l10n):Localization (l10n) | 10 | 15 |
Top Testers
Tester | # Results |
---|---|
mkairys | 88 |
channy | 81 |
Tomcat | 70 |
jpozlovsky | 35 |
Ampersand | 3 |
Result Status Breakdown By Tester
Tester | Pass | Fail | Unclear |
---|---|---|---|
Ampersand | 2 | 1 | 0 |
Tomcat | 70 | 0 | 0 |
channy | 81 | 0 | 0 |
jpozlovsky | 35 | 0 | 0 |
mkairys | 88 | 0 | 0 |