QA/Firefox3.5/TestPlan/Alpha1
From MozillaWiki
< QA | Firefox3.5 | TestPlan
Contents
Firefox 3.1 Alpha1 Test Results
The covered testing for this release will focus on smoketests and spotchecks. This will only be on the en-US locale.
Related Pages
Contact Info
PM: Mike Beltzner (beltzner)
Build: John O'Duinn (joduinn)
QA: Tony / Marcia / Hasham
Schedule
- Builds hand to QA
- ETA 7/23
- QA test signoff
- ETA 7/25
- Smoketests PASS
- Spotchecks PASS
Build Location and IDs
Build 1
- http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.1a1-candidates/build1/
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
- Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
- Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
Build 2 (mac respin only)
- ftp://ftp.mozilla.org/pub/firefox/nightly/3.1a1-candidates/build2/
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
Test Coverage
- Areas Covered (en-US):
- Spotchecks
- Smoketests
- Areas Not Covered:
- BFTs
- FFTs
- Updates
- L10n
- Web regression
Test Results
Types of Tests | Windows XP | Mac 10.5 | Linux |
---|---|---|---|
Smoketests | Hasham - PASS | Marcia - PASS | Hasham - PASS |
Spotchecks | Hasham - PASS | Marcia - PASS | Hasham - PASS |
Smoketests Results
Mac Leopard [marcia]
- PASS
- Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
- Bugs Filed
- Bugs Hit during testing
- Bug 444963 - Sites with java applets freeze the browser and require a force quit Pending blocker review
- Themes were not tested due to the fact no themes were compatible
Testing of Build 2 [marcia]
- Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
- Bugs Filed
Linux [hasham]
- PASS
- Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
- Bugs Filed -
- Bug 447690 - Rendering issue with Litmus on 3.1 SCREENSHOT
- Bugs Come Across -
- Bug 447699 To download themes, instead of "Add to Firefox", AMO displays "Download Now" to save the file. (All OS)
Windows XP [hasham]
- PASS
- Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
- Bugs Come Across -
- Bug 447699 To download themes, instead of "Add to Firefox", AMO displays "Download Now" to save the file. (All OS)
Spotcheck Results
Please just run a few visual and quick user tests across the sites to ensure there is nothing vividly broken. Test a few extensions and plugins to make sure web compatibility looks good.
Spotchecks on 10.4/10.5 [marcia]
- Build ID: Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1/Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
- Tested the Alexa Top 10 Global Sites - PASS
- Tested Installing Certificates - PASS
- Spot checks of new awesome bar features - http://ed.agadak.net/2008/07/firefox-31-restricts-matches-keywords. I tested the "+" modifier and it worked as expected.
Verifying Signing on XP [Hasham]
- PASS
- Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
Verifying Signing on Vista [marcia]
- PASS
- Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
- Checked updater, crash reporter, app and several dlls and all were signed
Verify Crash Reporter fires
- Install Crash Reporter xpi and verify Crash Reporter fires
- XP - Hasham - PASS
- Vista - marcia
- PASS using Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
- Mac - marcia
- PASS using Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
- Linux - Tomcat
- using Linux Fedora 9 and the 1.9.1a1 Build from the Ftp Server, Crash reporter and build works as expected - Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
Spot Checks of Live Builds
- Sanity check of all builds from ftp://ftp.mozilla.org/pub/mozilla.org/firefox/releases/3.1a1/ to make sure Build IDs match