QA/Firefox3.5/TestPlan/Alpha1

From MozillaWiki
Jump to: navigation, search

« QA/Firefox3.1/TestPlan

Firefox 3.1 Alpha1 Test Results

The covered testing for this release will focus on smoketests and spotchecks. This will only be on the en-US locale.

Related Pages

Firefox 3.1 Tracking Site

Contact Info

PM: Mike Beltzner (beltzner)
Build: John O'Duinn (joduinn)
QA: Tony / Marcia / Hasham

Schedule

Builds hand to QA
ETA 7/23
QA test signoff
ETA 7/25
  • Smoketests PASS
  • Spotchecks PASS

Build Location and IDs

Build 1

  • http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.1a1-candidates/build1/
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1

Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1

Build 2 (mac respin only)

Test Coverage

  • Areas Covered (en-US):
    • Spotchecks
    • Smoketests
  • Areas Not Covered:
    • BFTs
    • FFTs
    • Updates
    • L10n
    • Web regression

Test Results

Types of Tests Windows XP Mac 10.5 Linux
Smoketests Hasham - PASS Marcia - PASS Hasham - PASS
Spotchecks Hasham - PASS Marcia - PASS Hasham - PASS

Smoketests Results

Mac Leopard [marcia]

  • PASS
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
  • Bugs Filed
  • Bugs Hit during testing
    • Bug 444963 - Sites with java applets freeze the browser and require a force quit Pending blocker review
  • Themes were not tested due to the fact no themes were compatible

Testing of Build 2 [marcia]

  • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
  • Bugs Filed

Linux [hasham]

  • PASS
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
  • Bugs Filed -
  • Bugs Come Across -
    • Bug 447699 To download themes, instead of "Add to Firefox", AMO displays "Download Now" to save the file. (All OS)

Windows XP [hasham]

  • PASS
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
  • Bugs Come Across -
    • Bug 447699 To download themes, instead of "Add to Firefox", AMO displays "Download Now" to save the file. (All OS)

Spotcheck Results

Please just run a few visual and quick user tests across the sites to ensure there is nothing vividly broken. Test a few extensions and plugins to make sure web compatibility looks good.

Spotchecks on 10.4/10.5 [marcia]

  • Build ID: Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1/Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1
  • Tested the Alexa Top 10 Global Sites - PASS
  • Tested Installing Certificates - PASS
  • Spot checks of new awesome bar features - http://ed.agadak.net/2008/07/firefox-31-restricts-matches-keywords. I tested the "+" modifier and it worked as expected.

Verifying Signing on XP [Hasham]

  • PASS
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1

Verifying Signing on Vista [marcia]

  • PASS
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
    • Checked updater, crash reporter, app and several dlls and all were signed

Verify Crash Reporter fires

  • Install Crash Reporter xpi and verify Crash Reporter fires
    • XP - Hasham - PASS
    • Vista - marcia
    • PASS using Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a1) Gecko/2008072310 Shiretoko/3.1a1
    • Mac - marcia
    • PASS using Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a1) Gecko/2008072510 Shiretoko/3.1a1
    • Linux - Tomcat
    • using Linux Fedora 9 and the 1.9.1a1 Build from the Ftp Server, Crash reporter and build works as expected - Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a1) Gecko/2008072306 Shiretoko/3.1a1

Spot Checks of Live Builds

Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Firefox3.5/TestPlan/Alpha1&oldid=135707"