« QA/Firefox3.1/TestPlan

Firefox 3.1 Alpha2 Test Results

The covered testing for this release will focus on smoketests and spotchecks. This will only be on the en-US locale.

Related Pages

Firefox 3.1 Tracking Site

• Alpha 2 features

Contact Info

PM: Mike Beltzner (beltzner)
Build: John O'Duinn (joduinn)
QA: Tony / others

Schedule

Builds hand to QA

ETA

QA test signoff

ETA

Build Location and IDs

• http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.1a2-candidates/build1/

• Mac Leopard Build ID
  • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a2) Gecko/20080829065003 Shiretoko/3.1a2
• Mac Tiger Build ID
  • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.1a2) Gecko/20080829065003 Shiretoko/3.1a2
• XP Build ID
  • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a2) Gecko/20080829082037 Shiretoko/3.1a2
• Vista Build ID
  • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a2) Gecko/20080829082037 Shiretoko/3.1a2
• Linux Build ID
  • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a2) Gecko/20080829071937 Shiretoko/3.1a2

Test Coverage

• Areas Covered:
  • Smoketests
  • Spotchecks

• Areas Not Covered:
  • BFTs
  • L10n
  • FFTs
  • Updates

Test Results

Smoketests Results

Mac Leopard [marcia]

• PASS
• Build ID
  • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a2) Gecko/20080829065003 Shiretoko/3.1a2
• Tested with Shockwave Flash 10.0 d26
• Bugs observed during testing
  • https://bugzilla.mozilla.org/show_bug.cgi?id=423126 - Favicons don't show when you restore a backup
• No themes compatible, even experimental

Linux [marcia]

• PASS
• Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a2) Gecko/20080829071937 Shiretoko/3.1a2
• Tested in an Ubuntu VM
  • No themes compatible, even experimental

Windows Vista [marcia]

• PASS
• Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1a2) Gecko/20080829082037 Shiretoko/3.1a2
• Tested in Windows Vista VM and spot checks on Windows Vista Ultimate machine in QA lab.
• No themes compatible, even experimental
• Confirmed both XP and Vista builds were signed

Spotcheck Results

Spot check of Live builds on Windows XP (marcia)

• PASS
• Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1a2) Gecko/20080829082037 Shiretoko/3.1a2
• Confirm http://download.mozilla.org/?product=shiretoko-alpha2&os=win&lang=en-US downloads correctly
• Confirm builds are signed.

Please just run a few visual and quick user tests across the sites to ensure there is nothing vividly broken. Test a few extensions and plugins to make sure web compatibility looks good.

Spot Checks of Builds

Windows XP (tchung)

• PASS
• Opened bug 453379 - Flash video on CNN won't play on 3.1a2 trunk and 3.0.3pre branch builds. This blocks CNN users from watching videos. update - resolved invalid. User Agent detection issue.

Linux (tchung)

• PASS
• Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1a2) Gecko/20080829071937 Shiretoko/3.1a2

Mac OSX (tchung)

• PASS
• From FTP:
  • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a2) Gecko/20080829065003 Shiretoko/3.1a2
• From http://download.mozilla.org/?product=shiretoko-alpha2&os=osx&lang=en-US, 9/5/08:
  • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1a2) Gecko/20080829065003 Shiretoko/3.1a2