QA/Firefox3/TestResults/RC3

From MozillaWiki
< QA‎ | Firefox3‎ | TestResults
Jump to: navigation, search

« QA/Firefox3/TestResults

Firefox 3 RC3 Test Results

This respin of RC3 is primarily focused on mac 10.5.3 users only. Windows and Linux builds will remain at RC2. For more details, see bug 436575.

Related Pages

Links to separate test results. Some are referenced further below.

Project Release Tracking Page

Contact Info

PM: Mike Beltzner (beltzner)
Build: John O'Duinn (joduinn)
QA: Tony (tchung)

Schedule

Code Freeze
Code Build
6/10
QA test signoff
ETA 6/11
  • Mac Smoketests PASS
  • Update snippets from Alpha X, Beta X -> RC2 betatest, PASS releasetest, PASS, rc1,rc2->rc3 beta/release, PASS
  • P1 L10N spotchecks PASS
  • live tests PASS

Build Location and IDs

*Note: Mac builds only. Windows and Linux are not affected.

Test Coverage

  • Areas Covered:
    • Smoketests
      • Use test profiles stored here.
    • Focused Tests (primarily fix for bug 436575
    • Update snippets from Alpha X, Beta X, RC1, RC2 -> RC3 (mac only)
    • P1 L10N spotchecks (mac only)
  • Areas Not Covered:
    • Windows and Linux platforms
    • BFT
    • FFT
    • Top plugins
    • Top Sites
    • Top Themes
    • Top Extensions
    • Accessibility Tests (litmus and automation)
    • Memory Leak Testing (handled by Tomcat on debug builds)
    • Bc's topsite spidertests against jemalloc/malloc builds
    • localization (String changes) - Localizers to cover
    • Distribution
    • Major Updates
    • RC3 Testday

Test Results

Types of Tests Mac Tiger Mac Leopard
Smoketest Tomcat - PASS Tomcat - PASS
Updates Testing Tracy - Betatest PASS
Releasetest PASS
Beta/Release PASS
Tomcat - Betatest PASS
Releasetest PASS
Beta/Release result
l10N Pri 1 locales N/a Tchung - PASS
Live Checks & Download Links Tomcat - PASS Tracy - PASS

Updates Testing

We will be doing updates of Alpha and Beta users to RC3. We will be checking partial updates, complete updates, and failed status.

Will be available on betatest, releasetest, beta, and release (RC's only) channels

  • Betatest channel - PASS
  • Releasetest channel - PASS
  • Beta channel (live) - PASS
  • Release channel (rc1 & rc2) - PASS

Testcases and Results are tracked here. - PASS

L10N P1 Spotchecks

Visual inspection: Go through the P1 list of locales, and run a spotcheck to see if everything visually looks fine. Refer to L10N Requirements for more specifics.

Testcases and Results are tracked here - PASS

Live Spot Checks

Check live site download links on all platforms. Please cover en-US, and 2 or 3 additional Tier 1 locales as well. Pay attention to the following areas:

  • Check for signed installer and applications (windows only)
  • Firstrun page, whatsnew page, Home page, Search plugin
  • Install, uninstall
  • General spotchecks and browser functionality
  • Confirm Build IDs

OS assignments:

  • Mac Tiger - Tomcat - PASS
  • Mac Leopard - Tchung - PASS
  • Linux/Windows Checks - Tchung pass

Detailed Results

Smoketests (tomcat)

  • Tomcat
    • 10.5.3 Leopard
      • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9) Gecko/2008061004 Firefox/3.0
      • Status : PASS - Results in Litmus
    • 10.4.11 Tiger
      • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9) Gecko/2008061004 Firefox/3.0
      • Status : PASS - Results in Litmus

L10n Testing

  • Tchung
    • PASS. no issues found.