Firefox:3.0.1:Test Plan

From MozillaWiki
Jump to: navigation, search

General Firefox 3.0.1 Test Plan

This is the basic set of tests we run for every security & maintenance release.

Description of Release

3.0.1 is a normal security release for Firefox.

Specific Test Plan for this Release

  • Verify the fixed bugs that are going into this release
  • Run smoketest, BFTs, updates, and l10n tests

Assumptions

Current Tasks

  • Ongoing: Bug Reproduction

Schedule

This is an estimated schedule as a normal security release.

  • Code freeze: July 1
  • Builds start: June 2
  • QA starts: July 3 (4 testers)
    • Smoketests: 1 1/2 day
    • BFTs and Bug Verification: 3 days
    • l10n Testing: 1/2 day
    • Betatest & Beta Channel Testing: 1 day
  • Release to beta channel: July 10
    • Releasetest & Release Channel Testing: June 16
  • Final Release: July 16
  • huh?

Builds

  • From http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/3.0.1-candidates/build1/
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.0.1) Gecko/2008070206 Firefox/3.0.1
    • Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9.0.1) Gecko/2008070206 Firefox/3.0.1
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.1) Gecko/2008070206 Firefox/3.0.1
    • Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
    • Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1

Test Results

Builds
Windows Mac Linux
Smoketests Tomcat(XP) PASS
Marcia(Vista) PASS
Tomcat(10.5) PASS Tracy(fc7) Pass
BFTs Tomcat PASS Marcia PASS, but missing crash data Tracy PASS
L10n Tomcat PASS Tchung PASS Tchung PASS
Updates Tchung/Tracy
Betatest - PASS
Beta - PASS
Releasetest - PASS
Release - tbd
Tomcat/Marcia Mac 10.4 and 10.5
Betatest - PASS
Beta - PASS
Releasetest - PASS
Release - tbd
Tchung
Betatest - PASS
Beta - PASS
Releasetest - PASS
Release - PASS

Detailed Test Results

Bug Verifications

When you verify the bug is fixed:

  • Mark the whiteboard from fixed1.9.0.1 to verified1.9.0.1
  • Fixed 3.0.1 Bugs (30 bugs to verify)

Tips:

  • If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard.