Releases/Firefox 3.5.14/Test Plan:Smoketests

From MozillaWiki
Jump to: navigation, search

« Firefox:3.5.14:Test_Plan

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Firefox 3.5.14 Smoketest and BFT Results

Smoketests for Build 3

Build IDs

  • Windows: 20101001172330
  • OS X: 20101001164112
  • Linux: 20101001163017

Windows XP (gmealer)

  • Date: 10/1/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.14) Gecko/20101001 Firefox/3.5.14 (.NET CLR 3.5.30729)
  • Status: PASS in Litmus (Manual)

Smoketests for Build 1

Build IDs

  • Windows: 20100930131606
  • OS X: 20100930123633
  • Linux: 20100930122135

Windows XP (vlad)

  • Date: 10/1/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.14) Gecko/20100930 Firefox/3.5.14
  • Mozmill PASS (known failures)
  • Status: PASS in Litmus (Manual)
    • Notes: No new issues found

Windows 7 (gmontagu)

  • Date:
  • Build ID:
  • Mozmill PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes: No new issues found

Windows Vista (aravindm)

  • Date: 10/01/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.14) Gecko/20100930 Firefox/3.5.14
  • Mozmill RESULTS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Mac OS X 10.6 (vlad)

  • Date: 10/1/2010
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.14) Gecko/20100930 Firefox/3.5.14
  • Mozmill PASS (known failures)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes: No new issues found

Linux (vlad)

  • Date: 10/1/2010
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.14) Gecko/20100930 Firefox/3.5.14
  • Mozmill RESULTS
  • Status: SSL window for certified websites fails to display as expected in Litmus (Manual)

BFTs for Build 1

Windows XP (vlad&aravindm)

  • Date: 10/1/2010
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.14) Gecko/20100930 Firefox/3.5.14

The Manual section of the BFT will be divided up in four sections.

  • Sections (from Litmus in order)
    • Installation - Tabbed Browsing (aravindm, gmontagu)
      • Results (XP): PASS - Results in Litmus
      • Results (Win7): PASS - gmontagu
    • Search - Addons (aravindm)
      • Results: PASS - Results in Litmus
    • Downloading - Cookies (vlad)
      • Results: PASS - Results in Litmus
    • Security - Uninstall (vlad)
      • Results: PASS - Results in Litmus
  • Notes:

Other OS Spot Checks

Windows 2000 (tester)

  • Date:
  • Build ID:
  • Mozmill RESULTS
    • Normal: Results
    • Restart: [xx Results]
  • Status: RESULT
  • Comments
    • First Mozmill testrun gives an XML parsing error:

Error: undefined entity Source File: jar:file:///c:/docume~1/mozilla/locals~1/temp/tmpkbjjmv.binary/chrome/toolkit.jar!/content/global/netError.xhtml Line: 60, Column: 12 Source Code:

   <title>&loadError.label;</title>