QA/Fennec1.1/ReleaseTest/Beta1

From MozillaWiki
< QA
Jump to: navigation, search

Fennec 1.1 Beta 1 Test Results

The covered testing for this release will focus on smoketests, BFTs and updates. For a list of new features coming in for Fennec 1.1, take a look at the Mobile Planning Page and for test coverage, look at our test plan.

Project contacts

PM: Stuart Parmenter (stuart)
Build: John O'duinn (oduinn)
QA: Aakash Desai (aakashd)

Schedule

Code Freeze
-- 4/5
Builds hand to QA
-- 4/8
QA test signoff
--
  • See Test Coverage below

Build Location and IDs

Download:

Test Coverage

  • Areas Covered:
    • Smoketests - PASS
    • BFTs - result
    • Fixed Bug Verification - result
    • Updates - result

Smoketests

Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec 1.1 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Please record your detailed results in the "Detailed Test Results" section below.

BFTs

BFTs are a more comprehensive set of litmus tests that cover functional testing of features on the browser. Tests are available on litmus under the Fennec 1.1 Test Suite.

Please record your detailed results in the "Detailed Test Results" section below.

Testday

  • The Testday will be held on April on the latest b1 build

Fixed Bugs Verifications

The following link contains a list of bugs that are fixed for beta 1 and need verifications:

Updates/L10n

Fennec 1.0.x can be downloaded from the Mozilla Catalog as well as the Ovi Store for Maemo. For beta purposes, verification of updating Fennec 1.0 to the candidate builds will need to be performed on multi-locale and single locale builds.

Builds to be Tested:

  • multi-locale
  • 1 single-locale

Updates tests to perform for each build

Test Results

Types of Tests n900
Smoketests
  • mw22 - PASS
BFT
  • aakashd - PASS
  • tchung - PASS
  • mw22 - PASS
Updates
  • aakashd - PASS
  • tchung - result

Detailed Test Results

Smoketests Results

n900 [mw22]

  • Build: Mozilla/5.- (X11; U; Linux armv7l; es-ES; rv:1.9.2.5pre) Gecko/20100414 Firefox/3.6.5pre Fennec/1.1b1
  • Results: PASS
  • Notes:
    • Non-reproducible issues
      • There does not seem to be any extension compatible with Fennec1.1b1, so it is impossible for me to install any extension. That means, it is impossible for me to test the Add-ons manager

BFTs Results

n900 [aakashd] Installation -> History

  • Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2.5pre) Gecko/20100414 Namoroka/3.6.5pre Fennec/1.1b1
  • Notes:
    • filed bug 559578 - No restart notification when selecting a new language on multi-locale builds
    • filed bug 559591 - Site Preferences not saved when user clicks on "Don't Share" for geolocation
    • still see bug 535793 - autoconnect on my n900 works, but I get a page load error in the process
    • filed bug 559593 - Tapping favicon when awesome bar is opened pops it up briefly before it goes into a pressed state
    • filed bug 559625 - Pop-up blocking notification bar does not pop-up when its tab is loaded in the background
    • Non-reproducible issues
      • Firefox Start page shows nothing if there aren't any recommended add-ons for it.
      • issue 2

n900 [tchung] Add-ons Manager -> Search

  • Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2.5pre) Gecko/20100414 Namoroka/3.6.5pre Fennec/1.1b1
  • Results: PASS
  • Notes:
    • Many of the addons bfts were unrunable due to no extension compat support. forcing compatibility will at least allow me to test existing addons in my profile, but adding anything new via recommended or search does not apply.
    • filed bug 559655 - Installed addon before restart does not appear in the addons list
    • filed bug 559908 - Youtube enabler extension doesn't play any youtube videos on fennec 1.1b1
    • filed bug 559874 - No easy way to reset warnOnClose option
    • filed bug 559941 - Save PDF highlight does not fully extend in landscape mode
    • submitted a handful of unclear testcases with comments; really just needing testcase updates. See my litmus report for it.
    • wifi on n900 crapped out at home. Aakash will be finishing the Content Menu subgroup for me.

n900 [mw22] Security -> Screen Navigation

  • Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2.5pre) Gecko/20100414 Namoroka/3.6.5pre Fennec/1.1b1
  • Results: PASS
  • Notes:
    • [tester]: bug 559362 was filed by Aakash - [Regression] User can zoom in/out during page load. Litmus testcase: https://litmus.mozilla.org/single_result.cgi?id=253386
    • Non-reproducible issues
    • Reproducible issues
      • https://litmus.mozilla.org/single_result.cgi?id=253069 - I get a language choice dialog, where the rest of the page is greyed out. No problem, I see that too in a normal browser. Except, in Fennec, the right part is not greyed out. Not a big deal, but needs to be investigated at some point. I'll file a bug, if it hasn't been filed yet.
      • https://litmus.mozilla.org/single_result.cgi?id=253070 - I see a small layout problem. In a normal browser, the vertical menu-items on the left are separated by horizontal blue stripes. On the Nokia N900, they are white, except the last 2 ones. I don't see this on the windows 1.9.2 Fennec. Anyway, no big deal. Needs to be investigated, and then filed as a bug, if necessary.
      • https://litmus.mozilla.org/single_result.cgi?id=253383 - I see a white vertical stripe at the right of the page on www.mozilla.com. I don't see this in a normal browser or on Fennec on windows. I need to file a bug on this, if it hasn't been filed yet.
      • https://litmus.mozilla.org/show_test.cgi?id=9761 -The service terms link doesn't become purple when clicked upon. It is hash link so no new page gets visited, but the link color should still become purple, I think. Also, after that reloading the page, the webservices part has disappeared again. I think it should continue to show. This is also an issue in the desktop Firefox.
      • https://litmus.mozilla.org/show_test.cgi?id=7570 - I've marked this litmus test as failing. There are some issues. I can't double-click to zoom out on that page. How do I know that the select drop down is scrollable? I didn't know there were a lot of options there, until I saw the same page in a regular browser. Also, clicking on the select reacts slowly in Fennec on the n900. The "Select" and "Options" buttons don't have any color in the results, which makes them extremely difficult to read.
      • https://litmus.mozilla.org/show_test.cgi?id=7576 - 5. Dragging the map around with the styles doesn't work. I wouldn't know how to use Street View, because I can't drag the little mann onto one of the streets.
      • https://litmus.mozilla.org/show_test.cgi?id=7577 - The flash ad on http://bbs.qq.com/ on the left doesn't show up on the Fennec, I see this also on windows Fennec.
      • https://litmus.mozilla.org/show_test.cgi?id=7588 - Scrolling is slow inside Gmail on the n900
      • https://litmus.mozilla.org/show_test.cgi?id=7589 - On the n900, I don't get a page as in the desktop version, or on windows fennec. No idea why. On windows fennec, I noticed some painting errors while scrolling, the scrollbox in the middle.

Updates Results

n900 [tchung]

  • Build:
  • Results: result
  • Notes:
    • [tester]: filed bug 123456 - title
    • Non-reproducible issues
      • issue 1
      • issue 2

n900 [aakashd]

  • Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2.5pre) Gecko/20100414 Namoroka/3.6.5pre Fennec/1.1b1
  • Results: PASS
  • test1: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2.1) Gecko/20100330 Namoroka/3.6.1 Fennec/1.0.1
  • test2: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2.5pre) Gecko/20100416 Namoroka/3.6.5pre Fennec/1.1a2pre
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Fennec1.1/ReleaseTest/Beta1&oldid=216552"