QA/Fennec1.0/ReleaseTest/1.0Maemo Beta5

From MozillaWiki
< QA
Jump to: navigation, search

Fennec 1.0 Maemo B4 RC1 Test Results

The covered testing for this release will focus on bfts, l10n, top plugins, top financial sites, updates, and spotchecks.

Project contacts

PM: Stuart Parmenter (stuart)
Build: John O'duinn (oduinn)
QA: Aakash Desai (aakashd)

Schedule

Code Freeze
-- 10/28
Builds hand to QA
-- 11/4
QA test signoff
--
  • See Test Coverage below

Build Location and IDs

Download:

Builds:

Test Coverage

  • Areas Covered:
    • Smoketests - PASS
    • BFTs - PASS
    • Bug Fixes - PASS
    • Website Spotchecks
    • L10n Spotchecks - PASS

Test Results

Types of Tests n900 n810
Smoketests aakashd - PASS jmaher - PASS
BFTs aakashd - PASS jmaher - PASS
Staging/Live Webpages & Spotchecks & Webpages tester - result tester - result
L10n Build n900 n810
Auto-detect aakashd - PASS jmaher - PASS
es-ES aakashd - PASS jmaher - PASS
nl aakashd - PASS jmaher - PASS
fr aakashd - PASS jmaher - PASS
de aakashd - PASS jmaher - PASS
it aakashd - PASS jmaher - PASS
ru aakashd - PASS jmaher - PASS

BFT / FFT Testing

BFTs are a more comprehensive set of litmus tests that cover the build testing after smoketests result. Tests are available on litmus under the Fennec 1.0 test suite.

FFTs are a full comprehensive set of litmus tests that extend coverage in areas that BFTs dont often get to. These are run at least once during the major milestone timeline.

If you are running a BFT, Please record your detailed results in the section below.

Staging/Live Spotchecks & Webpages

1) Verify the following webpages that gets pushed to the live sites. Look for content messaging, spelling mistakes, broken links & images, etc..

2) Check live site download links on all platforms. Pay attention to the following areas:

Fixed Bugs Verifications

The following link constain a list of bugs that are fixed for beta 5 and need verifications:

https://wiki.mozilla.org/Mobile/Fennec/Fennec1.0/Maemo-B5

L10n Spotchecks

Run the Fennec 1.0 Localizer Test Run over each locale and device that is associated with the release.

  • Localized Parts of the Browser:
    • about:firstrun
    • about:firefox and about:fennec
    • Chrome Text

Testday

Detailed Results

Smoketests Results

n900 [aakashd]

  • Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2b2pre) Gecko/20091104 Namoroka/3.6b2pre Fennec/1.0b5
  • Results: PASS
  • Notes:
    • [aakashd] filed bug 526498 - Firstrun Page: Addons Manager doesn't scroll to the search area after get Weave button is clicked
    • [aakashd] filed bug 526499 - Networking: extension download does not re-start after losing Wifi connection
    • [aakashd] still seeing bug 468496 - Stretched images can show black blobs at edges on Linux (nearest neighbor scaling is not a substitute for EXTEND_PAD)

n900 [abillings]

  • Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2b2pre) Gecko/20091106 Firefox/3.6b2pre Fennec/1.0b5
  • Results: PASS

n810 [jmaher]

  • Build: Mozilla/5.0 (X11; U; Linux armv6I; en-US; rv:1.9.2b2pre) Gecko/20091104 Firefox/3.6b2pre Fennec/1.0b5
  • Results: PASS
  • Notes:
    • bug 562511 - Large Bookmark list (163 from Weave) are slow to load and pan
    • bug 526515 - Fennec .deb packages install as Fennec and not Firefox

BFT Results

n900 [aakashd]

  • Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2b2pre) Gecko/20091104 Firefox/3.6b2pre Fennec/1.0b5
  • Results: PASS
  • Notes:
    • [aakashd] filed bug 526526 - about:Certerror shows up in 1/2 screen zoom level on first load
    • [aakashd] filed bug 526543 - Youtube is crashy when playing videos
    • [aakashd] filed bug 526558 - CRH: Clear button is selectable after switching panes in options dialog
    • [aakashd] filed bug 526564 - Notification Bars: Half of the bar is shown when switching between tabs
    • [aakashd] filed bug 526670 - Pop ups in POST requests are made into active tabs
    • [aakashd] still sees bug 519459 - Large Sized elements do not constrain to the webpage's CSS rules
    • [aakashd] filed bug 526800 - Tabbed Browsing: Panning a tab while loading with multiple tabs open shows content from other tabs

n810 [jmaher]

  • Build: Mozilla/5.0 (X11; U; Linux armv6I; en-US; rv:1.9.2b2pre) Gecko/20091104 Firefox/3.6b2pre Fennec/1.0b5
  • Results: PASS
  • Notes:

Websites Testing

  • Notes

L10n Testing

n900 [aakashd]

  • Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2b2pre) Gecko/20091104 Firefox/3.6b2pre Fennec/1.0b5
  • Results: PASS
  • Notes:
    • [aakashd] filed bug 526863 - l10n: about:firstrun is not localized for russian in multi-locale builds FIXED
    • [aakashd] filed bug 526889 - l10n: Unusable Build when switching to da and de locales WORKSFORME [axel]

n900 [abillings]

  • Locale: it
  • Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; it; rv:1.9.2b2pre) Gecko/20091106 Firefox/3.6b2pre Fennec/1.0b5
  • Results: FAIL
  • Notes:
    • bug 526832 - IT locale - yahoo search provider in english
    • bug 526835 - IT locale - wikipedia search provider in english
  • Locale: da
  • Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; da; rv:1.9.2b2pre) Gecko/20091106 Firefox/3.6b2pre Fennec/1.0b5
  • Results: FAIL
  • Notes:
    • bug 526832 - IT locale - yahoo search provider in english
    • bug 527126 - Fennec: about:firstrun page is not localized in Danish
    • bug 527128 - Fennec: bookmark list is not localized in Danish
    • bug 527129 - Fennec: add bookmark dialog is not localized in Danish
    • bug 527130 - Fennec: Download manager "Remove" button is not localized in Danish
    • bug 527131 - Fennec: Extensions panel is not fully localized into Danish
    • bug 527132 - Fennec: Restart button says "Restart" in Danish locale

n810 [jmaher]

  • Build: Mozilla/5.0 (X11; U; Linux armv6I; en-US; rv:1.9.2b2pre) Gecko/20091104 Firefox/3.6b2pre Fennec/1.0b5
  • Results: PASS
  • Notes:
    • bug 526831 - download manager 'Yesterday' is not localized
    • bug 526832 - IT locale - yahoo search provider in english
    • bug 526835 - IT locale - wikipedia search provider in english
    • bug 526854 - FR locale - search providers in english
    • bug 526865 - DE locale - search providers in english
  • Marking as pass since core functionality is there although missing some l10n stuff. According to the l10n dashboard all locales are not at 100%.

TestDay Results