Confirm
7,000
edits
Changes
Created page with "<small> « Fennec 26 Beta 2 | Fennec 26 Beta 6 | Fennec 26 Beta 8 »</small> = Fennec (Firefox fo..."
<small> « [[QA/Fennec/26/Beta/2| Fennec 26 Beta 2]] | [[QA/Fennec/26/Beta/6| Fennec 26 Beta 6]] | [[QA/Fennec/26/Beta/8| Fennec 26 Beta 8]] »</small>
= Fennec (Firefox for Android) 26.0 Beta 4 Test Plan =
* Release Week: November 11th, 2012
* QA Contact: [mailto:atrain@mozilla.com Aaron Train]; [mailto:kbrosnan@mozilla.com Kevin Brosnan]
* IRC: irc://irc.mozilla.org#qa ping AaronMT; kbrosnan; ioanachiorean;
* Build 1: [ftp://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/26.0b4-candidates/build1/ Fennec (Firefox for Android) 26 Beta 4] | [http://hg.mozilla.org/releases/mozilla-beta/rev/ changeset] | [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_26_0b2_RELEASE&tochange=FENNEC_26_0b4_RELEASE pushlog]
=== Features ===
''See the [https://wiki.mozilla.org/Mobile/Roadmap/Tracking_Fx26 Feature Release Tracking] wiki for a general overview of this release. Found below are a subset of all high-priority items''
{| class="querytable"
| class="header" | Feature
| class="header" | Owner
| class="header" | Status
| class="header" | Tests
|-
| [[Mobile/Projects/AMO_and_Marketplace_discoverability | AMO discoverability]]
|
| {{mok}}
| [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdGVKQlRHUnFWVEZXNFFJbHo0RVpQMmc#gid=0 QA Feature Tracking & MozTrap References] & [https://wiki.mozilla.org/Mobile/Roadmap#Firefox_26:_.28Beta.29 Product Features]
|-
| [[Mobile/Projects/Addition_of_search_engines | Addition of search engines - Yahoo and Bing for selected locales ]]
|
| {{mok}}
| [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdGVKQlRHUnFWVEZXNFFJbHo0RVpQMmc#gid=0 QA Feature Tracking & MozTrap References] & [https://wiki.mozilla.org/Mobile/Roadmap#Firefox_26:_.28Beta.29 Product Features]
|-
| [[Mobile/Projects/About:home_redesign | About:home redesign ]]
| Adrian Tamas
| {{mok}}
| [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdGVKQlRHUnFWVEZXNFFJbHo0RVpQMmc#gid=0 QA Feature Tracking & MozTrap References] & [https://wiki.mozilla.org/Mobile/Roadmap#Firefox_26:_.28Beta.29 Product Features]
|-
| [[Mobile/Projects/Settings_UI_clean_up | search provider management in settings menu ]]
| Mihai Pop
| {{mok}}
| [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdGVKQlRHUnFWVEZXNFFJbHo0RVpQMmc#gid=0 QA Feature Tracking & MozTrap References] & [https://wiki.mozilla.org/Mobile/Roadmap#Firefox_26:_.28Beta.29 Product Features]
|-
| [[Mobile/Projects/About:home_-_Add-ons_can_add_content_to_the_%22promotional_banner%22_tile | Add-ons can add content to the "promotional banner" tile]]
|
| {{mok}}
| [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdGVKQlRHUnFWVEZXNFFJbHo0RVpQMmc#gid=0 QA Feature Tracking & MozTrap References] & [https://wiki.mozilla.org/Mobile/Roadmap#Firefox_26:_.28Beta.29 Product Features]
|-
| [[Mobile/Projects/Localization | Added locale: South African English (za-EN)]]
|
| {{mrisk}}
| [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdGVKQlRHUnFWVEZXNFFJbHo0RVpQMmc#gid=0 QA Feature Tracking & MozTrap References] & [https://wiki.mozilla.org/Mobile/Roadmap#Firefox_26:_.28Beta.29 Product Features]
|-
| [[Mobile/Projects/Localization | Added locale: Thai (th)]]
|
| {{mrisk}}
| [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdGVKQlRHUnFWVEZXNFFJbHo0RVpQMmc#gid=0 QA Feature Tracking & MozTrap References] & [https://wiki.mozilla.org/Mobile/Roadmap#Firefox_26:_.28Beta.29 Product Features]
|-
| [[Mobile/Projects/WebRTC_platform_support | WebRTC platform support, continued]]
|
| {{mok}}
| [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdGVKQlRHUnFWVEZXNFFJbHo0RVpQMmc#gid=0 QA Feature Tracking & MozTrap References] & [https://wiki.mozilla.org/Mobile/Roadmap#Firefox_26:_.28Beta.29 Product Features]
|}
=== Smoketests ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Smoketests
| Softvision
| Every Beta
|}
Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] under the [https://moztrap.mozilla.org/results/cases/?filter-run= 18.0 smoketest suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
{{:QA/Fennec/26/Beta/4/smoketests-results}}
[[QA/Fennec/26/Beta/4/smoketests-results|Detailed Smoketest results]]
=== Android Permissions Testing ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Verification
| Softvision
| Every Beta
|}
{{:QA/Fennec/26/Beta/4/permissions-results}}
[[QA/Fennec/26/Beta/4/permissions-results|Detailed Android Permissions Testing Results]]
<br/>''' Verify permissions between what is currently on the store and with this beta build candidate'''.
<br/>Details: [[QA/Fennec/Permissions|Android Permissions]]
=== Branch Bug Fix Verifications ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Verification
| Softvision
| Every Beta
|}
* '''[http://mzl.la/18xrduR Firefox for Android (26) Bugs]'''
* '''[http://mzl.la/1axhqYD Firefox 26 - Verification Query URL]'''
=== L10N (Localization) Spot Checks ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Strings Verification
| SoftVision
| Every Beta
|}
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
{{:QA/Fennec/26/Beta/4/L10N-strings matrix}}
[[QA/Fennec/26/Beta/4/L10N-strings matrix|Detailed L10N matrix]]
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Builds Verification
| SoftVision
| Every Beta
|}
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
{{:QA/Fennec/26/Beta/4/L10N-builds matrix}}
[[QA/Fennec/26/Beta/4/L10N-builds matrix|Detailed L10N matrix]]
=== AppThwack Automation ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|''How often?''
|-
| Runs against ARMv6 and ARMv7
| Ioana
| Alternating
|}
Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARM6 and ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities
{{:QA/Fennec/26/Beta/4/AppThwack Results}}
[[QA/Fennec/26/Beta/4/AppThwack Results|Detailed AppThwack Results]]
= Fennec (Firefox for Android) 26.0 Beta 4 Test Plan =
* Release Week: November 11th, 2012
* QA Contact: [mailto:atrain@mozilla.com Aaron Train]; [mailto:kbrosnan@mozilla.com Kevin Brosnan]
* IRC: irc://irc.mozilla.org#qa ping AaronMT; kbrosnan; ioanachiorean;
* Build 1: [ftp://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/26.0b4-candidates/build1/ Fennec (Firefox for Android) 26 Beta 4] | [http://hg.mozilla.org/releases/mozilla-beta/rev/ changeset] | [https://hg.mozilla.org/releases/mozilla-beta/pushloghtml?fromchange=FENNEC_26_0b2_RELEASE&tochange=FENNEC_26_0b4_RELEASE pushlog]
=== Features ===
''See the [https://wiki.mozilla.org/Mobile/Roadmap/Tracking_Fx26 Feature Release Tracking] wiki for a general overview of this release. Found below are a subset of all high-priority items''
{| class="querytable"
| class="header" | Feature
| class="header" | Owner
| class="header" | Status
| class="header" | Tests
|-
| [[Mobile/Projects/AMO_and_Marketplace_discoverability | AMO discoverability]]
|
| {{mok}}
| [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdGVKQlRHUnFWVEZXNFFJbHo0RVpQMmc#gid=0 QA Feature Tracking & MozTrap References] & [https://wiki.mozilla.org/Mobile/Roadmap#Firefox_26:_.28Beta.29 Product Features]
|-
| [[Mobile/Projects/Addition_of_search_engines | Addition of search engines - Yahoo and Bing for selected locales ]]
|
| {{mok}}
| [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdGVKQlRHUnFWVEZXNFFJbHo0RVpQMmc#gid=0 QA Feature Tracking & MozTrap References] & [https://wiki.mozilla.org/Mobile/Roadmap#Firefox_26:_.28Beta.29 Product Features]
|-
| [[Mobile/Projects/About:home_redesign | About:home redesign ]]
| Adrian Tamas
| {{mok}}
| [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdGVKQlRHUnFWVEZXNFFJbHo0RVpQMmc#gid=0 QA Feature Tracking & MozTrap References] & [https://wiki.mozilla.org/Mobile/Roadmap#Firefox_26:_.28Beta.29 Product Features]
|-
| [[Mobile/Projects/Settings_UI_clean_up | search provider management in settings menu ]]
| Mihai Pop
| {{mok}}
| [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdGVKQlRHUnFWVEZXNFFJbHo0RVpQMmc#gid=0 QA Feature Tracking & MozTrap References] & [https://wiki.mozilla.org/Mobile/Roadmap#Firefox_26:_.28Beta.29 Product Features]
|-
| [[Mobile/Projects/About:home_-_Add-ons_can_add_content_to_the_%22promotional_banner%22_tile | Add-ons can add content to the "promotional banner" tile]]
|
| {{mok}}
| [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdGVKQlRHUnFWVEZXNFFJbHo0RVpQMmc#gid=0 QA Feature Tracking & MozTrap References] & [https://wiki.mozilla.org/Mobile/Roadmap#Firefox_26:_.28Beta.29 Product Features]
|-
| [[Mobile/Projects/Localization | Added locale: South African English (za-EN)]]
|
| {{mrisk}}
| [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdGVKQlRHUnFWVEZXNFFJbHo0RVpQMmc#gid=0 QA Feature Tracking & MozTrap References] & [https://wiki.mozilla.org/Mobile/Roadmap#Firefox_26:_.28Beta.29 Product Features]
|-
| [[Mobile/Projects/Localization | Added locale: Thai (th)]]
|
| {{mrisk}}
| [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdGVKQlRHUnFWVEZXNFFJbHo0RVpQMmc#gid=0 QA Feature Tracking & MozTrap References] & [https://wiki.mozilla.org/Mobile/Roadmap#Firefox_26:_.28Beta.29 Product Features]
|-
| [[Mobile/Projects/WebRTC_platform_support | WebRTC platform support, continued]]
|
| {{mok}}
| [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdGVKQlRHUnFWVEZXNFFJbHo0RVpQMmc#gid=0 QA Feature Tracking & MozTrap References] & [https://wiki.mozilla.org/Mobile/Roadmap#Firefox_26:_.28Beta.29 Product Features]
|}
=== Smoketests ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Smoketests
| Softvision
| Every Beta
|}
Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on [https://moztrap.mozilla.org/manage/cases/ Mozilla Moztrap] under the [https://moztrap.mozilla.org/results/cases/?filter-run= 18.0 smoketest suite]. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
{{:QA/Fennec/26/Beta/4/smoketests-results}}
[[QA/Fennec/26/Beta/4/smoketests-results|Detailed Smoketest results]]
=== Android Permissions Testing ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Verification
| Softvision
| Every Beta
|}
{{:QA/Fennec/26/Beta/4/permissions-results}}
[[QA/Fennec/26/Beta/4/permissions-results|Detailed Android Permissions Testing Results]]
<br/>''' Verify permissions between what is currently on the store and with this beta build candidate'''.
<br/>Details: [[QA/Fennec/Permissions|Android Permissions]]
=== Branch Bug Fix Verifications ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Verification
| Softvision
| Every Beta
|}
* '''[http://mzl.la/18xrduR Firefox for Android (26) Bugs]'''
* '''[http://mzl.la/1axhqYD Firefox 26 - Verification Query URL]'''
=== L10N (Localization) Spot Checks ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Strings Verification
| SoftVision
| Every Beta
|}
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
{{:QA/Fennec/26/Beta/4/L10N-strings matrix}}
[[QA/Fennec/26/Beta/4/L10N-strings matrix|Detailed L10N matrix]]
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|'''How Often?'''
|-
| Builds Verification
| SoftVision
| Every Beta
|}
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
{{:QA/Fennec/26/Beta/4/L10N-builds matrix}}
[[QA/Fennec/26/Beta/4/L10N-builds matrix|Detailed L10N matrix]]
=== AppThwack Automation ===
{|width=100%
|-
| style="background-color: #efefef;"|'''QA Task'''
| style="background-color: #efefef;"|'''Person/Group'''
| style="background-color: #efefef;"|''How often?''
|-
| Runs against ARMv6 and ARMv7
| Ioana
| Alternating
|}
Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARM6 and ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities
{{:QA/Fennec/26/Beta/4/AppThwack Results}}
[[QA/Fennec/26/Beta/4/AppThwack Results|Detailed AppThwack Results]]
