QA/Fennec/28/0.1

From MozillaWiki
< QA‎ | Fennec‎ | 28
Jump to: navigation, search

«  Fennec 28 RC 1 | Fennec 28.0.1  »

Fennec (Firefox for Android) 28.0.1 Test Plan

Features

See the Feature Release Tracking wiki for a general overview of this release. Found below are a subset of all high-priority items

Focus on

  • bug 945429
  • bug 963621 - Regression: No video playback (MP4); Samsung Galaxy S4 (Android 4.4.2) (I420ColorConverter)
QA Task Person/Group How Often?
Check Bugs Softvision This Build

Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on Mozilla Moztrap under the 27.0 smoketest suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Assigned Device Completed Results
Teodora Vermesan LG Nexus 4 (Android 4.4.2) March 24th, 2014 all videos work fine (both reported and AaronMT's page)
Ioana Chiorean Google Nexus (Android 4.3) March 24th, 2014 all videos work fine (both reported and AaronMT's page)
Catalin Suciu Samsung Galaxy S3 (Android 4.3) March 24th, 2014 http://bit.ly/bug963 - video does not work, audio works fine, the video controls don't go off the screen
http://bit.ly/aaronmtv - video/audio work fine on all files
Catalin Suciu Samsung Galaxy Tab 2 (Android 4.2.2) March 24th, 2014 http://bit.ly/bug963 - video does not work, audio works fine, the video controls don't go off the screen
http://bit.ly/aaronmtv - video/audio work fine on all files
Catalin Suciu Samsung Galaxy Tab (Android 4.0.4) March 24th, 2014 http://bit.ly/bug963 - video does not work, audio works fine, the video controls don't go off the screen
http://bit.ly/aaronmtv - video/audio work fine on all files
Catalin Suciu Samsung Galaxy Note (Android 4.0.4) March 24th, 2014 http://bit.ly/bug963 - video does not work, audio works fine, the video controls don't go off the screen
http://bit.ly/aaronmtv - video/audio work fine on all files
Catalin Suciu Motorola RAZR XT 910 (Android 4.0) March 24th, 2014 http://bit.ly/bug963 - video does not work, audio works fine, the video controls don't go off the screen
http://bit.ly/aaronmtv - video/audio work fine on all files
Ioana Chiorean LG Slider (Android 2.3.4) March 24th, 2014 Only 1st video works from Aaron's page
Flaviu Cos Samsung Galaxy S 4 (Android 4.4.2) March 24th, 2014 Video and audio from http://goo.gl/wLwDAa works fine
Teodora Vermesan ZTE x86 (Android 4.0.4) March 24th, 2014 http://bit.ly/bug963 - video does not work, audio works fine, the video controls don't go off the screen
Ioana Chiorean Asus Transformers TF300T (Android 4.1.1) March 24th, 2014 all videos work fine (both reported and AaronMT's page)

Detailed bug verification results

Smoketests

QA Task Person/Group How Often?
Smoketests Softvision Every Beta

Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on Mozilla Moztrap under the 27.0 smoketest suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Assigned Device Completed Results
Teodora Vermesan ZTE x86 (Android 4.0) March 24th, 2014 PASS
Teodora Vermesan LG Nexus 4 (Android 4.4.2) March 24th, 2014 PASS
Catalin Suciu Samsung Galaxy Tab 2 (Android 4.2.2) March 24th, 2014 PASS
Ioana Chiorean Asus Transformer (Android 4.1.1) March 24th, 2014 PASS
Ioana Chiorean Google Nexus (Android 4.3) March 24th, 2014 PASS
Ioana Chiorean LG Slider (Android 2.3.4) March 24th, 2014 PASS exploratory only

Detailed Smoketest results

Android Permissions Testing

QA Task Person/Group How Often?
Verification Softvision Every Beta
Assigned Device Completed Results
Teodora Vermesan ZTE x86 (Android 4.0) March 24th, 2014 PASS
Ioana Chiorean LG Slider (Android 2.3.4) March 24th, 2014 PASS
Ioana Chiorean Galaxy Nexus (Android 4.3) March 24th, 2014 PASS
Ioana Chiorean Asus Transformers TF300T (Android 4.1.1) March 24th, 2014 PASS

Detailed Android Permissions Testing Results
Verify permissions between what is currently on the store and with this beta build candidate.
Details: Android Permissions

Branch Bug Fix Verifications

QA Task Person/Group How Often?
Verification Softvision Every Beta

AppThwack Automation

QA Task Person/Group How often?
Runs against ARMv6 and ARMv7 Ioana Alternating

Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARM6 and ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities

Assigned Build Completed Results
Ioana Chiorean fennec-28.0.1.multi.android-arm-armv6.apk March24th, 2014 not run
Ioana Chiorean fennec-28.0.1.multi.android-arm-i386.apk March 24th, 2014 not run
Ioana Chiorean fennec-28.0.1.multi.android-arm.apk March 24th, 2014 not run

Detailed AppThwack Results