Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that Firefox for Android lets you install Mozilla-signed add-ons and blocks non-signed add-ons

Ownership

Developer contact: Margaret Leibovic (:margaret)

QA: Mihai Pop (:MihaiP)

Overall Status

[LANDED] Nightly 47: first landed on - 2016-02-10

[LANDED] Aurora: first landed on - 2016-02-18

[NOT LANDED] Beta: not landed yet -

Testing Summary

Scope of testing

The testing will be focus on

• Support the 'add-on signing' requirement that has been added to the AMO Review steps
• Only signed add-ons can be installed (and therefore enabled) on Firefox
• Provide a seamless (no discernible difference) experience to users who have an existing unsigned add-on pre-45 when the add-on is updated as a signed version when 45 is released
• Notify users that an existing, previously un-signed add-on is on their device and is now disabled because the add-on wasn't signed for 45

Environments

Testing will be performed on following devices:

• Phones
  • 4.4 +
  • 5.x
  • 6.0
• Tablet
  • 4.4 +
  • 5.x
  • 6.0

Specifications

• Try to install a signed add-on
• Verify that non-signed add-ons are blocked
• Notify user that an existing, previously un-signed add-on is disabled after updating to Firefox 46

User stories

• As a mobile Firefox user I'm only able to install Mozilla-signed add-ons to Firefox.

Additional Info

• Add-ons will be signed by Mozilla in order to further protect our users from only being able to install Mozilla-signed add-ons to Firefox, whether this is desktop or mobile.
• Actual support for signed add-ons is already ready, but is currently switched off. Turning it on is a configuration change which needs to be tracked in order to coordinate with this feature's release.
• Differentiatior: we are the only browser on Android with Add-ons

Testing details

Test Cases

• https://moztrap.mozilla.org/manage/cases/?filter-suite=389

Bug Work

Tracking bugs

• bugs to track the feature

ex:

2 Total; 0 Open (0%); 2 Resolved (100%); 0 Verified (0%);

Issues

[NEW] Bug 1249328 - Un-signed add-ons are not disabled after updating Firefox
[NEW] Bug 1194125 - Show warning in add-on manager list for add-ons that aren't properly signed
[NEW] Bug 1172642 - Make sure distribution add-ons work when add-on signing is required by default
[NEW] Bug 1168577 - Create a new hotfix signing certificate for Android that chains to the AMO root.

Signoff

Criteria

• All test cases should be executed
• All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

Aurora testing

Beta testing