TestEngineering/UI/AMO/Testday/12152010
Hello there, and welcome to the AMO test day! Thanks for volunteering your time and energy to help us improve addons.mozilla.org! Below, you'll find the setup information and some use-cases to help guide you in your testing; feel free, though, to go off on your own and just ad-hoc test!
Staging server: https://addons-next.allizom.org/en-US/firefox/
What are we testing?
update.php is what Firefox asks to see if there are add-on updates available. We have migrated it to python and need to ensure that there are no regressions.
Settings
To test the updates on the staging server we need to tweak the settings.
Settings for Firefox:
To test update on the staging server, change the following setting in your about:config
Settings for Thunderbird:
To test update on the staging server, change the following setting in your about:config
extension.update.url to
https://addons.allizom.org/z/update?reqVersion=%REQ_VERSION%&id=%ITEM_ID%&version=%ITEM_VERSION%&maxAppVersion=%ITEM_MAXAPPVERSION%&status=%ITEM_STATUS%&appID=%APP_ID%&appVersion=%APP_VERSION%&appOS=%APP_OS%&appABI=%APP_ABI%
Settings for Seamonkey:
To test update on the staging server, change the following setting in your about:config
extension.update.url to
https://addons.allizom.org/z/update?reqVersion=%REQ_VERSION%&id=%ITEM_ID%&version=%ITEM_VERSION%&maxAppVersion=%ITEM_MAXAPPVERSION%&status=%ITEM_STATUS%&appID=%APP_ID%&appVersion=%APP_VERSION%&appOS=%APP_OS%&appABI=%APP_ABI%&locale=%APP_LOCALE%¤tAppVersion=%CURRENT_APP_VERSION%
Usecase Scenarios:
- testcase 1: Update add-on versions
- Check that clicking on “Find updates”, lists the latest supported versions for your installed add-ons
- Ensure that the update is successful
- testcase 2: Update Firefox versions (with add-on updates)
- Install an older version of Firefox
- Install older versions of add-ons which are not supported on the version you are updating to.(pick one extension, theme,dictionary and a language pack
- Upgrade Firefox to a newer version
- Check that when Firefox starts, it prompts you to upgrade all your incompatible add-ons
- Ensure that the update is successful
- testcase 3:Update Firefox versions (with no add-on updates)
- Install an older version of Firefox
- Install the latest versions of add-ons(pick one extension, theme,dictionary and a language pack
- Upgrade Firefox to a newer version
- Check that when Firefox starts, there are no fake prompts for updates
- testcase 4:Update prompt while opening a Firefox profile
- Create a profile which has a few older versions of add-ons installed.
- Quit Firefox
- Start the firefox profile
- Check that there are updates for incompatible add-on versions
- testcase 5: Update prompt for beta add-ons
- Select an add-on which has multiple beta versions(say b1-b4)
- Install an older version of a beta add-on(b1
- Click on “Find Updates”
- Check that b4 versions is listed as an update
- Update is successful
- testcase 6:Update prompt for:
+ extensions(.xpi)
+ themes(.xpi and.jar)
+ Dictionaries and Language packs
- testcase 6: Check that updates are only offered when the newer versions of the add-on are public
- Pick an add-on with an unreviewed latest version.
- Install the previous version of that add-on
- Click on “Find Updates” in the add-ons manager
- Check that there are no updates
- testcase 7: Check that there are no updates for unreviewed add-ons
- Pick an add-on with multiple unreviewed versions
- Install an older version
- Click on “Find Updates”
- No updates
- testcase 8: Check that no updates are offered if the newer version is incompatible with user's browser version/platform
- Pick an add-on with an incompatible latest version
- Install an older version and restart
- Click on “Find Updates”
- No updates are offered
- testcase 9: Check for platform compatibility
- Pick an add-on which has version (b-n) compatible with the test platform and version b not supported on your platform/OS
- Install version (b-n) and restart
- Click on “Find Updates”
- No updates are offered
