Features/Desktop/Add-on hotfix/Test Plan

From MozillaWiki
Jump to: navigation, search

Add-on hotfix

Release Target Status Lead Engineer QA Lead Status Health
Firefox 10 Complete Christian Legnitto VladG Landed OK

Summary

Firefox will have a hardcoded add-on id. When checking for add-on updates (every 24 hours), it will always check for a specific add-on id and install it if an update is found.

Use Cases to Test

  • We ship a new feature (like http:// hiding) and the user response is extremely negative. We issue an update to the add-on that flips a pref back to old behavior
  • We need to distrust a CA. We ship an update to the add-on that makes Firefox distrust it and users are silently updated within 24 hours
  • We have a problem with add-ons that require a rebuild of add-on metadata. We issue an empty add-on
  • We have an issue that only affects Italian builds. Rather than issue a new Firefox update to everyone, we ship an update to the add-on which only acts when the locale is set to Italian
  • We want to blocklist a widely used plugin. We turn on crude click-to-play and whitelist it for known good websites
  • We know that Netflix/Hulu/etc does bad user sniffing for a particular Firefox version. We issue an update that drops down a infobar telling users what is happening and to contact the site, or we ship the add-on that changes the user agent on the site while they work on a fix
  • We want to speak directly to our users with a one-time marketing message / news flash. We ship an update to the add-on that pops up an infobar with the message and then never shows again
  • We want to A/B test a UI pref on beta. We ship the add-on to x% of our population or ship it to all Beta users and have the add-on enable functionality x% of the time

New Bugs

Bug ID Summary Reporter Status
bug 727398 Mozilla Firefox Hotfix is listed in Add-ons Manager even though it shouldn't VladG NEW

Test Case 1 - installing the add-on

Steps to reproduce

  • Start Firefox with a new profile
  • In about:config set the following prefs:
    • set extensions.hotfix.id to test-hotfix@mozilla.org
    • set extensions.update.interval to 10
  • Restart Firefox

Expected Results

  • After restart, navigate randomly over 10 seconds
  • Open Add-ons Manager and Firefox Hotfix Test 1 should be installed
Firefox 10 Beta 4
  • [DONE] MacOS X 10.6.7 - PASS - 2012-01-13
  • [DONE] Windows 7 x86 - PASS - 2012-01-13
  • [DONE] Ubuntu 11.10 x64 - PASS - 2012-01-13
  • [DONE] Windows XP - PASS - 2012-01-13

Test Case 2

Steps to reproduce

  • Start Firefox with a new profile
  • In about:config set the following prefs:
    • set extensions.hotfix.id to test-hotfix-"extension's ID"@mozilla.org
    • set extensions.update.interval to 10
  • Restart Firefox

Expected Results

  • After restart, navigate randomly over 10 seconds
  • None of the add-on should be installed
Firefox 10 Beta 4
  • [DONE] MacOS X 10.6.7 - PASS - 2012-01-16
  • [DONE] Windows 7 x86 - PASS - 2012-01-16
  • [DONE] Ubuntu 11.10 x64 - PASS - 2012-01-16
  • [DONE] Windows XP - PASS - 2012-01-16

Test Case 3 - removing and reinstalling the add-on

Steps to reproduce 1

  • Start Firefox with a new profile
  • In about:config set the following prefs:
    • set extensions.hotfix.id to test-hotfix@mozilla.org
    • set extensions.update.interval to 10
  • Restart Firefox
  • After Firefox Hotfix Test 1 is installed, remove it from the Add-ons Manager. Do not restart the browser yet.

Expected Results

  • The Add-on should get removed with the "undo" function active.
    • Pressing the "undo" should keep the add-on installed.
  • After Firefox restarts, the add-on should be deleted.

Steps to reproduce 2

  • Start Firefox with a new profile
  • In about:config set the following prefs:
    • set extensions.hotfix.id to test-hotfix@mozilla.org
    • set extensions.update.interval to 10
  • Restart Firefox
  • After Firefox Hotfix Test 1 is installed, remove it from the Add-ons Manager and restart Firefox.
  • In about:config, reset the pref extensions.hotfix.lastVersion
  • Restart Firefox

Expected Results

  • After restart, navigate randomly over 10 seconds
  • Open Add-ons Manager and Firefox Hotfix Test 1 should be installed

Steps to reproduce 3

  • Start Firefox 10b5 with a new profile.
  • Manually add to Firefox the Hotfix Test Add-on 1
  • Set the folowing prefs in about:config:
    • set extensions.update.interval to 10
    • in extensions.update.url replace versioncheck.addons.mozilla.org from the string with addons-dev.allizom.org
  • Restart Firefox and wait for about 90 sec

Expected Results

  • After ~90 sec the test add-on should be removed.

Firefox 10b5:

  • [DONE] MacOS X 10.6.7 - PASS - 2012-01-20
  • [DONE] Windows 7 x86 - PASS - 2012-01-20
  • [DONE] Ubuntu 11.10 x64 - PASS - 2012-01-20
  • [DONE] Windows XP - PASS - 2012-01-20

Test Case 4 - removing Hotfix1 test add-on

Steps to reproduce

  • Install the Hotfix v1 in Firefox 10 beta
  • Change the update channel to "releasetest" and perform an update to Firefox 11 beta
  • In about:config set the following prefs:
    • set extensions.update.interval to 10
    • in extensions.update.url replace versioncheck.addons.mozilla.org from the string with addons-dev.allizom.org
  • Restart and browse for several minutes

Expected results

After browsing for several minutes, the Hotfix v1 add-on that was previously installed should be automatically deleted.

Firefox 11b2:

  • [DONE] MacOS X 10.6.7 - PASS - 2012-02-13
  • [DONE] Windows 7 x86 - PASS - 2012-02-13
  • [DONE] Ubuntu 11.10 x32 - PASS - 2012-02-13
  • [DONE] Windows XP - PASS - 2012-02-13