Firefox/Projects/Doorhanger notifications/Test Plan

From MozillaWiki
Jump to: navigation, search

Doorhanger Notifications

  • Development Status: - In progress (6/24/2010)
  • Feature Testing: - In progress (6/28/2010)
  • Team: gavin (dev), faaborg (ux), ashughes (qa)
  • Tracking Bugs: bug 398776

Feature Description

Provide a unified action and notification area.

Feature Release Readiness Assessment

The table below provides a top level go/no go assessment of whether the feature is release ready for the given milestone.

Milestone Assessment
#Beta1 Partial: Only Geolocation landed (testing)
#Beta2 N/A
#Beta3 N/A

top

Feature Documentation

Item Description Status
#Project_Wiki Wiki Links to all feature related entries wiki
#Developer_Links (blogs) Developer links to feature related sites [DONE]
#Other_Docs Web links to feature related sites [DONE]
#Developer_QA_Review Details from developer and qa discussions regarding feature test strategies and issues. [DONE]

top

Feature Bug Management

Item Description Status
#Bug_Tracking Top level bugs tracking feature bug 398776
#Bug_Verification Feature bugs that need verification pending-feedback
#Bug_Triage Links triage bug tasks pending-feedback

top

Feature Test Items

The table below provides a breakdown of all feature items that should be covered and how they will be tested. Not all items will be covered by internal QA team members.

Test Item Description Covered By Status
#Actions UI and function of actions Developer Tests, QA Tests, Beta tester exposure investigating
#Notifications UI and function of notifications Developer Tests, QA Tests, Beta tester exposure investigating
#Localization Feature localization QA tests, Beta tester exposure investigating
#Accessibility Feature accessibility Unknown at this time pending-feedback
#Plugins Plugins compatibility N/A N/A
#Addons Addons compatibility N/A N/A
#Topsites Top internet sites compatibilities N/A N/A

top

Feature Tests

Automated Tests

Item Description Status
#Developer_Tests Links to automated developer tests [DONE]
#Mozmill_Tests Links to automated mozmill feature test cases 1 test exists

Manual Tests

Item Description Status
#Smoke_Tests link to smoke tests [ON TRACK]
#Regression_Tests link to BFT and/or regression tests [ON TRACK]
#Functional_Tests link to FFT and/or complete functional tests [ON TRACK]

top

Community Test Events

Item Description Status
#Testdays Links to test day event results for feature nothing planned
#Bugdays Links to bug day event results for feature nothing planned
#Meetups Links to Meetup events for feature nothing planned

top

Feature Documentation Details

Project Wiki

top

Developer Links

top

Other Docs

top

Developer QA Review

  • Do we have automated tests for the feature?
    • Yes
  • What do they cover?
    • browser-chrome
    • basic functionality of JS-module
    • geolocation
  • What do they not cover?
    • interaction between different notifications
      • doorhanger and bar at the same time
      • multiple doorhangers
  • How well do they cover the feature?
    • core functionality nearly completely covered
  • What are the important areas we should focus on?
    • Preferences for "allow"
  • What are the dependencies?
    • [NEW] bug 572967 - Allow notifications to be reactivated via icon
    • [NEW] bug 565187 - Geolocation notification icons
    • [FIXED] bug 573187 - Test pilot downloads multiple copies of same JAR
    • [NEW] bug 572972 - Show Geolocation icon, Permissions prefs
  • What is our comfort level with this feature in its current state?
    • Once dependencies fixed, ship
  • What feedback would you like from QA?
    • Investigate UX/UI issues

top

Feature Release Readiness Assessment Details

Beta1

  • Targetting Beta1
  • Geolocation patch landed
  • Development feels this will be B1 ready

Beta2

Beta3

Feature Bug Management Details

Bug Tracking

Query Description
bug 398776 Top-level tracking bug
Dependencies Bugs blocking the release of this feature
Incoming Unconfirmed bugs pending triage
Resolved Resolved bugs pending verification

top

Bug Verification

  • Dependencies
    • [FIXED] bug 509642 - Menu-button styling improvements
    • [NEW] bug 572967 - Notifications reactivation via icon
    • [FIXED] bug 565187 - Geolocation notification icons
    • [FIXED] bug 573187 - Test pilot downloads same JAR
    • [NEW] bug 572972 - Show Geolocation icon, Permissions prefs
  • Resolved Fixed to Verify

top

Bug Triage

top

Feature Test Items Details

Actions

  • Details of action test requirements

top

Notifications

  • Details of notification test requirements

top

Localization

  • Styling rules similar to Larry
  • API similar to NotificationBox
  • Long message wrapping (no max-width)

top

Accessibility

  • Development needs to sync with Accessibility once bug 572967 lands

top

Plugins

  • Not relevant to this feature

top

Addons

  • Entirely additive (very little risk)
  • Adds another notification method to Firefox, does not alter existing methods

top

Topsites

  • Not relevant to this feature

top

Feature Tests Details

Automated Tests Details

Developer Tests

top

Mozmill Tests

If a particular feature needs manual tests which should also be covered by Mozmill tests please add the "[mozmill-test-needed]" whiteboard entry to the feature implementation or regression bug.

Pre-existing Tests

Function Tests Status
Geolocation Verify geolocation token is cleared when exiting private browsing No revisions necessary

top

Manual Tests Details

Smoke_Tests

Pre-existing Tests

Function Tests Status

New Tests

Function Tests Status
Geolocation Share location Added 06/29/2010

top

Regression_Tests

Pre-existing Tests

Function Tests Status

New Tests

Function Tests Status
Geolocation Geolocation popup notification Added 06/29/2010
Always Allow Sharing Location Added 06/30/2010
Never Share Location Added 06/30/2010

top

Functional_Tests

Pre-existing Tests

Function Tests Status
Geolocation Verify Share Location "Block" pref in Page Info revised
Verify geolocation token is cleared after allowing permissions via Page Info revised
Verify geolocation token is cleared when exiting private browsing revised


top

Community Test Events Details

Testdays

  • Links to test day event results for feature

Bugdays

  • Links to bug day event results for feature

Meetups

  • Links to Meetup events for feature