Labs/Ubiquity/Usability/Statistical

Proposals for statistical data gathering.

Goal:

• Understand feature usage, errors, and stickiness
• Triage context menu versus command line priority
• Combined with the streaming UI this allows us to quickly and cheaply test changes on large samples of users as pioneered most powerfully by Netflix but embraced by every major web company.

Usage

•  % of commands completed/fail
• What users type that are not commands/false syntax
  • and what user errors occur
• Where commands fail
• Contextual menu vs. Hotkey usage
  • breadth/depth of command usage (total daily distinct commands vs total daily commands)
  • by invocation method

Authoring & Subscription

A cheaper way to get at a subset of this data -- but the Herd data is offline!

• # of commands authored that operate on selections vs page/other
• # of subscriptions to commands that operate on selection vs page/other