Firefox OS/Performance/Automation/FPS

FPS Measurement and CI Roadmap

• Goal: Daily high-speed camera measurement of FPS in critical areas all actively developed branches with comparisons against "waterline" numbers, with notifications of improvements and regressions.
  • Method: Eideticker - high speed camera measurement
  • Frequency: Daily
  • Targets
    • Nightly builds of all branches that have active development
    • Various app screens and continuous actions in or between screens
    • Production/reference devices
  • Comparisons: Must be able to set "waterlines" to compare results against. Examples are: previous release, chipset vendor reference numbers, target numbers from Mozilla UX performance guidelines.

Teams

• FxOS Perf Team
• Automation Team
• Release Engineering (?)

TBD

• Enumerate all test scenarios and workloads (eg, Homescreen, scrolling Gallery, scrolling/panning web content, etc) which need to be measured
• Which device(s) to measure
• Need other teams to correct & update the roadmap items below

Roadmap