Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that the Speak the Article (TTS in Reader Mode) feature works as expected.

Scope

The testing will be focus on

• testing Narration on several pages in Reader Mode

• testing that the "media.webspeech.synth.enabled" pref is set to true by default on Nightly 48 and false on Aurora 47.

Testing will be performed manually, by QA Release team.

Ownership

Developer contacts: Eitan Isaacson
QA: Camelia Badau

Testing Summary

Scope of testing

In Scope

The main testing scope is to assure that the Speak the Article (TTS in Reader Mode) works correct.

Requirements for testing

Environments

Testing will be performed on following OSes (both x86 & x64 infrastructures):

• Mac OS X
• Windows 7
• Windows 10
• Ubuntu 13.10
• Ubuntu 16.04

Testing on specific devices is not needed.

References

• https://blog.monotonous.org/2016/03/07/narrate-a-new-feature-in-firefox-nightly/
• https://blog.monotonous.org/2016/03/17/benchmarking-speech-rate/

Test Strategy

Test Objectives

Following table contains main features to be tested:

Ref	Function	Test Objective	Evaluation Criteria
1	basic scenarios	TBD

Test Types

Type of Testing	Required (Yes/No)	Owners	Details/Comments
Manual	Yes	Moz QA Rel team
Automation	No
Performance	No
Security	No
Usability	No
Metrics/Telemetry	TBD

Builds

This section should contain links for builds with the feature

Nightly builds can be found at link

Aurora builds can be found at link

Test Execution Schedule

The following table identifies the anticipated testing period available for test execution.

Project phase	Start Date	End Date
Start project
Study documentation/specs received from developers		-
QA - Test plan creation
QA - Test cases/Env preparation
QA - Nightly Testing
QA - Aurora Testing
QA - Beta Testing
Release Date

Testing Tools

Detail the tools to be used for testing, for example see the following table:

Process	Tool
Test plan creation	Mozilla wiki
Test case creation	Google docs
Test case execution	Google docs
Bugs management	Bugzilla

Status

Overview

[LANDED] Nightly 48.0a1: first landed on - 2016-03-08

Risk analysis

- No Risks found at the moment

References

Meta: Bug 1166365

Test cases

Overview

• Tested that speech synthesis correctly works on several pages in Reader Mode
• Verified the "media.webspeech.synth.enabled" pref

Test suites

Full Test Suite - can be reached here

Bugs Work

Tracking bug: Meta bug 1166365 - Speak the article (speech synthesis in reader mode)

Sign off

Criteria

• All test cases should be executed
• All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)

Results

Pre-Aurora Sign-off (2016-06-13)

• • Manual testing covered Windows 7 x64, Windows 10 x64, Ubuntu 13.10 x32 and Mac OS X 10.9.5.
  • There were 1 known major issue: bug 1270110
  • Conditional Sign-Off

Mid-Aurora Sign-off (2016-07-07)

• • Manual testing covered Windows 7 x64, Windows 10 x64, Ubuntu 13.10 x86, Ubuntu 14.04 x86 and Mac OS X 10.9.5.
  • There were 1 known major issue: bug 1270110
  • 1 new logged issue: bug 1285226
  • Conditional Sign-Off

Pre-Beta Sign-off (2016-07-29)

• • Manual testing covered Windows 7 x64, Windows 10 x32, Ubuntu 13.10 x86, Ubuntu 14.04 x86 and Mac OS X 10.11.
  • There were 1 known major issue: bug 1270110 - it is fixed on Nightly 50, but needs uplift
  • 1 new logged issue: bug 1290442
  • Conditional Sign-Off

Checklist

• TBD