QA/Fennec/Media devices off while disabled

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that when a video device is turned off then all media connections are disabled.

Ownership

Developer contact: [pehrsons]

QA: [sorina] [oanah]

Overall Status

[LANDED] Nightly 60:

[LANDED] Beta 60:

Testing Summary

Scope of testing

The testing will be focus on

  • Camera - hardware
  • Memory usage
  • Web compatibility
  • UI
  • Microphone

Environments

Testing will be performed on following devices:

  • Phones
    • 5.1 -> 8.1.0
  • Tablet
    • 5.1.1, 7.0

Specifications

User stories

  • As a user, I want the device hardware light to properly reflect the on/off state
  • As a user, I want that this feature will not have an impact on the memory usage
  • As a user, I want that turning on the microphone won't enable the camera light

Acceptance Criteria

Testing details

Test Cases

Testing days

Date:2018-03-29

  • Created Test plan and Test Cases
  • Run TC suite on 60.0b7 with Google Pixel(Android 8.1.0) and Samsung Galaxy S8(Android 7.0)
  • New bug:

Date:2018-03-29

  • Run TC suite on 60.0b7 with HTC Desire 820 (Android 6.0.1) & Prestigio Grace X5 (Android 4.4.2)

Bug Work

  • Meta bug
    • bug 1299515 - Turn off camera/microphone while all tracks are muted/disabled.
Full Query
ID Priority Summary Status Resolution
1208378 P2 Implement MediaStreamTrack.muted/onmute/onunmute RESOLVED FIXED
1280099 P2 Intermittent test_peerConnection_trackDisabling.html | Test timed out. RESOLVED FIXED
1351655 P3 Intermittent command timed out: 7200 seconds elapsed running ['/tools/buildbot/bin/python', '-u', 'scripts/scripts/desktop_unittest.py', '--mochitest-suite', 'mochitest-media', after many WARNING: MsgDropped in ContentChild RESOLVED FIXED
1433878 P2 Set js-exposed camera resolution setting to scaled resolution, not native resolution RESOLVED WONTFIX
1434628 P2 Tier-2 windows-mingw32-32 debug build bustage RESOLVED FIXED
1434946 P2 MediaEngineRemoteVideoSource getSettings no longer reports constrained framerate RESOLVED FIXED
1434983 P5 Intermittent dom/media/tests/mochitest/test_peerConnection_basicScreenshare.html | Error in test execution: Error: Timeout checking for stats for track {d052d795-95ae-084a-871c-e234ceec9b38} after at least30000ms waitForRtpFlow@ RESOLVED FIXED
1435619 -- Crash in RtlEnterCriticalSection | mozilla::SourceMediaStream::EndTrack RESOLVED DUPLICATE
1435673 P1 Crash in libsystem_pthread.dylib@0x1530 VERIFIED FIXED
1435926 P2 NotReadableError regressed to crash in [@ pthread_mutex_lock | mozilla::detail::MutexImpl::lock | mozilla::SourceMediaStream::EndTrack ] RESOLVED DUPLICATE
1436074 P2 Reduce timer for turning off camera on disable by time camera has already been on VERIFIED FIXED
1436341 P2 On Windows the camera light is not turned off after you disabled the camera. VERIFIED FIXED
1436694 P2 SourceListener in bad state after initial Start() fails RESOLVED FIXED
1438134 P2 Failed applyConstraints may still change resolution RESOLVED FIXED
1440169 P2 Intermittent TEST-UNEXPECTED-TIMEOUT | dom/media/tests/mochitest/test_peerConnection_verifyAudioAfterRenegotiation.html | application timed out after 370 seconds with no output RESOLVED FIXED
1440252 P2 getUserMedia processing test page does not function accordingly VERIFIED FIXED
1440255 P1 Crash @ java.lang.RuntimeException: Camera thread already started! at org.webrtc.videoengine.VideoCaptureAndroid.startCapture(VideoCaptureAndroid.java) - Tokbox crashes on Nightly RESOLVED FIXED
1443157 P1 gUM capture doesn't display capture indicators in notification tray on Android VERIFIED FIXED
1443774 P2 Intermittent TEST-UNEXPECTED-TIMEOUT | dom/media/tests/mochitest/test_peerConnection_verifyAudioAfterRenegotiation.html | application timed out after 370 seconds with no output RESOLVED WONTFIX
1451798 P1 Video facingMode regression VERIFIED FIXED
1452048 P1 Camera thread hang when trying to reconfig android camera capture VERIFIED FIXED
1452472 P1 Crash in InvalidArrayIndex_CRASH | nsTArray_Impl<T>::operator[] | mozilla::MediaEngineWebRTCMicrophoneSource::Stop RESOLVED FIXED
1463581 P2 Stopping a live gUM track doesn't update the aggregated track.enabled state across track clones VERIFIED FIXED

23 Total; 0 Open (0%); 15 Resolved (65.22%); 8 Verified (34.78%);


Signoff

Criteria

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

  • in progress

Beta testing

  • in progress