Mobile/Testing/04 08 15

From MozillaWiki
Jump to: navigation, search

Previous Action Items

Status reports

Dev team

Rel Eng

  • Patches approved for Android 4.3 in bug 1133833 will land changes to enable this once I land the changes in bug 1131269 use SETA data to disable unneeded tests

Relops

A Team

  • android-2-3-armv7-api9 Total failure rate: [0.81%]
    • last week 0.6%
    • total failure excluding retries 0.76%
  • android-4-0-armv7-api11 Total failure rate: [11.71%]
    • last week 14.29%
    • total failure excluding retries 0.17%

Data fetched for: 2015-04-01 10:05 — 2015-04-07 20:21

Autophone

  • Resolved
    • bug 795416 - Autophone - properly handle non-fatal exceptions raised by tests.
    • bug 807207 - Failing to install fennec should not result in DISCONNECTED state
    • bug 829315 - Implement test-specific jobs
    • bug 1078643 - Autophone - trigger_runs.py by revision not working
    • bug 1088930 - Autophone - trigger_runs fails if buildurl does not end in forward slash
    • bug 1148423 - Autophone - Unit tests are failing due to rooting issues with devicemanagerSUT
    • bug 1138942 Add Autophone specific video test manifest
  • In progress
    • bug 1065599 - Autophone - audit/update Fennec preferences
      • Need feedback
    • bug 1151439 - Autophone - enable Mochitest Media, Reftest ogg and webm video tests
      • Need feedback
    • bug 1118751 - Autophone - PROFILE-ERROR | No crash directory (/data/local/tmp/profile/minidumps) found on remote device
      • Determined bug is real and will work on providing information to get it resolved.
    • bug 1151882 - Autophone - re-enable remote tests
    • bug 1151442 - Autophone - use devicemanagerADB for the unit tests.
    • bug 1150111 - Add nytimes to page load tests
    • bug 1152392 - Autophone - webappstartup should detect and use the proper profile
  • Future
    • bug 1129534 - Autophone - Replace autophone.qa.mtv2.mozilla.com
      • Started discussion with Van Le on next steps, met with jgriffin, mcote concerning plans. Hope to have completed in approximately ~1 month if the tides are right.

Eideticker

Round Table

  • [bc] One of the sources of random behavior in Autophone performance measurements is the lack of a clear logcat message which to use as the initial time when Gecko is requested to start. Is there anything we can do to introduce a standard logcat message that can be used?

Action Items