Mobile/Testing/11 12 14

From MozillaWiki
Jump to: navigation, search

Previous Action Items

  • wlach will experiment with running (fewer) eideticker tests against mozilla-inbound, maybe with 1 more device
  • mcote will look into getting a resource to look after emulator issues
  • mcote will check in with dminor about possible irregularities in weekly failure rates
    • dminor was indeed getting the stats at various points; agreed to peg them to 12:00 am Wednesday to ensure that they match week by week.

Status reports

Dev team

Rel Eng

  • jlund: split APK builds are available on cedar bug 1073772. Next step after he returns from a conference this week is to enable nightlies bug 1073772
  • kmoir: changes for single locale builds on m-b and m-r for android have landed, working to fix to some issues where bouncer and balrog is not updated correctly bug 1019724

Relops

A Team

  • android2.3 Total failure rate: [2.85%]
    • last week 2.2%
    • total failure excluding retries 1.29%
  • android4.0 Total failure rate: [20.51%]
    • last week 18.18%
    • total failure excluding retries 0.86%

Data fetched for: 2014-11-05 03:53 — 2014-11-11 23:32

Autophone

  • Downtime last week was due to a failed usb hub.
    • The bad hub has been replaced and an additional hub has been added to power the cooling pads.
    • System has been stable since hub additions.
    • nexus-5-kot49h-1's battery died and it can no longer boot.
      • A replacement battery has been ordered and hopefully the non user replaceable battery can be replaced. Backup Nexus 5 devices are in SF. Missing mozilla-inbound testing on Nexus 5.
  • Deferred bug 1078645 - Autophone - support/document use of emulators instead of physical devices.
    • Continued to find edge case failures handling orphaned emulators on OS X during testing. Sorry I spent so much time on this, but it always seemed like it was very close to completion and I was reluctant to give up.
  • Working on bug 1079923 - Autophone - update unittests to fix bitrot.
    • Have logcat submission to S3 and linking of logcat from Treeherder for all tests working.
    • Have Unittests running, will be ready to test submitting logs to S3/Treeherder today.
    • Outstanding issue is how closely I need to mimick the production logs to get benefit of Treeherder parsing.
  • bug 1068759 - Add video tests
    • Waiting on bug 1079923
    • Will need to enable and configure wifi on devices in QA Lab.

Eideticker

Round Table

Action Items

  • mcote will look into getting a resource to look after emulator issues
  • mcote will check in with dminor about possible irregularities in weekly failure rates
    • dminor was indeed getting the stats at various points; agreed to peg them to 12:00 am Wednesday to ensure that they match week by week.