Unified Telemetry/Status reports/Android/April 27 2016
From MozillaWiki
Contents
UT for Android status report April 27, 2016, 2015
Overall Project Health
Last week: Green
This week: Green
Project summary
- Q2 - Using UT in firefox android to make business decisions, including populating KPI dashboard.
Exec Summary
- Fennec-dashboard (firefox for android) backfill and validation should happen after initial 46 validation
- ongoing work on core pings (see timeline here)
- main ping content review kicked off
- Validation work on release once 46 is live
Accomplished for Last Period
- Distribution field Uplifted to 46
- Docs missing
- Testing? Pending mkaply
- Robustness discussion on reuploader
- core ping work
- main ping content review work
Planned for Next Period
Validation:
- Waiting to see data for fixes as it comes back in
- Planning to engage Mobile QA with an eye to network packet sniffing as validation effort.
- ongoing sprint based work
Risks and items to retire
Dashboards and consumers:
- Dashboard form core pings (need min requirements)
- PM input
- Significance of abnormal session and search counts for first rev.
Validation:
- automated tests
- manual QA
- mobile team has in-house and SoftVision QA
- scope of v0 ping version is not be appropriate for heavy test effort
- manual QA will happen from v3 on
- Android Nightly has small population, so:
- Sanity-check on Nightly
- use Beta for validation
- update latency to beta ~2 weeks to 90% of population
- server-side analysis
- quality checks for ordering of pings, etc. and verifying the data looks sane
- sanity checks at volume (look for large gaps etc)
- validate against adjust data?
- we should get to an ongoing "health of data" report from there
- QA & analysis work needs to be defined and scoped/packed
- schema validation
- pipeline-side schema validation support is on the way
- pipeline team may be interested to start this with the "core" ping
