Firefox OS/DeviceQA/2.1PostCC

Release flow

Major tasks of device QA team

• Smoke test & Manual effort
  • Description
    • After v2.1 CC, device QA team needs to execute manual smoke test daily and tests which need manual effort.
  • Contact:
    • Device QA team: Mike Lien
    • OS QA team: Peter Bylenga or Oliver Nelson
    • Executor: Outsourcing

• Automation tests
  • Description
    • Device QA team needs to the full automated test suite (GU) in the Taipei MTBF Lab.(TBC).
  • Contact:
    • Device QA team: Mike Lien or William Hsu
    • OS QA team: Zac Campbell or Dave Hunt
    • Executor: William Hsu (Test environment management) and Cynthia (Daily report)

• Bug triage for each branch (2.1, 2.1M, 2.1Q, and 2.1S)
  • Description:
    • Managing incoming bugs - move bugs to the proper component, ask follow-up questions, confirm unconfirmed bugs, close invalid and duplicate bugs.
  • Contact:
    • Device QA team: Brian Huang
    • OS QA team: Tony Chung
    • Executor: Stakeholders (Managers, developers, and QAs)

• QAwanted for each branch (2.1+patches)
  • Description:
    • Device QA team helps with steps to reproduce on 2.1+ bugs which flagged as 'qawanted', and finding regression windows. During the transition period, OS QA team will scale down while the device QA team scales up. We expect the transition to be over by mid-December 2014.
  • Contact:
    • Device QA team: Mike Lien
    • OS QA team: Joshua Mitchell (QAnalysts)
    • Executor: Outsourcing

• MTBF on 2.1 branch (Sustain 100 hours)
  • Description:
    • MTBF is purposed to test on version or branch with 0 functional failure. Device QA team needs to follow current MTBF pass criteria (Sustain 100 hours)
  • Contact:
    • Device QA team: Paul Yang and Walter Chen
    • OS QA team: TBC
    • Executor: Paul Yang and Walter Chen

• MCTS testing on partner’s branches
  • Description:
    • Run MCTS on partner's device and send result to partner.
  • Contact:
    • Device QA team: Al Tsai, Aseking Yen
    • Executor: Al Tsai and Owen Ouyang

• Performance bug on demand
  • Description:
    • Device QA will monitor v2.1 main branch performance result on Datazilla. If partner reports a performance issue, we will perform specific test for it.
  • Contact:
    • Device QA team: Mike Lien
    • OS QA team: TBC
    • Executor: Device QA

• Exploratory testing (Bug fixes, halo testing )
  • Description:
    • Exploratory testing of 2.1+ patches on the main 2.1 branch and partner 2.1 branches (2.1Q, 2.1M and 2.1S).
  • Contact:
    • Device QA team: Mike Lien
    • OS QA team: Peter Bylenga or Oliver Nelson
    • Executor: Outsourcing

• Weekly Quality
  • Description:
    • Weekly quality will be send to the "fxosqa-report-watchlist" or "b2g-release-drivers" mailing lists. This will contain the top bugs in 2.1, 2.1Q, 2.1M, and 2.1S branches that need priority attention.
  • Contact:
    • Device QA team: Mike Lien
    • OS QA team: Tony Chung (TBC)
    • Executor: Mike Lien

Bug Status

Smoketest Status

Nominations

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

Blockers

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

Gaia UI Test Regressions Status

Nominations

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

Blockers

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

2.1+ Bug list

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

2.1? Nomination Bug list

3 Total; 0 Open (0%); 3 Resolved (100%); 0 Verified (0%);

2.1 Verifyme Bug List

5 Total; 0 Open (0%); 5 Resolved (100%); 0 Verified (0%);