Firefox OS/DeviceQA/2015-01-19Status
From MozillaWiki
< Firefox OS | DeviceQA
Contents
V2.2 Highlight & Risk
- Bug list Issue
- Bug 1123205 - white screen issue, not in smoke test but a serious issue.
V2.2 Next Milestone
- 2015/02/23 FL
V2.2 Testing Scope
- Focus on bugs in agreed list, prepare new test cases or regression, and perform test runs.
- B2G V2.2 Overview Page for more info.
V2.2 Testing by Type
Smoke Testing
On Track
- No new blocker.
- Existing Bugs Breaking the Smoketests: Updated
- Resolved Fixed case, request to enable this case
- [Disabled] test_lockscreen_unlock_to_camera_with_passcode.py - Bug 1078270 - Camera app dies/crashes after unlocking from lockscreen with passcode, Bug 1122451 is trying to resolve this.
- Existing Bugs Breaking the Smoketests:
- [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192 - Problems with ActiveSync accounts
- [Disabled] test_receive_active_sync_email.py - Bug 1028192 - Problems with ActiveSync accounts
- [Disabled] test_cost_control_data_alert_mobile.py - Bug 1061698 - Need ability to work in the shadow root/shadow DOM
- [Disabled] test_call_log_all_calls.py - Bug 1096385 - Investigate failure in test_call_log_all_calls.py, call log is displayed erroneously
- Daily Reports can be found here.
- Manual - are available on Google Drive & fxosqa-report-watchlist.
- Automation - are available on Github.IO & fxosqa-report-watchlist.
Functional Testing
On Track
- QA focus - 33 bugs found.
- Privacy (Gerry)
- Health: Red (from last week)
- Test case coverage:
- Blocker: 1
- Cut, Copy, and Paste (Gerry, Edward, Teri, Eric)
- Health: Green
- Test case coverage: will check
- Details: WIP
- NFC (Alison)
- Health: Green
- Test case coverage: 90%
- Details: WIP
- Rocketbar refactor & search suggestion based on provider (Hermes)
- Health: Green
- Test case coverage: 90%
- Details: WIP
- App-grouping (Hermes)
- Health: Green
- Test case coverage: 75%
- Details: WIP, UX spec update, need to verify
- Task Manager (Hermes)
- Health: Green
- Test case coverage: 100%
- Details: WIP
- L-porting (Hermes)
- Health: RED
- Details: Build failed this week....Blocked by https://bugzilla.mozilla.org/show_bug.cgi?id=1119980
- CAF bugs (Eric)
- Health: Green
- Test case coverage: 66% done
- Details: 3 WIP, 3 Resolved, FDN requires no-FDN-support SIM, unable to test, ask help from partner
- TCL bugs (Alison, Eric)
- Health: Green
- Test case coverage: 100%
- Details: 2 WIP, 1 Resolved,
- STK bugs testing/verification needs to be pushed to partner
- Bluetooth (Eric, Teri)
- Health: Green
- Test case coverage: 100% (Regression)
- Details: 30% dependency bugs WIP, 70% Resolved, will perform regression and PTS
- Metrics (Shing)
- Health: Yellow
- Test case coverage: 50%
- Details: 1 WIP, only minor change, can reuse old test case. https://bugzilla.mozilla.org/show_bug.cgi?id=1109422
- 256M RAM memory optimization for WFVGA, 5MP. (Teri)
- Health: Yellow
- Test case coverage: Discussing with RD about test areas
- Details: https://bugzilla.mozilla.org/show_bug.cgi?id=1082290
Exploratory Testing
On Track
- 176 bugs found - includes every bug in bugzilla affecting v2.2, not limited to the bugs after branch day.
- UNCONFIRMED, NEW, ASSIGNED, REOPENED - 112 bugs found.
- UNCONFIRMED, NEW, ASSIGNED, REOPENED & 2.2?, 2.2+ - 15 bugs found.
- RESOLVED, VERIFIED, CLOSED - 64 bugs found.
- RESOLVED, VERIFIED, CLOSED & 2.2?, 2.2+ - 3 bugs found.
Performance Testing
- Will get started asap
Stability Testing
- Current running device: Flame-KK
- Will switch to Nexus-5-L & Flame-L in the future
- No statistics or report yet, we are trying to get familiar & stabilize the testing framework.
V2.2 Test Case Creation
Test Case Creation WIP
On Track
- [2.2-feature-qa+] & in-moztrap? (8 bugs) --> WORK IN PROCESS
Test Case Creation DONE
- [2.2-feature-qa+] & in-moztrap+ (15 bugs) --> WORK DONE
V2.2 Testing Verification Status
Overall Verification Summary
- No bugs marked as "VERIFIED FIXED" Yet.
- More details.