Loop/QA
From MozillaWiki
< Loop
Contents
Summary
Links
People
- Lead - TBD
- Desktop - TBD
- Mobile - TEF, ?
- Platform - Nils Ohlmeier
- H264 - Paul Yang, Martijn Wargers
- MSIIDN - Martijn Wargers
- Performance - Geo Mealer, Syd Polk
- Privileged API - TBD
- Server - Richard Pappalardo, Stuart Philp
- Services - Peter deHaan, Stuart Philp
Meetings
(these may be outdated)
| Meeting | When | Where | Notes | Last Meeting |
| Project Status | 11:30h Pacific on Tuesday | Shell Escalante's Vidyo room | Agenda | |
| Partner Testing Coordination | 09:30h Pacific on Wednesday | Shell Escalante's Vidyo Room | ||
| Tokbox Testing Coordination | 14:00h Pacific on Wednesday | Opentok | Agenda |
Tracking Bugs
| ID | Summary | Qa contact | Resolution |
|---|---|---|---|
| 971986 | [meta] Loop MVP desktop Client | FIXED | |
| 976789 | [meta] see what parts, if any, of unlanded SimplePush work is required for loop_mvp | WONTFIX | |
| 998332 | [meta] MVP Loop Server | FIXED | |
| 998748 | [meta] FxA Services for webRTC clients | FIXED | |
| 1004761 | [meta] Loop Platform | WORKSFORME | |
| 1026288 | Add new Target Milestones and feature-b2g tag for webRTC and Loop | FIXED | |
| 1107478 | [meta] Loop Mobile Client | WONTFIX |
7 Total; 7 Open (100%); 0 Resolved (0%); 0 Verified (0%);
Top-level Status
Milestones
By Firefox Version
- Firefox 32: Ship OpenH264
- Firefox 33: Ship Screensharing and Loop MLP
- Firefox 34: Ship Loop MVP
By Product Feature
- Screensharing via OpenH264: Begin testing in Firefox 32, ship in Firefox 33
- Loop MLP: 0 Open; 11 Resolved; 46 Verified; (target: Firefox 33)
- Loop MVP: 23 Open; 14 Resolved; 24 Verified; (target: Firefox 34)
- Server/Services:
- Mobile Client: B2G 2.0 via bug 1036490
- Platform:
Dashboards
Bugs Tracked for Loop MLP
57 Total; 0 Open (0%); 1 Resolved (1.75%); 56 Verified (98.25%);
Bugs Tracked for Loop MVP
69 Total; 0 Open (0%); 50 Resolved (72.46%); 19 Verified (27.54%);
Client
Desktop
Owner: TBD
Goals
- Target all Desktop platforms
- Target LAN, WiFi, and various NAT/Firewall configurations
Dogfooding
Follow these steps to start dogfooding the Desktop Loop client. If you have any questions, contact ashughes in #media on IRC (irc.mozilla.org) or ahughes@mozilla.com via email.
- Download, install, and start the latest Nightly
- Click the phone icon (you may need to enter Customize mode to add it)
- Create a call and share the URL with a friend
- Run these tests (or just play around with it until you break it)
- Report any issues, be sure to include the following information:
- Operating system and version
- Firefox version including build ID from about:support
- Whether the bug reproduces on a new profile
- Descriptive steps to reproduce the bug
- Screenshots/screencasts if it helps illustrate the problem
Testing
The following will be tested as part of the sign-off of the Desktop Loop client for MVP.
- Features work as intended/described
- Authentication/Registration using Firefox Accounts
- User Identity
- Contact list
- Call history
- Receiving and sending calls when authenticated or not
- In-call controls (mute, full screen, etc)
- URL handling (ex. callback)
- Privacy/security controls
- Accessibility - TO BE DETERMINED
- Localization - TO BE DETERMINED
- Switching between primary and fallback codec usage
- Error handling pre-call, in-call
- Post-call user feedback
- Stress Test Coverage
- Sending/receiving calls when device is under load
- Sending/receiving calls when device has poor/intermittent connectivity
- MVP is performant across all supported platforms
- MVP is stable across all supported platforms
- Call quality is on par with traditional service (Skype, Vidyo, etc)
- Calling between desktop<->desktop, desktop<->mobile, firefox<->chrome, firefox<->opera
- Calling between different network types: Wifi, Ethernet, GSM, etc
- Limited automated tests are getting implemented bug 976116
Blockers
90 Total; 90 Open (100%); 0 Resolved (0%); 0 Verified (0%);
Bugs
Mobile
Owner: TEF, TBD
Goals
- Target Firefox OS 2.0
- Target 2G (EDGE), 3.5G (HSPA), and open WiFI (MozGuest) networks
Testing
- TEF internal test plan -- Jason to review with Massimo to clarify gaps and to portion the testing based on Platform fixes
Blockers
84 Total; 0 Open (0%); 78 Resolved (92.86%); 6 Verified (7.14%);
Bugs
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Platform
H264 Support
Owner: Paul Yang, Martijn Wargers
Goals
Testing
Blockers
Bugs
178 Total; 178 Open (100%); 0 Resolved (0%); 0 Verified (0%);
MSISDN Support
Owner: Martijn Wargers
- Test Plan
- Server-side code repository
- bug 988469 (loop_msisdn_verific) MSISDN verification API for privileged apps
Goals
Testing
Blockers
Bugs
Performance
Owner: Geo Mealer, Syd Polk
Goals
Testing
- Proposed scenarios
- AV Sync performance over a 15 minute WebRTC call
- CPU performance over a 1 minute WebRTC call
- Power usage over a 1 minute WebRTC call
- E2E latency over a 1 minute WebRTC call
Blockers
Bugs
Privileged API
Owner: TBD
Goals
Testing
Blockers
10 Total; 10 Open (100%); 0 Resolved (0%); 0 Verified (0%);
Bugs
Partner Backend
Owner: Nils Ohlmeier
- Meetings: Tuesday @ 2pm Pacific
Goals
- Various networked environments, including NAT and Firewalls (CAF to assist?)
Testing
Blockers
Bugs
Services
Owner: Stuart Philp
Scalability
Owner: Richard Pappalardo
Goals
- Three primary goals
- Functional test of the Loop Server as deployed to the Stage environment (AWS stack)
- Stability testing of the Stage environment
- Size and Scalability testing of the Stage environment for capacity planning in Production
Testing
- All of the server-side testing has just started this week (first week of June). There are two parts of this testing:
- Standard functional/stress testing using the Loads tool and cluster
- Performance testing of the TokBox infrastructure using the Loads tool and cluster
- Loop-Server load test
- Test documentation - TBD
- Currently all in text form - I will be creating/editing wikis similar to the following
- Test Plan - N/A
- But, I may create a test tracking bug, similar to the following:
Blockers
- None at this time
Bugs
- Classification = Other
- Product = Loop
- Component = Server
- Bugzilla search: http://mzl.la/1iYe9Vn
API
Owner: Peter deHaan
Goals
Testing
Blockers
Bugs
- Classification = Other
- Product = Loop
- Component = Server
- Bugzilla search: http://mzl.la/1iYe9Vn
Server/Scalability/API References
- https://github.com/mozilla-services/docs/blob/master/source/loop/apis.rst
- https://wiki.mozilla.org/Loop/Architecture
- https://docs.services.mozilla.com/loop/apis.html
- https://people.mozilla.org/~dhenein/labs/loop-docs/
- https://etherpad.mozilla.org/msisdnapi
- https://github.com/mozilla-services/msisdn-gateway/blob/master/API.md
- https://github.com/mozilla/fxa-auth-server/wiki/API-extensions-for-supporting-MSISDN-verification-in-FxA-auth-server
Firefox Accounts Authentication
Owner: Richard Pappalardo
Goals
- Validation and Stability of FxA Authentication Workflow
Testing
- New user authentication
- Existing user authentication
- Create B2G FxA test tool for client-side validation
