Firefox OS/MoztrapGuideline
From MozillaWiki
Contents
General Info
- Moztrap General
- MozTrapHelper by Shing - recommend to add this to your Firefox browser.
- Previous discussion
Test case creation
- Do a search, check for duplicate case before you create any case/suite!!
- Test case creation primer - read this before creating test cases^^
- All-pairs testing - Test all possible discrete combinations of those parameters without lots of redundant cases.
- General
- Tool
- Perl script or Windows executable - input parameter options, it shows the cases needed for testing a feature.
- Sample
Test case priority
- Define test case’s priority
- P1 - Feature smoketests
- P2 - Feature basic functional tests
- P3 - Boundary, edge, stress test cases
- P4 - Anything else that doesn't fall in the above buckets
Organize cases
- Mindmap
- Use a mind map to show the structure of your test cases, mindmup integrates with Google drive, permission also controlled by Google drive.
- Sample: v2.1 contacts new features
- Tags
- Moztrap Suite
Put functional prefix before suites.
Functional | Prefix | Example |
---|---|---|
Communications | [Comms] | [Comms]Dialer |
Device | [Device] | [Device] Media Transfer Protocol |
Bluetooth | [BT] | [BT]Bluetooth |
Media | [Media] | [Media]Gallery |
Multimedia Platform | [Media PF] | [Media PF]WebRTC P2P |
Networking/Connectivity | [RIL] | [RIL]SimToolKit |
Productivity | [Prod] | Example |
System Front-End | [Sys FE] | Example |
System Platform | [Sys PF] | [Sys PF]Airplane Mode |
Services | [Service] | Example |
Performance & Metrics | [Perf] | Example |
- [Small set] prefix
- Cases can be tested in short time
- [RAT] prefix
- Release acceptance test - contains happy cases
- Test cases in proper suites
- Please also include your newly created cases in proper suites, for example, Case #14102 [Contacts][ICE] Set ICE contacts, is in [Comms]Contacts suite, [RAT] Comms suite and [Small set][Comms] Contacts, since this is a new feature in V2.1, it should also be included in the 2.1 New Features suite.
When to do what
- Case creation and maintenance
- Test cases for current master
- Usually created before FL, keep maintaining by current function owners.
- Test cases for other branches
- Maybe they are created by partners, added because of regression found or a feature just need more test coverage.
- Keep maintaining by partners or by current function owners.
- Test cases for bugs or added because of regression found
- Keep maintaining by current function owners.
- Test cases for current master
- Invalid/Redundant cases - how to?
- How to spot them?
- Scout around?
- Go through all cases and add tags to group similar cases? Continue to work on small set.
- Using keyword/tag searching/sorting to find issue?
- Reported by people who runs cases everyday (big thanks!)
- Maintenance
- Just updating them by yourself or
- Pass them to functional area owners to review and to update.
- How to spot them?
- Cases not in a suite - how to?
- The DroppedOnTheFloor suite is created to gather all cases that were previously not in any other suite, so that means the cases were never executed before. We need to continue to work on this.
- For cases that currently in a suite (other than DroppedOnTheFloor) - we can remove the case from DroppedOnTheFloor.
- For cases that currently in DroppedOnTheFloor only - Pass cases to functional owner to update/delete them.
- The DroppedOnTheFloor suite is created to gather all cases that were previously not in any other suite, so that means the cases were never executed before. We need to continue to work on this.
Improvement
Search link, Submit a new bug for Moztrap
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);