Objective

Create a tool that addresses the needs of QA and Mozilla as a whole in terms of testing infrastructure and support.

The Pain Points

• Adding a Functional Test
• Executing Test Matrices or State Diagrams
• Search a test case by tag
• Attach a case to multiple suites
• Reporting
  • See the results for a single test suite for every run (Chart)
  • See the results for a test case for every run
  • See the results for a given version
  • Compare 2 tests runs for 2 versions
• Automation
  • Pair a test case with automation
  • Extract the data (testcaseId, test result, revision, branch)
  • Format the automation results to JSON
  • Push the results of automation

The Solution

Use a combination of Moztrap enhancements and Github to alleviate the pain points and add a new layer of support for Test Case management.

Timeline

Full Road Map https://wiki.mozilla.org/QA/B2G/MozIlluminate/RoadMap

Sprint 4 Deadline June 12th, 2015:

• Demo: Reporting [Shing, Hermes, Shako, Al]
• Demo: User flow test creation [Johan]
• Demo: Perf improvement [shing]
• Demo: Dupe finder [shing]
• [HIGHEST-PRIORITY] Integrate Johan's parser w/ git-to-moztrap infrastructure [Johan, Shako, Shing]
• Demo: Road Map summary and future goals [Peter]
• Import test suites in https://github.com/JohanLorenzo/checklists-repo-example [PBylenga]

Future

• State Diagram Support
• Automate Test Matrix Generation of test cases
• UI Improvements
• Reporting Improvements
• Fix bugs
• Ultimately be a state where results can be shared between State Diagrams/Matrices/Test Cases/Checklists

Known Issues