QA/Firefox3/TestPlan/Platform
Gecko Platform Test Plan
Contents
Overview
The particular challenge of testing Gecko Platform is the significant scope of changes between 1.8 and 1.9. Also the reflow branch had a good number of changes as well, and will be challenging to test. Current the PRD does not have a clear definition of where P2 and P3 items are.
Scope of Planned Testing
Our Test coverage will be a multi-leveled approach:
- 1. Functional testing and
- 2. Some stress/boundary/negative tests (depth of functionality):
- 3. Ad hoc and regression testing
- 4. Automated testing:
- 4.1. Reftests - http://developer.mozilla.org/en/docs/Mozilla_automated_testing#Reftest
- 4.2. Mochikit tests - http://developer.mozilla.org/en/docs/Mozilla_automated_testing#Mochitest
- 4.3. Crashtests - http://developer.mozilla.org/en/docs/Mozilla_automated_testing#Crash_tests
- FFT in Litmus run on the platform specific test cases
Functional Testing
- We will run the Litmus platform specific test cases.
- Litmus test cases will be added for any new platform specific features that are supported.
Stress testing/Negative Testing (depth of functionality):
Ad hoc & regression testing
The Mozilla community users will cover some of the Ad hoc testing. Regression testing will cover:
- QA Verification of Resolved bugs
- Daily smoketesting of builds
Platform and Configurations
- We will cover all platforms that FF 3 supports.
Major Test Areas
Standards Compliance
- ACID 2 test - See https://litmus.mozilla.org/show_test.cgi?id=4685
GFX/Widget
- Cairo graphics
- Linking Content/Chrome Frame Trees
- nxTextFrame migration to Thebes
- Frame Display Lists
Layout
- Reflow Branch
- Caret Painting Rewrite
- Fix Units in Gecko
- Residual Style Handling
Networking
- Cross-domain XMLHttpRequest
Platform
- Killing nested event queues, threadmanager
- Offline Apps
- Add backend elements for offline app support
PDF Save
- Save web pages as PDF documents
Printing
There is currently no automated test suite for printing yet. So this has to be done manually in litmus, atm.
- Portrait and Landscape
- Alexa Top 10 sites plus others
- Mac specific Firefox print settings
Reference Bugs
- backend elements for offline app support
- Cairo Graphics
- Linking Content/Chrome Frame Trees
- nxTextFrame migration to Thebes
- Reflow Branch
- Caret painting rewrite
- Frame Display Lists
- Cross-domain XMLHttpRequest
- Killing nested event queues, threadmanager
Schedule/milestones
A lot of bugs related to offline applications will land for M11. Also most of the MathML bustage should be fixed by then.
( Provide some breakdown of the major areas of the feature, how long it will take to develop or run the tests, and an approximate time this will be done.
(List useful links to the bug containing design info, feature meeting notes, wiki info, standards info, litmus group or subgroup, etc)
Reference Documentation
- http://wiki.mozilla.org/Firefox3/Product_Requirements_Document#Gecko.2FPlatform
- http://spreadsheets.google.com/pub?key=p4kVYBRbEKKiemLr9CI-tZw