Fx 4b11 Test Plan

Top Sites Testing

Tomcat runs an automated test suite that checks for crashes on page load for the top 20k sites on an on-going basis. When there's a problem it's usually a crasher bug and Tomcat files those.

See also https://wiki.mozilla.org/User:Tomcat:Topsite-Testing and see Tomcat for question/inquiries about a run for you!

• In beta 10 we started using an outsourcing service that tested functionality (using beta 9) of the top 100 web sites according to alexa.com. A few issues were found and bugs were filed for them. Search for "uTest" in bugzilla to find related bugs.

• For the beta 11 cycle, this outsourced service will tests top financial sites in the US as well as globally (about 25 financial sites). The tests will include basic functionality like login, account details browsing, sorting, and other common use cases. These tests will be performed using official beta 10 builds. Issues will be filed directly in bugzilla.

• As of Monday February 7th, more than 50% of the test suite had been run, with common functionality tested in more than 20 sites. For a link to the spreadsheet tracking these results ping juanb@mozilla.com. These tests were run against beta 10. Right now there are still no issues filed, only a couple of problems under investigation.

• Farmville spotcheck using testing accounts: status