QA/mozilla-beta/fx6/Beta 2

From MozillaWiki
Jump to: navigation, search

« mozilla-beta:fx6 | mozilla-beta:fx6:Beta 2 | mozilla-beta:fx6:Beta 3 »

Beta 2 Test Plan and Results

Tasks

We should complete the following tasks before signing off on the next weekly beta. We should be focusing on bug verifications and testing around fixes.

  • [DONE] Automation (Mozmill BFTs) - ashughes/whimboo: Signed Off
  • [DONE] Bug Verifications - Waverley Team: Signed Off
  • [DONE] Manual Testing - Waverley Team: Signed Off
  • [DONE] Automation (Updates) - ashughes/whimboo: Signed Off
  • [DONE] Crash Stats / Feedback / Web Content Sign Off - juanb, marcia: Signed Off

Spotchecks should be performed across all supported operating systems, including Mac OSX 10.7 which is close to shipping:

  • Windows XP
  • Windows 7 (32-bit & 64-bit)
  • Windows Vista
  • Mac OSX 10.6
  • Ubuntu 10.10 (32-bit and 64-bit)
  • Windows 2000
  • Mac OSX 10.7

Results

Problems Found

List any found issues or bugs here. Use [6b2] whiteboard entry to keep track.

Automation

Run automated BFTs and link reports from dashboard

Platform General Tests Restart Tests
Windows 2000 PASS PASS
Windows XP PASS (known random failure) PASS
Windows Vista PASS PASS
Windows 7 PASS (known failure) PASS
Windows 7 64-bit PASS (known failure) PASS
Mac OS X 10.6 PASS (known failure) PASS
Mac OS X 10.7 PASS PASS
Ubuntu 10.10 PASS PASS
Ubuntu 10.10 64-bit PASS (i686) (known failure)
PASS (x86_64)
PASS (i686)
PASS (x86_64)
Issues Found
  • Any major issues?

Manual

Smoketests

Litmus Testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=321

Platform Name of tester Results
Windows 2000 SimonaB bug 671535 - Ogv videos fail to play on Windows 2000
Windows XP SimonaB PASS
Windows Vista SimonaB PASS
Windows 7 Andrei PASS
Windows 7 64-bit Andrei PASS
Mac OS X 10.6 VladG PASS
Ubuntu 11.04 George PASS
Ubuntu 11.04 64-bit George PASS
Mac OS X 10.7 VladG PASS
Issues Found
  • Any major issues?
    • bug 671535 - Ogv videos fail to play on Windows 2000
BFTs
  • WinXP
    • Testers: Andrei, George, Simona, Vlad
    • Results: PASS in Litmus with known issues
Issues Found
  • n/a

Updates

Target Build ID: Mozilla/5.0 (Windows NT 5.0; rv:6.0) Gecko/20100101 Firefox/6.0 (20110713171652)

Platform Builds Result
Betatest: report
Windows 2000 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru PASS
Windows XP 4.0b9 en-US/es-ES, 4.0 en-US/ko, 5.0b2 en-US/fr, 5.0 en-US/it, 6.0b1 en-US/ru PASS
Windows Vista 4.0b8 en-US/es-ES, 4.0.1 en-US/it, 5.0b3 en-US/it, 5.0 en-US/zh-TW, 6.0b1 en-US/ru PASS
Windows 7 4.0b8 en-US/es-ES, 4.0.1 en-US/de, 5.0b1 en-US, 5.0 en-US/zh-TW, 6.0b1 en-US/ru PASS
Windows 7 64-bit 4.0b8 en-US/es-ES, 4.0 en-US/de, 5.0b6 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru PASS
Mac OS X 10.6 4.0b10 en-US/de, 4.0.1 en-US/ja-JP-mac, 5.0b3 en-US/ja-JP-mac, 5.0 en-US/zh-TW, 6.0b1 en-US/es-ES PASS
Mac OS X 10.7
Ubuntu 11.04 4.0b11 en-US/es-ES, 4.0.1 en-US/de, 5.0b5 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ko PASS
Ubuntu 11.04 64-bit 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru PASS
Beta: report
Windows 2000 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru PASS
Windows XP 4.0b9 en-US/es-ES, 4.0 en-US/ko, 5.0b2 en-US/fr, 5.0 en-US/it, 6.0b1 en-US/ru PASS
Windows Vista 4.0b8 en-US/es-ES, 4.0.1 en-US/it, 5.0b3 en-US/it, 5.0 en-US/zh-TW, 6.0b1 en-US/ru PASS
Windows 7 4.0b8 en-US/es-ES, 4.0.1 en-US/de, 5.0b1 en-US, 5.0 en-US/zh-TW, 6.0b1 en-US/ru PASS
Windows 7 64-bit 4.0b8 en-US/es-ES, 4.0 en-US/de, 5.0b6 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru PASS
Mac OS X 10.6 4.0b10 en-US/de, 4.0.1 en-US/ja-JP-mac, 5.0b3 en-US/ja-JP-mac, 5.0 en-US/zh-TW, 6.0b1 en-US/es-ES PASS
Mac OS X 10.7
Ubuntu 11.04 4.0b11 en-US/es-ES, 4.0.1 en-US/de, 5.0b5 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ko PASS
Ubuntu 11.04 64-bit 4.0b12 en-US/es-ES, 4.0 en-US/de, 5.0b7 en-US/fr, 5.0 en-US/zh-TW, 6.0b1 en-US/ru PASS
Issues Found
  • Any major issues?