Firefox:1.5.0.7:UpdateTesting

From MozillaWiki
Jump to: navigation, search

en-US Builds

Software Update Testing Results

Note: The script we have does not test failing the partial on purpose and then having Firefox/Thunderbird go out and get the full update. In the chart below when it says "Fallback" that means fail the partial and make sure it goes out and gets the full update.

Firefox

Windows Mac Linux
1.5.0.6 en-US (alice) PASS (full + partial) en-US (alice) PASS (full + partial) en-US (tracy) PASS
1.5.0.4 en-US (tracy) PASS (alice) PASS
1.5.0.3 (alice) PASS One Tier 1 locale (jay) - PASS
1.5.0.1 One Tier 1 locale (jay) - PASS (alice) PASS
1.5 (alice) PASS One Tier 1 locale (jay) - PASS zh-TW (tracy) PASS

Detailed Results go here:

    • Platform
    • Talkback Build ID
    • Version String
    • PASS/FAIL

Alice's Tests

  • 1.5.0.6 -> 1.5.0.7 (enUS, winXP, partial)
    • releasetest
    • 531 KB
    • PASS
  • 1.5.0.6 -> 1.5.0.7 (enUS, winXP, fallback)
    • betatest
    • 6.1 MB
    • PASS
  • 1.5.0.6 -> 1.5.0.7 (enUS, MacOSX, partial)
    • releasetest
    • 1.6 MB
    • PASS
  • 1.5.0.6 -> 1.5.0.7 (enUS, MacOSX, fallback)
    • releastest
    • 14.5 MB
    • PASS
  • 1.5.0.4 -> 1.5.0.7 (enUS, MacOSX, full)
    • releasetest
    • 14.5 MB
    • PASS
  • 1.5.0.1 -> 1.5.0.7 (enUS, MacOSX, full)
    • betatest
    • 14.5 MB
    • PASS
  • 1.5 -> 1.5.0.7 (enUS, WinXP, full)
    • betatest
    • 6.1 MB
    • PASS
  • 1.5.0.3 -> 1.5.0.7 (enUS, WinXP, full)
    • releasetest
    • 6.1 MB
    • PASS

Jay's Tests

  • 1.5.0.1 -> 1.5.0.7 (fr, Win32, partial, releasetest) [6.1MB]
    • Talkback Build ID: 2006090918
    • User-agent:
    • PASS
  • 1.5 -> 1.5.0.7 (de, MacOSX, partial, betatest) [14.5MB]
    • Talkback Build ID: 2006090921
    • User-agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; de; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7
    • PASS
  • 1.5.0.3 -> 1.5.0.7 (ja, MacOSX, partial, releasetest) [14.5MB]

Tracy's Tests

  • Windows 1.5.0.4 -> 1.5.0.7 (en-US, full, releasetest)
    • Talkback Build ID: 2006090918
    • User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7
    • PASS
  • Linux 1.5.0.6 -> 1.5.0.7 (en-US, partial, betatest)
    • Talkback Build ID: 2006090918
    • User-agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7
    • PASS
  • Linux 1.5 -> 1.5.0.7 (zh-TW, full, releasetest)
    • Talkback Build ID: 2006090918
    • User-agent: Mozilla/5.0 (X11; U; Linux i686; zh-TW; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7
    • PASS

Thunderbird

Windows Mac Linux
1.5.0.5 en-US - Win2k Sp4 = Partial and Complete -PASS en-US - Intel - Partial and Complete - PASS en-US - FC5 - Partial and Complete - PASS
1.5.0.4 One Tier 1 locale
1.5.0.2 en-US fallback - Partial and Complete - PASS
1.5 One Tier 1 locale - ko, PASS One Tier 1 locale fallback - zh-CN, PASS

Marcia's Testing

  • 1.5.0.5 -> 1.5.0.7 (en-US, Linux FC5, partial [MB], releasetest)
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (en-US, Linux FC5, complete [9.2 MB], betatest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (en-US, Intel MacOSX, partial [1.6 MB], releasetest)
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (en-US, Intel MacOSX, complete [15.8 MB], betatest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
    • On first run through after the full applied and I hit continue, Tbird did not restart and the application froze. Had to force quit to stop Thunderbird. The build was then unusable.
  • 1.5.0.5 -> 1.5.0.7 (fr, Intel MacOSX, partial, releasetest)
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5 -> 1.5.0.7 (en-US, PPC MacOSX, partial [MB], releasetest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.2 -> 1.5.0.7 (en-US, Windows, partial [7.3 MB], releasetest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.2 -> 1.5.0.7 ((en-US, Windows, complete [ MB], betatest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.4 PPC Build -> 1.5.0.7 (it, PPC MacOSX, partial [15.8MB], betatest
    • Talkback Build ID: 2006090918
    • versione 1.5.0.7 (20060909)
    • FAIL - looks like it goes out and gets the full? Or is it because of jump from PPC to UB?
    • Text is slightly cutoff in update confirmation dialog.
  • 1.5 PPC Build -> 1.5.0.7 (ko, PPC MacOSX, partial [15.8MB], releasetest
    • Talkback Build ID: 2006090918
    • 버전 1.5.0.7 (20060909)
    • PASS
  • 1.5 -> 1.5.0.7 (zh-CN, Linux, complete [9.2 MB], releasetest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.4 PPC Build -> 1.5.0.7 (da, PPC MacOSX, partial [MB], releasetest
    • Talkback Build ID:
    • First Pass FAIL, makes me go through 1.5.0.5
    • Second Pass PASS on Mac PPC

Tomcat`s Testing

  • 1.5.0.5 -> 1.5.0.7 (en-US, Linux, complete [9.2 MB], releasetest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (en-US, Linux, partial, releasetest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (en-US, Linux, complete [9.2 MB], betatest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (en-US, Linux, partial, betatest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (de, Linux, partial, betatest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (de, Linux, partial, releasetest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (fi, Linux, complete [9.2 MB], betatest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (fi, Linux, complete [9.2 MB], releasetest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (en-US, Windows, complete [7,4 MB], releasetest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (en-US, Windows, partial (703 kb), releasetest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (en-US, Windows, complete [7,4 MB], betatest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (en-US, Windows , (703 kb) partial, betatest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (de, Windows, partial, betatest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (de, Windows, partial, releasetest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (fi, Windows, complete [7,4 MB], betatest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (fi, Windows, complete [7,4 MB], releasetest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.4 -> 1.5.0.7 (en-US, Windows, complete [7,4 MB], betatest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.4 -> 1.5.0.7 (en-US, Windows, complete [7,4 MB], releasetest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.4 -> 1.5.0.7 (DE, Windows, complete [7,4 MB], betatest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.4 -> 1.5.0.7 (DE, Windows, complete [7,4 MB], releastest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS

1.5.0.4 -> 1.5.0.7 (en-US, Linux, complete [7,4 MB], betatest

    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.4 -> 1.5.0.7 (en-US, Linux, complete [7,4 MB], releasetest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.4 -> 1.5.0.7 (DE, Linux, complete [7,4 MB], betatest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.4 -> 1.5.0.7 (DE, Linux, complete [7,4 MB], releastest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS

P1 Locales

Every other locale, test failing the partial and make sure it falls back to full. If you are making a longer hop from 1.5->1.5.0.7 you can still test failing the update to see that after the failure it goes out and gets the update on the second try. Note that only 1.5.0.6 will use a partial update; 1.5.0.* will all use full updates.

  • da
  • de
  • es-ES
  • fi
  • fr
  • it
  • ja-JP-mac (mac primarily)
  • ja
  • nl
  • pl
  • zh-CN
  • zh-TW

P2 Locales

Those not assigned to any P1 locale can still help by selecting a localization from the complete list of locales and testing it (Complete list of locales). Post results here.


Tomcat`s Testing

  • 1.5.0.5 -> 1.5.0.7 (en-GB, Windows, complete [7,4 MB], releasetest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (en-GB, Windows, partial (703 kb), releasetest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (en-GB, Windows, complete [7,4 MB], betatest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • 1.5.0.5 -> 1.5.0.7 (en-GB, Windows , (703 kb) partial, betatest
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS

Live Testing

Marcia's Testing

  • Thunderbird 1.5.-> 1.5.0.7 en-US, Windows Vista
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • Thunderbird 1.5.-> 1.5.0.7 en-US, Mac PPC
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS
  • Firefox 1.5.-> 1.5.0.7 en-US, Windows Vista
    • Talkback Build ID: 2006090918
    • version 1.5.0.7 (20060909)
    • PASS

Jay's Tests

    • ff, win, ja 1.5.0.6->1.5.0.7 = PASS
    • tb, mac, enUS 1.5.0.5->1.5.0.7 = PASS
    • ff, mac, enUS 1.5.0.5->1.5.0.7 = PASS
    • ff, win, 1.5.0.7 download/launch = PASS
    • ff, mac, 1.5.0.7 download/launch = PASS
    • tb, mac, 1.5.0.7 download/launch = PASS

Timr's Tests

  • FFx, win, fr, download
    • Version String: Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7
    • Talkback ID: 2006090918
  • FFx, win, de, download
    • Version String: Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7
    • Talkback ID: 2006090918
  • FFx, win, es-ES, download
    • Version String: Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7
    • Talkback ID: 2006090918