Releases/Firefox 24 ESR/Test Plan

Firefox 24 ESR


Builds	FTP, HTTP
ID	20130910201120
Changeset	c5fc2f003e4d (pushlog)

Checklist

[DONE] Functional automation
[DONE] Manual tests
[DONE] Bug fix verifications

Automated Tests

The following are the detailed results of the automated Mozmill test runs.

Platform	Results (report)
Windows XP	PASS
Windows Vista	PASS
Windows 7 32-bit	PASS
Windows 7 64-bit	PASS
Windows 8 32-bit	PASS
Windows 8 64-bit	PASS
Mac OS X 10.6	PASS
Mac OS X 10.7	PASS
Mac OS X 10.8	PASS
Ubuntu 12.04 32-bit	PASS
Ubuntu 12.04 64-bit	PASS

Manual Smoketests

Run the Firefox ESR 24 Smoketests in MozTrap and report the results below.

Platform	Assignee	Result: report
Windows 8 32-bit	Manuela Muntean	[DONE]
Windows 7 64-bit	Mihai Morar	[DONE]
Mac OS X 10.7	Bogdan Maris	[DONE]
Ubuntu 12.04 32-bit	Petruta Rasa	[DONE]

Additional Spotchecks

Pave-over install of FF24esr over FF17esr [DONE]
- From 17.0.x to 24
- From 17.0.8 to 24
- From 17.0.9 to 24
Firefox Desktop : Sync : Account [DONE]
- Moztrap tests
- Notes/Issues:
  - on Win 8 32bit, Ubuntu 32bit and Mac OS X 10.7.5: regarding "View and dismiss Sync discovery notifications" test -> there is no "browser.syncPromoViewsLeft" option in "about:config"
Show PDF inline Smoketests [DONE]
- Moztrap tests
- Notes/Issues:
  - on Win 8 32bit, Ubuntu 32bit and Mac OS X 10.7.5: "Display embedded PDF" test fails, because the PDF embedded with the object tag isn't displayed; known issue: see bug 738967
SocialAPI Service Management [DONE]
- Moztrap tests
- Notes/Issues:
Mixed Content Blocker [DONE]
- Moztrap tests
- Notes/Issues:
  - on all platforms:
    - the behavior explained in bug 906190 is encountered
    - the prefs used in the test cases aren't the correct ones; these are the correct prefs: "security.mixed_content.block_active_content" and "security.mixed_content.block_display_content"

Bug Fix Verifications

[DONE] bug 633001 VERIFIED: SSL cannot set exceptions on IPv6 addresses
[DONE] bug 888820 VERIFIED: Crash in nsHtml5TreeBuilder
[DONE] bug 887334 NOT VERIFIED: GC hazard with default compartments and frame chain restoration
- No test case or STR. Also, developer has created his own tests.
[DONE] bug 874952 VERIFIED: Always create enough last chunks for an engine, even if we don't end up calling into its ProduceAudioBlock function
List of all security bugs verified in FF24

Issues

New

Known

bug 738967 pdf.js doesn't work for embedded PDFs

Firefox 24.1.0 ESR


Builds	FTP, HTTP
ID	20131021230807
Changeset	b6aa22c418f4 (pushlog)

Checklist

[DONE] Functional automation
[DONE] Manual smoketests
[DONE] Bug fix verifications
[DONE] Update automation on esrtest
[DONE] Conditional sign-off for push to mirrors
[DONE] Update automation on releasetest
[DONE] Final sign-off for push to esr
[DONE] Update automation on esr

Automated Testing

The following are the detailed results of the automated Mozmill test runs.

Platform	Functional [report]
Windows XP	PASS
Windows Vista	PASS
Windows 7 32-bit	PASS
Windows 7 64-bit	PASS
Windows 8 32-bit	PASS
Windows 8 64-bit	PASS
Mac OS X 10.6	PASS
Mac OS X 10.7	PASS
Mac OS X 10.8	PASS
Ubuntu 12.04 32-bit	PASS
Ubuntu 12.04 64-bit	PASS
Ubuntu 13.04 32-bit	PASS
Ubuntu 13.04 64-bit	PASS

Manual Smoketests

Run the Firefox ESR 24.1 Smoketests in MozTrap and report the results below.

Platform	Assignee	Result: report
Windows 8 32-bit	Paul Silaghi	[DONE]
Windows 7 64-bit	Alexandra Lucinet	[DONE]
Mac OS X 10.7	Cornel Ionce	[DONE]
Ubuntu 12.04 32-bit	Mihai Morar	[DONE]

Firefox Desktop : Sync : Account - Moztrap tests
Show PDF inline Smoketests - Moztrap tests
SocialAPI Service Management - Moztrap tests
Mixed Content Blocker - Moztrap tests

Update Testing

Complete: 24.0

Platform	Target Version	esrtest	releasetest	esr
Windows XP	Firefox 24.0	PASS	PASS	PASS
Windows Vista	Firefox 24.0	PASS	PASS	PASS
Windows 7 32-bit	Firefox 24.0	PASS	PASS	PASS
Windows 7 64-bit	Firefox 24.0	PASS	PASS	PASS
Windows 8 32-bit	Firefox 24.0	PASS	PASS	PASS
Windows 8 64-bit	Firefox 24.0	PASS	PASS	PASS
Mac OS X 10.6	Firefox 24.0	PASS	PASS	PASS
Mac OS X 10.7	Firefox 24.0	PASS	PASS	PASS
Mac OS X 10.8	Firefox 24.0	PASS	PASS	PASS
Ubuntu 12.04 32-bit	Firefox 24.0	PASS	PASS	PASS
Ubuntu 12.04 64-bit	Firefox 24.0	PASS	PASS	PASS
Ubuntu 13.04 32-bit	Firefox 24.0	PASS	PASS	PASS
Ubuntu 13.04 64-bit	Firefox 24.0	PASS	PASS	PASS

Bug Fix Verifications

[DONE] bug 913614 NO VERIFY: For lines and rectangles, skip the work when the input is invalid
- Verification of related bug is enough
[DONE] bug 914667 VERIFIED: PDF viewer doesn't resolve base URIs properly
[DONE] bug 897678 VERIFIED: Make worker code stop using propertyops, as a step toward removing propertyops altogether.
[DONE] bug 918864 VERIFIED: Improve doStopDocumentLoad
[DONE] bug 914017 VERIFIED: Initialize members variables of the document hash correctly. (mwobensmith)
[DONE] bug 916580 NO VERIFY: Fix bugs related to the usage of calloc (mwobensmith)
- No test case
[DONE] bug 916404 NO VERIFY: ContentIsHostIncludingDescendantOf,
- Can't reproduce, relying on reporter's verification
[DONE] bug 869406 NO VERIFY: Really enforce non-parallel build of ICU.
- Can't verify, no test case
[ON TRACK] bug 910881 NOT VERIFIED: Do not call RasterImage::DoError off the main thread. (Ioana)
- Still crashes, cannot mark bug as verified
- Developer has not responded to inquiries; we are going to proceed anyway
[DONE] bug 916404 NO VERIFY, relying on reporter
[DONE] bug 838105 VERIFIED: Don't rely on key lookup to remove items from the user font cache, as the principal could have changed (Cornel)
[DONE] bug 788031 VERIFIED: For object/embed/applet tags, pass baseURI to shouldProcess if mURI is null.
[DONE] bug 868327 VERIFIED: Only allow the drop-down menu to open above the combobox if there is room for it, otherwise open it below even though it doesn't fit.
[DONE] bug 911158 VERIFIED: Removal of URL Protocol from FirefoxURL causes problems for some users. (Ioana)
[DONE] bug 916126 VERIFIED: Move IDL addition to the end of the IDL since we're not bumping the IID, (Manuela)
[DONE] bug 915210 VERIFIED: Improve GetPresContext
[DONE] bug 860123 VERIFIED: Disallow extending or collapsing selections across documents.
[DONE] bug 916576 VERIFIED: Follow the com rules when calling LoadURI.
[DONE] bug 921090 NO VERIFY: Upgrade Firefox to NSS 3.15.2
- All-or-nothing change, can't easily verify just this fix
[DONE] bug 917160 VERIFIED: AssureBlitted before switching EGLSurfaces with MakeCurrent. (Cornel)
[DONE] bug 914618 VERIFIED: Reimplement XML pretty printing with events
[DONE] bug 916685 NO VERIFY: No need to store empty event handlers no verify,
- Can't reproduce, relying on reporter's verification

Issues

New

Full Query

ID	Summary	Priority	Status
931791	When creating a new sync account the validity of the email is not checked.	--	RESOLVED
931800	Closing the window with the generated Device code will result in a unsuccessful pairing of the said device.	--	RESOLVED
931869	Missing text in Pdf	P3	RESOLVED

3 Total; 0 Open (0%); 3 Resolved (100%); 0 Verified (0%);

Known

Full Query

ID	Summary	Priority	Status
801715	Sync: "Warning: Unresponsive script" when changing recovery key / MozTrap test case #2675	--	NEW
918864	[FIX] Heap-use-after-free in nsDocLoader::doStopDocumentLoad()	--	RESOLVED

2 Total; 1 Open (50%); 1 Resolved (50%); 0 Verified (0%);

Firefox 24.1.1 ESR


Builds	FTP, HTTP
ID	20131112155850
Changeset	7d89d35ff7e3 (pushlog)

Checklist

[DONE] Functional automation
[DONE] Update automation on esrtest
[DONE] Update automation on releasetest
[DONE] Final sign-off for push to esr
[DONE] Update automation on esr

Automated Testing

The following are the detailed results of the automated Mozmill test runs.

Platform	Functional [report]
Windows XP	PASS
Windows Vista	PASS
Windows 7 32-bit	PASS
Windows 7 64-bit	PASS
Windows 8 32-bit	PASS
Windows 8 64-bit	PASS
Mac OS X 10.6	PASS
Mac OS X 10.7	PASS
Mac OS X 10.8	PASS
Ubuntu 12.04 32-bit	PASS
Ubuntu 12.04 64-bit	PASS
Ubuntu 13.04 32-bit	PASS
Ubuntu 13.04 64-bit	PASS

Regression Testing

Localized String Testing

See bug 932310 for details. Spot-check non-English locales to make sure that various strings are translated.

Windows XP	Windows 7 64-bit	Windows 8.1 32-bit	Mac OSX 10.9	Ubuntu 13.04 64-bit
[DONE] fr	[DONE] es-ES	[DONE] de	[DONE] ru	[DONE] pt-BR
[DONE] th	[DONE] ja	[DONE] zh-CN	[DONE] ko	[DONE] af
[DONE] fi	[DONE] bn-IN	[DONE] es-MX	[DONE] ar	[DONE] he
[DONE] pl	[DONE] tr	[DONE] hi-IN	[DONE] zh-TW	[DONE] id
[DONE] it	[DONE] sv-SE	[DONE] da	[DONE] kn	[DONE] fa

Notes

fr, th, fi, pl, it - text is in English on the Save dialog (ctrl+S), Open dialog (ctrl+O), the Downloads pop-up (options - general - download files to...), Print menu (ctrl+P), about:home - the messages under the search bar.
th - text is in English for the privacy menu (privacy options), setting - updates (Automatically install updates string), submit feedback page and the profiler (dev tools).
fi - text is in English for the privacy menu (privacy options), submit feedback page, dev tools
pl - text is in English on the FF health report from about menu and the profiler (dev tools)
es-ES, ja, bn-IN, tr, sv-SE, fr, pt-BR, af, he, id, fa - not completetly localized Bookmarks menu.
tr, bn-IN, ja, af, he, id, fa, zh-CN, hi-IN, es-MX - Addons Manager not localized or only partially localized.
ja - not localized Tools -> Options - OK button.
bn-IN, es-MX - not localized menu option - File -> New Private Window, most of the menu options - Tools -> Web Developer and the entire Web Console.
tr, sv-SE, bn-IN - not localized help page - Help -> Firefox Help.
pt-BR, af, he, id, fa, es-MX - Library not completely localized.
he, fa - not localized File -> New Private Tab menu item, address bar placeholder text.
he, es-MX, hi-IN - about:support not fully localized.
id - Edit menu option not localized.
kn, zh-TW - text is in English on the Save dialog (ctrl+S), Open dialog (ctrl+O), Print menu (ctrl+P).
ru - Mozilla Crash Reporter is in english and text is out of panel.
ru, ko, ar, zh-TW, kn - text from Details located in Mozilla Crash Reporter is in english.
ko - Library -> Import and backup your bookmarks is in english.
ar, zh, hi-IN - Web developer partially localized.
zh-TW - Web developer -> Web console -> Inspector (Box Model is in english), Firefox -> Services -> (no services apply and Services Preferences are in english).
kn - Preferences -> General -> Choose -> Choose download folder (buttons english), Web developer -> Web Console buttons are in english and hovering messages are in english.
es-MX - Larry Panel -> Permissions and Tools -> Options -> Privacy are partially localized.
es-MX, de - Tools -> Options -> Advanced is partially localized.
hi-IN - Mozilla crash reporter, Bookmarks Toolbar, CTP overlay, Add-ons installer, Submit feedback page and Tools -> Set Up Sync menu option are partially localized.
about:license; about:buildconfig; about:cache; about:compartments; about:credits; about:memory doesn't seem to be localized at all.
about:crashes - zh-TW
about:mozilla - zh-TW, kn, de, es-MX
about:plugins - kn, de, es-MX
about:rights - kn, hi-IN, de
about:about - hi-IN, zh-CN
about:sync-progress - hi-IN
about:robots - de, da
about:downloads; about:telemetry - es-MX

SSL Topsite Testing

Choose a website which uses SSL and do some exploratory testing on that site
Be sure to log in to the website if it has that functionality
Report any issues with rendering and general usage, in particular if you get any SSL errors
Suggestions for sites to test include email, banking, social networking, shopping, video streaming, and forum websites
Try to test at least 25 different websites
Add PASS if there were no problems or FAIL if you encountered an issue
Be sure to note any issues in the Issues Found section below

Sites Tested	Windows XP	Windows 7 64-bit	Windows 8.1 32-bit	Mac OSX 10.9	Ubuntu 13.04 64-bit
1. https://www.facebook.com/	PASS	PASS	PASS	PASS	PASS
2. https://www.tumblr.com/	PASS	PASS	PASS	PASS	PASS
3. https://login.yahoo.com/	PASS	PASS	PASS	PASS	PASS
4. https://www.linkedin.com/	PASS	PASS	PASS	PASS	PASS
5. https://login.live.com/	PASS	PASS	PASS	PASS	PASS
6. https://twitter.com/	PASS	PASS	PASS	PASS	PASS
7. http://www.amazon.com/	PASS	PASS	PASS	PASS	PASS
8. https://accounts.google.com/	PASS	PASS	PASS	PASS	PASS
9. http://wordpress.com/	PASS	PASS	PASS	PASS	PASS
10. http://www.ebay.com/	PASS	PASS	PASS	PASS	PASS
11. http://www.aliexpress.com/	PASS	PASS	PASS	PASS	PASS
12. https://www.pinterest.com/	PASS	PASS	PASS	PASS	PASS
13. https://www.paypal.com/	PASS	PASS	PASS	PASS	PASS
14. https://instagram.com/accounts/login/	PASS	PASS	PASS	PASS	PASS
15. https://login.alibaba.com/	PASS	PASS	PASS	PASS	PASS
16. https://www.adcash.com/en/index.php	PASS	PASS	PASS	PASS	PASS
17. https://vimeo.com/	PASS	PASS	PASS	PASS	PASS
18. http://emag.ro	PASS	PASS	PASS	PASS	PASS
19. https://www.dropbox.com/	PASS	PASS	PASS	PASS	PASS
20. https://eu.battle.net/shop/en-us/	PASS	PASS	PASS	PASS	PASS
21. https://wiki.mozilla.org/	PASS	PASS	PASS	PASS	PASS
22. https://mozqa.etherpad.mozilla.org/	PASS	PASS	PASS	PASS	PASS
23. https://bugzilla.mozilla.org/	PASS	PASS	PASS	PASS	PASS
24. https://soundcloud.com/	PASS	PASS	PASS	PASS	PASS
25. https://drive.google.com/	PASS	PASS	PASS	PASS	PASS

Update Testing

Complete: 24.0
Partial: 24.1.0

Platform	Target Version	esrtest	releasetest	esr
Windows XP	Firefox 24.0	PASS	PASS	PASS
Windows Vista	Firefox 24.0	PASS	PASS	PASS
Windows 7 32-bit	Firefox 24.0	PASS	PASS	PASS
Windows 7 64-bit	Firefox 24.0	PASS	PASS	PASS
Windows 8 32-bit	Firefox 24.0	PASS	PASS	PASS
Windows 8 64-bit	Firefox 24.0	PASS	PASS	PASS
Mac OS X 10.6	Firefox 24.0	PASS	PASS	PASS
Mac OS X 10.7	Firefox 24.0	PASS	PASS	PASS
Mac OS X 10.8	Firefox 24.0	PASS	PASS	PASS
Ubuntu 12.04 32-bit	Firefox 24.0	PASS	PASS	PASS
Ubuntu 12.04 64-bit	Firefox 24.0	PASS	PASS	PASS
Ubuntu 13.04 32-bit	Firefox 24.0	PASS	PASS	PASS
Ubuntu 13.04 64-bit	Firefox 24.0	PASS	PASS	PASS

Issues

New

Full Query

ID	Summary	Priority	Status
938029	Test failure "Java(TM) Platform SE 7 U45 state is Enabled in about:plugins - got 'false'" in testAddons/testPluginDisableAffectsAboutPlugins.js	--	RESOLVED
938698	Java 7u45 is CTP blocked for some versions	--	RESOLVED

2 Total; 0 Open (0%); 2 Resolved (100%); 0 Verified (0%);

Known

Full Query

ID	Summary	Priority	Status
801715	Sync: "Warning: Unresponsive script" when changing recovery key / MozTrap test case #2675	--	NEW
918864	[FIX] Heap-use-after-free in nsDocLoader::doStopDocumentLoad()	--	RESOLVED
931791	When creating a new sync account the validity of the email is not checked.	--	RESOLVED
931800	Closing the window with the generated Device code will result in a unsuccessful pairing of the said device.	--	RESOLVED
931869	Missing text in Pdf	P3	RESOLVED

5 Total; 1 Open (20%); 4 Resolved (80%); 0 Verified (0%);

Firefox 24.2.0 ESR


Builds	FTP, HTTP
ID	20131205180928
Changeset	e408ebe9e449 (pushlog)

Checklist

[DONE] Functional automation
[DONE] Manual smoketests
[DONE] Bug fix verifications
[DONE] Update automation on esrtest
[DONE] Conditional sign-off for push to mirrors
[DONE] Update automation on releasetest
[DONE] Final sign-off for push to esr
[DONE] Update automation on esr

Automated Testing

The following are the detailed results of the automated Mozmill test runs.

Platform	Functional [report]
Windows XP	PASS
Windows Vista	PASS
Windows 7 32-bit	PASS
Windows 7 64-bit	PASS
Windows 8 32-bit	PASS
Windows 8 64-bit	PASS
Mac OS X 10.6	PASS
Mac OS X 10.7	PASS
Mac OS X 10.8	PASS
Ubuntu 12.04 32-bit	PASS
Ubuntu 12.04 64-bit	PASS
Ubuntu 13.04 32-bit	PASS
Ubuntu 13.04 64-bit	PASS

Manual Smoketests

Run the Firefox ESR 24.2 Smoke Tests in MozTrap and report the results below.

Platform	Assignee	Result: report
Windows 8 32-bit	Cornel Ionce	[DONE]
Windows 7 64-bit	Catalin Varga	[DONE]
Mac OS X 10.7	Andrei Vaida	[DONE]
Ubuntu 12.04 32-bit	Petruta Rasa	[DONE]

Update Testing

Complete: 17.0.x, 24.x

Platform	Target Version	esrtest	releasetest	esr
Windows XP	Firefox 24.0	PASS	PASS
Windows Vista	Firefox 24.0	PASS	PASS
Windows 7 32-bit	Firefox 24.0	PASS	PASS
Windows 7 64-bit	Firefox 24.0	PASS	PASS
Windows 8 32-bit	Firefox 24.0	PASS	PASS
Windows 8 64-bit	Firefox 24.0	PASS	PASS
Mac OS X 10.6	Firefox 24.0	PASS	PASS
Mac OS X 10.7	Firefox 24.0	PASS	PASS
Mac OS X 10.8	Firefox 24.0	PASS	PASS
Ubuntu 12.04 32-bit	Firefox 24.0	PASS	PASS
Ubuntu 12.04 64-bit	Firefox 24.0	PASS	PASS
Ubuntu 13.04 32-bit	Firefox 24.0	PASS	PASS
Ubuntu 13.04 64-bit	Firefox 24.0	PASS	PASS

Bug Fix Verifications

[DONE] bug 905903 VERIFIED: Properly trace ICTypeMonitor chains for pre-barrier when unlinking them.
[DONE] bug 929261 NO VERIFY: Only generate TypedArray IC stubs on in-bounds accesses.
- May not verify pre-release
[DONE] bug 886850 VERIFIED: Clean up write barriers for ion/baseline scripts.
[DONE] bug 937582 VERIFIED: Fix nsPrefetchNode
- Can only be verified by reporter, who has already verified on one branch. This is probably acceptable.
[DONE] bug 891904 NO VERIFY: Un-schedule full spell check when checker is disabled.
- Issue can't be reproduced in desktop FF; therefore no verification necessary
[DONE] bug 909078 VERIFIED: Pretend the inner table frame is top-of-page if the outer table frame is.
[DONE] bug 921045 VERIFIED: include the new update cert and remove the no longer used Equifax cert.
[DONE] bug 905382 NO VERIFY: register callbacks in workers.
[DONE] bug 909490 NO VERIFY: Add per-zone data for use by embedder.
[DONE] bug 891693 VERIFIED: Make sure that huffval gets zeroed before use.
[DONE] bug 910845 NO VERIFY: Add a wrapper for mmap() in order to keep the high 17-bits of JS pointers cleared on IA64.
- Affects third party use of FF, can be verified by developer and/or parties who use it for their purposes
[DONE] bug 938341 VERIFIED: Clean up nsEventListenerManager
[DONE] bug 919021 NO VERIFY: Convert ctypes over to use JS::AutoValueVector instead of its own array class.
[DONE] bug 922009 NO VERIFY: MOZ_CRASH when trying to transplant objects with SCSWs.
[DONE] bug 930281 VERIFIED: Use nsINode instead of nsIContent.
[DONE] bug 927073 NOT VERIFIED: Binary compatibility broken for maintenance releases due to strict version-script
- We have decided not to verify this, as there isn't a feasible way to do so in the window of time we have.
[DONE] bug 946351 VERIFIED: Update to NSS 3.15.3.1

Issues

New

Known

Full Query

ID	Summary	Priority	Status
801715	Sync: "Warning: Unresponsive script" when changing recovery key / MozTrap test case #2675	--	NEW
856034	Ogg video is muted/unmuted with delay	--	RESOLVED
918864	[FIX] Heap-use-after-free in nsDocLoader::doStopDocumentLoad()	--	RESOLVED
928379	QuickTime controls bar is missing	--	RESOLVED
940378	Multiple issues with Social API sidebar	--	RESOLVED

5 Total; 1 Open (20%); 4 Resolved (80%); 0 Verified (0%);

Firefox 24.3.0 ESR


Builds	FTP, HTTP
ID	20140131092626
Changeset	557a5299bc6a (pushlog)

Checklist

[DONE] Functional automation
[DONE] Manual smoketests
[DONE] Bug fix verifications
[DONE] Update automation on esrtest
[DONE] Conditional sign-off for push to mirrors
[DONE] Update automation on releasetest
[DONE] Final sign-off for push to esr
[DONE] Update automation on esr

Automated Testing

The following are the detailed results of the automated Mozmill test runs.

Platform	Functional [report]
Windows XP	PASS
Windows Vista	PASS
Windows 7 32-bit	PASS
Windows 7 64-bit	PASS
Windows 8 32-bit	PASS
Windows 8 64-bit	PASS
Mac OS X 10.6	PASS
Mac OS X 10.7	PASS
Mac OS X 10.8	PASS
Ubuntu 12.04 32-bit	PASS
Ubuntu 12.04 64-bit	PASS
Ubuntu 13.04 32-bit	PASS
Ubuntu 13.04 64-bit	PASS

Manual Smoketests

Run the Firefox ESR 24.3 Smoke Tests in MozTrap and report the results below.

Platform	Assignee	Result: report
Windows 8 32-bit	Bogdan Maris	[DONE]
Windows 7 64-bit	Andrei Vaida	[DONE]
Mac OS X 10.7	Petruta Rasa	[DONE]
Ubuntu 12.04 32-bit	Alexandra Lucinet	[DONE]

Update Testing

Partial 17.0.x
Complete: 24.x

Platform	Target Version	esrtest	releasetest	esr
Windows XP	Firefox 24.0	PASS	PASS
Windows Vista	Firefox 24.0	PASS	PASS
Windows 7 32-bit	Firefox 24.0	PASS	PASS
Windows 7 64-bit	Firefox 24.0	PASS	PASS
Windows 8 32-bit	Firefox 24.0	PASS	PASS
Windows 8 64-bit	Firefox 24.0	PASS	PASS
Mac OS X 10.6	Firefox 24.0	PASS	PASS
Mac OS X 10.7	Firefox 24.0	PASS	PASS
Mac OS X 10.8	Firefox 24.0	PASS	PASS
Ubuntu 12.04 32-bit	Firefox 24.0	PASS	PASS
Ubuntu 12.04 64-bit	Firefox 24.0	PASS	PASS
Ubuntu 13.04 32-bit	Firefox 24.0	PASS	PASS
Ubuntu 13.04 64-bit	Firefox 24.0	PASS	PASS

Bug Fix Verifications

[DONE] bug 918612 VERIFIED: Mac: Remote profile slow start (mwobensmith)
[DONE] bug 942164 VERIFIED: Store weak references to imgRequest consumers (bogdan)
[DONE] bug 943803 VERIFIED: Use a reentrant monitor instead of unlocking for notifications in RasterImage (bogdan)
[DONE] bug 947592 VERIFIED: Streamline ReportLoadError (bogdan)
[DONE] bug 925896 NO VERIFY: Signaling: Addref when adding sessiondata_t to hash
[DONE] bug 898431 NO VERIFY: Update NSS to NSS 3.15.4
[DONE] bug 932906 NO VERIFY: Exempt Remote XUL from CanCreateWrapper checks
[DONE] bug 950268 VERIFIED: Fix leak in nsCertTree::GetDispInfoAtIndex (Nagasahas)
[DONE] bug 932906 NO VERIFY: Exempt Remote XUL from CanCreateWrapper checks
[DONE] bug 943152 VERIFIED: Remove ChromePowers from mochitest-chrome (mwargers)
[DONE] bug 882933 NO VERIFY: Copy treatAsRunOnce bit when cloning scripts, don't clone scripts unnecessarily for arrow lambdas (gkwong)
[DONE] bug 901348 NO VERIFY: [10.9] Duplicate symbol errors building --with-intl-api
[DONE] bug 960309 NO VERIFY: Make browser_tabview_bug625269.js more reliable (???)
[DONE] bug 951366 VERIFIED: Use AutoDetectInvalidation for disabled GetElement caches (decoder)
[DONE] bug 950438 VERIFIED: IonMonkey: The intersection of two ranges that both contain NaN is not empty (mwobensmith)
[DONE] bug 932162 NO VERIFY: Dispatch IndexedDB FileInfo releases to the main thread
[DONE] bug 903274 NO VERIFY: Have the search bar binding's initialization callback bail out if the binding is destroyed
[DONE] bug 951142 NO VERIFY: Check for a close method to be present on the binding before invoking it
[DONE] bug 777574 NO VERIFY: Skip quickCheckAPI-B2.html on Linux
[DONE] bug 937132 NO VERIFY: SpiderMonkey: Check for overflows in LifoAlloc
[DONE] bug 908915 NO VERIFY: Fix compartment mismatch in shell decompileThis and disassemble functions
[DONE] bug 907689 NO VERIFY: Use example.org as the blocklist URL
[DONE] bug 953114 VERIFIED: Fix GetElementIC typed array issue
[DONE] bug 936056 VERIFIED: Be consistent about the thisobj we pass to getters (mwobensmith)
[DONE] bug 937697 VERIFIED: Simplify some BoundsCheckRange code
[DONE] bug 950590 VERIFIED: Use nsRefPtr for gfxFontGroup's reference to the user font set, and support changing it from canvas context (mwobensmith)
[DONE] bug 950909 NO VERIFY: Remove XPCWrappedJS hack from Codegen.py on branch
[DONE] bug 937152 NO VERIFY: Remove XPCWrappedJS::mMainThread and mMainThreadOnly
[DONE] bug 867505 NO VERIFY: Intermittent test_bug536567_perwindowpb.html
[DONE] bug 950342 NO VERIFY: Random failures in toolkit/components/places/tests/browser/browser_visituri_privatebrowsing_perwindowpb.js
[DONE] bug 950367 NO VERIFY: Random failures in test_bug462106_perwindow.xul
[DONE] bug 893572 VERIFIED: Add tests for Canvas2D (mwobensmith)
[DONE] bug 546169 NO VERIFY: Use an event listener instead of a timeout to avoid intermittent failures
[DONE] bug 949227 NO VERIFY: browser_bug609700.js | Found an unexpected tab at the end of test run: about:blank
[DONE] bug 944128 NO VERIFY: Random failures with test_bug_461710_perwindowpb.html
[DONE] bug 944126 NO VERIFY: Random failures with browser_privatebrowsing_aboutSessionRestore.js
[DONE] bug 944125 NO VERIFY: test_bug602962.xul is racy
[DONE] bug 945667 NO VERIFY: Disable browser_aboutHome.js on Linux due to intermittent failures
[DONE] bug 924307 NO VERIFY: Disable browser_aboutHealthReport.js on Linux due to intermittent failures
[DONE] bug 920952 NO VERIFY: Flush metro test harness output
[DONE] bug 948134 NO VERIFY: Fix "value is not defined" in PlacesDBUtils.jsm
[DONE] bug 921470 VERIFIED: Remove hasFallbackStub_ check in resetMonitorStubChain (decoder)
[DONE] bug 936409 NO VERIFY: Intermittent failure | chrome://mochitests/content/browser/dom/indexedDB/test/browser_perwindow_privateBrowsing.js | Test timed out
[DONE] bug 911864 NO VERIFY: Add annotations to our XBL tests as-needed
[DONE] bug 822425 NO VERIFY: Expose a few simple compartment assertions in jsfriendapi
[DONE] bug 884014 NO VERIFY: Can't build QuartzSupport with 10.9 SDK
[DONE] bug 917526 NO VERIFY: Various duplicate symbol errors building tree with the 10.9 SDK
[DONE] bug 901278 NO VERIFY: More intelligently detect installed Xcode
[DONE] bug 899910 NO VERIFY: Intermittent TEST-UNEXPECTED-FAIL | layout/base/tests/chrome/test_leaf_layers_partition_browser_window.xul
[DONE] bug 941587 NO VERIFY: Intermittent TEST-UNEXPECTED-FAIL | chrome://mochitests/content/browser/toolkit/components/satchel/test/browser/browser_privbrowsing_perwindowpb.js
[DONE] bug 945939 NO VERIFY: Use the pre-split value when numbering values
[DONE] bug 945979 NO VERIFY: Intermittent browser_privatebrowsing_geoprompt.js
[DONE] bug 943793 NO VERIFY: Intermittent TEST-UNEXPECTED-FAIL | chrome://mochitests/content/browser/browser/components/privatebrowsing/test/browser/browser_privatebrowsing_localStorage.js.
[DONE] bug 939084 NO VERIFY: Intermittent browser_social_chatwindow_resize.js
[DONE] bug 936808 NO VERIFY: Serialize calls to PK11 routines in SSLServerCertVerification
[DONE] bug 948067 NO VERIFY: manually update the HSTS preload list for ESR24 once on a CLOSED TREE r=cviecco a=hsts-update
[DONE] bug 898593 NO VERIFY: Fix intermittent failures in test_bug413958.html and others by making SimpleTest.monitorConsole() ignore unexpected messages by default

Issues

New

Full Query

ID	Summary	Priority	Status
965757	Broken CTP doorhanger for embedded PDFs	--	RESOLVED
965780	Video thumbnails bar is flickering on trailers.apple.com after toggling a mouseover/mouseout action	--	RESOLVED
965809	Zoom changes back to default if a paragraph is selected from Document Outline	--	RESOLVED

3 Total; 0 Open (0%); 3 Resolved (100%); 0 Verified (0%);

Known

Full Query

ID	Summary	Priority	Status
801715	Sync: "Warning: Unresponsive script" when changing recovery key / MozTrap test case #2675	--	NEW
856034	Ogg video is muted/unmuted with delay	--	RESOLVED
900925	[Exception... "Component returned failure code: 0x8000ffff (NS_ERROR_UNEXPECTED) [nsIPrefBranch.getCharPref]" nsresult: "0x8000ffff (NS_ERROR_UNEXPECTED)" location: "JS frame :: chrome://browser/content/aboutDialog.js :: init :: line 14" data: no]	--	VERIFIED
918864	[FIX] Heap-use-after-free in nsDocLoader::doStopDocumentLoad()	--	RESOLVED
928379	QuickTime controls bar is missing	--	RESOLVED
940378	Multiple issues with Social API sidebar	--	RESOLVED

6 Total; 1 Open (16.67%); 4 Resolved (66.67%); 1 Verified (16.67%);

Firefox 24.4.0 ESR


Builds	FTP, HTTP
ID	20140315085348
Changeset	4ca6defeab8a (pushlog)

Checklist

[DONE] Functional automation
[DONE] Manual smoketests
[DONE] Bug fix verifications
[DONE] Update automation on esrtest
[DONE] Conditional sign-off for push to mirrors
[DONE] Update automation on releasetest
[DONE] Final sign-off for push to esr
[DONE] Update automation on esr

Automated Testing

The following are the detailed results of the automated Mozmill test runs.

Platform	Functional [report]
Windows XP	PASS
Windows Vista	PASS
Windows 7 32-bit	PASS
Windows 7 64-bit	PASS
Windows 8 32-bit	PASS (two failures, MozMill bugs pending)
Windows 8 64-bit	PASS
Mac OS X 10.6	PASS
Mac OS X 10.7	PASS
Mac OS X 10.8	PASS
Ubuntu 12.04 32-bit	PASS
Ubuntu 12.04 64-bit	PASS
Ubuntu 13.04 32-bit	PASS
Ubuntu 13.04 64-bit	PASS

Manual Smoketests

Run the Firefox ESR 24.4 Smoke Tests in MozTrap and report the results below.

Platform	Assignee	Result: report
Windows 8 32-bit	Andrei Vaida	[DONE]
Windows 7 64-bit	Bogdan Maris	[DONE]
Mac OS X 10.7	Cornel Ionce	[DONE]
Ubuntu 12.04 32-bit	Petruta Rasa	[DONE]

Update Testing

Partial 17.0.x
Complete: 24.x

Platform	Target Version	esrtest	releasetest	esr
Windows XP	Firefox 24.0	PASS	PASS	PASS
Windows Vista	Firefox 24.0	PASS	PASS	PASS
Windows 7 32-bit	Firefox 24.0	PASS	PASS	PASS
Windows 7 64-bit	Firefox 24.0	PASS	PASS	PASS
Windows 8 32-bit	Firefox 24.0	PASS	PASS	PASS
Windows 8 64-bit	Firefox 24.0	PASS	PASS	PASS
Mac OS X 10.6	Firefox 24.0	PASS	PASS	PASS
Mac OS X 10.7	Firefox 24.0	PASS	PASS	PASS
Mac OS X 10.8	Firefox 24.0	PASS	PASS	PASS
Ubuntu 12.04 32-bit	Firefox 24.0	PASS	PASS	PASS
Ubuntu 12.04 64-bit	Firefox 24.0	PASS	PASS	PASS
Ubuntu 13.04 32-bit	Firefox 24.0	PASS	PASS	PASS
Ubuntu 13.04 64-bit	Firefox 24.0	PASS	PASS	PASS

Bug Fix Verifications

bug 982906 VERIFIED: No free lunches! r=bzbarsky, a=lsblakk
bug 982957 VERIFIED: Fix crash if ConstraintTypeSet::sweep or TypeObject::sweep OOMs. r=bhackett, a=lsblakk
bug 982909 VERIFIED: Consistently use inner window when calling OpenJS. r=jst, r=mrbkap, a=lsblakk
bug 896268 OK: Use a stateless approach to synchronous image decoding. r=jdm, a=abillings
- Local ASan build is unstable independent of this bug; bug seems fixed but will retest post-release
bug 940714 NO VERIFY: Add a RAII class to make synchronous decoding safer. r=tn, a=abillings
bug 982974 VERIFIED: Be paranoid about neutering ArrayBuffer objects.
bug 983344 VERIFIED: Length checks on TypedArrays
bug 977538 VERIFIED: Disable PGO for CanonicalizeNaN. r=luke, a=abillings
bug 963974 NO VERIFY: Null mCurrentCompositeTask after calling Cancel() on it. r=mattwoodrow, a=1.2.x+
bug 967341 VERIFIED: uri management r=honzab a=sylvestre
bug 873661 NO VERIFY: Wait both browserloadend and process-created event. r=fabrice, a=test-only
bug 950604 VERIFIED: Backport of a small bugfix that was part of bug 861925
bug 971285 NO VERIFY: Fix intermittent failure in smil/anim-path-d-01.svg. r=dholbert, a=test-only
bug 541855 NO VERIFY: Add in the error tolerance before calling the timing function, so that we allow more error for steeper functions, and less error for most. r=dholbert, a=test-only
bug 965982 NO VERIFY: Thread-safe shutdown r=bent, a=lsblakk
bug 960145 NO VERIFY: IonMonkey: Don't ignore OSR-like values when computing phi ranges. r=mrosenberg, a=sledru
bug 942152 NO VERIFY: NSS stability r=dkeeler, r=honzab, a=sledru
bug 970031 NO VERIFY: Re-apply bug 761077
bug 963324 NO VERIFY: Import mismatch menclose reftests from the MathJax testsuite. r=karlt, a=test-only
bug 912322 VERIFIED: Stop making XBL methods available to the web. r=bz a=sylvestre
bug 894448 NO VERIFY: Move IsChromeOrXBL to xpcpublic.h
bug 925747 VERIFIED: Patch file extraction cleanup. (Kamil) r=bbondy, a=sledru
bug 958867 NO VERIFY: Consistent OwningObject handling in IDBFactory::Create methods. r=bent, a=sledru
bug 968461 NO VERIFY: Fix imgStatusTracker.h to build with gcc 4.4. r=jdm, a=sledru
bug 850721 NO VERIFY: Fix social blocklist oranges by not enabling the default update server. r=mixedpuppy, a=test-only
bug 966311 VERIFIED: Calculate frame size for stereo wave. r=doublec, a=sledru
bug 963198 VERIFIED: Don't mix up byte-size and array-length. r=tn, a=sledru
bug 966021 NO VERIFY: Fix load_truetype_table in the cairo dwrite font backend. r=bas, a=lsblakk
bug 960571 NO VERIFY: Talos https://hg.mozilla.org. r=jgriffin, a=test-only

Issues

New

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

Known

Full Query

ID	Summary	Priority	Status
928379	QuickTime controls bar is missing	--	RESOLVED

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);

Firefox 24.5.0 ESR


Builds	FTP, HTTP
ID	20140421162246
Changeset	2dcea6a55d16 (pushlog)

Checklist

[DONE] Functional automation
[DONE] Manual smoketests
[DONE] Bug fix verifications
[DONE] Update automation on esrtest
{{|}} Conditional sign-off for push to mirrors
[DONE] Update automation on releasetest
{{|}} Final sign-off for push to esr
{{|}} Update automation on esr

Automated Testing

The following are the detailed results of the automated Mozmill test runs.

Platform	Functional [report]
Windows XP	PASS
Windows Vista	PASS
Windows 7 32-bit	PASS
Windows 7 64-bit	PASS
Windows 8 32-bit	PASS
Windows 8 64-bit	PASS
Mac OS X 10.6	PASS
Mac OS X 10.7	PASS
Mac OS X 10.8	PASS
Ubuntu 12.04 32-bit	PASS
Ubuntu 12.04 64-bit	PASS
Ubuntu 13.10 32-bit	PASS
Ubuntu 13.10 64-bit	PASS

Manual Smoketests

Run the Firefox ESR 24.5 Smoke Tests in MozTrap and report the results below.

Platform	Assignee	Result: report
Windows 8 32-bit	Petruta Rasa	[DONE]
Windows 7 64-bit	Catalin Varga	[DONE]
Mac OS X 10.7	Bogdan Maris	[DONE]
Ubuntu 13.04 32-bit	Paul Silaghi	[DONE]

Update Testing

Partial 17.0.x
Complete: 24.x

Platform	Target Version	esrtest	releasetest	esr
Windows XP	Firefox 24.5.0	PASS	PASS
Windows Vista	Firefox 24.5.0	PASS	PASS
Windows 7 32-bit	Firefox 24.5.0	PASS	PASS
Windows 7 64-bit	Firefox 24.5.0	PASS	PASS
Windows 8 32-bit	Firefox 24.5.0	PASS	PASS
Windows 8 64-bit	Firefox 24.5.0	PASS	PASS
Mac OS X 10.6	Firefox 24.5.0	PASS	PASS
Mac OS X 10.7	Firefox 24.5.0	PASS	PASS
Mac OS X 10.8	Firefox 24.5.0	PASS	PASS
Ubuntu 12.04 32-bit	Firefox 24.5.0	PASS	PASS
Ubuntu 12.04 64-bit	Firefox 24.5.0	PASS	PASS
Ubuntu 13.04 32-bit	Firefox 24.5.0	PASS	PASS
Ubuntu 13.04 64-bit	Firefox 24.5.0	PASS	PASS

Bug Fix Verifications

bug 992968 VERIFIED: Out of memory in allocateCache (decoder)
bug 966630 VERIFIED: Clamp level to TexImage operations to [0..31]
bug 993546 NO VERIFY: Refactor malloc-wrapping memory reporter implementations
bug 991471 VERIFIED: Fix offset when setting host on URL
bug 969226 VERIFIED: Check if there is enough data to read u32 to avoid buffer overflow
bug 944353 VERIFIED: If we've had a decoder error then the image is not usable (mwobensmith)
bug 966006 NO VERIFY: Fix DNS issues in ConditionallyRefreshRecord
bug 986843 NO VERIFY: Replace AutoHoldZone with AutoCompartmentRooter.
bug 986678 VERIFIED: Fix type check in TryAddTypeBarrierForWrite.
bug 980537 NO VERIFY: Only store FakeBackstagePass instances in mThisObjects.
bug 989183 VERIFIED: Check for nsXBLJSClass on esr24.
bug 952022 VERIFIED: Add missing detachAsmJSModule
bug 987003 VERIFIED: Be more careful sandboxing javascript: URLs.
bug 961676 VERIFIED: Monitor temp directory usage (kjozwiak)
bug 987140 VERIFIED: Return width/height from the most recent image request.
bug 895557 VERIFIED: Add a test for fragment navigation during load.

Issues

New

Full Query

ID	Summary	Priority	Status
1000108	Switching videos from sd to hd in quicktime is not working properly in Firefox.	P3	RESOLVED
1000297	'Print to File' ignores the chosen location for saving	--	RESOLVED
1000306	[Linux] Tabs From Other Devices become blank on click	--	RESOLVED

3 Total; 0 Open (0%); 3 Resolved (100%); 0 Verified (0%);

Known

Full Query

ID	Summary	Priority	Status
856034	Ogg video is muted/unmuted with delay	--	RESOLVED
928379	QuickTime controls bar is missing	--	RESOLVED
946581	YouTube's HTML5 video context menu is immediately dismissed in Firefox but works in Chrome	--	RESOLVED

3 Total; 0 Open (0%); 3 Resolved (100%); 0 Verified (0%);

Firefox 24.6.0 ESR


Builds	FTP, HTTP
ID	20140609182057
Changeset	f2e036f80683 (pushlog)

Checklist

[DONE] Functional automation
[DONE] Manual smoketests
[DONE] Bug fix verifications
[DONE] Update automation on esrtest
[DONE] Conditional sign-off for push to mirrors
[DONE] Update automation on releasetest
[DONE] Final sign-off for push to esr
[DONE] Update automation on esr

Automated Testing

The following are the detailed results of the automated Mozmill test runs.

Platform	Functional [report]
Windows XP	PASS
Windows Vista	PASS
Windows 7 32-bit	PASS
Windows 7 64-bit	PASS
Windows 8 32-bit	PASS
Windows 8 64-bit	PASS
Mac OS X 10.6	PASS
Mac OS X 10.7	PASS
Mac OS X 10.8	PASS
Ubuntu 12.04 32-bit	PASS
Ubuntu 12.04 64-bit	PASS
Ubuntu 13.10 32-bit	PASS
Ubuntu 13.10 64-bit	PASS

Manual Smoketests

Run the Firefox ESR 24.6 Smoke Tests in MozTrap and report the results below.

Platform	Assignee	Result: report
Windows 8 32-bit	Bogdan Maris	[DONE]
Windows 7 64-bit	Catalin Varga	[DONE]
Mac OS X 10.7	Alexandra Lucinet	[DONE]
Ubuntu 13.04 32-bit	Andrei Vaida	[DONE]

Update Testing

Partial 17.0.x, 24.x.0
Complete: 24.5.0

Platform	Target Version	esrtest	releasetest	esr
Windows XP	Firefox 24.6.0	PASS	PASS	PASS
Windows Vista	Firefox 24.6.0	PASS	PASS	PASS
Windows 7 32-bit	Firefox 24.6.0	PASS	PASS	PASS
Windows 7 64-bit	Firefox 24.6.0	PASS	PASS	PASS
Windows 8 32-bit	Firefox 24.6.0	PASS	PASS	PASS
Windows 8 64-bit	Firefox 24.6.0	PASS	PASS	PASS
Mac OS X 10.6	Firefox 24.6.0	PASS	PASS	PASS
Mac OS X 10.7	Firefox 24.6.0	PASS	PASS	PASS
Mac OS X 10.8	Firefox 24.6.0	PASS	PASS	PASS
Ubuntu 12.04 32-bit	Firefox 24.6.0	PASS	PASS	PASS
Ubuntu 12.04 64-bit	Firefox 24.6.0	PASS	PASS	PASS
Ubuntu 13.04 32-bit	Firefox 24.6.0	PASS	PASS	PASS
Ubuntu 13.04 64-bit	Firefox 24.6.0	PASS	PASS	PASS

Bug Fix Verifications

bug 991981 [DONE] NO VERIFY: Followup fix for ESR24 to properly init TypedArray structs using the provided obj in the constructor, rather than requiring Init to be called after construction.
bug 999651 [DONE] NO VERIFY: More ArrayBuffer neutering cleanup
bug 1005552 [DONE] VERIFIED: Fuss around with marquee some more.
bug 967354 [DONE] VERIFIED: Fix incorrect usage of UpdateWebGLErrorAndClearGLError();
bug 996715 [DONE] VERIFIED: Remove the code that bails when determining if the second instruction in a chunk is a branch.
bug 1007940 [DONE] VERIFIED: Improve the performance of editor initialization.
bug 983709 [DONE] VERIFIED: Simple branch patch for uplift.
bug 978811 [DONE] VERIFIED: Fix isFakeExitFrame to return true for entry frames.
bug 1000185 [DONE] VERIFIED: Perform synchronous SMIL sample after registering with refresh driver, not before, for consistency.
bug 995603 [DONE] VERIFIED: Ensure mouse-enter/exit events are sent to plugins as appropriate (reland after esr24-specific changes).
bug 992274 [DONE] VERIFIED: Tweak an edge case in line number handling.
bug 994907 [DONE] NO VERIFY: imgDecoderObserver does reference counting on different threads, so should be using thread safe reference counting.

Issues

New

Full Query

ID	Summary	Priority	Status
1020763	[OSX] 24.6.0-ESR: cannot click on player controls (Flash, Silverlight)	--	RESOLVED
1020925	PDF viewer page number textfield disabled when Toggle Sidebar is open	--	RESOLVED
1021815	Flash hide mouse cursor broken in ESR24.6.0	--	RESOLVED

3 Total; 0 Open (0%); 3 Resolved (100%); 0 Verified (0%);

Known

Full Query

ID	Summary	Priority	Status
856034	Ogg video is muted/unmuted with delay	--	RESOLVED
928379	QuickTime controls bar is missing	--	RESOLVED
946581	YouTube's HTML5 video context menu is immediately dismissed in Firefox but works in Chrome	--	RESOLVED
1000108	Switching videos from sd to hd in quicktime is not working properly in Firefox.	P3	RESOLVED
1000297	'Print to File' ignores the chosen location for saving	--	RESOLVED
1000306	[Linux] Tabs From Other Devices become blank on click	--	RESOLVED

6 Total; 0 Open (0%); 6 Resolved (100%); 0 Verified (0%);

Firefox 24.7.0 ESR

Builds	FTP, HTTP
ID	20140714155506
Changeset	1061c4065849 (pushlog)

Checklist

[DONE] Functional automation
[DONE] Manual smoketests
[DONE] Bug fix verifications
[DONE] Update automation on esrtest
[DONE] Conditional sign-off for push to mirrors
[DONE] Update automation on releasetest
[DONE] Final sign-off for push to esr
[DONE] Update automation on esr

Automated Testing

The following are the detailed results of the automated Mozmill test runs.

Platform	Functional [report]
Windows XP	PASSED
Windows Vista	PASSED
Windows 7 32-bit	PASSED
Windows 7 64-bit	PASSED
Windows 8 32-bit	PASSED
Windows 8 64-bit	PASSED
Mac OS X 10.6	PASSED
Mac OS X 10.7	PASSED
Mac OS X 10.8	PASSED
Ubuntu 12.04 32-bit	PASSED
Ubuntu 12.04 64-bit	PASSED
Ubuntu 13.10 32-bit	PASSED
Ubuntu 13.10 64-bit	PASSED

Manual Smoketests

Run the Firefox ESR 24.7 Smoke Tests in MozTrap and report the results below.

Platform	Assignee	Result: [report]
Windows 8 32-bit	Cornel Ionce	[DONE]
Windows 7 64-bit	Alexandra Lucinet	[DONE]
Mac OS X 10.7	Andrei Vaida	[DONE]
Ubuntu 13.04 32-bit	Petruta Rasa	[DONE]

Update Testing

Partial 17.0.x, 24.x.0
Complete: 24.5.0

Platform	Target Version	esrtest	releasetest	esr
Windows XP	Firefox 24.7.0	PASSED	PASSED	PASSED
Windows Vista	Firefox 24.7.0	PASSED	PASSED	PASSED
Windows 7 32-bit	Firefox 24.7.0	PASSED	PASSED	PASSED
Windows 7 64-bit	Firefox 24.7.0	PASSED	PASSED	PASSED
Windows 8 32-bit	Firefox 24.7.0	PASSED	PASSED	PASSED
Windows 8 64-bit	Firefox 24.7.0	PASSED	PASSED	PASSED
Mac OS X 10.6	Firefox 24.7.0	PASSED	PASSED	PASSED
Mac OS X 10.7	Firefox 24.7.0	PASSED	PASSED	PASSED
Mac OS X 10.8	Firefox 24.7.0	PASSED	PASSED	PASSED
Ubuntu 12.04 32-bit	Firefox 24.7.0	PASSED	PASSED	PASSED
Ubuntu 12.04 64-bit	Firefox 24.7.0	PASSED	PASSED	PASSED
Ubuntu 13.04 32-bit	Firefox 24.7.0	PASSED	PASSED	PASSED
Ubuntu 13.04 64-bit	Firefox 24.7.0	PASSED	PASSED	PASSED

Bug Fix Verifications

bug 913805 [DONE] VERIFIED: Hold a lock on the RasterImage in ScaleRequest so that the srcFrame doesn't go away if we need to discard images to free up memory. r=seth, a=abillings
bug 919592 [DONE] VERIFIED: Ionmonkey (ARM): Guard against branches being out of range and bail out of compilation if so. r=mjrosenb, a=sledru
bug 995603 [DONE] VERIFIED: Ensure mouse-enter/exit events are sent to plugins as appropriate. r=mstange a=abillings
bug 1012694 [DONE] VERIFIED: IonMonkey (ARM): Use the second scratch register to avoid clobbering the scratch register. r=dougc, a=abillings
bug 1018234 [DONE] VERIFIED: Reference count fontFaces. r=jfkthame, a=sledru
bug 1019003 [DONE] NO VERIFY: ESR24 backport of a visibility warning-fix. r=trivial, a=sledru
bug 1019684 [DONE] VERIFIED: Appease the style checker gods. r=jandem, a=orange
bug 1020695 [DONE] NO VERIFY: Upgrade NSS to version 3.16.2 RTM. r=wtc, a=abillings
bug 1022785 [DONE] NO VERIFY: Disable android snippets for reftests/crashtests/jsreftests. r=jmaher, a=test-only
bug 1023121 [DONE] NO VERIFY: Update our progress in docloader before calling state change listeners. r=smaug, a=sledru
bug 1024765 [DONE] NO VERIFY: Make refcounting logic around PostTimerEvent more explicit. r=bz, a=sledru
bug 1033340 [DONE] VERIFIED: Uplift recent PSL changes to Firefox 24

Issues

New

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

Known

Full Query

ID	Summary	Priority	Status
619040	Misplaced geolocation doorhanger when using fullscreen mode with Dual Monitors	--	NEW
913747	PDF viewer page number textfield disabled after using Aero Snap to resize the Firefox window	P2	RESOLVED
928379	QuickTime controls bar is missing	--	RESOLVED
1000108	Switching videos from sd to hd in quicktime is not working properly in Firefox.	P3	RESOLVED

4 Total; 1 Open (25%); 3 Resolved (75%); 0 Verified (0%);

Firefox 24.8.0 ESR

Windows

Builds	FTP, HTTP
ID	20140825140210 (Win)
Changeset	420be099bad9 (pushlog)

OSX & Linux

Builds	FTP, HTTP
ID	20140825054619 (OSX) (Linux)
Changeset	420be099bad9 (pushlog)

Checklist

[DONE] Functional automation
[DONE] Manual smoketests
[DONE] Bug fix verifications
[DONE] Update automation on esrtest
[DONE] Conditional sign-off for push to mirrors
[DONE] Update automation on releasetest
[DONE] Final sign-off for push to esr
[DONE] Update automation on esr

Automated Testing

The following are the detailed results of the automated Mozmill test runs.

Platform	Functional [report]
Windows XP	PASSED
Windows Vista	PASSED
Windows 7 32-bit	PASSED
Windows 7 64-bit	PASSED
Windows 8 32-bit	PASSED
Windows 8 64-bit	PASSED
Mac OS X 10.6	PASSED
Mac OS X 10.7	PASSED with 1 Failure bug 1023206
Mac OS X 10.8	PASSED
Ubuntu 12.04 32-bit	PASSED
Ubuntu 12.04 64-bit	PASSED
Ubuntu 13.10 32-bit	PASSED
Ubuntu 13.10 64-bit	PASSED

Manual Smoketests

Run the Firefox ESR 24.8 Smoke Tests in MozTrap and report the results below.

Platform	Assignee	Result: report
Windows 8 32-bit	Cornel Ionce	[DONE]
Windows 7 64-bit	Camelia Badau	[DONE]
Mac OS X 10.7	Bogdan Maris	[DONE]
Ubuntu 14.04 32-bit	Mihaela Velimiroviciu	[DONE]

Update Testing

Partial 17.0.x, 24.x.0
Complete: 24.5.0

Platform	Target Version	esrtest	releasetest	esr
Windows XP	Firefox 24.8.0	PASSED	PASSED	PASSED
Windows Vista	Firefox 24.8.0	PASSED	PASSED	PASSED
Windows 7 32-bit	Firefox 24.8.0	PASSED	PASSED	PASSED
Windows 7 64-bit	Firefox 24.8.0	PASSED	PASSED	PASSED
Windows 8 32-bit	Firefox 24.8.0	PASSED	PASSED	PASSED
Windows 8 64-bit	Firefox 24.8.0	PASSED	PASSED	PASSED
Mac OS X 10.6	Firefox 24.8.0	PASSED	PASSED	PASSED
Mac OS X 10.7	Firefox 24.8.0	PASSED	PASSED	PASSED
Mac OS X 10.8	Firefox 24.8.0	PASSED	PASSED	PASSED
Ubuntu 12.04 32-bit	Firefox 24.8.0	PASSED	PASSED	PASSED
Ubuntu 12.04 64-bit	Firefox 24.8.0	PASSED	PASSED	PASSED
Ubuntu 13.04 32-bit	Firefox 24.8.0	PASSED	PASSED	PASSED
Ubuntu 13.04 64-bit	Firefox 24.8.0	PASSED	PASSED	PASSED

Bug Fix Verifications

bug 1054359 [DONE] VERIFIED: Add is-object check to IonBuilder::makeCallHelper. r=efaust, a=abillings
bug 1037641 [DONE] VERIFIED: Split SetDirectionFromChangedTextNode into TextNodeWillChangeDirection and TextNodeChangedDirection. r=ehsan, a=abillings
bug 1041148 [DONE] NO VERIFY: Move HoldJSObjects call to XMLHttpRequest constructor to simplify the code. r=bz, a=lmandel
bug 701479 [DONE] NO VERIFY: Remove usage of EnumPrintersW to test if port is FILE:. nsDeviceContextSpecWin shouldn't start UI for asking for a filename nor query all possible printers. r=jimm, a=lsblakk

Issues

New

Full Query

ID	Summary	Priority	Status
1059310	Add-ons are updated while sync'ed between machines	--	RESOLVED

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);

Known

Full Query

ID	Summary	Priority	Status
913747	PDF viewer page number textfield disabled after using Aero Snap to resize the Firefox window	P2	RESOLVED
928379	QuickTime controls bar is missing	--	RESOLVED
1000108	Switching videos from sd to hd in quicktime is not working properly in Firefox.	P3	RESOLVED
1000306	[Linux] Tabs From Other Devices become blank on click	--	RESOLVED
1058010	Re-enabling a service from about:addons page will not automatically enable the sidebar.	--	RESOLVED

5 Total; 0 Open (0%); 5 Resolved (100%); 0 Verified (0%);

Firefox 24.8.1 ESR

Builds	FTP, HTTP
ID	20140923194127
Changeset	1a4ef6655b21 (pushlog)

Checklist

[DONE] Functional automation
[DONE] Manual smoketests
[DONE] Bug fix verifications
[DONE] Update automation on esrtest
[DONE] Conditional sign-off for push to mirrors
[DONE] Update automation on releasetest
[DONE] Final sign-off for push to esr
[DONE] Update automation on esr

Automated Testing

The following are the detailed results of the automated Mozmill test runs.

Platform	Functional [report]
Windows XP	PASSED
Windows Vista	PASSED
Windows 7 32-bit	PASSED
Windows 7 64-bit	PASSED
Windows 8 32-bit	PASSED
Windows 8 64-bit	PASSED
Mac OS X 10.6	PASSED
Mac OS X 10.7	PASSED
Mac OS X 10.8	PASSED
Ubuntu 12.04 32-bit	PASSED
Ubuntu 12.04 64-bit	PASSED
Ubuntu 13.10 32-bit	PASSED
Ubuntu 13.10 64-bit	PASSED

Manual Smoketests

Exploratory testing focused on: Browsing secure sites, Web compatibility, Add-on & Plug-in compatibility, Common media format playback, Sync & Persona sign-on. Results are at: https://mozqa.etherpad.mozilla.org/ESR31-24-Testing.

Platform	Assignee	Result: report
Windows 8.1 32-bit	Andrei Vaida	[DONE]
Windows 7 64-bit	Cornel Ionce	[DONE]
Mac OS X 10.9.5	Alexandra Lucinet	[DONE]
Ubuntu 14.04 32-bit	Mihaela Velimiroviciu	[DONE]

Update Testing

Partial 17.0.x, 24.x.0
Complete: 24.5.0

Platform	Target Version	esrtest	releasetest	esr
Windows XP	Firefox 24.8.1	PASSED	PASSED	PASSED
Windows Vista	Firefox 24.8.1	PASSED	PASSED	PASSED
Windows 7 32-bit	Firefox 24.8.1	PASSED	PASSED	PASSED
Windows 7 64-bit	Firefox 24.8.1	PASSED	PASSED	PASSED
Windows 8 32-bit	Firefox 24.8.1	PASSED	PASSED	PASSED
Windows 8 64-bit	Firefox 24.8.1	PASSED	PASSED	PASSED
Mac OS X 10.6	Firefox 24.8.1	PASSED	PASSED	PASSED
Mac OS X 10.7	Firefox 24.8.1	PASSED	PASSED	PASSED
Mac OS X 10.8	Firefox 24.8.1	PASSED	PASSED	PASSED
Ubuntu 12.04 32-bit	Firefox 24.8.1	PASSED	PASSED	PASSED
Ubuntu 12.04 64-bit	Firefox 24.8.1	PASSED	PASSED	PASSED
Ubuntu 13.04 32-bit	Firefox 24.8.1	PASSED	PASSED	PASSED
Ubuntu 13.04 64-bit	Firefox 24.8.1	PASSED	PASSED	PASSED

Bug Fix Verifications

bug 1064636 [DONE] VERIFIED: Update NSS to latest version r=rrelyea, a=lmandel
bug 1069405 [DONE] VERIFIED: Update NSS to latest version r=rrelyea, a=lmandel

Issues

New

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

Known

Full Query

ID	Summary	Priority	Status
591893	Undo or cancel the installation of add-ons in search pane doesn't list them anymore in "Available Add-ons"	--	RESOLVED
864912	startup crash in mozilla::layers::CrossProcessCompositorParent::AllocPLayers	--	RESOLVED
870779	Video area is also shown for audio files	--	RESOLVED
913747	PDF viewer page number textfield disabled after using Aero Snap to resize the Firefox window	P2	RESOLVED
928379	QuickTime controls bar is missing	--	RESOLVED
942130	360p max resolution for WebM HTML5 Videos on Youtube	--	RESOLVED
947079	Passive mixed content indicator (grey triangle) shows up on full HTTPS sites that have no mixed content	--	RESOLVED
1000108	Switching videos from sd to hd in quicktime is not working properly in Firefox.	P3	RESOLVED
1000306	[Linux] Tabs From Other Devices become blank on click	--	RESOLVED
1010976	Hitting the "Hide Controls" option twice causes the container area to disappear	--	VERIFIED
1021703	Black screen in google street view	--	RESOLVED
1058010	Re-enabling a service from about:addons page will not automatically enable the sidebar.	--	RESOLVED
1059310	Add-ons are updated while sync'ed between machines	--	RESOLVED
1059726	Hide Controls/Show Controls displays fullscreen button for audio files.	--	RESOLVED

14 Total; 0 Open (0%); 13 Resolved (92.86%); 1 Verified (7.14%);

Releases/Firefox 24 ESR/Test Plan

Contents

Firefox 24 ESR

Automated Tests

Manual Smoketests

Bug Fix Verifications

Issues

Firefox 24.1.0 ESR

Automated Testing

Manual Smoketests

Update Testing

Bug Fix Verifications

Issues

New

Known

Firefox 24.1.1 ESR

Automated Testing

Regression Testing

Update Testing

Issues

New

Known

Firefox 24.2.0 ESR

Automated Testing

Manual Smoketests

Update Testing

Bug Fix Verifications

Issues

New

Known

Firefox 24.3.0 ESR

Automated Testing

Manual Smoketests

Update Testing

Bug Fix Verifications

Issues

New

Known

Firefox 24.4.0 ESR

Automated Testing

Manual Smoketests

Update Testing

Bug Fix Verifications

Issues

New

Known

Firefox 24.5.0 ESR

Automated Testing

Manual Smoketests

Update Testing

Bug Fix Verifications

Issues

New

Known

Firefox 24.6.0 ESR

Automated Testing

Manual Smoketests

Update Testing

Bug Fix Verifications

Issues

New

Known

Firefox 24.7.0 ESR

Automated Testing

Manual Smoketests

Update Testing

Bug Fix Verifications

Issues

New

Known

Firefox 24.8.0 ESR

Automated Testing

Manual Smoketests

Update Testing

Bug Fix Verifications

Issues

New

Known

Firefox 24.8.1 ESR

Automated Testing