Releases/Firefox 4.0b12/BuildNotes

From MozillaWiki
Jump to: navigation, search

Notes About Releasing

Please update the Release:Primer for future releases (bug fixes, changes to automation) as needed

Build Engineers

nthomas - bug 631731

Signed-off Revision(s)

L10N changesets

Tags

Build # Tag Changeset
1 GECKO20b12_2011022218_RELBRANCH 42e7f9088975
FIREFOX_4_0b12_BUILD1 FIREFOX_4_0b12_RELEASE d322a1c8537e

Build data

Build # Type Build ID Build machine Time to build
1 Linux [compressed .tar.bz2] 20110222205441 moz2-linux-slave43 2hr 7min (VM!)
Linux64 [compressed .tar.bz2] 20110222212644 moz2-linux64-slave02 1hr 7min
Mac [.dmg] 20110222205430 moz2-darwin10-slave46 4hr 23min
Win32 [.exe/.zip] 20110222210221 mw32-ix-slave06 3hr 7min

Build 1

We're on pm01 for this release.

Setup

cd /builds/buildbot/builder_master1
PYTHONPATH=/builds/buildbot/builder_master1:/builds/buildbot/builder_master1/tools/lib/python python /builds/buildbot/builder_master1/tools/buildbot-helpers/release_sanity.py -u nthomas -V 4.0b12 --branch mozilla-central --build-number 1 -c release-firefox-mozilla-2.0.py --dryrun localhost:9010
PYTHONPATH=/builds/buildbot/builder_master1:/builds/buildbot/builder_master1/tools/lib/python python /builds/buildbot/builder_master1/tools/buildbot-helpers/release_sanity.py -u nthomas -V 4.0b12 --branch mozilla-central --build-number 1 -c release-firefox-mozilla-2.0.py localhost:9010

Tag

The ku locale failed to complete tagging. After applying the tags we check for outgoing changesets and for any incoming changesets that race us: 

command: START
command: hg -q out --template '{node} {branches}\\n' -e 'ssh -l ffxbld -i ~cltbld/.ssh/ffxbld_dsa' ssh://hg.mozilla.org/l10n-central/ku
command: cwd: ku
command: output:
abort: no suitable response from remote hg!
command: END (0.22 elapsed)

command: START
command: hg pull -e 'ssh -l ffxbld -i ~cltbld/.ssh/ffxbld_dsa' ssh://hg.mozilla.org/l10n-central/ku
command: cwd: ku
command: output:
remote: ssh_exchange_identification: Connection closed by remote host^M
abort: no suitable response from remote hg!
command: END (0.21s elapsed)

It then successfully retries the hg out and strips the two new changesets, suspect there's a bug here. Filed bug 636103 for investigation.

Fix: 

# cltbld@mv-moz2-linux-ix-slave04
cd /builds/slave/rel-cen-tag/ku
hg unbundle .hg/strip-backup/5f7ec1f49f63-backup.hg
hg unbundle hg unbundle .hg/strip-backup/0fb34c4abef6-backup.hg
hg -q out --template '{node} {branches}\\n' -e 'ssh -l ffxbld -i ~cltbld/.ssh/ffxbld_dsa' ssh://hg.mozilla.org/l10n-central/ku
5f7ec1f49f63aadc147bc31e122289138a3bbb6f GECKO20b12_2011022218_RELBRANCH
0fb34c4abef6ddc523548f9732321aa1b5f0b7c6 GECKO20b12_2011022218_RELBRANCH
hg push -e 'ssh -l ffxbld -i ~cltbld/.ssh/ffxbld_dsa' --new-branch ssh://hg.mozilla.org/l10n-central/ku

Restarted the release adding 

releaseConfig['skip_tag']    = True

to release-firefox-mozilla-2.0.py locally, reconfiging and calling 

buildbot sendchange --username nthomas --master localhost:9010 --branch mozilla-central -p release_config:mozilla/release-firefox-mozilla-2.0.py -p script_repo_revision:FIREFOX_4_0b12_RELEASE release_build

Got a second tagging started email to r-d, which you could argue was unnecessary for a Dummy factory. Filed bug 636083.

The skip_tag was reverted and picked up as part of the reconfig for bug 636621 on 2011-02-24.

Source

Both Firefox and XULRunner source builders got VM slaves, and failed in the create_bundle step with 

62712 changesets found
command timed out: 1200 seconds without output, killing pid 1535

So that's the default 20 minute timeout for a buildbot step. Filed bug 636101

Used Rebuild to get fast slaves.

Build/Repack

win32_repack_6/6 failed after getting a VM and timing out cloning m-c for 20 minutes. Used Rebuild to get a fast slave. Otherwise green.

Unittests

Ignored any results for tests on compile slaves, since those are to be disabled. Finding failures in the absence of TBPL for Firefox-Release. Use self-serve sort on Status an Builder name.

  • Rev3 Fedora 12 release-mozilla-central opt test reftest - known orange bug 633566
  • Rev3 Fedora 12x64 release-mozilla-central opt test mochitests-5/5 - known orange bug 608206
  • Rev3 Fedora 12x64 release-mozilla-central opt test xpcshell - known orange bug 619920 plus unknown fail
TEST-UNEXPECTED-FAIL | /home/cltbld/talos-slave/test/build/xpcshell/tests/toolkit/components/places/tests/unit/test_async_history_api.js | test failed (with xpcshell return code: 0), see following log:
TEST-UNEXPECTED-FAIL | /home/cltbld/talos-slave/test/build/xpcshell/tests/toolkit/components/places/tests/unit/test_async_history_api.js | 2 == 3 - See following stack:
    • sdwilsh says this 'is ignorable'
  • Rev3 MacOSX Leopard 10.5.8 release-mozilla-central talos dirty - known orange bug 567401
  • Rev3 MacOSX Snow Leopard 10.6.2 release-mozilla-central opt test reftest - known orange bug 633566 again
  • Rev3 WINNT 5.1 release-mozilla-central opt test mochitest-other - probably known orange bug 632290

Update Bouncer

Failed because the bs locale isn't in product-details. rail filed bug 636087. Worked around below.

XULRunner Build

No problems with linux, linux64 or win32 builds. Mac build failed to upload with a known issue with the checksums bug 634809.

Fix: 

# cltbld@moz2-darwin10-slave44
cd /builds/slave/rel-cen-xr-osx64-bld/build/obj-firefox/x86_64/dist/sdk
scp -i ~/.ssh/xrbld_dsa \
 xulrunner-2.0b12.en-US.mac-x86_64.sdk.tar.bz2 \
 xrbld@stage.mozilla.org:/pub/mozilla.org/xulrunner/nightly/2.0b12-candidates/build1/sdk/

Signing

Autosign to be used, Build:CombinedSigning.

XULRunner Signing

#!/bin/bash
set -x
set -e

PRODUCT=xulrunner
VERSION=2.0b12
BUILD=1
TAG=FIREFOX_4_0b12_RELEASE
REPO="mozilla-central"
EMAIL=nthomas@mozilla.com
KEYDIR=d:/2010-keys

cd ~/hg-tools
hg pull
hg up -r ${TAG}

mkdir -p ~/signing-work/${PRODUCT}-${VERSION}
cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .

make setup PRODUCT=${PRODUCT} VERSION=${VERSION} \
  BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1
rsync -av -e "ssh -i /home/cltsign/.ssh/xrbld_dsa" \
  --exclude=*.txt --exclude=*-symbols.zip \
  xrbld@stage.mozilla.org:/home/ftp/pub/${PRODUCT}/nightly/${VERSION}-candidates/build${BUILD}/ \
 unsigned-build${BUILD}
rsync -av --exclude=unsigned unsigned-build${BUILD}/ \
 signed-build${BUILD}/
rsync -av unsigned-build${BUILD}/unsigned/ \
 signed-build${BUILD}/

make checksum-files create-sigs stage verify-sigs \
  PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} \
  REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1

rmdir signed-build${BUILD}/contrib{,-localized}

rsync -av -e "ssh -i /home/cltsign/.ssh/xrbld_dsa" \
  signed-build${BUILD}/ \
  xrbld@stage.mozilla.org:/home/ftp/pub/${PRODUCT}/nightly/${VERSION}-candidates/build${BUILD}/

L10N Verify

All platforms were red. Logs are useless for figuring out why.

Updates

worked as expected (green)

Update Verify

worked as expected (green). Some locales leave some searchplugins behind on a complete update.

bn-BD: 

Only in source/bin/searchplugins: answers.xml
Only in source/bin/searchplugins: cellbazaar.xml
Only in source/bin/searchplugins: clickbd.xml
Only in source/bin/searchplugins: creativecommons.xml

da: 

Only in source/bin/searchplugins: answers.xml
Only in source/bin/searchplugins: creativecommons.xml
Only in source/bin/searchplugins: yahoo-dk.xml

fi: 

Only in source/bin/searchplugins: creativecommons-fi.xml
Only in source/bin/searchplugins: huuto-fi.xml

hr: 

Only in source/bin/searchplugins: creativecommons.xml

ja/ja-JP-mac: 

Only in source/bin/searchplugins: creativecommons.xml

They do get removed by a partial. Follow up with Axel for next release. Some of these may not be removable because other locales still use them, eg answers.xml, creativecommons.xml.

Some mac updates have 

Only in source/Firefox.app: force_plist_reload

Some have that for completes only, some for partials only, and one has both. That's from bug 600098, which starts talking about major update transitions, so we're probably fine for 4.0b* -> b12 updates. We may have to add force_plist_reload to the force list in the patcher config. Why the inconsistency ? Follow up before next release.

Permissions and virus check

Now autotriggered, both green.

Socorro product data updates

Someone else already added 4.0b12 as unfeatured (for now). Added 4.0b13pre and set it to featured, removing feature from 4.0b12pre.

Update Bouncer

Usual procedure failed due to missing locale in Tuxedo (bug 636087).

Applied a patch allowing adding Bouncer products w/o specifying locales which was backed out after forcing the builder. The patch was applied to production-0.8 branch only.


Push to mirrors

Ran "push_to_mirrors" builder with the following properties set: 

   Your name: jhford (optional)
   Reason for build: push to mirrors (optional)
   Branch to build: mozilla-central (optional)
   Revision to build: FIREFOX_4_0b12_RELEASE (mandatory)
   Property 1 Name: release_config Value: mozilla/release-firefox-mozilla-2.0.py (mandatory)

There was an exception because of a missing 'script_repo_revision' property, filled out form again and forced another build 

   Your name: jhford (optional)
   Reason for build: push to mirrors (optional)
   Branch to build: mozilla-central (optional)
   Revision to build: FIREFOX_4_0b12_RELEASE (mandatory)
   Property 1 Name: release_config Value: mozilla/release-firefox-mozilla-2.0.py (mandatory)
   Property 2 Name: script_repo_revision Value: FIREFOX_4_0b12_RELEASE

Received a FULL STOP due to bug636766, currently under investigation but might not be an issue.

Investigation revealed that this is not an issue and we are still underway

Push snippets to beta channel

# ssh cltbld@aus2-staging, run in screen
cd /opt/aus2/snippets/staging/
time ~/bin/backupsnip 20110222-Firefox-4.0b12
real	11m22.688s
user	0m2.225s
sys	0m11.010s

time ~/bin/pushsnip 20110222-Firefox-4.0b12
real    5m17.024s
user    0m2.010s
sys     0m10.913s

Send mail to metrics

Firefox,firefox,firefox,4.0b12,4.0
Firefox,firefox,firefox,4.0b13pre,4.0

Release

# cltbld@stage.mozilla.org
cd /pub/mozilla.org/zz/

Update rsync exclude files to take last release off mirrors. Check 

grep 4.0b11 rsyncd-mozilla-*releases.exclude
rsyncd-mozilla-prereleases.exclude:- firefox/releases/4.0b11
rsyncd-mozilla-releases.exclude:- firefox/releases/4.0b11

Push XULRunner to mirrors

# xrbld@stage
rsync -av --exclude=*.txt --exclude=*unsigned*  --exclude=*-symbols.zip \
  /pub/mozilla.org/xulrunner/nightly/2.0b12-candidates/build1/ \
  /pub/mozilla.org/xulrunner/releases/2.0b12/

Note for 4.0rc1: Edited cltbld@stage:/pub/mozilla.org/zz/rsyncd-mozilla-{pre,}releases.exclude and add 

- xulrunner/releases/2.0b12

Update XULRunner entries on wiki

Updated the links in these two wiki pages for the version change:

Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_4.0b12/BuildNotes&oldid=290656"