Releases/Firefox 3.5.15/BuildNotes

From MozillaWiki
Jump to: navigation, search

Notes About Releasing

Please update the Release:Primer for future releases (bug fixes, changes to automation) as needed

Build Engineers

bhearsum, nthomas
bug 607240

Signed-off Revision(s)

Build 1: a16bdaafa0ea

L10N changesets

Tags

Build # Tag Changeset
1 FIREFOX_3_5_15_RELEASE FIREFOX_3_5_15_BUILD1 bb324a17c2b1

Build data

Build # Type Build ID Build machine Time to build
1 Linux 20101026195820 mv-moz2-linux-ix-slave12 34m31s
Mac 20101026200251 bm-xserve19 1h22min
Windows 20101026205513 mw32-ix-slave20 1h30min

Notes

using pm02

Build 1

  • Marked pm02, any release, all builders for a clobber with clobberer
  • No slave movement prior to kicking off automation because pm02 already has Linux slaves
  • Landed updated automation config
  • Updated configs-default and buildbotcustom
  • Removed *.pyc
  • Manually tagged buildbot-configs, buildbotcustom, tools with FIREFOX_3_5_15_RELEASE and FIREFOX_3_5_15_BUILD1
  • Ran 'buildbot checkconfig'
  • Ran 'buildbot reconfig .
  • Kicked off automation with:
buildbot sendchange --username=bhearsum --master=localhost:9010 --branch=releases/mozilla-1.9.1 -m "Firefox 3.5.15 build1" Go
  • Moved some additional slaves to pm02:
    • mw32-ix-slave06,07,09,14,20
    • bm-xserve15,19

Tag

No problems. Reopened the tree after tagging finished.

Source

No problems with Firefox or XULRunner source.

XULRunner Builds

  • Linux: no problems
  • Windows: no problems
  • Mac: failed with:
/builds/slave/xulrunner_macosx_build/build/build/macosx/universal/unify: compareZipArchives: zip archives differ:
  obj-firefox/ppc/dist/xulrunner/XUL.framework/Versions/1.9.1.14pre/chrome/toolkit.jar,
  obj-firefox/i386/dist/xulrunner/XUL.framework/Versions/1.9.1.14pre/chrome/toolkit.jar
/builds/slave/xulrunner_macosx_build/build/build/macosx/universal/unify: compareZipArchives: members differ:
  content/global/buildconfig.html
make[1]: *** [postflight_all] Error 1
make: *** [build] Error 2
    • Caused by XULRunner not being clobbered bug 607756
    • Rekicked with force build, passed.

Build/Repack

  • Linux en-US: no problems
  • Most Linux repacks failed out due to a pty issue on mv-moz2-linux-ix-slave20. Restarted failed ones with:
# on bhearsum's laptop:
hg clone http://hg.mozilla.org/build/tools
cd tools/buildbot-helpers
wget -Oshipped-locales --no-check-certificate  http://hg.mozilla.org/releases/mozilla-1.9.1/raw-file/bb324a17c2b1/browser/locales/shipped-locales
# Edited shipped-locales, removed the the locales that didn't fail:
# ca, en-US, el, eo, it, mr, oc, ta-LK
# and also ja-JP-mac
# and appended 'linux' to the end of all lines
cat shipped-locales

af linux
ar linux
as linux
be linux
bg linux
bn-BD linux
bn-IN linux
cs linux
cy linux
da linux
de linux
en-GB linux
es-AR linux
es-CL linux
es-ES linux
es-MX linux
et linux
eu linux
fa linux
fi linux
fr linux
fy-NL linux
ga-IE linux
gl linux
gu-IN linux
he linux
hi-IN linux
hr linux
hu linux
id linux
is linux
ja linux
ka linux
kk linux
kn linux
ko linux
ku linux
lt linux
lv linux
mk linux
ml linux
mn linux
nb-NO linux
nl linux
nn-NO linux
or linux
pa-IN linux
pl linux
pt-BR linux
pt-PT linux
rm linux
ro linux
ru linux
si linux
sk linux
sl linux
sq linux
sr linux
sv-SE linux
ta linux
te linux
th linux
tr linux
uk linux
vi linux
zh-CN linux
zh-TW linux

PYTHONPATH=~/Mozilla/checkouts/ python force_release_l10n.py -m http://production-master02.build.mozilla.org:8010 -t FIREFOX_3_5_15_RELEASE -v -s shipped-locales -n bhearsum

Once the Linux repacks were completed, double checked that we had the right amount with (expecting 75 according to http://hg.mozilla.org/releases/mozilla-1.9.1/file/FIREFOX_3_5_15_RELEASE/browser/locales/shipped-locales): 

# ffxbld@stage
cd /home/ftp/pub/firefox/nightly/3.5.15-candidates/build1/linux-i686
ls -1 | grep -v xpi | wc -l
  • Mac en-US: no problems
  • Mac repacks: no problems
  • Win32 en-US: no problems
  • Win32 repacks: no problems

Sign

Removed en-US.xpi from candidates directory

To speed up signing, did the following on keymaster prior to repacks finishing: 

PRODUCT=firefox
VERSION=3.5.15
BUILD=1
TAG=FIREFOX_3_5_15_RELEASE
REPO='releases/mozilla-1.9.1'
EMAIL=bhearsum@mozilla.com
KEYDIR=d:/2010-keys
cd ~/hg-tools
hg pull && hg up -r ${TAG}
mkdir ~/signing-work/${PRODUCT}-${VERSION}
cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .
make df verify-gpg-passphrase setup verify-signcode-passphrase PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1
# download target run multiple times to get things as they complete
make download PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1

Once all the repacks finished, ran the following in the same window to do the signing: 

# Need to download one more time to make sure we've got everything
make download PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1
make stubs sign2 stage verify fake-upload PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1

And then to upload: 

make postsign PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL}

L10N Verify

Only diffs are absolute paths in mac repacks.

Updates

bug 607564 upload_snippets failed with: 

rsync -av -e ssh -oIdentityFile=~/.ssh/cltbld_dsa aus2.test/ cltbld@aus2-staging.mozilla.org:/opt/aus2/snippets/staging/20101026-Firefox-3.5.15-test
....
Permission denied (publickey).

rsync: connection unexpectedly closed (0 bytes received so far) [sender]
rsync error: unexplained error (code 255) at io.c(463) [sender=2.6.8]

Second run failed during commit_verify_configs (bug 607570): 

hg commit ...
nothing changed
program finished with exit code 1

Disabled self.bumpVerifyConfigs() in ReleaseUpdatesFactory (http://diff.pastebin.mozilla.org/827934), reconfigured the master, reran updates.

Reverted the patch and reconfigured the master after updates builder finished.

Update Verify

  • Linux: PASS
  • Mac: PASS
  • Win32: PASS

Move slaves back

Moved the following back to their original masters:

  • mw32-ix-slave06,09,14
  • bm-xserve19, moz2-darwin9-slave46

Major Update Generation (-> 3.6.12)

Used 'force build' to start the major_update builder.

The first forced run was triggered before the patch made for updates builder was reverted and the master was reconfigured. The builder skipped the update verify bump step, so all MU update verify builders failed.

Forced the second run.

Verification

  • mn fails for all platforms, normal and expected.
  • sl blurts the following, normal and expected:
Only in source/firefox/searchplugins: iskalnik-gov-si.xml
Only in source/firefox/searchplugins: najdi-si.xml
Only in source/firefox/searchplugins: yahoo.xml
  • Linux: nothing else, PASS
  • Win32: the usual .chk file differences:
Files source/bin/freebl3.chk and target/bin/freebl3.chk differ
Files source/bin/nssdbm3.chk and target/bin/nssdbm3.chk differ
Only in source/bin: removed-files
Files source/bin/softokn3.chk and target/bin/softokn3.chk differ
  • Mac: the usual mac differences:
diff -r source/Firefox.app/Contents/MacOS/defaults/pref/channel-prefs.js target/Firefox.app/Contents/MacOS/defaults/pref/channel-prefs.js
1c1
< //@line 2 "/builds/moz2_slave/macosx_build/build/browser/app/profile/channel-prefs.js"
---
> //@line 2 "/builds/slave/macosx_build/build/browser/app/profile/channel-prefs.js"
Only in source/Firefox.app/Contents: Plug-Ins
Contents of source/Firefox.app/Contents/Plug-Ins dir only in source or target
61374947        0 drwxr-xr-x    3 cltbld   staff         102 Oct 26 21:16 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin
61374949        0 drwxr-xr-x    4 cltbld   staff         136 Oct 27 08:49 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents
61374952        0 drwxr-xr-x    2 cltbld   staff          68 Oct 27 08:49 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/MacOS
61374953        0 drwxr-xr-x    3 cltbld   staff         102 Oct 26 21:16 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/Resources
61374958        0 drwxr-xr-x    3 cltbld   staff         102 Oct 27 08:49 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/Resources/English.lproj
61374959        0 drwxr-xr-x    2 cltbld   staff          68 Oct 27 08:49 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/Resources/English.lproj/PrintPDE.nib

Socorro product data updates

Added '3.5.15' and '3.5.16pre' to crash-stats with this admin page.

Update Bouncer

Added by forcing bouncer_submitter builder

Final checks before push

# ffxbld@stage
cd /pub/mozilla.org/firefox/nightly/3.5.15-candidates/build1/
find . ! -user ffxbld # (anything in contrib/ is ok)
find . ! -group firefox
find . -type f ! -perm 644
find . -mindepth 1 -type d ! -perm 755 ! -name 'contrib*'
find . -maxdepth 1 -type d ! -perm 2775  -name 'contrib*'

contrib/solaris_pkgadd and solaris_tarball were 755 (g+s), which is OK too.

Virus check

# cltbld@stage
clamdscan /mnt/netapp/stage/archive.mozilla.org/pub/firefox/nightly/3.5.15-candidates/build1/

Push to mirrors

justdave ran this command directly on ftp01 rather than us running it on stage, because it can go faster when run there: 

rsync -av --exclude="*reporter*" --exclude=*.log --exclude=*.txt --exclude=*unsigned* /pub/mozilla.org/firefox/nightly/3.5.15-candidates/build1/ /pub/mozilla.org/firefox/releases/3.5.15/

We did this part still: 

# cltbld@stage
vim -n /pub/mozilla.org/zz/rsyncd-mozilla-current.exclude
# replace 3.5.14 with 3.5.15

Final verify

Some of the CDNs redirected back to pv-mirror01 (because of store-and-forward caching), which didn't have all of the files yet. It got the files pretty quickly after final verify finished.

Push updates to release channel

# cltbld@aus2-staging
~/bin/backupsnip 20101027-Firefox-3.5.15
~/bin/pushsnip 20101027-Firefox-3.5.15

The release channel was then unthrottled, bug 607795. Later we pushed to beta 

~/bin/pushsnip 20101027-Firefox-3.5.15-beta

and reopened bug 607795 to update the throttling again.

Release

# ffxbld@stage
cd /home/ftp/pub/firefox/releases/
rm latest-3.5 && ln -s 3.5.15 latest-3.5

Sent the following to metrics@mozilla.com 

Firefox,firefox,firefox,3.5.15,3.5
Firefox,firefox,firefox,3.5.16pre,3.5

Push 3.5.15 -> 3.6.12 MU

# cltbld@aus2-staging
~/bin/backupsnip 20101027-Firefox-3.5.15-3.6.12-MU
~/bin/pushsnip 20101027-Firefox-3.5.15-3.6.12-MU

These are throttled.

XULRunner

Signing

Signed with: 

PRODUCT=xulrunner
VERSION=1.9.1.15
BUILD=1
TAG=FIREFOX_3_5_15_RELEASE
REPO="releases/mozilla-1.9.1"
EMAIL=lsblakk@mozilla.com
KEYDIR=d:/2010-keys

mkdir -p ~/signing-work/${PRODUCT}-${VERSION}
cd ~/signing-work/${PRODUCT}-${VERSION}
cd ~/hg-tools
hg pull
hg up -r ${TAG}

cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .

make setup PRODUCT=${PRODUCT} VERSION=${VERSION} \
  BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1
rsync -av -e "ssh -i /home/cltsign/.ssh/xrbld_dsa" \
  --exclude=*.txt --exclude=*-symbols.zip \
  xrbld@stage.mozilla.org:/home/ftp/pub/${PRODUCT}/nightly/${VERSION}-candidates/build${BUILD}/ \
 unsigned-build${BUILD}
rsync -av --exclude=unsigned unsigned-build${BUILD}/ \
 signed-build${BUILD}/
rsync -av unsigned-build${BUILD}/unsigned/ \
 signed-build${BUILD}/

make checksum-files create-sigs stage verify-sigs \
  PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} \
  REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1

rmdir signed-build${BUILD}/contrib{,-localized}

rsync -av -e "ssh -i /home/cltsign/.ssh/xrbld_dsa" \
  signed-build${BUILD}/ \
  xrbld@stage.mozilla.org:/home/ftp/pub/${PRODUCT}/nightly/${VERSION}-candidates/build${BUILD}/

Push XULRunner to mirrors

  1. xrbld@stage
rsync -av --exclude=*.txt --exclude=*unsigned* --exclude=*symbols.zip \
/pub/mozilla.org/xulrunner/nightly/1.9.1.15-candidates/build1/  \
/pub/mozilla.org/xulrunner/releases/1.9.1.15/


Edited cltbld@stage:/pub/mozilla.org/zz/rsyncd-mozilla-releases.exclude and added 

- xulrunner/releases/1.9.1.14

...to exclude the previous release.

Update XULRunner wiki

Update the links in these two wiki pages for the version change. NOTE: make sure to update all the links on the page!!!

Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_3.5.15/BuildNotes&oldid=264588"