Releases/Firefox 16.0/BuildNotes

From MozillaWiki
Jump to: navigation, search

Checklist

Bugs hit

  • bug 785965 - failed on copy of new index.html
  • bug 799654 - symbol upload should retry upon name resolution failure

Notes

  • Tracking bug: bug 782990
  • Release engineer: kmoir
  • Buildbot master: bm13 bm12

Build 1

Starting the automation

  • Set reserved_slaves to 8 and locked slaves on bm13
  • Created milestones for Fennec and Firefox using the l10n dashboard & downloaded changesets (still need to ship them)
    • Fennec
      • Clicked "Ship", then "Ship it" (to confirm that I wanted to ship even though there were pending signoffs - verified with Pike that was okay).
      • Clicked "Shipping Tools"
      • Made sure "android" was the only platform listed, and "android-multilocale" was listed for multi-locale file, then clicked "Add"
      • Made sure "releases/mozilla-beta", "default", "mobile/android/locales/maemo-locales" were in the new fields, then clicked "l10n-changesets.json"
      • Downloaded the changesets from the resulting link
    • Firefox
  • Landed config updates, transplanted to the production branch
  • Tagged buildbot-configs, buildbotcustom, tools with {FIREFOX,FENNEC}_16_0_{RELEASE,BUILD1}
  • Updated and reconfiged bm13
  • Was talking to bhearsum in irc and he said that release builds should be run from bm12. So: set reserved_slaves to 0 on bm13 and unlocked slaves on bm13, set reserved slaves to 8 on bm13 and locked appropriate slaves.
  • Ran release sanity:
cd /builds/buildbot/build1/master
source ../bin/activate
PYTHONPATH=. python ../tools/buildbot-helpers/release_sanity.py -u kmoir \
   -V 16.0 --branch mozilla-release --build-number 1 \
   --release-config release-firefox-mozilla-release.py \
   --release-config release-fennec-mozilla-release.py --products firefox,fennec  \
   --dryrun localhost:9001
  • Had the following errors
2012-10-05 15:18:48,179 : INFO : Comparing fennec mozconfigs to nightly mozconfigs...
2012-10-05 15:18:49,689 : ERROR : found in mobile/android/config/mozconfigs/android-armv6/release but not in mobile/android/config/mozconfigs/android-armv6/nightly: ac_add_options --enable-updater
2012-10-05 15:18:49,690 : ERROR : found in mobile/android/config/mozconfigs/android-armv6/release but not in mobile/android/config/mozconfigs/android-armv6/nightly: ac_add_options --with-branding=mobile/android/branding/official
2012-10-05 15:18:49,690 : WARNING : ac_add_options --with-branding=mobile/android/branding/beta not in android-armv6 ['ac_add_options --enable-update-channel=nightly', 'ac_add_options --enable-update-channel=${MOZ_UPDATE_CHANNEL}', 'ac_add_options --enable-warnings-as-errors', 'ac_add_options --with-ccache=/usr/bin/ccache']!
2012-10-05 15:18:49,690 : ERROR : found in mobile/android/config/mozconfigs/android-armv6/nightly but not in mobile/android/config/mozconfigs/android-armv6/release: ac_add_options --with-branding=mobile/android/branding/beta
2012-10-05 15:18:50,887 : ERROR : Error verifying mozconfigs

 bhearsum i see the problem
 bhearsum	https://hg.mozilla.org/releases/mozilla-release/file/ddb22ac6c03b/mobile/android/config/mozconfigs/android-armv6/nightly has beta  branding
 bhearsum	and the mozconfig comparison expcets nightly & release to be thesame
 bhearsum	so, we can ignore this error too, because release branding is correct
 bhearsum	i'll file a bug for lsblakk to fix the nightly branding

Ran build with bypass-check to override errors:

cd /builds/buildbot/build1/master
source ../bin/activate
PYTHONPATH=. python ../tools/buildbot-helpers/release_sanity.py -u kmoir \
   -V 16.0 --branch mozilla-release --build-number 1 \
   --release-config release-firefox-mozilla-release.py \
   --release-config release-fennec-mozilla-release.py --products firefox,fennec  \
   --bypass-check localhost:9001

release-mozilla-release-xulrunner_linux_build and release-mozilla-release-xulrunner_linux64_build

failed with ssh: symbols1.dmz.phx1.mozilla.com: Temporary failure in name resolution
reran those builds and the completed successfully 

release-mozilla-release-xulrunner_push_to_mirrors failed the first time, reran it sucessfully after bug 785965 was fixed

Traceback (most recent call last):
  File "/builds/slave/rel-m-rel-xr-psh-mrrrs/scripts/scripts/release/stage-tasks.py", line 244, in <module>
    buildNumber=buildNumber)
  File "/builds/slave/rel-m-rel-xr-psh-mrrrs/scripts/scripts/release/stage-tasks.py", line 159, in makeIndexFiles
    scp(indexFile.name, '%s@%s:%s/index.html' % (stageUsername, stageServer, candidates_dir))
  File "/builds/slave/rel-m-rel-xr-psh-mrrrs/scripts/scripts/release/../../lib/python/util/transfer.py", line 8, in scp
    return run_cmd(cmd)
  File "/builds/slave/rel-m-rel-xr-psh-mrrrs/scripts/scripts/release/../../lib/python/util/commands.py", line 42, in run_cmd
    return subprocess.check_call(cmd, **kwargs)
  File "/tools/python-2.7.2/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 511, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['scp', '-o', 'BatchMode=yes', '/var/folders/30/yq_p3wk15yb9wdsv6sm_m0v00000gn/T/tmp8mETcm', 'xrbld@stage.mozilla.org:/pub/mozilla.org/xulrunner/nightly/16.0-candidates/build1//index.html']' returned non-zero exit status 1

Sign Android Builds

Ran the following as cltsign@signing1:

cd ~/signing-work/mozharness
hg pull -u && hg up -C
cd ..
python2.6 mozharness/scripts/sign_android.py --config-file signing/android_mozilla-release.py

r-d was mailed automatically.

Push to mirrors

Failed first time - bug 785965 on copy of index.html to server (hwine).

Reset reserved slaves

Reset to 0 on bm12.

Publish Fennec

Google Play

Published through the Google Play store per docs.

Push the files

Edited ~ffxbld/push_fennec.sh on stage to point at 16.0 build1 and android/androidv6, ran it.

Apply throttling

bhearsum landed patch for https://bugzilla.mozilla.org/show_bug.cgi?id=797429
Opened bug with IT to enable the throttling https://bugzilla.mozilla.org/show_bug.cgi?id=799473 

Run pushsnip

# ffxbld@aus3-staging.mozilla.org
cd /opt/aus2/snippets/staging
~/bin/pushsnip Firefox-16.0-build1

Ran before IT applied to patch to enable throttling. Ben noticed that this happened and changed the permissions on the directory to hide the updates.

After the patched was applied, I chmod /opt/aus2/incoming/3/Firefox back to 755 on aus3-staging.

Update bouncer links

I didn't have rights to bouncer admin, bhearsum added them for me. Updated /firefox/releases/15.0.1/win32/:lang/Firefox%20Setup%2015.0.1.exe to /firefox/releases/16.0/win32/:lang/Firefox%20Setup%2016.0.exe

Verify throttling

https://aus3.mozilla.org/update/1/Firefox/10.0.2/20120215223356/Darwin_x86_64-gcc3-u-i386-x86_64/ta/release/update.xml  should be empty          
https://aus3.mozilla.org/update/1/Firefox/10.0.2/20120215223356/Darwin_x86_64-gcc3-u-i386-x86_64/ta/release/update.xml?force=1 should have the update

Update XULRunner wiki pages

Delayed due to bug 785965, bhearsum removed index.html files manually and I updated the pages.

Post Release tasks

Started "post release" builder with "force build"

Update browser choice website

Opened bug 799556