SeaMonkey:Release Process:2.0rc2

From MozillaWiki
Jump to: navigation, search

Build Harness

SeaMonkey:Release Automation

Bugs

Tracking bug filed as bug 522409

Build Engineer

Robert Kaiser

Signed-off Revisions

http://hg.mozilla.org/comm-central/rev/8c3a7a74702c
http://hg.mozilla.org/releases/mozilla-1.9.1/rev/e178dbd2a389
http://hg.mozilla.org/dom-inspector/rev/f1fc2297e2c5
http://hg.mozilla.org/venkman/rev/74a705e85ad0
chatzilla CVS timestamp: 2009-10-14 00:00

L10n revisions according to opt-ins as listed in l10n-changesets

Build 2

All versions stay unchanged, with the following exceptions:

Trees that had no relbranchOverride now come from COMM1914_20091015_RELBRANCH
New revisions:
http://hg.mozilla.org/comm-central/rev/acaa5081b109
http://hg.mozilla.org/releases/mozilla-1.9.1/rev/49342a1d9d93

Notes

Build

  • Updated shipped-locales, l10n-changesets, release-config.py
  • Kicked off with the following command:
buildbot sendchange --username=kairo --master=localhost:9010 --branch=comm-central -m "SeaMonkey 2.0rc2build1" doit
  • Had forgotten to undo the change from RC1 that excluded tagging comm-central (!) so everything but that one was tagged. Commented out all others for tagging for a second run and kicked off again.
  • The source factory choked because a leftover directory from the first run was still in place, had to trigger it again manually.
  • Stopped macosx_build manually after word came in that 1.9.1.4 needs another respin, which directly affects us.

Build 2

  • Updated release-config.py and undid all the commenting-out in tagging from previous run
  • Kicked off with the following command:
buildbot sendchange --username=kairo --master=localhost:9010 --branch=comm-central -m "SeaMonkey 2.0rc2build2" doit
  • The tagging strangeness with RC1 found its prolongation: comm-central had a differently named relbranch due to different dates, I pushed a removeal of the RC2 tag to the same relbranch name as the others based off the other relbranch, and then kicked off the release automation again.

Signing

We have no signing infrastructure for SeaMonkey right now, so I faked the signing step that is usually done after completion of builds and L10n repacks and before the update generation.

Logged onto stage-old.mozilla.org and ran fakesign.sh as documented in 2.0b1 notes.

Updates and Verification

  • l10n_verify and updates started automatically, triggered by the fake-signing, the update verification steps all were triggered by the updates step completing.
    • Win32 verification is red for NSS .chk file differences, which is expected.
    • Linux and Mac verification is green.

Build 3

  • Looks like the Firefox build process removed the SeaMonkey build2 tags from mozilla-1.9.1, so I updated release_config.py for a build3 and commented out all tagging except the Mozilla repo in release_master.py
  • Kicked off with the following command:
buildbot sendchange --username=kairo --master=localhost:9010 --branch=comm-central -m "SeaMonkey 2.0rc2build3" doit

Build 3 - Signing

We have no signing infrastructure for SeaMonkey right now, so I faked the signing step that is usually done after completion of builds and L10n repacks and before the update generation.

Logged onto stage-old.mozilla.org and ran fakesign.sh as documented in 2.0b1 notes.

Build 3 - Updates and Verification

  • l10n_verify and updates started automatically, triggered by the fake-signing, the update verification steps all were triggered by the updates step completing.
    • Win32 verification is red for NSS .chk file differences, which is expected. Additionally, CRC errors for partial updates show up with nssdbm3.chk - I tested updates myself on a Windows machine and saw this is a real error, after investigation I filed it as bug 522943 and manually restarted the update factory after checking in the likely fix to the patcher config.
    • Linux and Mac verification is green.
  • After the manually started regeneration of updates completed, I also manually started update verification steps on all platforms again.
    • Win32 verification is red for NSS .chk file differences, which is expected. Partial updates now apply correctly without errors and only fail the check because of differing .chk files again.
    • Linux verification is green.

Copy ZIPs

Used zipcopy.sh as documented in 2.0b1 notes to provide ZIPs along with the installers for Windows.

Copy Language Packs

Used langpackmove.sh as documented in 2.0b1 notes to move the langpacks into the directory we want them in for release.

Create Checksums

With make-checksums.sh which I created last time around, I created MD5SUMS and SHA1SUMS files containing all files we release. Also, I copied the README from last time and modified it as needed.

Push To Mirrors

With mirrorpush.sh, containing the line documented in 2.0b1 notes, I finally pushed the files to the public dir for mirrors to pick them up.

Final Verification

  • Used 'Force Build' to start the final_verification builder, most tested URLs are HTTP 200 and 302, some 404s on one server that seems to not have fully synched yet, getting in touch with IT to correct determination of sync finish.
  • Used 'Force Build' again on it, all tested URLs are HTTP 200 and 302 - everything good to go!

Publish Updates to the beta channel

~/bin/backupsnip 20091017-SeaMonkey-2.0rc2
~/bin/pushsnip 20091017-SeaMonkey-2.0rc2

Create and publish updates for the release channel

RC1 was, as all RCs, shipped with the "release" channel set, so we also need to provide the RC1->RC2 updates on that channel.

First, create the release snippets by converting the beta snippets: 

rsync -av /opt/aus2/snippets/staging/20091017-SeaMonkey-2.0rc2/ /opt/aus2/snippets/staging/20091017-SeaMonkey-2.0rc2-release
cd /opt/aus2/snippets/staging/20091017-SeaMonkey-2.0rc2-release/SeaMonkey/
rm -rf 2.0a* 2.0b*
for dir in 2.0/*/*/*; do mv -v $dir/beta $dir/release; done
cd /opt/aus2/snippets/staging/

Then, push those release snippets: 

~/bin/backupsnip 20091017-SeaMonkey-2.0rc2-release
~/bin/pushsnip 20091017-SeaMonkey-2.0rc2-release

Wall Clock Time

Build

  • buildbot sendchange: Wed Oct 14 18:52:03 PDT 2009
  • tag:
    • Start: Wed Oct 14 19:22:52 2009
    • End: Wed Oct 14 19:33:28 2009 (tagged everything but comm-central due to forgotten commenting in release_master.py)
    • Elapsed: 10 mins, 36 secs
  • buildbot sendchange: Thu Oct 15 04:51:13 PDT 2009
  • tag:
    • Start: Thu Oct 15 04:58:12 2009
    • End: Thu Oct 15 04:59:32 2009
    • Elapsed: 1 mins, 20 secs
  • source:
    • Start: Thu Oct 15 06:15:01 2009
    • End: Thu Oct 15 06:24:31 2009
    • Elapsed: 9 mins, 29 secs
  • linux_build:
    • Start: Thu Oct 15 04:59:43 2009
    • End: Thu Oct 15 06:06:18 2009
    • Elapsed: 1 hrs, 6 mins, 34 secs
  • win32_build:
    • Start: Thu Oct 15 04:59:32 2009
    • End: Thu Oct 15 07:29:39 2009
    • Elapsed: 2 hrs, 30 mins, 6 secs
  • macosx_build:
    • Start: Thu Oct 15 08:58:36 2009
    • End: Thu Oct 15 09:41:05 2009 (manually stopped after word came that we need a respin)
  • linux_repack (19 locales):
    • Start: Thu Oct 15 07:11:28 2009
    • End: Thu Oct 15 07:47:30 2009
  • win32_repack (19 locales):
    • Start: Thu Oct 15 07:50:34 2009
    • End: Thu Oct 15 09:31:32 2009
  • macosx_repack (19 locales):
    • Never started for build 1

Build 2

  • buildbot sendchange: Fri Oct 16 04:57:41 PDT 2009
  • tag:
    • Start: Fri Oct 16 06:16:25 2009
    • End: Fri Oct 16 06:17:14 2009 (failed pulling the right relbranch for DOMi as comm-central had a different relbranch name than all the others)
    • Elapsed: 49 secs
  • buildbot sendchange: Fri Oct 16 06:51:12 PDT 2009
  • tag:
    • Start: Fri Oct 16 07:31:28 2009
    • End: Fri Oct 16 07:45:55 2009
    • Elapsed: 14 mins, 26 secs
  • source:
    • Start: Fri Oct 16 07:45:55 2009
    • End: Fri Oct 16 07:58:30 2009
    • Elapsed: 12 mins, 35 secs
  • linux_build:
    • Start: Fri Oct 16 08:55:27 2009
    • End: Fri Oct 16 10:22:41 2009
    • Elapsed: 1 hrs, 27 mins, 13 secs
  • win32_build:
    • Start: Fri Oct 16 08:47:45 2009
    • End: Fri Oct 16 11:05:47 2009
    • Elapsed: 2 hrs, 18 mins, 2 secs
  • macosx_build:
    • Start: Fri Oct 16 11:16:51 2009
    • End: Fri Oct 16 15:52:19 2009
    • Elapsed: 4 hrs, 35 mins, 27 secs
  • linux_repack (19 locales):
    • Start: Fri Oct 16 10:22:41 2009
    • End: Fri Oct 16 11:02:17 2009
  • win32_repack (19 locales):
    • Start: Fri Oct 16 11:23:18 2009
    • End: Fri Oct 16 13:05:14 2009
  • macosx_repack (19 locales):
    • Start: Fri Oct 16 17:58:56 2009
    • End: Fri Oct 16 20:02:20 2009
  • updates:
    • Start: Fri Oct 16 20:51:15 2009
    • End: Fri Oct 16 21:26:33 2009
    • Elapsed: 35 mins, 17 secs

Signing

Done manually at Fri Oct 16 20:46 PDT 2009

Verification

  • l10n_verify:
    • Start: Fri Oct 16 20:51:15 2009
    • End: Fri Oct 16 21:31:20 2009
    • Elapsed: 40 mins, 5 secs
  • linux_update_verify:
    • Start: Fri Oct 16 21:26:33 2009
    • End: Fri Oct 16 21:40:03 2009
    • Elapsed: 13 mins, 30 secs
  • win32_update_verify:
    • Start: Fri Oct 16 21:53:23 2009
    • End: Fri Oct 16 22:08:09 2009
    • Elapsed: 14 mins, 46 secs
  • macosx_update_verify:
    • Start: Fri Oct 16 23:47:42 2009
    • End: Sat Oct 17 01:46:02 2009
    • Elapsed: 1 hrs, 58 mins, 19 secs

Build 3

  • buildbot sendchange: Sat Oct 17 06:59:53 PDT 2009
  • tag:
    • Start: Sat Oct 17 06:59:54 2009
    • End: Sat Oct 17 07:11:00 2009
    • Elapsed: 11 mins, 6 secs
  • source:
    • Start: Sat Oct 17 07:11:00 2009
    • End: Sat Oct 17 07:24:16 2009
    • Elapsed: 13 mins, 16 secs
  • linux_build:
    • Start: Sat Oct 17 08:21:07 2009
    • End: Sat Oct 17 09:26:39 2009
    • Elapsed: 1 hrs, 5 mins, 31 secs
  • win32_build:
    • Start: Sat Oct 17 07:51:50 2009
    • End: Sat Oct 17 10:20:44 2009
    • Elapsed: 2 hrs, 28 mins, 53 secs
  • macosx_build:
    • Start: Sat Oct 17 09:56:17 2009
    • End: Sat Oct 17 14:00:52 2009
    • Elapsed: 4 hrs, 4 mins, 35 secs
  • linux_repack (19 locales):
    • Start: Sat Oct 17 10:09:29 2009
    • End: Sat Oct 17 11:13:32 2009
  • win32_repack (19 locales):
    • Start: Sat Oct 17 10:20:44 2009
    • End: Sat Oct 17 11:34:13 2009
  • macosx_repack (19 locales):
    • Start: Sat Oct 17 14:00:53 2009
    • End: Sat Oct 17 15:32:40 2009
  • updates:
    • Start: Sat Oct 17 15:38:03 2009
    • End: Sat Oct 17 16:19:57 2009
    • Elapsed: 41 mins, 53 secs
  • updates (with bug 522943 fix):
    • Start: Sun Oct 18 06:04:57 2009
    • End: Sun Oct 18 07:07:08 2009
    • Elapsed: 1 hrs, 2 mins, 10 secs

Build 3 - Signing

Done manually at Sat Oct 17 15:34 2009

Build 3 - Verification

  • l10n_verify:
    • Start: Sat Oct 17 15:38:03 2009
    • End: Sat Oct 17 16:17:37 2009
    • Elapsed: 39 mins, 33 secs
  • linux_update_verify:
    • Start: Sat Oct 17 16:19:57 2009
    • End: Sat Oct 17 16:31:10 2009
    • Elapsed: 11 mins, 12 secs
  • win32_update_verify:
    • Start: Sat Oct 17 16:19:57 2009
    • End: Sat Oct 17 17:12:27 2009
    • Elapsed: 52 mins, 29 secs
  • macosx_update_verify:
    • Start: Sat Oct 17 17:09:13 2009
    • End: Sat Oct 17 18:23:37 2009
    • Elapsed: 1 hrs, 14 mins, 23 secs
  • linux_update_verify (after regenerating updates with bug 522943 fix):
    • Start: Sun Oct 18 07:10:33 2009
    • End: Sun Oct 18 07:25:26 2009
    • Elapsed: 14 mins, 52 secs
  • win32_update_verify (after regenerating updates with bug 522943 fix):
    • Start: Sun Oct 18 07:10:42 2009
    • End: Sun Oct 18 07:24:23 2009
    • Elapsed: 13 mins, 41 secs
  • macosx_update_verify (after regenerating updates with bug 522943 fix):
    • Start: Sun Oct 18 07:10:50 2009
    • End: Sun Oct 18 08:50:10 2009
    • Elapsed: 1 hrs, 39 mins, 19 secs
  • final_verification (triggered manually after mirror push):
    • Start: Mon Oct 19 07:47:40 2009
    • End: Mon Oct 19 07:50:49 2009 (red with a mirror not fully updated)
    • Elapsed: 3 mins, 8 secs
  • final_verification (triggered manually after sentry correction to check for tr locale builds):
    • Start: Mon Oct 19 09:09:16 2009
    • End: Mon Oct 19 09:16:37 2009
    • Elapsed: 7 mins, 20 secs
Retrieved from "https://wiki.mozilla.org/index.php?title=SeaMonkey:Release_Process:2.0rc2&oldid=176850"