ReferencePlatforms/Test/Mac
Contents
Talos on Mac
Important: Do _NOT_ upgrade past 10.4.8. hdiutil has a bug/feature in 10.4.9 and above that prevents Talos Buildbot's from working properly.
OS Setup
- Change the resolution
- System Preferences -> Displays
- Select 1024x768
- Turn off the screen saver
- System Preferences -> Desktop & Screen Saver
- Move 'Start screen saver' to 'Never'
- Autohide the dock
- Turn off sleep
- System Preferences -> Energy Saver
- "Put the computer to sleep when it is inactive for..." Never
- 'put the display to sleep' Never
- uncheck 'Put the hard disk(s) to sleep when possible'
- In options set dock to autohide
- Create a 'mozqa' account
- System Preferences -> Accounts -> press '+' to add account
- Username : mozqa, 'Allow user to administrate this computer' checked
- in 'Login Items' add Terminal (Applications -> Utilities -> Terminal)
- handy to have this on startup
- Enable VNC
- System Preferences -> Sharing
- Make sure 'Apple Remote Desktop' is checked.
- Click 'Access Privileges'
- Change the VNC password
- Install the mozqa ssh key in ~/.ssh
- Enable autologin
- System Preferences -> Accounts -> Login Options -> Automatically login as 'mozqa'
XCode Installation
- The next step is to retrieve the Mac reference platform packages from CVS:
export CVS_RSH=ssh ocvs -d :ext:unittest@cvs.mozilla.org:/mofo co ref-platforms/mac
- Install Xcode
- Mount the Xcode dmg
- Double click on XcodeTools.mpkg
- In the 'Installation Type' section choose 'Customize' and enable everything under 'Cross-Development'
Wget
curl https://ftp.gnu.org/pub/gnu/wget/wget-1.10.2.tar.gz > wget-1.10.2.tar.gz tar -zvxf wget-1.10.2.tar.gz cd wget-1.10.2 ./configure --prefix=/usr make sudo make install
BuildBot Setup
Install Python 2.4.4
- Download and install MacPython
wget https://www.python.org/ftp/python/2.4.4/python-2.4.4-macosx2006-10-18.dmg hdiutil attach python-2.4.4-macosx2006-10-18.dmg cd /Volumes/Univeral\ MacPython\ 2.4.4 sudo installer -pkg MacPython.mpkg -target / cd .. hdiutil detach /Volumes/Univeral\ MacPython\ 2.4.4
- You must logout and log back in to make sure you are using the new version of Python.
Install Twisted and Zope-Interface
wget https://twistedmatrix.com/Releases/Twisted/2.4/Twisted-2.4.0.tar.bz2 tar -jvxf Twisted-2.4.0.tar.bz2 cd Twisted-2.4.0 cd ZopeInterface-3.1.0c1 python setup.py build sudo python setup.py install cd ../TwistedCore-2.4.0/ python setup.py build sudo python setup.py install cd .. python setup.py build sudo python setup.py install cd ..
Install BuildBot
ocvs -d:pserver:anonymous@cvs-mirror.mozilla.org:/cvsroot co -d buildbot mozilla/tools/buildbot cd buildbot python setup.py build sudo python setup.py install cd .. rm -rf buildbot/
Talos Setup
Install PyYAML
wget https://pyyaml.org/download/pyyaml/PyYAML-3.05.tar.gz tar -zvxf PyYAML-3.05.tar.gz cd PyYAML-3.05 python setup.py build sudo python setup.py install
Setting up a Talos Buildbot slave
How to setup a Buildbot Talos slave (replace the master.host, username, and password with the correct values)
cd ~ mkdir talos-slave buildbot create-slave --umask=002 talos-slave master.host:9989 username password
Edit the buildbot.tac file to have keepalive = None
You should then start the slave once to create the proper directory structure.
buildbot start talos-slave buildbot stop talos-slave
When running Buildbot slaves on Mac you must start it from a Terminal window in VNC and leave that window open (even though it's a daemon process). hdiutil will throw errors if you do not.
Apache Setup
Install apache from https://httpd.apache.org/download.cgi (use unix source) - the copy of apache bundled with the mac is too old.
In the apache directory:
./configure --prefix=/etc/apache2 make make install
Stop the built in apache:
sudo apachectl stop
The DocumentRoot will be dependent on the builddir of your Buildbot slave. In this section that directory will be referred to as $BUILDDIR.
For machines in the pool of slaves, $BUILDDIR should be 'talos-data'.
Pageset
You will need to install a pageset in /Users/mozqa/pages
The rest
- Create an empty directory so Apache doesn't complain:
cd ~/talos-slave/$BUILDDIR mkdir talos
- Open up /etc/apache2/httpd/httpd.conf and change both references of "/Library/WebServer/Documents" to "/Users/mozqa/talos-slave/$BUILDDIR/talos".
Add an alias so Apache knows where the pageset is. Add this to your configuration file:
Alias /page_load_test/pages /Users/mozqa/pages <Directory /Users/mozqa/pages> Options Indexes Order allow,deny Allow from all </Directory>
Turn off logging, remove any lines that begin with "CustomLog"
- replace the old apache install with the new apache2 install
mv /usr/sbin/apachectl /usr/sbin/apachectl1.3 ln -s /etc/apache2/bin/apachectl /usr/sbin/apachectl
Restart apache with:
sudo apachectl start
Auto start on reboot
Install buildbot.start.talos.slave.plist in /Library/LaunchAgents/.
<?xml version="1.0" encoding="UTF-8"?> <!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd"> <plist version="1.0"> <dict> <key>EnvironmentVariables</key> <dict> <key>PATH</key> <string>/Library/Frameworks/Python.framework/Versions/Current/bin:/bin:/sbin:/usr/bin:/usr/sbin</string> </dict> <key>Label</key> <string>buildbot.start.talos.slave</string> <key>ProgramArguments</key> <array> <string>/Library/Frameworks/Python.framework/Versions/Current/bin/buildbot</string> <string>start</string> <string>/users/Mozqa/talos-slave</string> </array> <key>RunAtLoad</key> <true/> <key>UserName</key> <string>mozqa</string> <key>WorkingDirectory</key> <string>/Users/mozqa/</string> </dict> </plist>
Updating Talos
Assuming your Buildbot master configuration is proper, Buildbot will automatically update Talos on every performance run. If the pageset is updated, you will need to refresh /home/mozqa/pages.
Post-cloning Setup for Pool
- Edit /Users/mozqa/talos-slave/buildbot.tac.sample and update buildmaster_host and slavename appropriately
- Rename buildbot.tac.sample to buildbot.tac
- Reboot