Auto-tools/Projects/Platform Quality/Infrastructure Migration 2015

From MozillaWiki
Jump to: navigation, search

Introduction

Platform QA currently has a significant infrastructure in the QA Lab in MTV2 on the second floor. We wish to move the machinery to a data center for the following reasons:

  • UPS backup of power.
  • Remote control off and on.
  • Scaling of virtual machines.

This is a (living) plan to accomplish this. The goals is to have most of the functionality of the systems replaced by end of Q3 2015.

Another problem is that our ESX server is currently at or over capacity. We have too many VMs on it, and we are going to need to be able to add more as new versions of operating systems ship (Windows 10, Mac OS X 10.11 El Capitan).

Systems in place

There are two test systems currently established:

  • Sunny Day - please see [1] for more information. This is 3 1U servers plus a USB MP3 player and a USB camera. This system will be left in the lab.
    • However, they are behind a VPN, and may need to be accessible by the machines in the data center.
  • pf-jenkins [2] - This Jenkins instance is completely housed on an ESX server (platform-esx-large.qa.mtv2.mozilla.com). There are many VMs supporting this instance on this ESX server.
  • platform-fusion.qa.mtv2.mozilla.com and 10.252.73.233 (misconfigured) Mac Minis each running 4 mac VMs.

Basic strategy

Due date: End of Q3 2015
  • Data center (Syd, James, Van)
    • ESX server moved to datacenter.
    • Non WebRTC-virtual machines migrated to data center's ESX farm to relieve capacity of ESX server.
    • Sunny day machines left in lab.
    • Mac minis moved to data center.
  • Mozmill merge (Syd, Henrik, Nils)
    • Functionality of pf-jenkins to be assumed by the mozmill jenkins instance.
      • Jobs migrated.
      • Reconfigured to use the pulse notifications for build downloads.
      • New jobs to take advantage of beta, release and ESR developed.
    • QUESTION: Can mozmill master see the Sunny Day steeplechase machine?
      • If not, Sunny Day will need its own Jenkins master.
    • Some jobs can also be run on mozmill's existing VMs.

Staging of changes

  1. Move jenkins master to mozmill (downtime over one weekend)
  2. Migrate VMs to data center ESX (no appreciable downtime; a few hours-1 day per VM)
  3. Move ESX server to data center (1 week downtime for WebRTC tests; other tests will be sharing mozmill builders)

Machine inventory

Auto-tools/Projects/Platform Quality/Jenkins Machine Inventory

Retrieved from "https://wiki.mozilla.org/index.php?title=Auto-tools/Projects/Platform_Quality/Infrastructure_Migration_2015&oldid=1094306"