QA/Automation/Meetings/141124

From MozillaWiki
< QA‎ | Automation‎ | Meetings
Jump to: navigation, search

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees: Andreea, Cosmin, Daniela, Teodor, Andrei, Otilia, Henrik, Barbara, Syd
  • Chair: Andrei
  • Notes: Teodor

Last Weeks Action Items

  • [DONE] [Henrik] follow up on bug 1083166 for network timeouts
    • I triggered the networking team and they will work with Mark to get some more details
      • Talked to networking team for more info on setting up another pulse translator
  • [NEW] [Andreea] Check in-qa-testsuite flags for proxy/network tests
    • Didn't had time for these yet, will start this week as Florin mentioned they don't cover these so would be good to have
  • [DONE] [Mihaela] Check with the team from AWSY if they have detected our endurance memory increased consumption
    • they had an increase but a few days earlier
    • could not reproduce the increase locally, on staging nor on production
      • talked to dev team they had memory increase on nov the 7th
      • it may be related to the migration of mozmill automation 2.0.8 to 2.0.9, see if it's a regression
      • it's possible to be an increase of memory after flash update, try to downgrade flash locally, flash seems to be the same version
  • [NEW] [Henrik] goals wiki page
    • added to own etherpad
  • [DONE] [Henrik] check if we can shutdown the old tps system
    • It's hard to see if there are broken runs with failures given that we do not really log locally on the machine. Also the mailing list for failures is the same as the general one, so I do not see why emails should not come through. Further we would have to implement Pulse Guardian, which is not a good investment of our time
    • get reports from tps, cross-check with revisions from mozilla-central
    • checked mailing list for failures, no failures in the last three months, since the new system

Highlights

  • [Henrik] Mozmill CI got updates: https://github.com/mozilla/mozmill-ci/compare/fed024694316...9ed1b907f73d (dummy nodes, Jenkins 1.580.1, xshell, pulse guardian, Ubuntu 14.04)
    • live on production
      • issue with high memory usage on jenkins (staging), we should run the garbage collector manually periodically
      • http session issue is not observed anymore
    • we updated all machines today => with the change from mm-ci-master to mm-ci-production all testruns were failing to properly finish
  • [SV] Last week in the project for Andrei and we'd like to introduce Daniela, she's been in ramp-up for a while now
    • The Softvision Desktop Automation Team will be out office next monday, December the 1st due to National Day holiday in Romania

Blockers

  • List of blockers (http://bit.ly/Tph0NY):
    • [07/10] - bug 735184 - RFE: Create Pulse notifications for update channel activities (maybe in Q4)
    • [09/01] - bug 1038646 - Broken package dependencies when installing OpenJDK 7 on Ubuntu 12.04 machines (maybe wontfix because we want to get rid of it)
      • Most likely we'll rely on openjdk, will be installed by default on linux
      • We don't use java on our mozmill tests, so we don't need oracle versions
    • [09/03] - bug 997230 - Setup Mac Mini for DeployStudio needed by PuppetAgain (needs action RelOps)
    • [10/29] - bug 917204 - Add open squid proxy to qa.scl3.mozilla.com for testing purposes (waiting setting up network ACLs)
      • We got a squid proxy, needs testing by adding the squid proxy to the proxy list in firefox and test if mozqa.com can be opened for http/https
    • [10/29] - bug 1066493 - TPS failure: Error: signIn() failed with: "error.sync.reason.serverMaintenance" (depends on bug 1057892)
      • Waiting for the push on production for the database, hopefully by today/tomorrow will be landed and the failures will be fixed
    • [11/05] - bug 1083166 - [SCL3] Pulse and maybe other connections are timing out in irregular intervals (maybe also causing test failures when loading web pages)
    • [11/07] - bug 1094272 - [pulsetranslator] With SSL enabled publishing of normalized messages get stuck
      • Stopped to publish messages by its own, and it seemed fine, except for some failure today.
    • [11/11] - bug 1096367 - move aurora updates onto cdn temporarily
      • We might need to find a solution here, it happened only once, in one day, but it might happen again

Contributor Spotlight

  • TBD

Roundtable

  • TBD

Goals

Framework and Tools (Henrik)

Make Marionette ready for Mozmill tests

  • Reorganized the current structure of the green-light tests repository
  • Gave feedback regarding current implementations, which will be discussed later today
    • Checked some check-ins from Dev Team, will talk about solutions in the Mozmill to Marionette transition meeting
    • Next week planned some of the tests porting to marionette
    • Firefox OS Automation Team are having issues with marionette and the asynchronous events.

Locale Rotation for Aurora builds in Mozmill-CI

  • No update

Turn on PuppetAgain for Mozmill CI and TPS CI

  • No update

Improvements to Testday bot [stretched]

  • No update

Test Automation (Softvision)

Creation of automated tests for important regressions

  • New tests in work:
    • bug 941477 - Create a remote Mozmill test for the 'Get more Search Engines' feature | Blocked by New Beta Search UI
      • Talk to Liz regarding the tests which require update.
      • No simple fix in our tests, look what parts of the tests are still relevant
      • Disable all relevant tests when the change lands in nightly
    • bug 1088638 - Add automated test to install, disable, enable and remove services
    • bug 1088534 - Add a test to verify that basic Firefox operations work ok with the enabled complete theme or persona
    • bug 1098351 - Add new automated test for "Override mixed script content blocking"

Project Updates

Mozmill (Henrik)

  • Fixed remaining proxy issues on Ubuntu 14.04 machines
  • Finally enrolled all the latest changes from staging to production (Jenkins 1.580.1, Ubuntu 14.04, ...)
    • We had an issue with the new ubuntu 14.04 machines, inverted proxy changes.

Mozmill Tests (Softvision)

  • Will work this sprint on the search library and update the tests as we disabled them on Friday with the changes in beta
  • Merge will happen tonight, Andreea tested today, linux and osx are fine, windows will be done soon
  • Fixed:
    • bug 1088561 - Add automated test for plugins in different states
    • bug 987612 - The restart functional tests for 'Blocklist Extension' shouldn't fail with no network connection
      • Still three tests failing in functional, two may be fixed, one should be moved to remote
    • bug 1099123 - [en-US] Test failures in /testSecurity/testSSLDisabledErrorPage.js
    • bug 972770 - Test failure 'Element.waitForElement(): Element 'ID: errorTitleText' has been found' in /testSecurity/testSSLDisabledErrorPage.js
    • bug 1074695 - [az] Command key "tabView.commandkey" is the same with "addons.commandkey"
  • In Progress:
    • bug 1055453 - Add new ui module for the page-info window
    • bug 908649 - Refactor lib/downloads.js replacing the nsiDownloadManager backend with the new Downloads.jsm implementation

TPS (Henrik)

  • Coversheet is running through Pulse Guardian now
  • Have to find a way to check latest server-side changes for signIn() problem against the staging server
    • Not on the production server

WebRTC (Nils, Syd)

  • TBD

Softvision Updates

Personal Status

For the personal status please check the weekly status updates:

  • 141124 - 141128
    • Andrei will be on PTO on Thursday
    • Thursday and Friday are US National Holidays

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

If you missed the meeting you can also watch it in our archive.

Action items

  • [NEW] [Andrei] test public squid proxy for mozmill-tests
  • [NEW] [Henrik] goals wiki page
  • [NEW] [Andreea] Check in-qa-testsuite flags for proxy/network tests
  • Chair: Andreea
  • Notes: Cosmin
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Automation/Meetings/141124&oldid=1036371"