QA/Automation/Meetings/140414

From MozillaWiki
< QA‎ | Automation‎ | Meetings
Jump to: navigation, search

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees:
  • Chair: Henrik
  • Notes: Andrei

Last Weeks Action Items

  • [CARRY OVER] [Mihaela, Daniel] Get a list of the tests needed to automate - create an email thread on the automation list to get them prioritized (in-qa-testsuite? flag)
  • [CARRY OVER] [Softvision] Metro
    • finish mozmill tests for metro
  • [ON TRACK] [Henrik] To update the goals for the metric - 10 tests to automate (Kamil is also helping with the tests)
    • Gathering further information for generating the metrics
  • [DONE] [Henrik] Talk to Marc about the goals for Nils
    • His goals will be part of our team

Highlights

  • New blockers, any updates?
    • bug 992753 - Update SSL certificate for ssl-md5.mozqa.com
    • bug 986013 - Rack Mac Mini Servers and Automation Mac Pros In MTV2 QA Lab
  • You can find all blockers here: http://bit.ly/Tph0NY

Roundtable

  • [henrik] Do we want to have our own blog at blog.mozilla.com (similar to https://blog.mozilla.org/addons)?
    • Right now Henrik uses his own blog for any automation related post (http://www.hskupin.info)
    • I feel we should do more blogging, and not only by a single person from the whole team
  • [Andrei] merge day next Monday + easter Holiday (21 April)
    • Who will be available?

Goals Overview

Project Updates

Mozmill (Henrik)

  • We see lots of jsbridge disconnect failures lately. We might give all that a priority because it makes our CI instable
  • Lots of additional crashes with Flash in endurance tests, debug version is working fine - so we installed that one on Windows.

TPS (Henrik)

  • Broken Weave login for fxaccounts and old sync. Upcoming patch will fix 3 test failures for tabs (996027 bug Bug 996027)
  • Remaining failing test will be test_tabs but I need feedback from devs (bug 990509)

WebRTC (Nils)

Softvision Updates

Desktop Automation

  • Goals progress:
  • Resolved Fixed:
    • bug 990557 - Test failure "[object Object] - got 'false' " in testSecurity/testMD5HashSignature.js
    • bug 991736 - Disable flash tests on Windows due to crashes
    • bug 980330 - [pulsebuildmonitor] Change wording from "Connecting to" to "Connected to" when connection has been established
    • bug 960781 - Ensure software update tests can handle new final release process (Beta N -> RC N -> Beta N+1)
    • bug 993433 - Update machines for the latest Flash
    • bug 987098 - Failure 'Argument 1 of Window.getComputedStyle is not an object' in testPopups\testPopupsBlocked.js
    • bug 993308 - Update the HTML5 video page with preload attribute on video element
    • bug 936478 - Test failure "controller.waitForPageLoad(): Timeout waiting for page loaded" in /testSecurity/testSafeBrowsingWarningPages.js
    • [Mozmill CI] Added --override-update-settings parameter for ondemand_update job (#429)
  • Working on:
    • Andreea
      • bug 980938 Crash of Adobe Flash with protected mode enabled and clearing cookies [@ F2102588022]
      • bug 979249 Disable "New app installed" notification from Win 8 and 8.1 nodes
      • bug 994040 Failures across several tests due to notification panel changes
      • bug 711129 Mozmill Endurance test for Open & Close a popup window
      • bug 995182 crash in npswf32_13_0_0_182.dll@0x23b1b - look for flash debug log
    • Andrei
      • bug 989922 - Test failure "Element.waitForElement(): Element 'ID: errorTitleText' has been found" in testSecurity/testSSLDisabledErrorPage.js
      • bug 972912 - Mozmill fails to ran all expected tests
      • buildmaster, new bugs:
        • bug 992738 Xorg sometimes errors out during reboot with "(EE) failed to create screen resources(EE)"
        • bug 992763 JSBridge disconnect after running 'restartTests/testAddons_uninstallTheme/test1.js'
        • bug 992910 testrun_update which passed failed with timeout
        • bug 993300 Crash [@ pt_SetSocketOption ] in libnss3.dylib duplicate of bug 980800
        • bug 993955 Test failure 'Identity is verified' in /testSecurity/testSecurityNotification.js
        • bug 994040 Failures across several tests due to notification panel changes
        • bug 994648 Enhance closeAllTabs() with a force argument which will use an API to close tabs instead of relying on UI actions
        • bug 994658 Several JSbridge disconnect failures
        • bug 995182 crash in npswf32_13_0_0_182.dll@0x23b1bd
    • Cosmin
      • bug 992139 - [mozversion] Enhance mozversion to return "application_name" if "application_code_name" doesn't exists
      • bug 942737 - Test failure "Suggestions from two search engines are available - '1' should equal '2' " in testSearchSuggestions.js
      • bug 732353 - Disable all Discovery Pane tests due to unpredictable web dependencies
      • bug 904577 - Method exists() from elementslib.Elem returns true even after the node has been removed
      • bug 931704 - Test failure "plainTheme is undefined" in /restartTests/testAddons_changeTheme/test1.js
    • Daniel
      • investigate and updated https://etherpad.mozilla.org/tests-to-automate
      • bug 968079 - Update tabs.js metro library to use UI elements only
      • bug 883860 - Create metro mozmill test for Pop-up blocker
      • bug 969428 - Create form data backend library for handling form related actions
      • bug 863139 - Add ui module for in-content security pages & security dialogs
      • bug 816084 - Update toolbars.js shared module to move elements from security tests in locationBar.getElement()
      • bug 908649 - Refactor lib/downloads.js replacing the nsiDownloadManager backend with the new Downloads.jsm implementation

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

If you missed the meeting you can also watch it in our archive.

Action items

  • [NEW] [Henrik] get information on how to setup a blog on mozilla.com
  • [NEW] [Henrik] To update our team wiki page for the goals of Q2 2014
  • [NEW] [Andreea] prepare the merge patch (Beta > Release) by Friday
  • [CARRY OVER] [Mihaela, Daniel] Get a list of the tests needed to automate - create an email thread on the automation list to get them prioritized (in-qa-testsuite? flag)
  • [CARRY OVER] [Softvision] Metro
    • finish mozmill tests for metro
  • [ON TRACK] [Henrik] To update the goals for the metric - 10 tests to automate (Kamil is also helping with the tests)
    • Gathering further information for generating the metrics