QA/Automation/Meetings/140407

From MozillaWiki
< QA‎ | Automation‎ | Meetings
Jump to: navigation, search

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees: Andrei, Andreea, Mihaela, Daniel, Henrik, Cosmin, Nils, Otilia
  • Chair: Daniel
  • Notes: Andreea

Last Weeks Action Items

  • [DONE] [Henrik] Update the goal list and send and email update
  • [DONE] [Nils] Check if links to WebRTC bugs made it into the Wiki from last week
  • [DONE] [Daniel] file an issue against mozmill-dashboard to implement a testrun status report
  • [CARRY OVER] [Mihaela, Daniel] Get a list of the tests needed to automate - create an email thread on the automation list to get them prioritized (in-qa-testsuite? flag)
  • [CARRY OVER] [Softvision] Metro
    • finish mozmill tests for metro
      • bug 883860 - Create metro mozmill test for Pop-up blocker
      • Only this test left to be completed;
    • bug 968079 - Update tabs.js metro library to use UI elements only
      • final review provided and it's almost finished

Highlights

Roundtable

Goals Overview

Project Updates

Mozmill (Henrik)

TPS (Henrik)

  • All remaining backports have been landed on mozilla-aurora
  • Bug 986190 - [tps] Synced data on the server is not always wiped at the end of a test
  • Bug 990797 - TPS CI errors out when trying to e-mail results
  • Bug 989045 - [tps] Registering of observer topics happens too late so 'weave:engine:start-tracking' can be missed during startup
  • Bug 989249 - test_addon_reconsiling.js broken due to missing sync
  • Work happens on bug 992198, where we want to allow wiping the remote server on first sync

WebRTC (Nils)

Softvision Updates

Desktop Automation

  • Goals progress:
  • Updates: A week full of regressions and crashes, mostly on endurance and security tests and crashes related to Flash.
  • Resolved Fixed:
  • Working on:
    • Andreea
      • bug 991736 - Disable endurance flash tests on esr24 for Windows due to crashes
      • bug 711129 - Mozmill Endurance test for Open & Close a popup window
      • bug 990557 - Test failure "[object Object] - got 'false' " in testSecurity/testMD5HashSignature.js
    • Andrei
      • bug 891288 - Create subdomains of mozqa with self-signed SSL certificates for all supported versions versions (SSL3 - TLS 1.1)
      • bug 989922 - Test failure "Element.waitForElement(): Element 'ID: errorTitleText' has been found" in testSecurity/testSSLDisabledErrorPage.js
      • bug 972912 - Mozmill fails to ran all expected tests
      • bug 990509 - TPS test failure "[phase3] Exception caught: ASSERTION FAILED! error locating tab" in test_tabs.js
    • Cosmin
      • [Mozmill CI] - Added --override-update-settings parameter for ondemand_update job (#428) #429 https://github.com/mozilla/mozmill-ci/pull/429
      • bug 911257 - [mozrunner] Add feature to set MetroFirefox as the default browser
      • bug 904577 - Method exists() from elementslib.Elem returns true even after the node has been removed
      • bug 732353 - Disable all Discovery Pane tests due to unpredictable web dependencies
      • bug 942737 - Test failure "Suggestions from two search engines are available - '1' should equal '2' " in testSearchSuggestions.js
      • bug 799149 - Add mozmill test to ensure that there are no conflicts in context menu access keys.
      • bug 992139 - [mozversion] Enhance mozversion to return "application_name" if "application_code_name" doesn't exists
    • Daniel
      • bug 987098 - Failure 'Argument 1 of Window.getComputedStyle is not an object' in testPopups\testPopupsBlocked.js
      • bug 969428 - Create form data backend library for handling form related actions
      • bug 936478 - Test failure "controller.waitForPageLoad(): Timeout waiting for page loaded" in /testSecurity/testSafeBrowsingWarningPages.js
      • bug 883860 - Create metro mozmill test for Pop-up blocker
      • bug 968079 - Update tabs.js metro library to use UI elements only
      • bug 816084 - Update toolbars.js shared module to move elements from security tests in locationBar.getElement()
      • bug 863139 - Add ui module for in-content security pages & security dialogs
      • bug 991066 - Test failure "Video data is available" in endurance/testVideo_OGVBuffering/test1.js
    • Mihaela
      • bug 974914 - Add test for the functionality of Panel Menu buttons in Australis
        • failures investigations and new fixes
        • partial patch green in tbpl
      • bug 973641 - Add test for the functionality of addon button in Australis
      • Moztrap need_automation tests - triage and check for existing coverage
      • work at a list of tests needed to automate for in-testsuite/in-qa-testsuite bugs

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

If you missed the meeting you can also watch it in our archive.

Action items

  • [CARRY OVER] [Mihaela, Daniel] Get a list of the tests needed to automate - create an email thread on the automation list to get them prioritized (in-qa-testsuite? flag)
  • [CARRY OVER] [Softvision] Metro
    • finish mozmill tests for metro
      • bug 883860 - Create metro mozmill test for Pop-up blocker
      • bug 968079 - Update tabs.js metro library to use UI elements only
  • [NEW] [Henrik] To update the goals for the metric - 10 tests to automate (Kamil is also helping with the tests)
  • [NEW] [Henrik] Talk to Marc about the goals for Nils