QA/Automation/Meetings/130107

From MozillaWiki
Jump to: navigation, search

previous meeting | Meetings | next meeting »

Dial in

 # Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:  650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #         1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:    irc://irc.mozilla.org:6697/#automation

General

  • Attendees:
    • TBD
  • This meeting:
    • Chair: Henrik

Last Weeks Action Items

  • [DONE] Henrik: Check the new way in setting the system proxy for our ESX Linux VMs
    • Lots of work was involved here because of tools like Mercurial or mozdownload were not happy when called via Jenkins (there is a bug which drops env variables)
  • [DONE] Henrik: Follow up with Ted about the faked devices for WebRTC
    • Ted was working before Christmas on a Linux implementation. It's up for review and installation on test machines now.
  • [DONE] Dave: Investigate and fix the broken SeleniumIDE extension for Firefox 20

Highlights

  • [henrik] Mozmill ESX cluster in PHX data center is mostly ready to be finished off for Linux and Windows machines
    • Was working heavily on setting everything up. Proxy settings caused us a lot of headaches across Linux and Windows given that tools retrieve that information from different sources, and Jenkins is even buggy in handling environment variables (see bug)
    • As by now all Linux and Windows machines should be connected and running the daily tests (32 VMs have been deployed so far - Fedora machines are left to do)
    • We have to think about how to best get our Mac minis moved to PHX or requesting new ones?
    • Only a single test is failing due to proxies (/restartTests/testSoftwareUpdateAutoProxy/test2.js)

Goals Overview

Blockers

Issues

Project Updates

Gaia UI (Dave)

WebAPI (Rob)

  • Final two WebAPI tests are under review bug 813774 and bug 813777
  • Finished post-review patch for maximum segment SMS test bug 806811
  • Some WebTelephony tests are disabled on TBPL as they cause the following WebAPI tests to fail (battery tests), even though the WebTelephony tests were passing; Rob to investigate using Cedar

WebRTC (Henrik)

  • mozGetUserMedia has been enabled by default on mozilla-central, given that our gUM mochitests do not fail and leak anymore
  • Also the peer connection leaks have been mostly fixed. There are only some around which are hard to investigate. So we cannot enable crashtests for now too.
  • We will decide later to turn on peer connection tests on the aurora channel given how stable the code is
  • Have to continue to write peer connection tests (e.g. datachannel) and catch up with crashtests

Softvision Updates

  • Fixed:
    • bug 782661 -Mozmill endurance test failure in testBookmarks_OpenAllIntTabs | "could not find element Selector: .bookmark-item[label='Test Folder'] "
    • bug 772360 - Mozmill test failure //testBookmarks_AddAndRemoveBookmarkViaAwesomeBar/ with error "The bookmark was created "
    • bug 823869 - Test which checks that the accept cookie dialog is not displayed in private browsing mode
    • bug 812435 - Test failure "could not find element Link: Documenti" in testPreferences/testPreferredLanguage.js
    • bug 810301 - AddonsManager.close in lib/addon.js closes the current tab without checking if it is the addons manager
    • bug 780892 - Split testFocusAndSearch.js into two test modules
  • Blocked bugs:
    • bug 788531 - Revise default delay for endurance test to make scenarios more realistic - needs ESX cluster
    • bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted - blocked by bug 804952 - Setup virtual host on mozqa.com for Mozmill MD5 hash signatures check
  • Waiting for review
    • bug 818456 - Investigate and prepare existing Mozmill tests for per window private browsing - P1
    • bug 809431 - Get rid of controller.assertNode() and controller.assertNodeNotExist() calls in favor of assert.* methods
  • Working on:
    • bug 818456 - Investigate and prepare existing Mozmill tests for per window private browsing - P1
      • waiting for review
    • bug 790538 - Enhance update tests to check for the 'what's new page' when `actions='silent'` given in update snippet
    • bug 781547 - Failure in "/testBookmarks_OpenAllInTabs/test1.js" with "Default bookmarks have been imported"
      • unable to reproduce locally yet
    • bug 809431 - Get rid of controller.assertNode() and controller.assertNodeNotExist() calls in favor of assert.* methods
      • waiting for review
    • bug 807931 - Test failure "Active tab url should equal the page url - 'http://localhost:43336/mozilla_governance.html' should equal 'http://localhost:43336/mozilla_grants.html'" in testAwesomeBar/testSwitchToTab.js
      • unable to reproduce locally yet
    • bug 763159 - Test failure 'secure.mur.at == erle.mur.at ' in testSecurity/testUnknownIssuer.js
    • bug 600291 - Update test module testSearchAddons to reflect the new Add-ons API
      • patch will be added today
    • bug 809434 - Get rid of controller.assertChecked() in favor of expect.* and assert.* methods
      • Checkin on default done, backports will be added today
    • bug 823064 - Refactor testDownloadManagerClosed.js for the new PB per-window mode
    • bug 800708 - Test failure "All downloads have been finished" in /testPrivateBrowsing/testDownloadManagerClosed.js
    • bug 785041 - Mozmill test failure testSecurity/testGreyLarry.js with "Controller.assertJSProperty(ID: page-proxy-favicon) : http://localhost:43336/images/mozilla_favicon.ico == http://localhost:43336/favicon.ico "
      • Andreea will update the issue today
    • bug 800872 - Test failure "Window number '1' has been opened" in endurance//testTabbedBrowsing_OpenNewWindow/test1.js

Roundtable

  • [henrik] Sprint definition task will be a joined task by Otilia and Daniela

Presentation / Demo

  • [%name%] %topic%

Triage

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

Action items

  • [NEW] Henrik to get back to Clint and ask about feedback re: moving mac mini machines
  • [NEW] Henrik: Update meeting page template for blockers list
  • [NEW] Andrei: look into MozMill 2.0, see if we have any regressions
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Automation/Meetings/130107&oldid=887913"