QA/Automation/Meetings/140512

From MozillaWiki
< QA‎ | Automation‎ | Meetings
Jump to: navigation, search

previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

  • Attendees:
  • Chair: Andreea
  • Notes: Cosmin

Last Weeks Action Items

  • [DONE] [Marc] Finalize the test plan for geolocation tests with Doug
  • [DONE] [Andreea] Send email for possible automation training days
  • [CARRY OVER] [Kamil] Get back to Jim and let him know he can go ahead with the fix in try builds
  • [CARRY OVER] [Andrei] Update mozmill-tests documentation for patch handling on MDN for github users
  • [DONE] [Henrik] File an issue for mozmill-dashboard to get an overview page for testruns executed by buildid
  • [CARRY OVER] [Henrik] get information on how to setup a blog on mozilla.com
    • Still under discussion if it is worth to have that or to collect posts under Planet

Highlights

Roundtable

  • TBD

Goals Overview

Project Updates

Puppet for Mozmill CI (Henrik, Andreea, Andrei)

TPS continuous integration (Henrik, Cosmin)

  • Current goal status:
  • Notes
    • Cosmin: Check INSTALL.sh and make it working across platforms and with packaged tests
    • Henrik: Triggered discussion where machines will live. Once we agreed on, new VMs will be requested

Automation of important tests for Desktop QA (Daniel, Mihaela)

  • Current goal status:
  • Notes
    • Next steps to work on this week:
      • Send email on mailing list asking for details about Geolocation testing
      • Log bugs for corresponding tests (geolocation and tps) established in the last call
      • Update the project page
      • Send email with bugs logged for tests

Automation Trainings (Andreea, Cosmin)

  • Current goal status:
    • First training next week - Wednesday on May 21st
    • This week: create blog post, send invites on mailing lists (one this week, one next week on Tuesday)
    • Work on a list of small One and Done tasks like setup environment, run a testrun etc.
    • Talk to Ioana Chiorean for help with advertising the event in several community groups
  • Notes
    • TBD

Mozmill for Marionette (Andrei, Andreea)

  • Current goal status:
    • Start with: Import mozhttpd for mozmill and get it running. Test how to access pages from Mozmill
  • Notes
    • TBD

Others

  • Mozmill (Henrik)
    • Slow shutdowns
      • jsbridge disconnect issues dropped a lot since we increased the delay for the addon installation dialog. This might be related to other known bugs for slow shutdowns as we are aware of for fx29 and later. We will work with devs to get this investigated
      • We would like to get shutdown times measured with Mozmill - see bug 1008848
    • Patch for more descriptive disconnect issues will land soon
    • We have to refactor MozMillElement and throw away the smart broken detection of element types - see bug 1007596
  • WebRTC (Nils)
    • Trying to properly close down all connections at the end of each WebRTC test is quite a bit more complex then anticiapted - bug 965656
    • WebRTC Tiger team is working on adding TURN servers and call metrics to the tests

Softvision Updates

Desktop Automation

  • Goals progress:
  • Resolved Fixed:
    • bug 1004986 - [zh-CN] Test failure "(NS_ERROR_MALFORMED_URI) [nsIWebNavigation.loadURI]" in mozmill tests
    • bug 1003052 - Update machines to the latest Flash
    • bug 1005035 - Increase 'security.dialog_enable_delay' to work around JSBridge disconnect issue
    • bug 1005075 - Update OS X nodes for platform security updates from Apr 23rd
    • bug 1007364 - OS X 10.6 nodes show upgrade request (modal dialog) for Mavericks
    • [mciconf] Don't rely on candidates builds when adding release options (#13) #13
    • [mciconf] Remove the specified locale and not the last one when the checkbox is unchecked (#11) #11
  • Working on:
    • Andreea
      • bug 994040 - Failures across several tests due to notification panel changes
    • Andrei
      • bug 1008135 - With Mozmill 2.0 application update logs are no longer printed to the console
      • Buildmaster
        • Filed new bugs
          • bug 1005801 - Disable Windows 8 check for update to Windows 8.1
          • bug 1005833 - Firefox fails to start on specific windows machines
          • bug 1005837 - WSAEINVAL (JSbridge) disconnect after testFlash_SWFVideoURL\test1.js on Windows nodes
          • bug 1005847 - Test failure 'Video has loaded and skipped to the expected timeframe' in /testVideo_OGVBuffering/test1.js
          • bug 1005856 - Failed to uninstall build: 'mozinstall.mozinstall.UninstallError: Failed to uninstall' on mm-win-8-32-2
          • bug 1006345 - Test failure 'Tab has been closed' in /testTabbedBrowsing/testCloseTab.js
          • bug 1007596 - Remove MozMillElement type detection because it is simply broken
          • bug 1007637 - Test failure "User has permissions to update the build. - got 'false'" in /testDirectUpdate/test2.js
        • Reopened
          • bug 931704 - Test failure "plainTheme is undefined" in /restartTests/testAddons_changeTheme/test1.js
    • Cosmin
      • bug 732353 - Disable all Discovery Pane tests due to unpredictable web dependencies
      • bug 994102 - Search engines don't work right away after installation [05/06]
      • bug 1002394 - Test failure "Add-ons Manager has been opened" across addons tests
      • bug 599290 - Update SoftwareUpdateAPI to support complete relocation to the about dialog
      • bug 989922 - Test failure "Element.waitForElement(): Element 'ID: errorTitleText' has been found" in testSecurity/testSSLDisabledErrorPage.js
    • Daniel
      • bug 1005811 - Update Mozmill tests for in-content preferences pane
      • bug 908649 - Refactor lib/downloads.js replacing the nsiDownloadManager backend with the new Downloads.jsm implementation
      • bug 996530 - Add new PlacesOrganizer UI library;
      • bug 972912 - Mozmill fails to ran all expected tests
      • worked on understanding & putting things together related to the Test Creation project
    • Mihaela
      • tests updates based on review
        • bug 967568 - Create Mozmill test for Firefox's safebrowsing feature
        • bug 947914 - Add test for the functionality of Panel Menu buttons in Australis
        • bug 830379 - Create mozmill test for restarting the browser while having an opened PDF file
          • blocked by bug 1007596 - Remove MozMillElement type detection because it is simply broken
      • Endurance results triage and investigations
        • bug 1003155 - Firefox 31 memory usage increase since April 27th - investigation
          • the memory regression was caused by changeset 483210d830f0 which was backed out = > the memory consumption returned to normal
        • no new memory spikes

Personal Status

For the personal status please check the weekly status updates:

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

If you missed the meeting you can also watch it in our archive.

Action items

  • [CARRY OVER] [Kamil] Get back to Jim and let him know he can go ahead with the fix in try builds
  • [CARRY OVER] [Andrei] Update mozmill-tests documentation for patch handling on MDN for github users
  • [CARRY OVER] [Henrik] get information on how to setup a blog on mozilla.com
    • We went with quality.mozilla.org as our blog for automation related events
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Automation/Meetings/140512&oldid=978172"