QA/Automation/Meetings/140414
From MozillaWiki
< QA | Automation | Meetings
previous meeting | Meetings | next meeting »
Contents
Dial in
# When: Every Monday at 8:45am PDT/PST # Vidyo: https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz # Phone: 650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL) # 1-800-707-2533 (pin 369) Conf# 9654 (US) # IRC: irc://irc.mozilla.org:6697/#automation # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation
General
- Attendees:
- Chair: Henrik
- Notes: Andrei
Last Weeks Action Items
- [CARRY OVER] [Mihaela, Daniel] Get a list of the tests needed to automate - create an email thread on the automation list to get them prioritized (in-qa-testsuite? flag)
- [CARRY OVER] [Softvision] Metro
- finish mozmill tests for metro
- [ON TRACK] [Henrik] To update the goals for the metric - 10 tests to automate (Kamil is also helping with the tests)
- Gathering further information for generating the metrics
- [DONE] [Henrik] Talk to Marc about the goals for Nils
- His goals will be part of our team
Highlights
- [henrik] Firefox Automation report – week 7/8 2014: http://www.hskupin.info/2014/04/10/firefox-automation-report-week-78-2014/
- [henrik] Firefox Automation report – week 9/10 2014: http://www.hskupin.info/2014/04/11/firefox-automation-report-week-9-10-2014/
- [cosmin] Mozmill's software update tests can handle Beta -> RC -> Beta updates now (see bug 960781)
- [henrik] Mozmill-CI production got new features: https://github.com/mozilla/mozmill-ci/compare/07d0cf541be7...1657a35475e0
- New blockers, any updates?
- bug 992753 - Update SSL certificate for ssl-md5.mozqa.com
- bug 986013 - Rack Mac Mini Servers and Automation Mac Pros In MTV2 QA Lab
- You can find all blockers here: http://bit.ly/Tph0NY
Roundtable
- [henrik] Do we want to have our own blog at blog.mozilla.com (similar to https://blog.mozilla.org/addons)?
- Right now Henrik uses his own blog for any automation related post (http://www.hskupin.info)
- I feel we should do more blogging, and not only by a single person from the whole team
- [Andrei] merge day next Monday + easter Holiday (21 April)
- Who will be available?
Goals Overview
Project Updates
Mozmill (Henrik)
- We see lots of jsbridge disconnect failures lately. We might give all that a priority because it makes our CI instable
- Lots of additional crashes with Flash in endurance tests, debug version is working fine - so we installed that one on Windows.
TPS (Henrik)
- Broken Weave login for fxaccounts and old sync. Upcoming patch will fix 3 test failures for tabs (996027 bug Bug 996027)
- Remaining failing test will be test_tabs but I need feedback from devs (bug 990509)
WebRTC (Nils)
- Got Steeplechase up and running in our dedicated sunny day environment
- Chased a couple of issues around the RTCPeerConnection.close() implementation
- https://bugzilla.mozilla.org/show_bug.cgi?id=993780 PeerConnection.js:538 - TypeError: can't access dead object
- https://bugzilla.mozilla.org/show_bug.cgi?id=994999 PC.IsClosed() should refer to SignalingState not media presence
- https://bugzilla.mozilla.org/show_bug.cgi?id=991877 Add a test for PeerConnection.close()
Softvision Updates
Desktop Automation
- Goals progress:
- Resolved Fixed:
- bug 990557 - Test failure "[object Object] - got 'false' " in testSecurity/testMD5HashSignature.js
- bug 991736 - Disable flash tests on Windows due to crashes
- bug 980330 - [pulsebuildmonitor] Change wording from "Connecting to" to "Connected to" when connection has been established
- bug 960781 - Ensure software update tests can handle new final release process (Beta N -> RC N -> Beta N+1)
- bug 993433 - Update machines for the latest Flash
- bug 987098 - Failure 'Argument 1 of Window.getComputedStyle is not an object' in testPopups\testPopupsBlocked.js
- bug 993308 - Update the HTML5 video page with preload attribute on video element
- bug 936478 - Test failure "controller.waitForPageLoad(): Timeout waiting for page loaded" in /testSecurity/testSafeBrowsingWarningPages.js
- [Mozmill CI] Added --override-update-settings parameter for ondemand_update job (#429)
- Working on:
- Andreea
- bug 980938 Crash of Adobe Flash with protected mode enabled and clearing cookies [@ F2102588022]
- bug 979249 Disable "New app installed" notification from Win 8 and 8.1 nodes
- bug 994040 Failures across several tests due to notification panel changes
- bug 711129 Mozmill Endurance test for Open & Close a popup window
- bug 995182 crash in npswf32_13_0_0_182.dll@0x23b1b - look for flash debug log
- Andrei
- bug 989922 - Test failure "Element.waitForElement(): Element 'ID: errorTitleText' has been found" in testSecurity/testSSLDisabledErrorPage.js
- bug 972912 - Mozmill fails to ran all expected tests
- buildmaster, new bugs:
- bug 992738 Xorg sometimes errors out during reboot with "(EE) failed to create screen resources(EE)"
- bug 992763 JSBridge disconnect after running 'restartTests/testAddons_uninstallTheme/test1.js'
- bug 992910 testrun_update which passed failed with timeout
- bug 993300 Crash [@ pt_SetSocketOption ] in libnss3.dylib duplicate of bug 980800
- bug 993955 Test failure 'Identity is verified' in /testSecurity/testSecurityNotification.js
- bug 994040 Failures across several tests due to notification panel changes
- bug 994648 Enhance closeAllTabs() with a force argument which will use an API to close tabs instead of relying on UI actions
- bug 994658 Several JSbridge disconnect failures
- bug 995182 crash in npswf32_13_0_0_182.dll@0x23b1bd
- Cosmin
- bug 992139 - [mozversion] Enhance mozversion to return "application_name" if "application_code_name" doesn't exists
- bug 942737 - Test failure "Suggestions from two search engines are available - '1' should equal '2' " in testSearchSuggestions.js
- bug 732353 - Disable all Discovery Pane tests due to unpredictable web dependencies
- bug 904577 - Method exists() from elementslib.Elem returns true even after the node has been removed
- bug 931704 - Test failure "plainTheme is undefined" in /restartTests/testAddons_changeTheme/test1.js
- Daniel
- investigate and updated https://etherpad.mozilla.org/tests-to-automate
- bug 968079 - Update tabs.js metro library to use UI elements only
- bug 883860 - Create metro mozmill test for Pop-up blocker
- bug 969428 - Create form data backend library for handling form related actions
- bug 863139 - Add ui module for in-content security pages & security dialogs
- bug 816084 - Update toolbars.js shared module to move elements from security tests in locationBar.getElement()
- bug 908649 - Refactor lib/downloads.js replacing the nsiDownloadManager backend with the new Downloads.jsm implementation
- Andreea
- Mihaela
- review in-testsuite and in-qa-testsuite bugs
- bug 993641 - investigate failures
- still blocked by bug 985332
- bug 947914 - failures investigations, tests fixes and partial patch
- bug 987185 - work at test
- bug 830379 - update tests
- bugs verification and investigation: bug 974892, bug 983903, bug 974458
- Mihaela
Personal Status
For the personal status please check the weekly status updates:
Meeting Notes
The meeting notes for this meeting can be read in the following etherpad:
If you missed the meeting you can also watch it in our archive.
Action items
- [NEW] [Henrik] get information on how to setup a blog on mozilla.com
- [NEW] [Henrik] To update our team wiki page for the goals of Q2 2014
- [NEW] [Andreea] prepare the merge patch (Beta > Release) by Friday
- [CARRY OVER] [Mihaela, Daniel] Get a list of the tests needed to automate - create an email thread on the automation list to get them prioritized (in-qa-testsuite? flag)
- [CARRY OVER] [Softvision] Metro
- finish mozmill tests for metro
- [ON TRACK] [Henrik] To update the goals for the metric - 10 tests to automate (Kamil is also helping with the tests)
- Gathering further information for generating the metrics