previous meeting | Meetings | next meeting »

Dial in

 # When:     Every Monday at 8:45am PDT/PST
 # Vidyo:    https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz
 # Phone:    650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL)
 #           1-800-707-2533 (pin 369) Conf# 9654 (US)
 # IRC:      irc://irc.mozilla.org:6697/#automation
 # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation

General

• Attendees: Mario, Andreea, Cosmin, Henrik, Dave, Otilia, Adrian, Mihai, Andrei
  • TBD
• Chair: Dave Hunt
• Notes: Mario

Last Weeks Action Items

• [NEW] Henrik: Update the wiki for quarter goals
  • Not done yet - will happen once we got all CI issues fixed
• [DONE] Henrik: Release Mozmill 2.0
  • http://www.hskupin.info/2013/09/25/mozmill-2-0-released/

Highlights

• [henrik] Automation Development report – week 38 2013
• [henrik] Due to constant crashes, we disabled Windows 8.1 tests until we get the final version of 8.1
• [henrik] Mozmill 2.0 has been released
• [dave] Released b2gperf 0.8
• [dave] Released gaiatest 0.14 & 0.15
• [dave] New blog post - Building a harness for Eideticker... with LEGO
• [henrik] Disabling Windows Defender on all Windows nodes stopped the critical performance issues (see bug 918676)
• [henrik] Windows Error Reporting has been disabled for all of our Windows nodes to stop hanging processes (see bug 920964)
• New blockers, any updates?
  • bug 915697 - Flashing Unagi or Inari devices with latest master build fails and we end up with a black screen
  • bug 919618 - Create VMs for Windows 8.1 final (x86, x86-64) in qa.scl3.mozilla.com
  • bug 920944 - Two instances of the Homescreen app can be launched
  • bug 921194 - TypeError: stack is undefined from trusted_ui.js, line 303
• You can find all blockers here: http://bit.ly/Tph0NY

Roundtable

• [Andreea] Bug Priorities - it appears that the new way we organized priorities is making us have way too many P1 bugs
  • We think it would be best to use all 5 priority flags from Bugzilla to cover all cases:
    • P1 - critical, constant failures
    • P2 - new tests - the ones with [qa-needed] whiteboard entry are handled first
    • P3 - intermittent Failures, enhancements
    • P4 - Rare failures (once a month)
    • P5 - refactoring, small enhancements
• [SV] Metro proposal
  • We need to have the structure discussed on the work week inside the repository, so maybe would be good to have a first test: bug 879382
    • mozmill-tests
    • > firefox > libs, tests
    • > metro > libs, tests
  • UI lib will be ready in a couple of days
  • Firefox Nightly should be set as the default browser on Win 8 machines in order to open it in metro mode
  • We need to add the metro testrun to mozmill-automation
  • Have Jenkins configured for metro runs
  • Have the dashboard updated with a metro tab for results

Goals Overview

• https://wiki.mozilla.org/Auto-tools/Automation_Development#Prioritized_Projects

Project Updates

Mozmill (Henrik)

• Mozmill 2.0 and 1.5.23 have been released
• Working on a proposal for the future development

Gaia UI (Dave)

• Goals progress:
  • Working like crazy to get the perf tests running again, including a bunch of new scrolling tests and a new FPS metric.
  • Also trying to get Eideticker into a presentable state for the Summit.
• [rwood] Some updates for endurance tests for 1.3/master; pull request submitted (bug 920180)
• [rwood] Will be demonstrating the endurance tests at the Summit innovation fair in Brussels, if a table becomes available (currently on the waiting list)

Games Benchmarking (Rob, Joel, BC)

• Deploying a Google Nexus 4 with Firefox OS onto the speedtest framework (Toronto) this week

AWSY (Rob)

• Continuing development on AWSY test driver
• Next steps: Jenkins job and node setup when VMs become available; make output available for AWSY dashboard

Softvision Updates

Desktop Automation

• Goals progress:
• Mozilla Softvision Team Pic: http://tinypic.com/r/2q2hisp/5
• We have added a Top Bugs section to our weekly etherpad in Softvision team to keep track of the most important P1 bugs
• Resolved Fixed:
  • bug 888924 - Test failure "Memory cache has no entries after PB mode - 'undefined' should equal '0'" in /testPrivateBrowsing/testAboutCache.js
  • bug 911101 - Test failure 'No item selected for element ID: historyMode' in testDisableCookies.js testEnableCookies.js testRemoveAllCookies.js testRemoveCookie.js
  • bug 912941 - Fix scrollIntoView calls for earlier Firefox versions where it hasn't been implemented yet
  • bug 920416 - Update code to use controller.select() in testPreferences/testPreferredLanguage.js
  • bug 919932 - Clean up multiple instances of teardownModule found in the same test
  • bug 835383 - Add test that installs an addon without EULA directly from addons.mozilla.org

• Working on:
  • Andreea
    • bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted
    • bug 916380 - Modal XPI installation dialog is shown during the restart of Firefox and blocks its shutdown
    • bug 758187 - [landed on nightly, need backport] Write a new mozmill test for checking location sharing
    • bug 853005 - Update automation script should exit with a non-zero exit code if unable to get update channel

• • Cosmin
    • bug 916380 - Modal XPI installation dialog is shown during the restart of Firefox and blocks its shutdown
    • bug 890181 - Test failure "Tab has been closed" when trying to close a tab with close button
    • bug 904577 - Method exists() from elementslib.Elem returns true even after the node has been removed
    • bug 865640 - 3rd party plugin failures: "Shockwave Flash is disabled - 'true' should equal 'false'" and "Java Plug-in 1.7.0_21 has been disabled - got 'false'"

• • Mario
    • bug 835296 - Add test that installs an addon with EULA directly from addons.mozilla.org
    • bug 920497 - Update closeTab method in tabs.js to prevent wrong index values
    • bug 786306 - Add more logic to the restart tests to skip following test files if a test is failing
    • bug 874344 - Test failure 'New tab has been opened' in testTabbedBrowsing/testNewTab.js

• • Andrei
    • bug 917771 - Test failure "The next result has been selected - '0' should not equal '0'" in testFindInPage

Mobile (Robocop)

• Progress on Robocop Automation
• Bugs with work in progress:
  • bug 820859 - Robocop: Add test for 'Clear Private Data'
  • bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
  • bug 836341 - Robocop: Add test for "Clear download history"
  • bug 899187 - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in
  • bug 888277 - Robocop: Add test for Private Browsing
• Bugs awaiting integration:
  • bug 899182 - [fig] Re-implement robocop testBookmark.java.in
• Bugs recently integrated:
  • bug 896574 - [fig] Fix and re-enable testAddSearchEngine
  • bug 907734 - Robocop: Split database interactions and strings definitions in separate classes to structure Robocop apis better
  • bug 916107 - Tag the BrowserSearch ListView and the TopBookmarksView in order for UI tests to access them
  • bug 896566 - [fig] Fix and re-enable testClearPrivateData
  • bug 896557 - [fig] Fix and re-enable testWebContentContextMenu
• Issues
  • We are waiting for the new-new-about-home work to finalize before completing the bookmark tests and focusing on other tests.

Personal Status

For the personal status please check the weekly status updates:

• 130930 - 131004

Meeting Notes

The meeting notes for this meeting can be read in the following etherpad:

• http://etherpad.mozilla.com:9000/automation-developer-meeting-20130930

Action items

• [NEW]  %name%: %task%