Auto-tools/Automation Development/Meetings/130715
From MozillaWiki
< Auto-tools | Automation Development | Meetings
previous meeting | Meetings | next meeting »
Contents
Dial in
# When: Every Monday at 8:45am PDT/PST # Vidyo: https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz # Phone: 650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL) # 1-800-707-2533 (pin 369) Conf# 9654 (US) # IRC: irc://irc.mozilla.org:6697/#automation # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation
General
- Attendees:
- Dave, Andrei, Daniela, Andreea, Rob, Adrian, Henrik, Cosmin, Otilia
- Chair: Henrik
- Notes: Andreea
Last Weeks Action Items
- [CARRY OVER] Henrik - Start a thread on the public list to collect ideas for the show and tell
- [DONE] Henrik - Develop patch/update to only enable Mozmill restarts and not user-initiated restarts
- Not sure what this entry was about, but I'm not going to fix that for 2.0. The bug has been filed btw.
- [CARRY OVER] Dave, Rob - Discuss gaia-ui tests, autolog, heuristics and html reports
Highlights
- [henrik] Due to the constant failures in submitting Mozmill test results to iriscouch we have been moved to a new server. Big thanks goes to Jason Smith from IrisCouch for his ultra-fast response and action!
- [henrik] About to fix a major bug in jsbridge which leds to dataloss when sending too much data. See bug 764640.
- [dave] First passing Travis-CI build for Gaia UI tests on desktop build!
- [dave] HTML report for Gaia UI tests finally available!
- [dave] Gaia UI tests are now running (and passing!) in TBPL against the Cedar branch
- [dave] b2gpopulate 0.8 released with support for call history and MMS messages
- [dave] b2gperf 0.5 released
- New blockers, any updates?
- bug 892928 - b2gperf is failing to gather FPS measurements on mozilla-central builds
- bug 893693 - TypeError: IccHelper.removeEventListener is not a function
- You can find all blockers here: http://bit.ly/Tph0NY
Roundtable
- [Andreea] Bug Priorities
- P1 - critical, constant failures, important enhancements (regressions, tests that fail constantly. I'd say even if skipped)
- P2 - mozmill 2.0 blocker (if release is approaching, this can take higher priority in order to finish in time)
- P3 - not that often failures, medium enhancements
- P4 - new tests - the ones needed by the QA team have higher priority
- P5 - refactoring, small enhancements
- Dependecies take the blocking bug's priority
- Our prioritized backlog: https://docs.google.com/spreadsheet/ccc?key=0AgbJACdAek5ndGw5TWNuWWw1VFFzelZHektWRTNaSnc#gid=10
- [Mario] UI objects for content pages
- Do we want to create UI objects in the libraries for content pages?
- Related to Bug 835383 : https://bugzilla.mozilla.org/show_bug.cgi?id=835383
- Do we want to create UI objects in the libraries for content pages?
- [henrik] Do we want to make use of github releases instead of uploading versions to pypi directly?
- See https://github.com/blog/1547-release-your-software
- That would simplify the release process drastically for our projects
- Downside would be when github is not reachable, you wont be able to install applications
Goals Overview
Project Updates
Gaia UI (Dave)
- Goals progress:
- See highlights
WebAPI (Rob)
- Submitted patch to fix two WebTelephony WebAPI failures
WebRTC (Henrik)
- In process to get the datachannel framework backported - currently blocked by try outage
- Most likely working on two or three other enhancements
Games Benchmarking (Rob, Joel, BC)
- [rwood] Working on getting speedtests running on Firefox OS
Softvision Updates
Desktop Automation
- Goals progress: Mozmill 2.0 releases
- Fixed:
- bug 882068 - Test failure "linkId.getNode(...) is null" in testSessionStore/testUndoTabFromContextMenu.js with Mozmill 2.0
- bug 887315 - Mutt test window_focus.js fails with: "Windows have maintained their order - '[3,31,41]' should equal '[3,41,31]'
- bug 887258 - Disable new tab preloading preference in mozmill 1.5
- bug 890883 - Test failure due to timeout when trying to find the Find Bar in testFindInPage
- bug 889314 - Update the restartless.xpi addon to be compatible with AMO. Set maxValue to a valid value instead of "*"
- bug 891842 - Test failure 'Expression "{"anonid":"findbar-textbox"}" returned null. Anonymous == true' in testFindInPage.js
- bug 892946 - Test failure in testFindInPage due to the fact that the find bar was moved to the top
- bug 892388 - Create a clone of restartless.xpi for uploading to AMO with an end user license agreement
- bug 763461 - Mozmill tests for cut-off elements should not report failure for scrollable direction
- Working on:
- Daniela/Cosmin
- bug 885221 - controller.waitForPageLoad() failures with mozmill 2.0 due to closeAllTabs method opening about:newtab instead of about:blank
- bug 880135 - Test failure "The tab with index '1' has been selected" in testOpenInBackground.js
- bug 684801 - Timeout failure in /testTabView_SwitchTabs/test1.js | TabView is still open.
- Andreea
- bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted
- bug 880417 - Create user interface shared module for metro
- bug 853005 - Update automation script should exit with a non-zero exit code if unable to get update channel
- Mario
- bug 874394 - [Australis] Test failure in '/testAwesomeBar/testPasteLocationBar.js' due to the urlbar-container not being found
- bug 835296 - Add test that installs an addon with EULA directly from addons.mozilla.org
- bug 835383 - Add test that installs an addon without EULA directly from addons.mozilla.org
- bug 835132 - Test failure "Current domain name matches target domain name" in /testSearch/testSearchSelection.js
- Andrei
- bug 888196 - Memory increase in endurance testsruns on Win 8 (since June the 16th) - running more endurance tests on SCL
- Daniela/Cosmin
Bug number | Status | Requestee | Requester | Bug Subject |
bug 489474 | Review | Henrik | Andreea | Write automated tests for user generated video controls |
bug 800872 | Review | Henrik | Andreea | Test failure "Window number '1' has been opened" in endurance/testTabbedBrowsing_OpenNewWindow/test1.js |
bug 786306 | Review | Henrik | Mario | Restart tests logic |
bug 732353 | Feedback | Henrik | Daniela | Disable all Discovery Pane tests due to unpredictable web dependencies |
bug 799149 | Review | Henrik | Daniela | Add mozmill test to ensure that there are no conflicts in context menu access keys. |
bug 791634 | Review | Henrik | Daniela | Make waitFor() method available in the assertions module (also for soft assertions) |
bug 871441 | Feedback | Henrik | Daniela | Focus inside the select method is not set properly on the menulist |
bug 886811 | Review | Henrik | Andrei | Use controller.restartAppplication() instead of controller.startUserShutdown() for mozmill-2.0 |
bug 838192 [Pull Request] | Review | Henrik/Dave | Andrei | Add screenshot functionality to assertion module |
bug 599290 | Feedback | Henrik | Cosmin | Update SoftwareUpdateAPI to support complete relocation to the about dialog |
bug 874393 | Feedback | Henrik/Dave | Mario | [Australis] Update SoftwareUpdateAPI to support complete relocation to the about dialog |
Mobile (Robocop)
- Progress on Robocop Automation
- Bugs with work in progress:
- bug 820859 - Robocop: Add test for 'Clear Private Data'
- bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
- bug 836341 - Robocop: Add test for "Clear download history"
- bug 869277 - Intermittent testAddSearchEngine | The number of search results has increased - got 5, expected 10
- bug 854043 - Intermittent testWebContentContextMenu | Verify that the download started - The download started
- Bugs awaiting integration:
- bug 888277 - Robocop: Add test for Private Browsing
- Bugs recently integrated:
- bug 886299 - Intermittent testShareLink | Exception caught - junit.framework.AssertionFailedError: The text: Share is not found!
- Issues
- Because of bug 891889 - Only running 2 of 3 chunks for Android 4.0 robocop - we can't integrate any new tests since they are not run on the tryserver
- I was unable to build the armv6 version in order to debug bug 869277 - the testAddSearchEngine intermittent fail - logged a new issue: bug 893759 - Unable to build armv6 on linux x86_64 from the latest m-c sources
- The implementation of the new multipage about:home on mobile will most likely cause a need to rewrite most of the tests
Personal Status
For the personal status please check the weekly status updates:
Meeting Notes
The meeting notes for this meeting can be read in the following etherpad:
Action items
- [CARRY OVER] Henrik - Start a thread on the public list to collect ideas for the show and tell
- [CARRY OVER] Dave, Rob - Discuss gaia-ui tests, autolog, heuristics and html reports
- [NEW] Henrik - talk to Clint about next quarter goals
- [NEW] Andreea - start a mail thread about the bug priorities