QA/Automation/Meetings/140505
From MozillaWiki
< QA | Automation | Meetings
« previous meeting | Meetings | next meeting »
Contents
Dial in
# When: Every Monday at 8:45am PDT/PST # Vidyo: https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz # Phone: 650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL) # 1-800-707-2533 (pin 369) Conf# 9654 (US) # IRC: irc://irc.mozilla.org:6697/#automation # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation
General
- Attendees:
- Chair: Andrei
- Notes: Kamil
Last Weeks Action Items
- [CARRY OVER] [Henrik] get information on how to setup a blog on mozilla.com
- Still under discussion if it is worth to have that or to collect posts under Planet
- [ON TRACK] [Marc] Contact Doug regarding geolocation tests
- [DONE] [Henrik] setup template project for goals
- See the Puppet project page
- [DONE] [Henrik] Create bug to get a temporary Mac Mini setup for DeployStudio testing
- Filed bug 1002624
- [DONE] [Andreea] Find possible days for automation training days
- We propose to have those on: May 21st and 28th | June 4th and 11th. Would be 4 consecutive weeks, on each Wednesday, easy to remember.
- [NEW] [Kamil] Get back to Jim regarding the new app notification (bug 979249)
Highlights
- [henrik] We have a mirror of the mozmill-tests repository on github (bug 997743): https://github.com/mozilla/qa-mozmill-tests
- [henrik] Firefox Automation report – week 11/12 2014: http://www.hskupin.info/2014/05/05/firefox-automation-report-week-11-12-2014/
- New blockers, any updates?
- bug 735184 - RFE: Create Pulse notifications for update channel activities
- [DONE] bug 997739 - Please create clone of puppet repository for QA infrastructure
- [DONE] bug 973901 - Add mapping for crashreporter-symbols.zip for nightly builds on ftp.mozilla.org
- Github blockers:
- Bugsahoy does not work for language options of github repositories: https://github.com/jdm/bugsahoy/issues/71
- Cannot delete workspace problem on Windows: https://github.com/mozilla/mozmill-ci/issues/358
- You can find all blockers here: http://bit.ly/Tph0NY
Roundtable
- [Andreea] We still have an open question about the testrun reports
- From what I understand, train owners are responsible to check the test failures for beta
- What about the fact that testruns have been ran for each platform/version/locale, no matter the results?
- In case pulse doesn't trigger something or we have aborted testruns that weren't retriggered
- https://docs.google.com/spreadsheet/ccc?key=0ApWA7fkeN63IdC16dTViT3RNbWlZcGtVMURTcTBiRmc&usp=sharing
- [Otilia] What distribution list should we use for our daily updates and planning emails? Options: dev-automation, dev-quality
Goals Overview
- Project planning meeting: https://vreplay.mozilla.com/replay/showRecordingExternal.html?key=OeiX2wBifFzD88Q
- https://wiki.mozilla.org/QA/Automation#Goals
Project Updates
Puppet for Mozmill CI (Henrik, Andreea, Andrei)
- Current goal status:
- Still under planning - we will get started soon
- Notes
- Not being worked on the last week
TPS continuous integration (Henrik, Cosmin)
- Current goal status:
- Planning session happened today - Project page has to be setup
- Notes
- Nothing changed since last week
Automation of important tests for Desktop QA (Daniel, Mihaela)
- Current goal status:
- added feature tests
- Notes
- need to update the tests and prioritize them
Automation Trainings (Andreea, Cosmin)
- Current goal status:
- We propose to have those on: May 21st and 28th | June 4th and 11th. Would be 4 consecutive weeks, on each Wednesday, easy to remember.
- Notes
- We established to have blog posts from each of us to planet
- Also talk to Ioana Chiorean for support on promoting the training inside the community
Mozmill for Marionette (Andrei, Andreea)
- Current goal status:
- Haven't started yet, we'll probably start this week and sketch a plan
- Notes
- TBD
Others
- Mozmill (Henrik)
- JSbridge disconnects may be related to the short delays for the addon installation dialog. Maybe we don't have a sane shutdown of Firefox
- With having the crash reporter symbols available we can continue in adding full mozcrash support to Mozmill
- TPS (Henrik)
- Disabling automatic sync should fix all remaining intermittent TPS test failures (see bug 1003250)
- WebRTC (Nils)
- Trickle ICE is not working https://bugzilla.mozilla.org/show_bug.cgi?id=1004530
- WebRTC team makes slowly progress in turning the 3 server setup into an automated testing lab https://intranet.mozilla.org/QA/WebRTC_Lab
Softvision Updates
Desktop Automation
- Goals progress:
- Resolved Fixed:
- Working on:
- Andreea
- [Mozmill Automation] Add test-run for structural tests (developers, back-end tests)
- bug 994040 - Failures across several tests due to notification panel changes - 15 tests affected
- bug 1003052 - Update machines to the latest Flash [04/29]
- bug 1004986 - [zh-CN] Test failure "(NS_ERROR_MALFORMED_URI) [nsIWebNavigation.loadURI]" in mozmill tests
- Andrei
- bug 994658 - Several JSbridge disconnect failures
- bug 972912 - Mozmill fails to ran all expected tests
- Cosmin
- bug 1002394 - Test failure "Add-ons Manager has been opened" across addons tests
- bug 732353 - Disable all Discovery Pane tests due to unpredictable web dependencies
- Daniel
- PTO
- Mihaela
- bug 967568 - Create Mozmill test for Firefox's safebrowsing feature
- bug 987185 - Add test for the functionality of the Sync button when user is signed into an account
- investigate needinfo? bugs: bug 1001755, bug 1001754
- Andreea
Personal Status
For the personal status please check the weekly status updates:
Meeting Notes
The meeting notes for this meeting can be read in the following etherpad:
If you missed the meeting you can also watch it in our archive.
Action items
- [NEW] [Marc] Finalize the test plan for geolocation tests with Doug
- [NEW] [Andreea] Send email for possible automation training days
- [CARRY OVER] [Kamil] Get back to Jim and let him know he can go ahead with the fix in try builds
- [NEW] [Andrei] Update mozmill-tests documentation for patch handling on MDN for github users
- [NEW] [Henrik] File an issue for mozmill-dashboard to get an overview page for testruns executed by buildid
- Might already been filed: https://github.com/mozilla/mozmill-dashboard/issues/93