QA/StaffMeetings/QA-Staff-05-01-2013
From MozillaWiki
< QA | StaffMeetings
May 1, 2013 # Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core # # Vidyo: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh # Phone: +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL) # +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free) # +1 416 848 3114 x92 Conf# 9245 (Canada) # IRC: irc://irc.mozilla.org:6697/#qa
QA Org Items
New Hires & Interviews
Upcoming Events/Conferences
Jammink invited to speak at MobileWebDevcon in Boston, July 16th-18th
Open Badges Brown Bag - Thursday at Noon in Ten Forward - https://bugzilla.mozilla.org/show_bug.cgi?id=858152
Reference spreadsheet - https://docs.google.com/spreadsheet/ccc?key=0AsHml-k4XnX7dG1tV0JLTE1yZjJlM2RqaVdfS24zX0E&usp=sharing
Mozilla Mt. View Meetup scheduled for Monday, May 20 - WebRTC with Jason Smith at Hacker Dojo http://events.hackerdojo.com/event/2839004-mountain-view-mozilla-meetup-group
mbrandt - Telerik Testing Summing in Austin, Texas, May 3rd - May 4th.
Notices
Travel / PTO
[jammink] May 1 (working half day - birthday!)
[mwobensmith] PTO Friday, 5/3
[juanb] PTO: May 2 - 7
[tony] MMS Workweek in Portland, 4/30 - 5/3
[geo] PTO: 5/24, 5/28-5/29
QA Team Updates
Desktop (Juan)
Firefox
Firefox 21.0b6 candidates available for testing -- please use this as your day-to-day build for a couple days to dogfood for plug-ins related issues:
ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/21.0b6-candidates/build1/
ESR (mwobensmith)
Stability (marcia)
Weekly Stability Report: https://wiki.mozilla.org/Platform/2013-04-30#Stability
https://bugzilla.mozilla.org/show_bug.cgi?id=865701 caused a very high spike on Beta 4, but fortunately has not been seen in Beta 5
Automation (ashughes)
WebRTC (jsmith)
Next Week
Automation - addIceCandidate, critical crashtests, FxAndroid
Exploratory testing around WebRTC fixes landing
Working on automation plan to get tests running on B2G emulators
Last Week
Test run on media stream tracks
Debugging media flow automation
Debugging FxAndroid automation
Add ice candidate smoke test automation complete
Security (mwobensmith)
Mixed content blocking feature
Community
Mobile (Tony)
Issues
Fennec
Scrollable address bar prefed off on Aurora (FxA 22)
https://bugzilla.mozilla.org/show_bug.cgi?id=867637
L10N repack changes on (FxA 23); mobile stopped packaging a whole ton of files as part of the multi-locale builds. If you see any regressions, please file a bug and CC :Pike, :wesj.
B2G
Today's Inari v1.0.1 smoketests - 100% passed!
Blocked on Leo phones not seeing cell and data (bug 859260)
MMS workweek this week, trying to land all work in the next week - QA supporting testcases
IOT #2 for latam starts next week
Fennec (Kevin/Aaron)
Testing split Java/chrome strings
bug Bug 856445 needs support
Stability (nhirata)
https://wiki.mozilla.org/CrashKill/2013-04-29#Mobile
B2G (Geo/jhammink)
1.1
Assessing test coverage gaps for 1.1. and filling them
Preparing for regression run of 1.1 (possiblynext week)
Checking leorun1 whiteboards for regressions
1.0.1
Burning down IOT bugs for round 2 certification
4/26 partner build is intended for round 2, however
32 open IOT bugs
of those, only 13 resolved
of those only 2 out of the first five I've tested appear to actually be fixed
checking inarirun1 whiteboard bugs for regressions
qawanted
resolved fixed
Stability (nhirata)
https://wiki.mozilla.org/CrashKill/2013-04-29#B2G
There's a number of blocking bugs in terms of Leo:
https://bugzilla.mozilla.org/show_bug.cgi?id=857632
https://bugzilla.mozilla.org/show_bug.cgi?id=859260
https://bugzilla.mozilla.org/show_bug.cgi?id=851812
Leo basebuild is necessary in order to flash with the latest build or you will get a kernel panic on the phone.
Apps (jsmith)
Burning through partner app customization testing
Initial results already show we're generally not meeting TEF's requirements
Heavily doing triage and reporting right now
Verifications
Sent out a proposal to get some consistency in how we are verifying bugs
https://mozqa.etherpad.mozilla.org/Bug-Verification
Smoketests
Round one of Smoketest Revision Meeting was held on Monday.
https://mozqa.etherpad.mozilla.org/Smoketest-Brainstorm
Round Two to be scheduled by marcia
Dietrich likes the changes we made to the smoketest report
Followup discussion re: CTS estimate with QC happened, kicked off first iteration of http://bit.ly/moz-cts-planning. Strategy concentrates on verifying Gecko interaction w/ OEM hardware. (geo)
Determined Platform QA goals: attacking Web Apps automation this quarter, along with expanding out legacy mochitests and compatibility suite. (geo)
Camera mochitests landing https://bugzilla.mozilla.org/show_bug.cgi?id=864621 (dclarke)
Work continuing on landing legacy mochitests. Working to fix issue with focus getting lost during tests https://bugzilla.mozilla.org/show_bug.cgi?id=861689 (martijn)
Community Members Onboarding
Services (Edwin)
Work week 5/6 week in Vancouver
Identity
Yahoo bigtent fix - postponed
AWS integration 5/13
Vinz Clothor - mozilla.{com,org} idP - 5/20 [karl]
b2g merge - this train - first test pass complete
train-2013.04.26 in progress for release next Wednesday 5/8
PiCL
Planning - dependencies: PiCL - Sign In
First brainstorm of QA requirements is under review
Many, many difficult design talks/reviews are under way right now
Services
2 days of Heka testing scheduled
PushServer Dev needs some QA time in mid-May. They will send details soon...
Web (Stephen)
Affiliates
No updates
B2G/Gaia testing:
keep up-to-date with all the latest in a nice, digestible format, here:
https://github.com/mozilla/gaia-ui-tests/pulse
have Unagi commercial-RIL builds in our CI, with runs against them
apart from an annoying "ding"-on-notification issues (each restart), they look good
now we can troubleshoot the modem issue
Inaris requested from ServiceNow
have an engineering build on 1.0.1 for them
will soon set up a download job and run against them
3 new tests (Marketplace, Settings)
Some good coverage re-enabled as devs repaired regressions
Full-steam ahead on Payments testing although no significant coverage in place yet
Dave Hunt made good gain in reliability by configure device state before the testrun
mbrandt 1.1 manual testing and testcase creation
Bouncer
No updates
Engagement Projects
Firefox flicks updates its carousel, blog posts, jugdges list and early winners
ReMo put out a new release with bug fixes and some back end feature components
Firefox Health Report
Small release on 2013-05-01
https://bugzilla.mozilla.org/show_bug.cgi?id=858242
https://bugzilla.mozilla.org/show_bug.cgi?id=856315
https://bugzilla.mozilla.org/show_bug.cgi?id=862002
Firefox Marketplace
Marketplace login is automated, lots of work in-progress for payments testing
working on sorting out the dev/staging test-environments issues to pave the way for the automation we're already working on
escalating to our payments partner for their support
http://mzl.la/11CZ6Ze goes live tomorrow
Mozilla.com
pushed https://github.com/mozilla/bedrock/compare/a8597793ab53b600af8ad2679c9cc7c79e17f5e4...master
Mozillians
2013-05-02 release scheduled for tomorrow
https://wiki.mozilla.org/Mozillians/Releases/2013-05-02
MDN
http://bit.ly/UbALKp
Socorro
Milestone 44 released on 2013-05-01
https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&target_milestone=44&product=Socorro&list_id=6436947
Community Members Onboarding
Community (Marcia)
Grow Mozilla Meeting this Thursday
https://wiki.mozilla.org/Grow/Meeting_05_02_13
Projects
[One and Done] Mockups for wizard created. The wizard helps new contributors choose their areas of interest. https://wiki.mozilla.org/QA/Taskboard/Workflows/New
Upcoming Events
Mozilla Summit update
Voting has been completed on the first round of community nominations
Paris is no longer the European City
Working idea:
Teams will be given equal spots in each city and among them they can decide who goes where.
Summit Planning Assembly meets June 14-16th, 2013
Testdays (ashughes)
Firefox 21 Plugins: https://etherpad.mozilla.org/testday-20130507
Contact ashughes if you are interested in organizing a testday this quarter
Video Work
No update this week
QMO.next (Raymond)
no update
Community Members Onboarding
:suchcoder helping with MozTrap
Automation Development (Henrik, Dave)
General
mozdownload 1.7.1 released: https://github.com/mozilla/mozdownload/issues/75
Projects
Mozmill:
Mozmill 2.0rc2 released: https://groups.google.com/forum/?fromgroups=#!topic/mozmill-dev/YrmpKDW8SzQ
Gaia:
Gaia endurance tests landed: https://github.com/mozilla/gaia-ui-tests/commit/b00cb8fa2973b2cd325db7e527f0bf68ba64af16
MozTrap (Cameron)
Met with Stephen, Rebecca and Matt Brandt to talk about future work on MozTrap.
Collected some action items and wishlist items.
Experimenting with sorting by result while running tests. Trickier than you might think...
Community Members Onboarding
:suchcoder is investigating helping develop a couple new features in MozTrap.
Roundtable/Discussion Items
[whimboo] https://bugzilla.mozilla.org/show_bug.cgi?id=866881 - Having Groups in Mozillians directory be public
[jsmith] End of the road testing on B2G - resource preparation for high risk areas for QA
Example - Late rewrite of Google Calendar authentication in the Calendar App
[marcia] Any update on potential QA Director candidates?
Notes, Takeaways and Action Items
Today
Notes
Action Items
Action Items