QA/StaffMeetings/QA-Staff-05-21-2014

From MozillaWiki
Jump to: navigation, search

Mozilla QA Meeting May 21 , 2014 (Video Replay)

# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Room: QA
#
# Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
# Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)
#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://irc.mozilla.org:6697/#qa

Actions From Last Week

QA Show and Tell

https://wiki.mozilla.org/QA/Show-and-Tell#Schedule

  • This week:
    • WebRTC Tiger Team: Steeplechase deployment
  • Next week:
    • Services: Graphs and Screenshots [edwong]

Milestones and Calls for Action

Achievements

Upcoming Events/Conferences

Community

Contributor Welcome

These are new contributors, if you see them around, say hello

  • New One and Done Contributor: Welcome Shreyas aka dun3buggi3!

Contributor Honor Roll

For those that went above and beyond this week, we salute you here.

Updates

How To Find Us

Internal Goals

Detailed Updates

Below follows detailed updates on what each team is working on and toward. The leads highlighted in each section are the people you want to find if you're interested in helping out.

Desktop (Juanb)

  • Firefox
  • ESR (mwobensmith)
  • Stability (KaiRo)
    • No useful crash rates for nightly due to ADI issues, we are backing out bug 1006615 that tried switching us to the future ADI collection mechanism (which isn't fully ready yet).
    • The 29 release seems to have very slightly higher crash rates than 28, probably just known issues we fixed for 30 already.
    • Need to see more data of builds with fixes in 30 to make sure we fixed regressions, also tracking two new regressions around stopping plugins (bug 883134 and bug 1013972).
  • Automation (ashughes)
  • Security (mwobensmith)
    • Ongoing pkix, key pinning, root cert removal testing

Mobile (Tchung)

  • Firefox for Android (Kbrosnan/AaronMT)
    • Stability (kbrosnan)
  • Firefox OS (jsmith/nhirata)
    • 1.3t
      • Tarako coming to a close… hopefully soon!
      • l10n questions arose; Partner blocking on 3rd party apps bugs: Facebook, twitter, you tube
      • We already released versions to OEM against QA's advice
      • 47/47 tests passing, no blockers
      • next deadline 5/26
      • Smoke testing ending 5/30; QA wanted, exploratory testing as needed
    • Stability (nhirata)
    • 1.4
      • 46/48 tests passing, 2 blockers - due to switching Flame to correct DPI setting
      • Non-smoketest, but bad bug found with right DPI setting set in wallpaper app - https://bugzilla.mozilla.org/show_bug.cgi?id=1011460
      • QA signoff analysis
        • [Pass] 3 test runs complete
        • [Pass] Final test run had >= 98% test coverage (99% coverage total)
        • [Pass] Final test run <= 10 blockers (6 blockers found)
        • [Pass] Test Failure % has a downwards trend (8.80%, 6.28%, 5.03%)
        • [Fail] Smoketest Greenness - greater than five days with no smoketest blockers
          • Failed due to bad bugs found when fixing the DPI setting for Flame builds
        • [Pending] Qualitative signoff of 4 - 5 exploratory areas
          • Camera
          • Partner Apps
          • Top Sites
          • Reference Workloads
          • Real User Phone Usage
      • 1.4 localization test run complete
      • 1.4 exploratory testing ongoing
      • 1.4: smoke testing + exploratory + qawanted
    • 2.0
      • 48/48 tests passing, 0 blockers
      • Test planning in progress for 2.0 features
      • 2.0 test planning in process
      • 2.0 targeted feature test runs this week as needed
      • in-moztrap sprint for partner blockers & invalid test cases
    • Gaia UI Automation
      • 2.0 - 38/39 smoketests, 76/78 non-smoketests
      • 1.4 - 33/37 smoketests, 79/82 non-smoketests
  • Smoketests
    • Reorganizing the order of smoketests
    • Continuing testing on all 3 branches

Platform (sydpolk)

Services (Edwong)

  • FxA
    • OAuth work (intern/selenium)
    • FxOS tests
  • Sync
    • Monitoring
    • DIY server
  • FMD
    • App Server testing
  • Loop
    • load testing server, staging is stood up

Web (Stephend)

Firefox Automation (Whimboo)

  • General
  • Projects
    • Mozmill
      • Figured out the problem with non-working pulse triggered Mozmill tests for beta and release builds - we are working on a solution
    • TPS
      • Requested new VMs and machines for the CI system in SCL3

Travel / PTO

  • [geo] PTO May 22-23, 27-28 (BayCon)
  • [jsmith] PTO May 21st - 23rd, Remote from NY May 27th - May 30th
  • [kthiessen] PTO May 21-June 1 http://baycon.org is Memorial Day Weekend -- come join us!
  • [nhirata] PTO May 23
  • lizzard out May 22-26
  • stephend on PTO May 29/30
  • Anthony Hughes will be in Mountain View May 26-30 for the Partner Engineering work week

Template available at: https://etherpad.mozilla.org/qa-mtg-template

Retrieved from "https://wiki.mozilla.org/index.php?title=QA/StaffMeetings/QA-Staff-05-21-2014&oldid=985925"