QA/Fennec/Waverley/2011-08-23

Meeting Notes for 08-23/2011

Welcome

(eg. headcount, updates with staffing, vacation/away time)

• Aaron (PTO, 22nd-26th)
• Andrei (PTO, 26th-02nd)
• Vlad Maniac - Vacation: August 22 - 31; will return to office on Thursday, September 1st
• Nicolae Cristian - Vacation: August 18 - 31; will return to office on Thursday, September 1st
• New SoftVision team members - photos and contact info here: https://wiki.mozilla.org/QA_SoftVision_Team
  • Ioana Budnar - Desktop Firefox (started today)
  • Carla Nadastean - Fennec (started today)

Take Ways From Last Week

(eg. Action items from last weeks's Take Aways)

• [MISSED] Anthony follow up with Tony RE: Vidyo
• [PTO] Aaron and Kevin to follow up with Tony RE: DeviceAnywhere
• [MISSED] Anthony to follow up with Tony to add Otilia to MozQA Vacation Calendar
• [DONE] Marlena/Vlad to investigate Discovery Pane failures
• [DONE] Matt/Otilia to breakout Softvision standups into separate etherpad

Round Table

• In order to verify some fixed bugs, developers ask to run Mochitests. Our question is how can we run these tests. Is there a tutorial in this matter?
• if the bug is a fix for a failing mochitest, just check the recent tinderbox logs to see if the test still fails

Firefox Updates

(eg. Status, top issues)

Mozilla (ashughes)

• Firefox 7 Features
  • apparently we are missing features not covered in wiki pages, working with Product teams to figure out the situation
  • until this gets sorted out triaging FIXED Firefox 7 bugs is a top priority
• Have asked Softvision to start triaging Input and Endurance dashboards on a daily basis
• Firefox 8 Features - please add your features to the testplan
• Firefox 9 Features - please add your features to the testplan
• Firefox 7 Testday coming up this Friday, covering UNCONFIRMED Graphics bugs, FIXED Firefox 7 bugs, and general Firefox 7 testing (see testplan)
• Firefox 7 Beta 2 should be out later this week -- will be similar in scope to Beta 1

Waverley (Andrei, Alin, Mihaela, Simona, Vlad, Virgil)

• Firefox 7 Test Plan
  • Verification of fixed bugs - milestone "mozilla 7"; tracking firefox 7 "+"
• Firefox 7 Beta1: Test Plan
  • Smoketests
  • Web App Compatibility
  • Exploratory testing
• Firefox 9 Test Plan
  • Triage of Unconfirmed bugs across platforms
  • Noted results for daily endurance tests
• Assigned QA contacts for new Firefox Features Link
• Assigned moderators for testday testplan

Automation Updates

(eg. Status, top issues)

WebQA (Selenium)

Waverly (Teodosia, Florin)

• Code review/Update/Merge
• Fixing AMO failing tests
• Moderated/planned AMO Automation test day

Mozilla (Marlena)

Desktop (Mozmill)

Waverley (Alex, Vlad, Remus)

• Helped the WebQA Team with the testday
• Worked on P1, P2 tests and API bugs
• Investigated failures from WebQA
• Worked on a test theme
• Worked on endurance tests with flash content
• Updated testcases for web console

Mozilla (Anthony)

• Open Web Apps:
  • need to start thinking about a strategy/plan for automated tests
  • will consult with Automation Services this week; stay tuned for update
• Failures: will begin enforcing the "24 hour skipped" policy
  • if you can't fix a failure in 24 hours, submit a patch to the bug to skip the test
  • if the test is only failing on old branches, we will skip the test and WONTFIX the bug
  • if the failure breaks the testrun (ie. Disconnects) it gets top priority over all other automation work
  • otherwise continue to work on the fix with the skipped test
  • [mozmill-test-skipped] - to be used in the whiteboard of a bug when you skip a test

Fennec Updates

(eg. Status, top issues)

Mozilla (ashughes)

• continue to assist with regression window wanted bugs
• beta 2 should be out this week
• Aaron is on vacation so Kevin will be the lead for the build

Waverley (Ioana, Andreea, Catalin, Cami)

• Weekly Status:
  • run BFTs, OS integration tests and daily smoke tests on all new devices (Tablet Acer 500 Iconia, LG Optimus 2X P990, HTC Desire Z, Google Nexus S, Motorola Droid 2) daily results ; archive . Builds tested as follows: Smoketests on Aurora (weekly) on Nightly (daily), BFTs and OS Integration Tests on Nightly and BFTs on Aurora.
  • run performance tests (all) against daily builds with the add-on (daily on aurora and nightly)(result are on server)
  • Beta 7.0b1 results: here
  • Logged issues
  • watch assigned features
  • created Test run for 9.0
• Important bugs:
  • bug 676780 - Fennec is unable to load webpages and close tabs
  • bug 676505 - Unable to trigger a list inside of an Object
  • bug 676238 - about: pages are covered by a black area when device is switched to landscape
  • bug 678159 - [HKb] Unable to load webpages after the language pack is changed
  • bug 680365 - Content of m.youtube.com is not displayed if "Allow Cookies" is set to "No"
  • bug 680900 - Content crash [@ js::RegExp::execute] on Android2.2 when loading pages
• Questions / Issues:
  • Zippity results are not posted anymore (since august 11th)

Take Aways This Week

(eg. Action items)

• Carry-over Action Items
  • Anthony follow up with Tony RE: Vidyo
  • Aaron and Kevin to follow up with Tony RE: DeviceAnywhere
  • [DONE] Anthony to follow up with Tony to add Otilia to MozQA Vacation Calendar