Auto-tools/Meetings/2012-07-02
From MozillaWiki
< Auto-tools | Meetings
Contents
- 1 Goals Progress
- 2 Highlights
- 3 In-Depth Project Discussion
- 4 The Overview
- 4.1 AutoPhone/Noah's Ark
- 4.2 Bughunter
- 4.3 Bugzilla
- 4.4 Eideticker
- 4.5 Firebug Testing
- 4.6 Jetperf
- 4.7 Marionette
- 4.8 Mobile Automation
- 4.9 Mobile Evangelism Site-Scraping Tool
- 4.10 Mochitest
- 4.11 MozBase
- 4.12 Mozmill
- 4.13 MozTrap
- 4.14 New Graphserver (Datazilla)
- 4.15 Open Web Apps
- 4.16 Peptest
- 4.17 Powerball
- 4.18 Pulse
- 4.19 Signal From Noise
- 4.20 Speedtests
- 4.21 Systems
- 4.22 Talos
- 4.23 Sheriffing & Trees
- 4.24 Tinderboxpushlog
- 4.25 Treestatus
- 4.26 War on Orange
- 4.27 Web QA
- 5 Upcoming Events
- 6 Round Table
- 7 Misc
Goals Progress
Below are our top level goals. Beneath each goal, note any progress made towards that goal this week.
- [DONE] Extend Mobile Platform Automation for B2G and Fennec Native to extend our automation systems to work with specific phone hardware and new development boards for both products.
- [DONE] Datazilla: Provide generic interfaces/web app plugability for new harnesses to reuse the same infrastructure backend
- We now have error-tracking in place that will make it easier to track down issues with data we are getting from test harnesses.
- [DONE] Datazilla: Ensure that new UI is based on extensible statistics package that can be used both by developers and the graphserver UI.
- NOTE: Revised deliverable in light of developer feedback and changed course mid-quarter to deliver a system that would turn TBPL orange/green based on per-patch regression detection, this means we won't deliver the UI by end of quarter, but we'll still land datazilla on production hardware in end of Q2/early Q3 (waiting on hardware to arrive)
- Hardware has arrived, IT is working on setting everything up, security review meeting will be this week.
- NOTE: Revised deliverable in light of developer feedback and changed course mid-quarter to deliver a system that would turn TBPL orange/green based on per-patch regression detection, this means we won't deliver the UI by end of quarter, but we'll still land datazilla on production hardware in end of Q2/early Q3 (waiting on hardware to arrive)
- [DONE] Signal From Noise Phase II - Make the same noise-reduction changes we made on Tp5 on all the other page-load tests and ensure all performance tests are sending raw observations to Datazilla.
- [DONE] Refactor how rapid-release tracking flags are implemented for improved performance and maintainability
- Code complete, just needs testing (and lots of it).
- May schedule for after 4.2 so that we don't have to retest with 4.2.
- [AT RISK] Upgrade bugzilla.mozilla.org to Bugzilla version 4.2
- [glob+dkl] Testing of BMO 4.2 code and debugging and fixing of several issues such as HTML email, SecureMail, etc.
- SecureMail raising more issues than expected.
- Expect test systems to be sanitised and open early this week.
- Hopefully aiming for release around July 23.
- [DONE] Reduce android test automation instability and make it easier for the web QA and desktop QA teams to write and run automated tests.
Highlights
This is a place for people to put announcements or to describe activities that they'd like to highlight. It's not the responsibility of the MC to find things to put here.
In-Depth Project Discussion
Sam will present on Spade.
The Overview
Progress, notes, problems, and other statuses about current projects. Add any new projects to this template!
AutoPhone/Noah's Ark
Bughunter
[bc] Working on testing Flash crashiness, developing test cases and testing updates to crash reporter
Bugzilla
- http://globau.wordpress.com/2012/06/28/happy-bmo-push-day-3/
- [glob+dkl] bmo/4.2 testing and fixing
- [dkl+glob] various upstream reviews and patches
- [dkl] securemail updates for 4.2
- [glob] qa-migration scheduling
- [glob] improvements to bmo/4.2's bugmail
- [dkl] component search now everywhere!
- [dkl+glob] bmo administrative work, as always
Eideticker
Firebug Testing
Jetperf
- [jhammel] need to serialize addons for datazilla upload
- [jhammel] jetperf config files WIP
Marionette
- [mdas] updated b2g build times, updated b2g perf test code and test runner, currently investigating why marionette on emulator is broken.
- [mdas] fixed one regression (bug 761202) but bug 753490 is proving to be difficult, need to spend more time on this next week.
Mobile Automation
Mobile Evangelism Site-Scraping Tool
- [samliu, carljm] - spider successfully crawls the list of 18,000 sites with multiple UA strings, following links one level deep, and storing all HTML/CSS/JS
Mochitest
MozBase
- [henrik] MozInstall 1.1 has been released (no assert in is_installer() anymore)
Mozmill
- [henrik] A couple more of refactoring patches for Mozmill have been landed (PEP8, --restart)
- [henrik] We now use pprint-color as default logging format (Mutt takes that too)
- [henrik] Transformed our mozmill-automation scripts to a real Python package
- [henrik] Added support for functional, remote, and l10n testruns to mozmill-automation for Mozmill 2
MozTrap
- [camd] completed the results API feature and tests
- [carljm] figured out broken result-api test and reviewed and merged result-api branch to master
- [camd] created a 1.1.X branch and requested it be pulled to staging (moztrap.allizom.org)
New Graphserver (Datazilla)
- [jeads] Putting the finishing touches on a two legged Oauth implementation in datazilla. This is in preparation for the datazilla security review this week.
- [carljm] implemented error-tracking for data ingestion, so when data is missing we have a record of exactly why it failed to ingest
- [carljm] increased test coverage of core data model code from 30% to 85% (full coverage of data ingestion code, missing coverage of UI-support code)
- [samliu] completed implementation of objectstore branch, separating acceptance of data via REST endpoint from actual data ingestion
Open Web Apps
Peptest
Powerball
Pulse
Signal From Noise
Speedtests
Systems
Talos
- [jhammel] talos now serializes for datazilla using simplejson/json
Sheriffing & Trees
- [edmorley] Day-to-day sheriffing of the trees.
- [edmorley] Infra/tree closure issues:
- [edmorley] More m-cMerge testing, filed: #10, #11, #12 & #13.
- [edmorley] Discussions with peterbe about the changes in direction for the new Sheriff Duty site.
Tinderboxpushlog
- [edmorley] More papercuts filed: https://bugzil.la/767915,768386
- [edmorley] Patches to fix the reftest analyser for both local testing and prod.
- [edmorley] Reviewed bug 768386 & bug 769018.
- [edmorley] Deployed: https://bugzil.la/768474,768386,769018
Treestatus
War on Orange
- [edmorley] Reviewed bug 765193.
- [edmorley] OrangeFactor patches:
Web QA
Upcoming Events
Standing weekly meeting related to our projects should go here
Round Table
Put your questions and things to raise with the entire team here
- Goals Q3 planning - aka PivotalTracker & You
- Minhea Starts today!
Take notes here and copy and paste them to this section afterwards.
Notes
Holidays and Trips
- Ahal and Jgriffin in MV next week
Next week MC
jeads!
Misc
Find something you think is cool, interesting, funny, or exciting and put it here