Firefox/Channels/Meetings/2018-10-30

Channel Meeting Details

• Tuesdays 10am and Thursdays at 8am Pacific Time
• irc.mozilla.org #planning for backchannel

Video/Teleconference Details - NEW

• 650-903-0800 or 650-215-1282 x92 Conf# 99951 (US/INTL)
• 1-800-707-2533 (pin 369) Conf# 99951 (US)
• Vidyo Room: Release Coordination
• Vidyo Guest URL

Attendees

marcia, philipp, Thomas, Tom, Ritu, RyanVM

Schedule Update

Current releases dashboard: https://mozilla.github.io/delivery-dashboard

• 63.0.1 Desktop tomorrow
  • Gtb today
  • Push to release tomm
  • https://docs.google.com/spreadsheets/d/1kVQdd23AgK3MQTiXzY_E66O79Z0lO-uRV_zhHW0aUKY/edit#gid=74667125 - "Dot Release Uplifts" tab

• 64.0b5 shipped to all channels today
• 64.0b6 coming Thursday - considering a Fennec build as well for topcrash fix (bug 1497526) up for approval

Off-train releases

Current Shield studies: https://strategy-and-insights.mozilla.com/shield-studies/index.html

Stability

• Handling of beta version numbers in Socorro has changed
  • Crash reports now get rc versions and there's no more b99 stuff which fixes bug #1295963
  • Crash reports for the first beta which is a devedition/aurora build now get the right version without me having to manually update

anything which fixes bug #1486035

• • Any version mismatches are now likely due to bad data in Buildhub and not problems with the quixotic machinations of ftpscraper
    • slight hiccups still: https://bugzilla.mozilla.org/show_bug.cgi?id=1503250

Nightly

firefox nightly summary score: 10.20

• Both mac and linux seem to have had a spike in Content Shutdown crashes according to Mission Control
  • There seems to be a spike in the Shutdown Kill Signatures - https://crash-stats.mozilla.com/signature/?product=Firefox&version=65.0a1&platform=Mac%20OS%20X&platform=Linux&signature=IPCError-browser%20%7C%20ShutDownKill&date=%3E%3D2018-10-22T20:35:27.000Z&date=%3C2018-10-29T20:35:27.000Z&_columns=date&_columns=product&_columns=version&_columns=build_id&_columns=platform&_columns=reason&_columns=address&_columns=install_time&_sort=platform&_sort=-date&page=28#summary
  • https://data-missioncontrol.dev.mozaws.net/#/nightly/mac
  • https://data-missioncontrol.dev.mozaws.net/#/nightly/linux
    • Linux crashes have Moz Crash reason DUMP_REQUESTED
• Core | Networking crash spike https://bugzilla.mozilla.org/show_bug.cgi?id=1503201, affects all platforms
• Small volume Web | Replay crash https://bugzilla.mozilla.org/show_bug.cgi?id=1502941

Beta

firefox beta summary score: 2.92

• Mac specific crash https://bugzilla.mozilla.org/show_bug.cgi?id=1491580 is still occuring on release, but only to users running 10.10

Release

firefox release summary score: 3.48

63.0

• new shutdownhang in 63 when trying to get dumps for content process shutdownkills while the browser is closing: https://bugzilla.mozilla.org/show_bug.cgi?id=1498942 - 12.7% of browser crashes
• oom tab crash signature new in 63: https://bugzilla.mozilla.org/show_bug.cgi?id=1472062 - 7.8% of content crashes
  • part of it is correlated to "Norton Safe Web" addon (21.98% in signature vs 03.81% overall)
• startup crashes with old amd cpu; presumably due to the change to clang-cl in 63: https://bugzilla.mozilla.org/show_bug.cgi?id=1501343 - 2.8% of browser crashes
• startup crash due to omni.ja corruption: https://bugzilla.mozilla.org/show_bug.cgi?id=1276488 - 1.4% of browser crashes
  • signature has been around for a long time; spiking up during 63
• startup crashes on macos with some facebook photo uploader plugin?: https://bugzilla.mozilla.org/show_bug.cgi?id=1502977 - 10% of mac browser crashes
• Filed new 10.14 specific shutdown hang: https://bugzilla.mozilla.org/show_bug.cgi?id=1503277

Mobile

• Crash rate is calculated based on usage hours (the time Firefox is actively used).
• Usage hours will be significantly lower on Fennec than on desktop Firefox, so we can't compare mobile rates to desktop rates.

• Release

fennec release summary score: 32.37

• • #4 top crash on release, https://bugzilla.mozilla.org/show_bug.cgi?id=1454639. Requested some QA to try to reproduce

• Beta

fennec beta summary score: 35.74

• • #3 top crash https://bugzilla.mozilla.org/show_bug.cgi?id=1499618 has a patch, but it needs revision and the developer is on PTO
  • New Layout bug showing up in beta: https://bugzilla.mozilla.org/show_bug.cgi?id=1503024

• Nightly

fennec nightly summary score: 34.67

• • https://bugzilla.mozilla.org/show_bug.cgi?id=1497526 still needs to be verified on Nightly, and crashes are still occuring (we suspected that would happen)
    • Filed meta bug https://bugzilla.mozilla.org/show_bug.cgi?id=1503255 to track remaining issues

QA

Nightly

Aurora / Dev Edition

Beta

Action items

Mobile Stability

SUMO Report / User Advocacy

Roundtable

Special Topics

Aurora/Beta Feature Review

Post-Mortem (Tues 2wks from GA Release)

https://public.etherpad-mozilla.org/p/63-0-Post-Mortem - Tues Nov 6th