CrashKill/Flash Breakdown Data

In order to respond to Flash crash data quickly, bsmedberg has prepared data subsets and graphs on crash-analysis.mozilla.com which chart various signatures and statistics broken down by Flash version. This is currently focused entirely on Windows.

In each nightly directory (e.g. https://crash-analysis.mozilla.com/bsmedberg/20120701/) there will be two files generated from the full nightly CSV:

windows-flash-summary.csv

e.g. https://crash-analysis.mozilla.com/bsmedberg/20120701/windows-flash-summary.csv

This summary includes totals of Flash-related hangs and crashes by OS version, release channel, and Flash version.

This data is used to produce the summary charts at https://crash-analysis.mozilla.com/bsmedberg/flash-summary.html

windows-flash-signatures.csv

e.g. https://crash-analysis.mozilla.com/bsmedberg/20120701/windows-flash-signatures.csv

This summary groups crashes by OS version, release channel, flash version, and signature.

This data can be used to verify that individual signatures are fixed in particular Flash versions, e.g. https://crash-analysis.mozilla.com/bsmedberg/F909392315_____________________________________.svg

It will also be used to produce a "pretty" topcrash report for each flash version each day.

Graph summaries

The graph summaries by Flash version are available from https://crash-analysis.mozilla.com/bsmedberg/flash-summary.html and should update each day on a cron job.

Topcrash breakdowns

Each day the cronjob will produce a daily topcrash and tophang report for each channel, e.g. https://crash-analysis.mozilla.com/bsmedberg/flash-topcrash-release.html

It is possible to create custom versions of these reports manually which cover multiple days of data.

export PYTHONPATH=/home/bsmedberg/lib/python2.6/site-packages
# topcrash report for windows XP users from July 21-present
python /home/bsmedberg/flash-topcrash-report.py -s 20120721 --winversion=xp > summaryfile.html

Use --help to check for specific options.

Producing a Signature Summary

Breakdowns for individual signatures can be useful to determine whether a particular release of Flash caused or fixed a bug. See https://crash-analysis.mozilla.com/bsmedberg/F909392315_____________________________________.svg for an example.

To produce a signature summary while logged into crash-analysis:

export PYTHONPATH=/home/bsmedberg/lib/python2.6/site-packages
python /home/bsmedberg/signature-version-graph.py <signature> > some-file.svg

Various options such as --channel can be used to change the default settings. See --help for details.

Code

The code to run these reports is maintained at http://hg.mozilla.org/users/bsmedberg_mozilla.com/flashreporting/