Quantum/Release Criteria
From MozillaWiki
< Quantum
- QRC = Quantum Release Criteria
- QF = Quantum Flow
Contents
Bug Workflow
A QRC bug is a bug that indicates Firefox is below some performance target on a QRC benchmark or metric.
QRC bug states:
- "[QRC][QRC_NeedAnalysis]" and unassigned (ready for profile analysis)
- "[QRC][QRC_NeedAnalysis]" and assigned to an engineer analyzing the profile
- "[QRC][QRC_Analyzed][qf:p1]" and unassigned (ready to be fixed by a QF engineer)
- "[QRC][QRC_Analyzed][qf:p1]" and assigned to a QF engineer fixing the bug
- Testers will:
- File a new bug for any QRC test failures that don't already have a bug.
- Make the new bug block one of the QRC meta bugs.
- Attach a link to a Gecko Profiler profile.
- Add the whiteboard tag "[QRC][QRC_NeedAnalysis]".
- Profile analysis engineers on the "Profiler Overflow" list:
- Select a bug from the "Bugs Ready To Be Analyzed" list below.
- Assign the bug to yourself while you are analyzing it.
- If the bug is invalid or not actionable, then needinfo the reporter or close the bug.
- There might not be obvious, visible problems. The profile analysis does not necessarily require the profile analysis engineer to reproduce the test case, just identify if there are obvious hot spots in the profile.
- If you can't identify the root cause, then unassign yourself. Another profile analysis engineer will pick it from the QRC_NeedAnalysis list, so leave any notes you have or needinfo someone who may have domain knowledge relevant to the profile.
- If you have identified the root cause, then:
- Change the whiteboard tag from "[QRC_NeedAnalysis]" to "[QRC_Analyzed][qf:p1]" (so the bug will be seen by QF engineers).
- Move the bug to an appropriate Bugzilla component.
- Unassign yourself.
Resources on "How to do Gecko Profiling"
If you have questions about using the Gecko Profiler, operators are ready standing by to help in the #flow IRC channel. :)
Ehsan's videos on how to analyze Gecko profiles
Mike's deep dive videos analyzing profiles on real bugs
- Search for "Joy of Profiling" on Air Mozilla. Effective Dec 4, 2017 - 15 episodes
- The Joy of Profiling - Pilot
- The Joy of Profiling - Pilot 2
- The Joy of Profiling - Episode 1 Posted on May 19/2017
- The Joy of Profiling - Episode 2 Posted on June 10/2017
- The Joy of Profiling - Episode 3 Posted on June 17/2017
- The Joy of Profiling - Episode 4 Posted on June 24/2017
- The Joy of Profiling - Episode 5 Posted on July 8/2017
- The Joy of Profiling - Episode 6 Posted on July 15/2017
Bugs Ready To Be Analyzed
QRC_NeedAnalysis bugs:
ID | Priority | Summary | Whiteboard | Assigned to |
---|---|---|---|---|
1363352 | -- | Amazon homepage start: time to first nonblank is slow | [QRC][QRC_NeedAnalysis] | |
1394761 | P3 | Hasal input latency case facebook_ail_scroll_home_1_txt regressed median from 22ms to 44ms on 7/29 | [QRC][QRC_NeedAnalysis] |
2 Total; 2 Open (100%); 0 Resolved (0%); 0 Verified (0%);
Bugs Now Being Analyzed
QRC_NeedAnalysis bugs:
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Bugs Ready To Be Fixed
QRC_Analyzed bugs that are ready to be fixed by a QF engineer:
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Links
Responsibilities of the Quantum Profiling Pool
QRC queries: