Firefox/Activity Stream/OKRs/Desktop OKRs/2017Q3 Archive

From MozillaWiki
Jump to: navigation, search

Activity Stream - Firefox Desktop - OKR Progress Report
Last Updated: Sep 29th, 2017
Next Update: NA - Final Report for Q3

Q3 Final Score: 74%

OKR Progress

OKR Github Project HERE

Objective Key Result Confidence State Notes
Aug 4 Sep 1 Sep 22 Final Score
Sep 29

- Release AS in Desktop Firefox 57 as the default UX for both about:home and about:newtab.
- Ensure feature parity with AS for Test Pilot, performance and feature parity with existing Tiles and about:home.

1.1 Implement Collect, Store and Query Operations for Rich Site Summary Metadata 70% 70% 100% 100% Done "At Risk" because of unknown performance, quality and memory consumption risks possible in our (so far largely untested) approach to metadata collection, storage and retrieval

9/29- Happened for highlights and topsites.

1.2 Implement Tippytop Sites Databases 70% 80% 80% 50% Attempted/Some Progress "At Risk" because of restrictions around what site metadata (and the manual customizations) that are allowed on that data. There is user engagement risk associated with lower quality icons of major sites, especially for Default Top Sites

9/22 - One part was what goes into Firefox -100% there. The other part is S3 bucket with crawler. Didn't get to that yet.

1.3 Implement Top Site Customization UI 90% 100% 100% 80% Done This includes Pin/Dismiss, Show More/Less, Add/Edit Top Site, Drag'n'Drop

8-25- Note that we have separated Drag and Drop Top Site functionality and have changed that functionality to a P2

1.4 Implement at least 10 performance probes/pings and develop methodology to measure and optimize AS performance 70% 80% 80% 70% Satisfactory Progress 9/29- Got the underlying framework to send performance pings and the most critical pings first.
1.5 Implement Highlights Section in Activity Stream 70% 70% 100% 100% Done This feature is dependent on #58 Metadata processing, and has some image caching subtleties that may cause perf regressions. Because of this, this feature would be a candidate to defer to a later release.

9-11 This has been completed.
9/29 - Did not implement the "added feature" of sub highlights selection mozilla/activity-stream#3155

1.6 Implement Activity Stream on about:home 50% 60% 100% 100% Done Activity Stream will be the user experience of both about:newtab and about:home. The challenge here will be to ensure that critical performance tests do not regress (Talos and Browser Start (Hero Element) Comparative Benchmark)

Considered 'At Risk' because of possible regressions associated with Comparative Benchmarking and the role about:home plays. Performance of about:home is critical.
9-11 - The prerendering patch is in the last stages of review/testing mozilla/activity-stream#3396 9/29 - Landed in FX57!

1.7 Integrate Snippets into Activity Stream 70% 80% 100% 100% Done 9-11 This has been completed.

- operationalize/productize Experimenter, ping-centre, and redash client
- provide experiment services to other Firefox product groups
- establish best practices for experimenting in Fx channels

2.1 Launch Prod Version of Experimenter with Shield integration 50% 80% 80% 60% Satisfactory Progress Project can be found HERE. Well underway and on track.

9/22 - Not a prod version. Shield is pretty close

2.2 Launch three AS pref studies in multiple Fx release channels 90% 90% 90% 100% Done Planned pref studies in Q3:
   **pref on 10% in Beta 56 en-US / USA Geo
   **pref on 50% of Beta 56 en-US / USA + Canada Geo
   **pref on 10% in Beta 56 de-DE / Germany Geo 

9/29 - Launched the studies as committed, but ran into the shield bug killing the experiments. Didn't get solid results.

2.3 Land ping-centre in m-c 90% 100% 100% 100% Done Landed. Details can be found HERE
2.4 Launch Experimentation Services for at least one non-AS Mozilla product group 70% 70% 70% 60% Satisfactory Progress Candidates include: search / awesome search, onboarding tour and data migration

9/29 - Was intended to help others use ping centre, dash boards, etc. Onboarding started integration

2.5 Implement a development/staging implementation of data pipeline to commodity AWS components (Logging 2.0) 60% 60% 60% 0% Deprioritized There is some uncertainty around the Logging 2.0 infrastructure and it's suitability for our needs. We are proceeding with a plan to "tee-off" the event pipeline into a Logging 2.0 pipeline and measure it's effectiveness

9/22 - Deprioritized

2.6 Integrate, productize and deploy redash-client 80% 80% 80% 60% Satisfactory Progress Project details found HERE.

9/22 - Interdependent with experimenter (KR 2.1)


- AS Web Extension API
- Go Faster / System Add-on mechanics, practices

3.1 Release AS Web Extension API (Newtab Content Extension) to Firefox 30% 30% 30% 60% Satisfactory Progress This will probably not land in Firefox 57 due to schedule constraints and feedback required from Addons team. This is more likely a Q4 KR.

9/22 - Written but not landed. Needs input from other groups

3.2 Release 1 Go Faster System update of AS (Nightly -> Beta) 60% 60% 60% 0% Deprioritized As a system addon, we need to build our "Go Faster" muscles to prove we can quickly roll out new functionality or experiments to Beta and/or Release channels.

9/29 - Deprioritized