Research:Article Creation Workflow/Data and metrics
This page describes the data and metrics plan for the Article Creation Workflow (ACW) feature.
Test phases
[edit]- During phase 1 we will focus on the usage of the landing page to understand how many among those users who are directed to the landing page enter a specific funnel or successfully complete them. We will also measure the effectiveness of of ACW at getting anonymous users to register an account.
- During phase 2 we will study the quality and survival of pages created via different ACW funnels.
Bucketing
[edit]We will display the new experimental ACW landing page to a small sample (1%) of all users trying to create a page by following a redlink (whether coming from (1) a search result page, (2) another article containing a redlink or (3) the interstitial displayed when typing a URL with a non-existent page name). We will redirect the remaining 99% to the default edit screen.
Data
[edit]All data for test phase 1 are obtained via the clicktracking extension. The full specifications of the data collected are here.
Metrics
[edit]Entry points
[edit]Impressions of the ACW landing page as a function of the redlink referral:
- search
- browse
- url
Clickthrough rates
[edit]Volume of clicks per impression of the ACW landing page:
- log in (anonymous only)
- sign up (anonymous only)
- article wizard
- create draft (registered only)
- create directly (registered only)
Conversion rates
[edit]Ratio of successfully completed edits per impression of the edit screen via the following funnels:
- create draft
- create directly
Notes
[edit]- We will use as a baseline the conversions of users directed to the default edit screen.
- The order of the elements on the landing page will be randomized (with the exception of the exit button which will be always at the bottom).