Schema talk:MobileWikiAppABTest
Add topic.svg)
| Maintainer: | Dmitry Brant |
|---|---|
| Team: | Mobile Apps |
| Project: | Mobile Apps |
| Status: | active |
| Sampling: | 1:1 |
| Purge: | Hash eventCapsule PII after 90 days, keep the rest indefinitely |
This page holds a JSON schema that specifies a data model for EventLogging.
[[Category:Schemas (Mobile Apps team)]]
A/B testing
[edit]A bit more detail about the "test_group" field:
As an example, suppose we want to run an A/B test where the A group sees a notification that encourages the user to keep editing in the app, and the B group does not get this notification, and we want to measure editor retention as a result of this notification.
When a user in the A group sees the notification, an event will be sent with a "test_group" of "editNotification_GroupA". And when the user in the B group is supposed to see the notification (but doesn't), an event will be sent with a "test_group" of "editNotification_GroupB".
When the test period is finished, we will have a total number of users for whom either the "GroupA" or "GroupB" event was sent, which should be an evenly-split distribution. And because this schema also records the "app_install_id" of each user, we should be able to look at the Editing schemas for each corresponding app_install_id, and see what each user's editing behavior turned out to be.