diff options
Diffstat (limited to '.gitlab/issue_templates/Experiment Implementation.md')
| -rw-r--r-- | .gitlab/issue_templates/Experiment Implementation.md | 21 |
1 files changed, 12 insertions, 9 deletions
diff --git a/.gitlab/issue_templates/Experiment Implementation.md b/.gitlab/issue_templates/Experiment Implementation.md index 481389f8023..b85271ccdad 100644 --- a/.gitlab/issue_templates/Experiment Implementation.md +++ b/.gitlab/issue_templates/Experiment Implementation.md @@ -1,24 +1,27 @@ <!-- Title suggestion: Experiment Implementation: [description] --> # Experiment Summary -<!-- Quick rundown of what is being done --> +<!-- Quick rundown of what is being done or a link to the Experiment epic --> # Design <!-- This should include the contexts that determine the reproducibility (stickiness) of an experiment. This means that if you want the same behavior for a user, the context would be user, or if you want all users when viewing a specific project, the context would be the project being viewed, etc. --> -# Rollout strategy -<!-- This is currently called A/B test, which isn't accurate for multi-variants. Let's call this rollout strategy. It should outline the percentages for variants and if there's more than one step to this, each of those steps and the timing for those steps (e.g. 30 days after initial rollout). --> +# Control vs Candidate Experience +<!-- This should include a screenshot of the control vs candidate experience and any helpful context regarding expected behavior --> + +| Control | Candidate | +|---------|-----------| +| | | -# Inclusions and exclusions -<!-- These would be the rules for which given context (and are limited to context or resolvable at experiment time details) is included or excluded from the test. An example of this would be to only run an experiment on groups less than N number of days old. --> +# Rollout strategy +<!-- This should outline the rollout percentages for variants and if there's more than one step to this, each of those steps and the timing for those steps (e.g. 30 days after initial rollout). --> -# Segmentation -<!-- Rules for always saying context with these criteria always get this variant. For instance, if you want to always give groups less than N number of days old the experiment experience, they are specified here. This is different from the exclusion rules above. --> +# Target Population +<!-- These would be the rules for which given context (and are limited to context or resolvable at experiment time details) is included or excluded from the test. An example of this would be to only run an experiment on groups who go through the Trial registration flow. --> # Tracking Details -- [json schema](https://gitlab.com/gitlab-org/iglu/-/blob/master/public/schemas/com.gitlab/gitlab_experiment/jsonschema/0-3-0) used in `gitlab-experiment` tracking. -- see [event schema](../../doc/development/internal_analytics/snowplow/index.md#event-schema) for a guide. +- [json schema](https://gitlab.com/gitlab-org/iglu/-/blob/master/public/schemas/com.gitlab/gitlab_experiment/jsonschema/1-0-3) used in `gitlab-experiment` tracking. | sequence | activity | category | action | label | property | value | | -------- | -------- | ------ | ----- | ------- | -------- | ----- | |