产品功能的Ab测试
[英]ab testing for product features
问题描述
If Yelp wanted to understand if ratings helped users pick a listing, and we use the CTR as the success metric to run the ab test, how do we know that a significant change in CTR is due to just the ratings and not other parts of the listing like the reviews? 
如果Yelp想了解收视率是否有助于用户选择列表，并且我们使用点击率作为进行ab测试的成功指标，那么我们如何知道CTR的重大变化仅是由于收视率而不是其他部分像评论一样列出吗？
Do we have to do some kind of user segmentation instead of randomly assigning users before running the ab test? 在运行ab测试之前，我们是否必须进行某种用户细分，而不是随机分配用户？
1 个解决方案
解决方案1
0 已采纳 2018-02-01 01:22:45
Randomization takes care of all other variables but the treatment. 随机化处理除治疗外的所有其他变量。 Test on statistical significance takes care of the choice between the treatment and chance. 统计显着性检验需要在治疗和机会之间进行选择。 It's only when you can't do a randomized trial, that you need to control for other differentiators. 只有在您无法进行随机试验时，才需要控制其他差异因素。
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.