Fixed Horizon Testing

Fixed horizon testing means you decide the length of the test and the sample size before you start. You then wait until the end to look at the result and make a decision. This helps avoid the mistake of stopping too early when the data is still bouncing around. It works well when your traffic and seasonality are stable. Example: Plan to run a checkout test for two full weeks, then pick the winner only after the full period finishes.