Frequentist Statistics

Frequentist statistics is a traditional way to decide the likelihood that a change made a real difference. It asks a simple question: "if the change had no effect, how surprising would these results be?" If the results would be very rare by chance alone, you can treat the change as real. This approach requires planning your test and being careful about not checking too often.

Example: You decide ahead of time what result would count as strong evidence and only make a call when the test reaches that point.

‍