Power and precision

Why the push for replacing “power” with “precision” is misguided

[Code for all the plots in this post is available in this gist.]

One of the common claims of anti-significance-testing reformers is that power analysis is flawed, and that we should be planning for study “precision” instead. I think this is wrong for several reasons that I will outline here. In summary:

• “Precision” is not itself a primitive theoretical concept. It is an intuition that is manifest through other more basic concepts, and it…