Sample Size, Precision and the Strength of a Research Claim
Count the units that answer the question
A paper might report hundreds of images but only a few independently treated biological samples. The number of measurements is not necessarily the number of independent experimental units. Repeated observations can improve measurement of a unit without creating additional independent evidence about an intervention.
In a hypothetical peptide experiment, several wells prepared from one biological sample may provide technical replication. Samples obtained independently address biological variation. Check which level received the intervention independently and which level the analysis treats as independent before interpreting the reported sample size.
Precision is more than a large total
Larger studies generally estimate an effect more precisely when other features are comparable. Variability, measurement reliability, design and missing data also matter. Two studies with the same number of participants can therefore produce substantially different uncertainty around their estimates.
The Cochrane Handbook, Chapter 15: Interpreting results and drawing conclusions discusses the relationship between study size and precision. A narrow interval is useful, but it does not correct a systematically biased measurement. Keep precision and validity as separate questions: how uncertain is the estimate under the analysis, and how well does the design support the comparison?
Read the justification for the number
A sample-size calculation typically depends on assumptions about the effect to detect, variability, statistical error rates and the planned analysis. The presence of a calculation does not show that those assumptions were realistic. Compare its target endpoint with the outcome highlighted in the conclusion.
The NIH notice: Use of the ARRIVE Essential 10 Checklist identifies sample sizes and experimental units among the details that animal research reports should provide. For a laboratory reading note, distinguish the number planned, the number started and the number analysed. Exclusions or failed measurements can change how much information the final comparison contains.
Describe a small study accurately
A small experiment may be useful for exploring feasibility, refining an assay or estimating variability for later work. Its value depends on its purpose. Problems arise when an exploratory result is described with the certainty expected from a precise test of a predefined question.
When using our research overview, record the sample count beside the effect estimate and uncertainty. Ask whether the result could reasonably accommodate several different effect sizes. That approach reveals what the study learned and what remains unresolved, without turning a single numerical threshold into a universal definition of adequate research.
Related research reading
Explore the research blog and original batch-document library for further context.