Mann-Whitney U vs t-test: Choosing the Right Test Before a Reviewer Chooses It for You

A published audit of medical research papers identified five consistent categories of t-test misuse. The most common: applying the test to non-normal data, running repeated t-tests across multiple groups, and applying an independent t-test to paired data. Any one of these errors can reverse the conclusion of a study. The decision between the t-test and Mann-Whitney U is not a formality: it changes the numbers you report and, in borderline analyses, whether your result is significant at all.

What each test actually measures

The independent-samples t-test is parametric. It assumes your data follow a normal distribution (a symmetric, bell-shaped pattern around the mean). It works by comparing group averages and asking whether the difference between those averages is larger than chance would produce.

The Mann-Whitney U test is non-parametric.¹ It makes no assumption about the shape of your data. Instead of working with means, it ranks every observation from smallest to largest across both groups and compares where each group's values tend to sit in that ranking. Both tests address the same clinical question (are these two independent groups different?), but each is valid under different conditions.

Using a parametric test when its assumptions are violated is a statistical error. Using a non-parametric test when a parametric one would have been valid is simply conservative. That asymmetry matters when your paper is under review.

Four questions to settle the choice

You do not need to guess. Work through these in order and the test follows directly.

How large are your groups? If both groups have 30 or more observations, the central limit theorem makes the t-test robust to moderate departures from normality. If either group has fewer than 30, the normality assumption carries more weight and Mann-Whitney is the safer route.

What kind of variable is your outcome? Continuous measurements (serum creatinine, blood pressure, weight) may work with either test, depending on distribution. Ordinal scales (Likert items, pain scores from 0 to 10, satisfaction ratings) require Mann-Whitney by default. The t-test needs to average your outcome in a meaningful way; ordinal data cannot be averaged.

Is the distribution roughly symmetric? A quick histogram is enough. Lab values like bilirubin, length of stay, and creatinine tend to bunch near zero and trail rightward (positive skew). That pattern disqualifies the t-test unless groups are large. A roughly bell-shaped histogram on both sides makes the t-test reasonable.

What does the normality test return? Run Shapiro-Wilk and let the p-value inform you. Above 0.05: you cannot reject normality, t-test is acceptable. At or below 0.05: the data are not normal, use Mann-Whitney. In SPSS, run this via Analyze → Descriptive Statistics → Explore, ticking "Normality plots with tests." StatsPlease runs Shapiro-Wilk automatically before selecting any test.

Checking normality and the limits of Shapiro-Wilk

The Shapiro-Wilk test is the standard normality check for small and medium clinical samples.² For groups larger than about 50, the Kolmogorov-Smirnov test (with Lilliefors correction) is often used instead. Both give you a p-value that guides the parametric vs non-parametric decision. But there is a problem that catches researchers every time.

When to use each test: the clinical version

Use the t-test when: both groups have 30 or more observations; the outcome is a continuous measurement; and the data are roughly normally distributed, confirmed by histogram and Shapiro-Wilk. When its assumptions hold, the t-test has slightly more statistical power: it is better at detecting a real difference.

Use Mann-Whitney U when: either group has fewer than 30 observations (standard in single-centre audits, subgroup analyses, and pilot studies); the outcome is ordinal such as a pain score, satisfaction rating, or any Likert item; the data are positively skewed (long tail to the right, as with bilirubin or length of stay); or Shapiro-Wilk rejects normality (p ≤ .05). In clinical research, these conditions describe the majority of comparisons you will run.

Paired data is a separate category. If the same patients appear in both groups (pre- and post-operative measurements, left eye and right eye), you need a paired t-test or a Wilcoxon signed-rank test, not the independent-samples versions. Applying an independent-samples test to paired data is one of the five misuse categories the audits identified.

How to report results in AMA format

AMA format is used by most clinical and surgical journals. Reviewers and statistical editors check these elements specifically, so getting them right matters.

For the t-test: report mean and standard deviation for each group, then the test statistic, degrees of freedom, p-value, and Cohen's d as the effect size. A correctly formatted AMA result: t(48) = 2.34, p = .023, d = 0.67. The number in parentheses is the degrees of freedom. Cohen's d of 0.2 is small, 0.5 medium, 0.8 large.³

For Mann-Whitney U: report median and interquartile range for each group, then the U statistic, p-value, and effect size r. A correctly formatted AMA result: U = 234.5, p = .012, r = 0.41. Effect size r of 0.1 is small, 0.3 medium, 0.5 large. Most clinical journals now require the effect size: omitting it invites a revision request.

Report exact p-values (p = .023) rather than p < .05. The only exception is when the value falls below .001, in which case write p < .001.

Consider a study comparing serum bilirubin between patients with and without hepatomegaly in a primary biliary cirrhosis cohort. Bilirubin is strongly right-skewed, so Shapiro-Wilk rejects normality in both groups and StatsPlease routes the comparison to Mann-Whitney U. The output looks like this:

Example data: Vanderbilt University Department of Biostatistics public teaching datasets (hbiostat.org/data). Figures computed with scipy from real data.

What to write in your methods section

State which test you used and why. One sentence closes the door on a methods query before it is raised. For Mann-Whitney: "The Mann-Whitney U test was used because Shapiro-Wilk analysis indicated non-normal distribution in the [outcome variable] (p = .03)." For the t-test: "An independent-samples t-test was used; normality was confirmed by Shapiro-Wilk analysis in both groups (p > .05)."

If you used Mann-Whitney because the outcome was ordinal rather than because of a normality test, say so: "The Mann-Whitney U test was used because the outcome (pain score) is measured on an ordinal scale." Reviewers accept that reasoning without further query.

The safe default

When you are unsure and groups are small, use Mann-Whitney U. It is never a statistical error to use a non-parametric test where a parametric one would also have worked. The reverse (using the t-test when its assumptions are violated) is an error that reviewers catch and that can change your conclusions. Default to the safer test, document your reasoning, and move on.

References

1. Nahm FS. Nonparametric statistical tests for the continuous data: the basic concept and the practical use. Korean Journal of Anesthesiology. 2016;69(1):8–14. https://doi.org/10.4097/kjae.2016.69.1.8
2. Mishra P, Pandey CM, Singh U, Gupta A, Sahu C, Keshri A. Descriptive Statistics and Normality Tests for Statistical Data. Annals of Cardiac Anaesthesia. 2019;22(1):67–72. https://doi.org/10.4103/aca.ACA_157_18
3. Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum Associates; 1988.