← All examples

01 / 06 · Welch t-test

Teaching example. Synthetic data.

Does a new formulation make a stronger material?

Compare the strength of standard and new material formulations. We care about both the evidence for a difference and its magnitude.

Open a copy and recalculate A separate copy of the example opens in a new tab. Changes there won’t affect your current project.

Theory: Comparing two groups →

16 specimens · 2 formulations

Points show observations. Mean intervals: 95%.
Mean difference: second group minus first
5
95% confidence interval
2.746 … 7.254
Two-sided p
0.000405
Inspect the original observations
ObservationStandard formulationNew formulation
1811
21016
3913
41118
5712
61215
71017
8914

Calculated by the Linza engine from this example’s data. Opening it in the editor runs a fresh calculation.

Why this method

Welch compares means of two independent groups without requiring equal variances. A paired test is inappropriate: specimens from different formulations have no matched partners. With eight specimens per group, check outliers and whether distributional assumptions are reasonable.

Explore the theory: Comparing two groups →

Work through it in Linza

Open the example. In Data, check the two columns with eight separate specimens each. In Analyses, compare the mean difference and its interval. Points on the chart are specimens; vertical intervals describe each group mean. These are different from the difference interval below the chart.

Open a copy and recalculate

Try changing one condition

In a copy, subtract 5 MPa from every value of the new formulation. What happens to the mean difference and the within-group spread?

Show the explanation

The means become equal and their difference becomes zero. The spread within the new formulation stays the same because every point moved by the same amount. A zero observed effect does not establish equality in the population.

Data and reproducibility

Teaching studies with synthetic data. The scenarios reflect practical questions, but do not report real experimental findings.

Next exampleHow did scores change after training? →