Causal inference · Module 1: Where the idea came from

The wheat field

Why does randomisation matter in field trials?

1.4 · 3 min 53 s · published

Soil changes across every field, so with one variety on one side and another on the other, you can’t tell the varieties from the soil. Letting chance decide which plot gets which treatment means no gradient, known or unknown, can line up with it except by luck. It is the only method that deals with confounders nobody has thought of.

Key points

  • Broadbalk at Rothamsted, begun in 1843, is one of the oldest continuous field experiments in the world.
  • Replication tests each treatment on several plots, so one odd plot can’t decide the answer.
  • Blocking groups similar plots and randomises within them: blocks handle known differences, randomisation the rest.
  • In a randomised Australian trial, seaweed fed to steers cut methane per kilogram of feed by 98 per cent at the highest dose.

Chapters

  1. 0:00 Recap: food as the experiment
  2. 0:22 Broadbalk at Rothamsted
  3. 0:51 Why fields mislead
  4. 1:35 Randomise, block, replicate
  5. 2:09 Ghost fields and barley
  6. 2:37 A trial in blocks today

Key terms

Randomisation
Letting chance decide which unit gets which treatment. Then no difference between units, known or unknown, can line up with the treatment except by luck, and statistics can say how big that luck might be. Ronald Fisher developed it for field trials at Rothamsted; it is the only method that handles confounders nobody has thought of.
Blocking
Grouping units that are alike, such as plots along the same side of a field or fields on the same farm, and randomising treatments within each group. Blocks soak up the differences you know about; randomisation handles the ones you don’t. Ronald Fisher set it out for field experiments in the 1920s.
Replication
Testing each treatment on several units, such as several plots or strips, so that one odd plot can’t decide the answer. Replication lets a trial tell a real effect from the ordinary variation between plots, and repeating a test across farms and years is how a lead becomes knowledge.
Randomised controlled trial
A study in which chance decides which units get the treatment, and the groups are then compared. On farms the units can be strips, plots, animals, herds or whole communities. Because no hidden judgement can line up with the treatment, a randomised trial still beats every other design when it can be run.

Transcript

Last time's quick check: an infection would have spread to staff as well as inmates. Pellagra didn't, which pointed to the one thing they didn't share, their diet. Today we go to a field in Hertfordshire. In 1843, at Rothamsted in Hertfordshire, John Bennet Lawes and Henry Gilbert began growing wheat on a field called Broadbalk, with different fertilisers on different strips. It is still running, one of the oldest continuous field experiments in the world.

By 1919, Rothamsted had seventy-six years of records and no reliable way to read them. So it hired a young mathematician, Ronald Fisher. The trouble with fields is that they're never even. Soil changes across a field: a damp corner, an old hedge line, a patch where muck was spread years ago. Put variety A on one side and variety B on the other, and you can't tell the varieties apart from the soil.

Fisher's answer was startlingly simple. Let chance decide which plot gets which treatment. Then no gradient, known or unknown, can line up with the treatment except by luck, and statistics can say how big that luck might be. That's randomisation. It's the only method that deals with confounders nobody has thought of.

He added two more ideas. Replication: test each treatment on several plots, so one odd plot can't decide the answer. And blocking: group plots that are alike, say along the same side of the field, and randomise within each group. Blocks soak up the differences you know about; randomisation handles the ones you don't.

Fisher set it out in a short paper in 1926, The Arrangement of Field Experiments, and in 1935 in a book, The Design of Experiments. Around the same time, in Poland, Jerzy Neyman wrote the ghost fields from 1.2 into mathematics, for crop varieties on plots: every plot with a yield under every variety, only one ever seen.

And one of the tools Fisher built on came from a brewery. William Gosset, testing barley for Guinness, published under the name "Student" in 1908 and gave us the t-test. Fisher's design is still how careful farm trials work. In Australia, researchers tested a red seaweed, Asparagopsis, as a cattle feed additive.

Twenty steers were randomly assigned to four diets, within blocks. At the highest dose, methane per kilogram of feed fell by 98 per cent; at half that dose, by 38. Twenty animals on one ration is a small trial, and methane from the animal isn't the whole farm's footprint. But because the diets were randomised, nobody had to wonder which steers had been picked for the seaweed.

Next: a geneticist who drew causes as arrows, and his father, who used butter and flaxseed to measure a cause from outside.

Questions

What is the difference between blocking and randomisation?

Blocking groups plots that are alike, such as those along the same side of a field, and randomises treatments within each group. Blocks soak up the differences you know about. Randomisation handles the ones you don’t, because chance, not any gradient in the soil, decides which plot gets which treatment.

What did the Australian seaweed trial show?

Twenty steers were randomly assigned to four diets, within blocks. At the highest dose of the red seaweed Asparagopsis, methane per kilogram of feed fell by 98 per cent; at half that dose, by 38. It was a small trial, and methane from the animal isn’t the whole farm’s footprint, but randomisation made the comparison fair.

Sources

  1. Macdonald, A.J. (ed.) (2018). Guide to the classical and other long-term experiments, datasets and sample archive. Harpenden: Rothamsted Research. www.rothamsted.ac.uk/sites/default/files/national-capability/long-term-experiments/Web_LTE%20Guidebook_2019%20Final2.pdf
  2. Fisher, R.A. (1926). The arrangement of field experiments. Reprinted in Kotz, S. and Johnson, N.L. (eds) (1992), Breakthroughs in statistics (pp. 82–91). New York: Springer. doi:10.1007/978-1-4612-4380-9_8
  3. Fisher, R.A. (1935). The design of experiments. Edinburgh: Oliver and Boyd. Reissued in Fisher, R.A. (1990), Statistical methods, experimental design, and scientific inference. Oxford: Oxford University Press. doi:10.1093/oso/9780198522294.001.0001
  4. Splawa-Neyman, J. (1990). On the application of probability theory to agricultural experiments. Essay on principles. Section 9 (translated by D.M. Dabrowska and T.P. Speed from Neyman's 1923 Polish essay). Statistical Science, 5(4), 465–472. doi:10.1214/ss/1177012031
  5. Student (1908). The probable error of a mean. Biometrika, 6(1), 1–25. doi:10.1093/biomet/6.1.1
  6. Kinley, R.D., Martinez-Fernandez, G., Matthews, M.K. et al. (2020). Mitigating the carbon footprint and improving productivity of ruminant livestock agriculture using a red seaweed. Journal of Cleaner Production, 259, 120836. doi:10.1016/j.jclepro.2020.120836

All 30 films · Glossary · The Vitagri Academy

Follow the change in farming

Causal evidence is changing how farming is measured and rewarded. Leave your email and we will tell you when new films, courses and findings are published.

Prefer to read online? Vitagri also writes on Substack. See our privacy policy for how we use your email.