Sufficiency
Objective. Use factorisation to identify sufficient statistics.
- 1. Learn
- 2. Worked example
- 3. Practice
- 4. Feedback
- 5. Continue
Learn: the key idea
Sufficiency identifies a statistic T(X) that captures all the information in the sample about a parameter θ, so that the conditional distribution of the data given T(X) does not depend on θ. The Fisher–Neyman factorisation theorem states T is sufficient if and only if the likelihood factorises as L(θ) = g(T(x),θ)h(x), where h does not involve θ. For n Bernoulli(p) trials, the likelihood p^k(1−p)^(n−k) depends on the data only through the total count k, so T = Σxᵢ is sufficient for p.
Worked example
Using the factorisation theorem, identify a sufficient statistic for λ based on n i.i.d. Exponential(λ) observations x1,...,xn.
- 1Write the likelihood L(λ) = λⁿ e^(−λΣxᵢ)
- 2Identify this as a function of λ and the sum Σxᵢ only
- 3No remaining factor depends on the individual xᵢ beyond their sum
- 4State the sufficient statistic by the factorisation theorem
Answer: T = Σxᵢ
Concept mastery
Based on your past attempts at this lesson — the question types to practise again come first.
Complete a practice set to see your concept breakdown here.
Practice
Practice happens on its own screen, one question at a time. Answers stay hidden until you submit yours, and you can stop and pick up at the same question later.
Start practisingCommon mistake. Students sometimes think any statistic appearing in the likelihood is sufficient, without checking that the remaining factor h(x) is genuinely free of θ. Always verify the full factorisation before declaring sufficiency.
Your progress
Tick each step as you finish it. Your exact reading position is saved automatically, so Continue drops you back on the same line.
0 of 5 steps complete
Your place saves automatically as you read.