Instrumental Variables in WFM

From WFM Labs
An instrument Z affects the outcome only through the treatment X and is independent of the unobserved confounder U, isolating the part of X's variation that is unconfounded.

Instrumental Variables in WFM (IV) is a causal-estimation method that recovers the effect of a treatment on an outcome when there is unmeasured confounding, by using a third variable — the instrument — that influences the treatment but is otherwise unrelated to the outcome. It is one of the quasi-experimental tools for workforce management questions where a clean experiment is impossible and the confounders cannot all be measured.[1]

The idea

When treatment is confounded, the raw treatment–outcome association mixes the true effect with the influence of the confounder. An instrument breaks this by supplying variation in the treatment that comes from a source unrelated to the confounding. The method effectively uses only the part of the treatment that the instrument explains — variation that is "as good as random" — and reads the outcome's response to that part. In practice this is estimated in two stages (two-stage least squares): first predict the treatment from the instrument, then regress the outcome on the predicted treatment.[2]

The three conditions

A valid instrument Z for the effect of treatment X on outcome Y must satisfy:

  1. Relevance: Z actually affects X (a strong first-stage relationship). Weak instruments give unstable, biased estimates.
  2. Exclusion: Z affects Y only through X — there is no direct path from the instrument to the outcome.
  3. Independence (exogeneity): Z is not associated with the unobserved confounder U; it is as good as randomly assigned.

Relevance is testable from the data; exclusion and independence are assumptions that rest on domain knowledge and cannot be fully verified — which is why instrument choice is the hard part.

WFM examples

  • Staggered rollouts as instruments. When a new tool or policy is rolled out to sites in an order driven by logistics rather than performance, the rollout timing can instrument for tool adoption when estimating its effect on handle time or attrition.
  • Assignment quirks. Quasi-random routing or queue-assignment rules can instrument for the treatment an agent or contact actually received, when actual receipt is confounded by selection.
  • Encouragement designs. When agents are encouraged (but not forced) into a training program, the encouragement can instrument for actual participation, since take-up is otherwise confounded by motivation.

Cautions

  • Exclusion is fragile. If the instrument affects the outcome through any route other than the treatment, the estimate is biased; a staggered rollout that coincides with other changes violates exclusion.
  • Weak instruments. A weak first stage amplifies bias and produces wide, unreliable estimates — relevance must be strong, not just present.
  • Local effect (LATE). IV identifies the effect for the subpopulation whose treatment is moved by the instrument (the "compliers"), not the whole population — a local average treatment effect that may not generalize.[3]

Maturity Model Position

In the WFM Labs Maturity Model™, instrumental-variables thinking is an advanced identification capability for confounded observational questions.

  • Level 1–2 (Emerging / Foundational) — confounded effects are estimated as raw associations; unmeasured confounding is unaddressed.
  • Level 3 (Progressive) — analysts recognize unmeasured confounding and look for natural instruments (rollouts, assignment rules, encouragement) to identify effects.
  • Level 4–5 (Advanced / Pioneering) — IV designs are used deliberately and validated (first-stage strength, exclusion reasoning), and their local nature is accounted for when generalizing.

See also

References

  1. Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996). "Identification of Causal Effects Using Instrumental Variables". Journal of the American Statistical Association, 91(434), 444–455. doi:10.1080/01621459.1996.10476902.
  2. Angrist, J. D., & Pischke, J.-S. (2009). Mostly Harmless Econometrics: An Empiricist's Companion. Princeton University Press. ISBN 978-0-691-12035-5.
  3. Imbens, G. W., & Angrist, J. D. (1994). "Identification and Estimation of Local Average Treatment Effects". Econometrica, 62(2), 467–475.