Which critique is made about controlled studies in education research?

• A. They are flawless
• B. They are poorly done due to teacher effect
• C. They generalize too much
• D. They cover all cognitive aspects

Answer: (B)

The main issue with controlled studies in education is the teacher effect. The person delivering instruction can greatly influence student outcomes through skill, enthusiasm, classroom management, and how faithfully the program is implemented. Because teachers vary, results attributed to the intervention may actually reflect the instructor’s effectiveness, which clouds the ability to claim that the program alone caused the observed gains. This is a central threat to internal validity, and researchers try to address it with fidelity checks, thorough training, multiple teachers, and designs that separate teacher impact from the treatment. While other limitations exist, such as questions of how well findings generalize to different contexts, the teacher effect is the most salient critique of controlled education studies.