"In considering a technology-based intervention, consider both the 'research basis' that guided the development of the intervention, and the impact studies on its effectiveness."

Background - Teachers & Research - Types of Research - Metiri Rubrics

Types of Research

There are two classes of research that most publishers are currently offering in support of their interventions.

Research Basis The first is often referred to as a research or theoretical basis. A research basis describes a body of research that demonstrates the effectiveness of specific instructional strategies or learning theories within the content area. The publisher’s specific intervention is usually not part of this research, but the claim is made that intervention implements the strategy or theory in a technology-supported fashion. Therefore, results similar to those in the supporting research should be expected. For example, Inspiration, a popular charting and concept-mapping software package, claims a to have a basis in the research on graphic organizers and concept mapping. It has been demonstrated that using graphic representations of relationships between concepts or elements of a problem can enhance both problem solving and retention of information. In order for a research basis to be sufficient evidence of the power of an intervention, the technology-based environment must emulate all conditions of the original research and not introduce any new, confounding conditions. Reader Rabbit, for example, has a research basis in the significant research that demonstrate that students who have strong phonological awareness, a set of skills related to letter-sound relationships, are usually successful readers. Reader Rabbit exercises phonological awareness skills. Therefore it would be expected to contribute to success in reading. In Susan Haugland’s study that included Reader Rabbit, she demonstrated that because these skills are implemented in a developmentally inappropriate learning context (too much stress, lack of student control, etc.) the software did not have this impact and, in fact, had unexpected negative impacts.

Impact Studies The second class of research studies is often referred to by publishers as an “impact study”. Impact studies are research studies that assess the performance of the intervention under experimentally controlled conditions. The best of these studies are carefully controlled and provide significant information to the experienced reader. The worst are poorly constructed, even deceptive, and provide little or no useful information. Metiri Group provides educators with a critical analysis of the research studies linked to technology-based learning interventions. Access to this database places Metiri’s critical analysis and summaries across summaries just a click away—potentially saving schools hundreds of thousands of dollars by informing their decision making.