2007 NCTE Legislative Platform
On the Definition of Scientifically Based Research and Peer Review of Grant Proposals

Two issues have proven particularly problematic in the implementation of the No Child Left Behind Act and similar legislation designed to enhance student learning and close the achievement gap: (1) application of the definition of scientifically-based research and (2) the peer review of grant proposals.

Scientifically-based Research
Currently, the definition of scientifically-based research prescribes a single preferred research method regardless of the question or context being investigated; it thus fails to acknowledge that different research methods are appropriate for different questions. Moreover, the current statutory definition of “scientifically based research” has been used to exclude the full range of knowledge about how students learn to read and write.

To remedy this situation, Congress must adopt a consistent definition of “scientifically based research” that conforms to the principles of research enumerated by the National Research Council (NRC).  According to the NRC, scientifically-based research:

1. Poses significant questions that can be investigated empirically (through observation). Questions must reflect understanding of prior theoretical, methodological, and empirical work.

2. Links research to relevant theory. All inquiry is linked to some overarching theory or framework that guides investigation.

3. Uses methods that permit direct investigation of the question. A variety of methodological approaches may be needed to answer the range of questions and issues involved in a line of inquiry.

4. Provides a coherent and explicit chain of reasoning. Detailed descriptions of procedures, limitations or biases, error and counter-explanations, and analyses are critical so that others may critique, analyze, or replicate the study.

5. Replicates and generalizes across studies. Scientific knowledge advances when findings are reproduced in a range of times and places and are integrated and synthesized.

6. Discloses research to encourage scrutiny and critique. Scientific studies must be widely shared and subject to professional scrutiny.

Peer Review Panels
If the federal government is to reach its intended goal of advancing student achievement, it must ensure that research-based grant proposals are evaluated through a fair and thorough peer-review process. Grants under Title II of the No Child Left Behind Act and the Higher Education Act should be awarded through an objective peer review system comprised of independent panels of scholars with deep knowledge of a range of relevant literacy research methodologies and content knowledge. These reviewers should be nominated by diverse organizations, including:

• Professional and scholarly associations
• Postsecondary institutions
• State departments of education