Review Process (jedpsych-review-process)

The Journal of Educational Psychology combines selectivity for educational importance with rigorous methodological scrutiny. Under masked review, both author and reviewer identities are hidden, and editors and expert reviewers weigh not only whether the finding is interesting but whether it is theoretically grounded, rigorously designed for its nested setting, and transparent. Knowing this lets you pre-empt the common rejection reasons.

When to trigger

• Before submitting, to stress-test the manuscript
• Deciding whether to preregister and how to present transparency
• Interpreting a decision letter and setting expectations

How review works

1. Masked review. Identities of authors and reviewers are masked; keep author identity out of the

manuscript, exhibits, and repository links (see jedpsych-submission).

1. Editorial triage. The editor (and associate/handling editors) assesses scope fit (educational

relevance + primary psychological research), theory, design rigor, and contribution; weak-fit or out-of-scope papers (e.g., single-instrument validation, pure evaluation) may be desk-rejected.

1. Expert external review assesses the theoretical contribution, the design and analysis (especially

whether nesting/power are handled), the strength of the claim relative to the evidence, measurement quality, and transparency/JARS reporting.

1. Transparency and standards are weighed. The Transparency and Openness subsection, JARS compliance,

and preregistration (encouraged) factor into the evaluation.

1. Decisions. Reject, revise and resubmit (often major), or accept; expect substantive revision and

frequent requests for added rigor (multilevel modeling, mechanism tests), disclosure, or analyses.

What gets a paper through

• Make educational relevance and the theoretical mechanism explicit early.
• Show the design is rigorous for its setting — nesting modeled, powered at the cluster level,

validated measures, fidelity reported.

• Report effect sizes with CIs and educational interpretation; test the mechanism, not just the total

effect.

• Disclose fully (JARS) and prepare the Transparency and Openness subsection; preregister where feasible.

Desk-reject and decline patterns

The scope and rigor screens mean many manuscripts never reach full external review. Confirm current categories on the journal's submission guidelines, but recognize these shapes:

Worked micro-example (illustrative triage)

Manuscript: preregistered cluster-randomized reading trial (48 classrooms),
            multilevel model, effect size + CI + mediation, TOP subsection.
Editor read: educational relevance (classroom reading), theory (strategy
            instruction → monitoring), rigor (cluster-powered, nesting modeled),
            transparency (data/code with DOIs).
Likely route: external review, probable major R&R for added robustness/
            measurement detail.
Counter-case: same effect, single-level OLS on clustered data, no mechanism,
            "data on request" → likely declined or heavy revision.

How reviewers weigh the evidence (calibration anchors)

• A design that matches its nesting (randomized, powered, and analyzed at the cluster level) is the

single strongest methodological signal at JEP; ignoring clustering is a routine reason for rejection.

• A tested mechanism is what marks the paper as educational psychology rather than evaluation;

reviewers reward a mediation/moderation result tied to theory.

• Transparency is part of credibility: a candid restricted-data statement with an access path reads better

than silent opacity; preregistration quality (specific, dated, followed) strengthens the paper.

Anti-patterns

• A finding with no clear educational implication or theoretical mechanism
• Clustered data analyzed as independent (the classic JEP methodological reject)
• Stars-only reporting without effect sizes, CIs, or educational meaning
• Weak or absent transparency / JARS reporting
• Expecting acceptance without a rigor- and disclosure-heavy R&R

Output format

【Educational relevance】clear early? [Y/N]
【Theory + mechanism】grounded and tested? [Y/N]
【Design rigor】nesting modeled, cluster-powered, measures valid? [Y/N]
【Transparency + JARS】subsection + reporting standards strong? [Y/N]
【Masked】no identity leaks? [Y/N]
【Realistic outcome】reject / major R&R / minor R&R / accept
【Next】jedpsych-submission (or jedpsych-rebuttal if decided)

Supplementary resources

• ../../resources/official-source-map.md — masked review, scope, JARS, and preregistration policy