Literature Reviews

What a Systematic Review Actually Requires, and When You Need One

← Back to Blog
In this article
  1. A label that lost its meaning
  2. What makes a review systematic
  3. A systematic review is not a better literature review
  4. When you actually need one, and when you do not
  5. Sources

"Systematic review" has become a prestige phrase. It shows up in thesis proposals and grant applications to signal rigor, often attached to what is really just a careful literature review. The two are not the same thing, and using the label loosely can commit you to months of work you did not plan for, or oversell a review that was never built to the standard the words imply.

A systematic review is a specific method with specific requirements. Knowing what those are tells you two useful things: what the term actually promises, and whether your project needs it at all. For many projects, the honest answer is that it does not, and that is fine.

A label that lost its meaning

In everyday use, people say "systematic" to mean "thorough." If you read widely, took careful notes, and covered the major studies, it can feel systematic. But in research methodology the word has a technical meaning, and thoroughness alone does not meet it. A systematic review is defined not by how much you read but by how you searched, screened, and reported, and above all by whether someone else could repeat your process and arrive at the same set of studies.

That last idea, reproducibility, is the heart of it. A systematic review is built so that its method is explicit enough to be checked and repeated, which is what separates it from an expert's well informed summary of a field.

What makes a review systematic

A few requirements do the defining work. You start from a focused, answerable question, narrow enough to have a definite set of relevant studies. You write a protocol before you search, specifying where you will look, what counts as relevant, and how you will judge quality, so the rules are fixed in advance rather than adjusted to fit what you find. You then search comprehensively across multiple databases, screen every result against your stated criteria, usually with more than one person to catch errors⁠[1], and appraise the studies you keep. The second person is not a formality: in studies that compared the two approaches, a single reviewer screening alone missed a median of 5% of the relevant studies.

Finally, you report all of it transparently. The standard for that reporting is PRISMA, an updated guideline for reporting systematic reviews⁠[2], which sets out a 27 item checklist and a flow diagram that tracks how records move from your initial search through screening to the final set of included studies. That flow diagram is the visible signature of a systematic review: it shows, with numbers, exactly how you got from thousands of hits to the handful of studies you analyzed. PRISMA governs how you report the review, not how you run it, but a review reported to that standard has almost always been conducted to match.

A systematic review is not a better literature review

It is tempting to rank these, with the systematic review as the rigorous one and the literature review as the casual one. That is the wrong frame. They are different tools for different jobs. A narrative literature review synthesizes a field, builds theory, frames a research problem, and draws on the author's judgment about what matters. It is exactly the right form for a thesis introduction, a broad overview, or any question too wide to reduce to a single set of comparable studies.

A systematic review deliberately gives up that breadth for reproducibility. It answers one focused question as completely and as transparently as the evidence allows. Neither is superior. A systematic review of a question that did not need one is wasted effort, and a narrative review dressed up as systematic is a credibility problem. The skill is matching the form to the question.

When you actually need one, and when you do not

You need a systematic review when you have a focused, empirical question with a body of comparable studies behind it, and when the value of the answer depends on it being comprehensive and unbiased. "Does this intervention improve this outcome?" is the classic shape, which is why systematic reviews are a backbone of medicine and policy, where a single missed study can change a recommendation.

You do not need one for a broad topic, a theoretical argument, an emerging area with few studies, or the literature chapter of most theses. Those call for a strong narrative review. It is also worth knowing the cost before you commit: a genuine systematic review is a large undertaking, commonly run by a team over many months⁠[3], with a registered protocol and a fully documented search. Among 195 completed reviews of medical interventions registered with PROSPERO, the mean time from registration to publication was 67.3 weeks, more than a year, and the average review had five authors. If you do not have that scope, the answer is not to do a lighter systematic review. It is to do an excellent narrative one⁠[4] and call it what it is.

So before you write "systematic review" in a proposal, ask what your question actually needs. If it needs a comprehensive, reproducible answer to a narrow question, the method is worth every hour it demands. If it needs a thoughtful map of a field, a narrative review is not a lesser choice, it is the correct one. Using the right label, and meeting its standard, is itself a mark of the rigor the words are meant to signal.

Sources

42 peer reviewed
  1. [1]
    Peer reviewed

    Waffenschmidt S, Knelangen M, Sieben W, Bühn S, Pieper D. Single screening versus conventional double screening for study selection in systematic reviews: a methodological systematic review. BMC Medical Research Methodology, 2019;19(1):132.

  2. [2]
    Journal article

    Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ, 2021;372:n71.

  3. [3]
  4. [4]

Keep reading