How to critique a research article: a summary and critical appraisal

How should you read a research article before critiquing it?

Not from the first line to the last. That is the slowest way to understand a paper.

S. Keshav’s short note “How to Read a Paper” (ACM SIGCOMM Computer Communication Review, 2007) suggests up to three passes, and it works outside computer science too. For a critique I’d adapt it like this:

1. First pass (10 minutes). Title, abstract, headings, figures and tables, conclusion. You should be able to say in one sentence what the authors claim, and what kind of article it is (a review or short communication is judged differently from an original study; see types of research articles).
2. Second pass (an hour or two). The methods, closely, then the results tables. Mark every step you don’t follow.
3. Third pass. The discussion, read against the results. Most problems show up here, because authors sometimes write the discussion they hoped for rather than the one their tables allow.

Check the journal too. Acceptance in nine days by an unfamiliar journal is part of your appraisal (our predatory journal guide has the checks).

How do you write a summary of a research paper?

A summary reports what the paper did and found, in your own words, without judging it. In roughly this order: the aim, the design and method, the sample and setting (who, how many, where, when), the main findings with key numbers, and the authors’ own conclusion.

For literature review notes, three or four sentences are enough. In a coursework critique I would keep the summary to about a quarter or a third of the whole, and give the rest to appraisal. If the assignment asks for APA style, start with the full reference; our APA 7 guide has the format.

Don’t paraphrase the abstract. It is the authors’ sales pitch. Write from the methods and results, and you will often find the abstract claims a little more than the results show.

What questions should you ask in a critical appraisal?

Go through the paper section by section. These are the questions I would ask of almost any empirical article.

In the Indian social science and management papers I read, the sample row causes the most trouble. “Data were collected from 400 respondents” tells you nothing; “questionnaires were circulated in the college’s WhatsApp groups” tells you a lot. Our guide to sampling techniques explains what each method can support.

For measures, look for evidence that the scale worked in this sample. A scale validated on American undergraduates is not automatically valid for farmers in Vidarbha (see reliability and validity).

Which critical appraisal checklist should you use?

In health, nursing, psychology or public health, use a design-specific checklist rather than inventing your own. The two most used free sets are the CASP checklists and the JBI critical appraisal tools. Pick the one that matches the study’s design.

Here is a point that is often misunderstood. CONSORT, STROBE, COREQ and PRISMA are reporting guidelines: they list what a paper should report so that readers can judge it, and they do not tell you whether the study was done well. The STROBE website says its checklist “is not an instrument to evaluate the quality of observational research”. A trial can tick every CONSORT item and still have a serious flaw, reported clearly.

Reporting guidelines still help: if a STROBE item is missing (say, how missing data were handled), you can say the paper doesn’t let you judge that point. Just don’t call it “quality assessment using STROBE”.

The EQUATOR Network lists reporting guidelines; its sister project, the LATITUDES Network, lists risk-of-bias tools. A formal systematic review needs those tools, and our systematic review guide matches them to designs. Outside health research there is no standard checklist, so use the questions above.

What is the format of an article critique? (with example)

Unless your instructor gives a different format, this outline works for coursework, journal-club handouts and most “review this article” assignments.

1. 1

   Reference and context

   Full reference, the article type and why the paper matters to your topic.

2. 2

   Neutral summary

   Aim, design, sample, main findings and the authors’ conclusion. No judgement yet.

3. 3

   Strengths

   Two or three specific strengths, each tied to a part of the paper.

4. 4

   Weaknesses

   The problems that most affect the conclusions, in order of importance, with evidence.

5. 5

   Overall judgement

   How far the conclusions can be trusted, and what that means for your study.

A short article critique example

Summary. The article examines whether financial-literacy training is associated with mobile banking use among women in self-help groups (SHGs) in rural Odisha. The authors surveyed 280 members in one district, recruited through a partner NGO, using a Technology Acceptance Model questionnaire translated into Odia. Using structural equation modelling, they report that trained members used mobile banking more often. They conclude that training “leads to” adoption and recommend making it compulsory for all SHGs.

Strengths. The question matters for policy, and rural women are under-represented in a mostly urban literature. The questionnaire is printed in an appendix, and reliability is reported from the authors’ own sample.

Weaknesses. The most serious problem is the causal claim. A single cross-sectional survey can show that training and use go together, not that training causes use; women already confident with phones may be the ones who attend training. Second, every respondent came through the NGO that runs the training, so the results cannot be generalised to Odisha, let alone to all SHGs. Third, the translation is described in one line, with no back-translation or pilot. Ethics approval is stated, but there is no competing-interests or funding declaration, which matters because the NGO employs a co-author.

Overall judgement. A useful descriptive study that supports an association, not the causal conclusion or the national recommendation. In my review I would cite it as evidence of a link in NGO-connected SHGs, and note the need for a comparison group or longitudinal design.

The weaknesses are ordered by how much they damage the conclusion, and each says why it matters.

How do you write a critique that is critical but not negative?

“Critical” means judging carefully. A balanced critique finds both strengths and weaknesses; one that lists only faults, or only praise, covers half the job.

• Tie every criticism to a page, table or sentence in the article.
• Say what effect the weakness has on the conclusions. A flaw that changes nothing is a minor point.
• Allow for what the authors could not reasonably do (a national random sample is rarely feasible on a UGC fellowship).
• Suggest a fix: a comparison group, a longitudinal design, a sensitivity analysis.
• Describe the paper, not the people. “The sampling limits generalisation”, not “the authors were careless”.

Department journal clubs can range from polite praise to very sharp criticism. Bring two strengths and two weaknesses, with page numbers, and you will hold your own.

How do article critiques feed into your literature review?

You won’t write a full critique of every paper for your thesis. But every paper you rely on should get a short appraisal note, because the review chapter has to say how strong the evidence is as well as what it says. One row set per article:

Scholars leave the last two rows blank, and those are the rows that save you at the DC or RAC meeting when someone asks why you trusted a study. Our literature review guide shows how these notes become a synthesis matrix and then a chapter organised by theme.