SHORT STEPS ON HOW TO READ A PAPER. PART 8: CLINICAL TRIAL METHODOLOGY

Regular readers of the blog will know that we like to summarise a randomised clinical trial, where possible. We do this because they are the most reliable method of comparing the effectiveness of interventions fairly.

This short step is about looking at the method section of randomised trials.

Research methodologists and statisticians have developed an accepted formula for presenting clinical trial methods.  They have outlined this in the  CONSORT statement.

We think that this is an excellent reporting guide, but it is also a great learning resource. We produced an orthodontic version of this several years ago to help with orthodontic aspects of trial reporting.   Authors must include all of these points in a trial report. It is therefore difficult (and possibly inappropriate to cherry-pick from this), but I have nonetheless selected several vital points below:

Participants:

It is essential that the authors clearly describe the participants. Ultimately, we need to know whether the findings from the study are relevant to our practice. Studies carried out in university settings involving non-paying patients, treated by students may, for example, be less applicable to seasoned practitioners in private offices. Similarly, one would have to question the validity (and generalisability) of undertaking a clinical trial relating to growth modification in adults!

Outcomes:

We must consider outcomes relevant to both practitioners and patients to maximise the yield from onerous and expensive research studies. However, I will stop there as I know Kevin will consider this in more detail in a forthcoming post.

Sample size calculation:

Often, this is seen as the preserve of statisticians with mathematical minds that intimidate us; however, no randomised controlled trial is complete without one. Calculations should be undertaken before commencement and based on realistic estimates of what we feel are clinically-important between-groups differences. Adequate numbers are essential both to ensure that the study has sufficient power to identify meaningful differences and ensure that the investigation is credible.

Randomisation procedures:

These include both the generation of an unpredictable sequence and its subsequent implementation. A fundamental advantage of a randomised trial over, for example, retrospective studies is our ability to eliminate selection bias (to avoid the cherry-picking that I am guilty of right now). It is, therefore, essential that the process is transparent and performed carefully.

Statistical methods:

I will post about this in more detail soon. However, key messages are that statistics should be focussed and finite. Specifically, we must design our statistical approach to answer our key question (e.g. ‘Does the use of bracket A result in more efficient alignment of the lower anteriors than Bracket B?’) rather than undertaking a battery or analyses.

This short post is merely a potted summary of clinical trial methodology. You can garner lots more depth and explanation by accessing the CONSORT statement.

Next week we are going to look at randomisation and concealment in more detail.  You need to have a full understanding of these concepts if you are going to appraise a clinical trial.