ACE Report Cover
Reporting quality among RCTs in plastic surgery is low and in need of improvement
Translate this  ACE Report Translate this  ACE Report Translate this  ACE Report
Language
Download Download Download
Download
Cite this Report Cite this Report Cite this Report
Cite
Add to Favorites Add to Favorites Add to Favorites Remove from Favorites Remove from Favorites Remove from Favorites
+ Favorites
Translate this  ACE Report Translate this  ACE Report Translate this  ACE Report
Language
Download Download Download
Download
Cite this Report Cite this Report Cite this Report
Cite
Add to Favorites Add to Favorites Add to Favorites Remove from Favorites Remove from Favorites Remove from Favorites
+ Favorites
GENERAL ORTHOPAEDICS
Reporting quality among RCTs in plastic surgery is low and in need of improvement .
Verified
This report has been verified by one or more authors of the original publication.

OrthoEvidence Journal (OE Journal) - ACE Report

OE Journal. 2014;2(9):11 Eur J Plast Surg. 2014;37:55-62. Epub 2013 Oct 30.

57 randomized controlled trials (RCTs) pertaining to plastic surgery research (from 28 journals) were included in this systematic review. The purpose of this study was to determine the overall reporting quality among these RCTs. Results indicated that the median CONSORT score was low (11.5/23), however there is a general trend of improvement over time. There was no correlation between CONSORT score and either the number of authors (Spearman rho=0.12), the journal's impact factor (Spearman rho=0.26) or the geographical origin of the RCT.


Publication Funding Details +
Funding:
Not Reported
Conflicts:
Other

Risk of Bias

10/10

Reporting Criteria

15/20

Fragility Index

N/A

Were the search methods used to find evidence (original research) on the primary question or questions stated?

Was the search for evidence reasonably comprehensive?

Were the criteria used for deciding which studies to include in the overview reported?

Was the bias in the selection of studies avoided?

Were the criteria used for assessing the validity of the included studies reported?

Was the validity of all of the studies referred to in the text assessed with use of appropriate criteria (either in selecting the studies for inclusion or in analyzing the studies that were cited)?

Were the methods used to combine the findings of the relevant studies (to reach a conclusion) reported?

Were the findings of the relevant studies combined appropriately relative to the primary question that the overview addresses?

Were the conclusions made by the author or authors supported by the data and or analysis reported in the overview?

How would you rate the scientific quality of this evidence?

Yes = 1

Uncertain = 0.5

Not Relevant = 0

No = 0

The Reporting Criteria Assessment evaluates the transparency with which authors report the methodological and trial characteristics of the trial within the publication. The assessment is divided into five categories which are presented below.

3/4

Introduction

4/4

Accessing Data

3/4

Analysing Data

2/4

Results

3/4

Discussion

Detsky AS, Naylor CD, O'Rourke K, McGeer AJ, L'Abbé KA. J Clin Epidemiol. 1992;45:255-65

The Fragility Index is a tool that aids in the interpretation of significant findings, providing a measure of strength for a result. The Fragility Index represents the number of consecutive events that need to be added to a dichotomous outcome to make the finding no longer significant. A small number represents a weaker finding and a large number represents a stronger finding.

Why was this study needed now?

In 2008, The Consolidated Standards of Reporting Trials (CONSORT) guidelines for non-pharmacological interventions were released to improve and standardize reporting among randomized controlled trials in the literature. It has previously been found that, among randomized controlled trials in the field of plastic surgery, there is room for improvement in regards to methodological quality. However, to date, reporting quality among plastic surgery research papers has not yet been systematically reviewed, emphasizing the need for this study.

What was the principal research question?

What is the overall reporting quality among randomized controlled trials in plastic surgery research?

Study Characteristics +
Data Source:
MEDLINE and the Cochrane Database of Systematic Reviews were searched from January 1, 2009 to June 30, 2011.
Index Terms:
The following key words were used for the search strategy: "Surgery, Plastic" OR "Reconstructive Surgical Procedures".
Study Selection:
Study selection was performed independently by four reviewers. Plastic surgery studies were included if they were (1) randomized controlled trials, (2) human studies, and (3) published in English. The exclusion criteria were purely pharmacological studies, cost-analyses, interim studies, short communications, study protocols, and RCTs including virtual or simulated procedures.
Data Extraction:
Studies were scored according to the 23-item CONSORT NPT checklist independently by two reviewers, with disagreements being resolved through discussion. The following information was recorded for each study: year of publication, geographical origin, the number of authors, and the journal's ISI 2010 impact factor. Additional scoring criteria included whether the authors mention conflicts of interest, sources of funding, a trial registry number and ethical approval.
Data Synthesis:
Correlations were assessed using Spearman rho and SPSS version 20. Inter-rater reliability was assessed using the Kappa score.
What were the important findings?
  • 57 randomized controlled trials from 28 journals were included in this review. Among these RCTs, 7 were multi-centre studies.
  • The median CONSORT score was 11.5/23 (range: 4.5-21.0), with a Kappa score of 0.80.
  • Median consort scores were 9.9 in 2009, 11.5 in 2010 and 12.9 in 2011, displaying a trend towards improvement in overall reporting quality over time.
  • Compliance for the standard CONSORT criteria were lowest for intervention/comparison details (7%), randomization (11%) and blinding (26%).
  • In regards to additional CONSORT criteria, 61% of studies stated potential conflict of interest, 75% reported details regarding ethical approval, 47% reported sources of funding, and 16% identified a trial registry number.
  • There was no correlation between CONSORT score and either the number of authors (Spearman rho=0.12), the journal's impact factor (Spearman rho=0.26) or the geographical origin of the RCT.
What should I remember most?

In general, reporting quality was poor (11.5/23) among randomized controlled trials pertaining to plastic surgery, however there is a general trend of improvement over time. There was no correlation between CONSORT score and either the number of authors (Spearman rho=0.12), the journal's impact factor (Spearman rho=0.26) or the geographical origin of the RCT.

How will this affect the care of my patients?

The results from this study suggest that, although there are improvements as time goes on, researchers in the field of plastic surgery should focus on improving the reporting quality of their future studies according to the CONSORT guidelines. As this systematic review only included publications written in English and only up to 2011, additional systematic reviews are needed to monitor any improvement in reporting quality (or lack thereof).

DISCLAIMER

This content found on this page is for informational purposes only and is not intended to be a substitute for professional medical advice, diagnosis, or treatment. If you require medical treatment, always seek the advice of your physician or go to your nearest emergency department. The opinions, beliefs, and viewpoints expressed by the individuals on the content found on this page do not reflect the opinions, beliefs, and viewpoints of OrthoEvidence.

0 of 4 monthly FREE articles unlocked
You've reached your limit of 4 free articles views this month

Access to OrthoEvidence for as little as $1.99 per week.

Stay connected with latest evidence. Cancel at any time.
  • Critical appraisals of the latest, high-impact randomized controlled trials and systematic reviews in orthopaedics
  • Access to OrthoEvidence podcast content, including collaborations with the Journal of Bone and Joint Surgery, interviews with internationally recognized surgeons, and roundtable discussions on orthopaedic news and topics
  • Subscription to The Pulse, a twice-weekly evidence-based newsletter designed to help you make better clinical decisions
Upgrade
Welcome Back!
Forgot Password?
Start your FREE trial today!

Your account will be affiliated with
and includes free access to OrthoEvidence


OR
Forgot Password?

OR
Please check your email

If an account exists with the provided email address, a password reset email will be sent to you. If you don't see an email, please check your spam or junk folder.

For further assistance, contact our support team.

Please login to enable this feature

To access this feature, you must be logged into an active OrthoEvidence account. Please log in or create a FREE trial account.

Translate ACE Report

OrthoEvidence utilizes a third-party translation service to make content accessible in multiple languages. Please note that while every effort is made to ensure accuracy, translations may not always be perfect.

How to cite this ACE Report

OrthoEvidence. Reporting quality among RCTs in plastic surgery is low and in need of improvement. OE Journal. 2014;2(9):11. Available from: https://myorthoevidence.com/AceReport/Show/reporting-quality-among-rcts-in-plastic-surgery-is-low-and-in-need-of-improvement

Copy Citation
Please login to enable this feature

To access this feature, you must be logged into an active OrthoEvidence account. Please log in or create a FREE trial account.

Premium Member Feature

To access this feature, you must be logged into a premium OrthoEvidence account.

Share this ACE Report