Amanda Yang Shen MBBS,1 Robert S Ware PhD,2 Tom J O’Donohoe MBBS,3 Jason Wasiak PhD4,5
Box Hill Hospital
Menzies Health Institute Queensland
National Trauma Research Institute
Olivia Newton-John Cancer Wellness and Research Centre Heidelberg
Department of Paediatrics
Name: Amanda Yang Shen
Address: Box Hill Hospital
8 Arnold Street
Box Hill, Victoria, 3204
Phone: +61 (0)3 8804 9999
Citation: Shen AY, Ware RS, O’Donohoe TJ, Wasiak J. Reporting quality of systematic review abstracts in hand and wrist pathology: a review. Aust J Plast Surg. 2019;2(2):50–57. https://doi.org./10.34239/ajops.v2n2.141
Accepted for publication: 16 May 2019
Copyright © 2019. Authors retain their copyright in the article. This is an open access article distributed under the Creative Commons Attribution Licence which permits unrestricted use, distribution and reproduction in any medium, provided the original work is properly cited.
Background: An increasing number of systematic reviews are published on an annual basis. Although perusal of the full text of articles is preferable, abstracts are sometimes relied upon to guide clinical decisions. Despite this, the abstracts of systematic reviews have historically been poorly reported. We evaluated the reporting quality of systematic review abstracts within hand and wrist pathology literature.
Methods: We searched MEDLINE®, EMBASE and Cochrane Library from inception to December 2017 for systematic reviews relating to hand and wrist pathology. The 12-item PRISMA-A checklist was used to assess abstract reporting quality.
Results: A total of 114 abstracts were included. Most related to fracture (38%) or arthritis (17%) management. Forty-seven systematic reviews (41%) included meta-analysis. Mean PRISMA-A score was 3.6/12 with Cochrane reviews having the highest mean score and hand-specific journals having the lowest. Abstracts longer than 300 words (mean difference [MD]: 1.43, 95% CI [0.74, 2.13]; p <0.001) and systematic reviews with meta-analysis (MD: 0.64, 95% CI [0.05, 1.22]; p=0.034) were associated with higher scores. Unstructured abstracts were associated with lower scores (MD: –0.65, 95% CI [–1.28, –0.02]; p=0.044). A limitation of this study is the possible exclusion of relevant studies that were not published in the English language.
Conclusion: Abstracts of systematic reviews pertaining to hand and wrist pathology have been suboptimally reported as assessed by the PRISMA-A checklist. Improvements in reporting quality could be achieved by endorsement of PRISMA-A guidelines by authors and journals, and reducing constraints on abstract length.
Keywords: hand, wrist, abstracting and indexing as topic, checklist, standards
The biomedical evidence base is expanding at an exponential rate with data repositories such as PubMed currently housing more than 23 million references from more than 5600 journals.1 In addition, 8000 systematic reviews are indexed each year, making it increasingly difficult for clinicians to remain contemporary with either primary or synthesised evidence.2 One way in which clinicians have responded to this issue is to subscribe to a journal’s free abstract service or to read abstracts within free digital repositories, in order to obtain a brief synopsis of the information. The cost of article access can be prohibitive to clinicians without academic or institutional affiliations, especially for large or popular journals. Although a thorough evaluation of the full text of an article is preferable, there is some evidence that readers are more than twice as likely to read only the abstract, especially when they are unable to gain access to the full text.3,4 It is therefore possible that important healthcare decisions are being based on information that is contained within abstracts.5 Recognising this, a number of reporting guidelines have been developed in order to improve the quality of abstract reporting.3,6
The preferred reporting items for systematic reviews and meta-analyses for abstracts (PRISMA-A) checklist was developed in 2013 as an extension of the PRISMA statement with the aim of providing more focused guidance on writing abstracts for systematic reviews.7 Although the PRISMA-A checklist was not intentionally developed to improve how systematic reviews and meta-analyses are planned and carried out, it is implicit that setting standards in reporting could have an impact on how they are undertaken.7,8 The PRISMA-A checklist focuses on accurate representation of a systematic review in an abstract with emphasis placed on evaluations of interventions where meta-analyses have been conducted.3 The checklist covers the title, objectives, eligibility criteria, information sources, risk of bias assessment, included studies, results synthesis and findings, strengths and limitations, interpretation of findings, funding sources and protocol registration.
The PRISMA-A checklist has been adapted to evaluate the quality of systematic review abstract reporting in conference proceedings as well as in dental, general medical, oncological and mental health literature.9–14 However, it has not previously been used to examine the quality of abstract reporting within plastic surgery. The aim of this study was to evaluate the quality of abstract reporting in systematic reviews pertaining to surgical management of hand and wrist pathology and to identify characteristics associated with improved reporting.
Materials and methods
We used the Ovid SP platform to search MEDLINE®, EMBASE and the Cochrane Library from inception to December 2017 to identify systematic reviews addressing surgical interventions for hand and wrist pathology. In MEDLINE®, we used medical subject headings (MeSH) and free text terms related to ‘hand’ or ‘wrist’ or ‘upper limb’ and ‘systematic review’ or ‘meta-analysis’. The reference lists of included articles were also examined. The search strategy used for this systematic review was adapted from our previous study that assessed the methodological and reporting quality of systematic reviews in hand and wrist pathology.15
Study selection criteria and procedures
Our inclusion criteria were as follows:
- Systematic review alone or in combination with meta-analysis, as defined in the title, abstract or main text;
- A specific focus on pathology of the hand and/or wrist; and
- Inclusion of a greater number of studies pertaining to surgical rather than non-surgical interventions. Surgical interventions were defined as invasive procedures including endoscopic or open repair, while non-surgical interventions were defined as non-invasive treatment such as cast splinting.
Our exclusion criteria were:
- Narrative reviews, guidelines, editorials and opinion pieces;
- Studies that were not available in English or full text; and
- studies that addressed the upper limbs excluding hand and wrist (for example, elbow, shoulder). Articles that were not available in English were excluded as we did not have access to translation services. Two authors (JW, AS) screened eligible titles and abstracts against the inclusion criteria. Full-text articles were retrieved and reviewed independently by two authors (JW, AS) for final inclusion. Differences of opinion were resolved by discussion with a third author (TO). Figure 1 details the study selection process.
Each PRISMA-A item was assessed by two authors (AS, TO) and recorded with a ‘yes’, ‘no’ or ‘not applicable’ response using an electronic data collection form. A single point score was given to each item if reporting was adequate, and no points were given if reporting was not stated or not applicable. Consequently, the possible score for each individual systematic review abstract ranged from 0 to 12.
Two authors (AS, TO) independently extracted the general characteristics of each systematic review such as author details (number, country of origin), study descriptors (review category, disease state, intervention, number of studies), bibliographical features (journal name and impact factor [IF], year of publication, word limit for abstracts, structured format [introduction, methods, results and discussion—IMRAD] and whether the journal endorsed the PRISMA statement). These characteristics were selected as descriptive comparators and have been reported in other studies as being associated with improved review quality.14–16
Descriptive statistics were summarised as the mean (standard deviation—SD) for continuous variables and as the frequency (%) for categorical variables. A univariable linear regression model was used to investigate the association between study characteristics and the PRISMA-A score. Multivariable linear regression models were constructed to determine significant predictors for each variable. All multivariable models were adjusted for abstract length, abstract structure, whether a meta-analysis was included, impact factor and whether publication occurred before or after the PRISMA-A checklist appeared. Effect estimates were presented as mean differences (MD) and 95 per cent confidence intervals (95% CI).
The initial search strategy resulted in 810 studies. After removing the duplicate articles, independent review of titles and abstracts by two authors (AS, TO) identified 201 potentially relevant articles. Of these, 87 were excluded because they failed to meet the inclusion criteria. Therefore, a total of 114 studies were included in this study.
The characteristics of the included studies are shown in Table 1. Interventions for fracture management (37.7%, n=43) and arthritis (16.7%, n=19) were strongly represented in the included reviews. Many authors originated from the Americas (43.9%, n=50), followed by Europe (36.8%, n=42) and Australasia (19.3%, n=22). The majority of systematic reviews had fewer than six authors (76.3%, n=87). There were 47 systematic reviews (41%) that included a meta-analysis.
|Characteristic||n (%)||Mean PRISMA-A score (SD)|
|Plastic surgery||18 (15.8)||3.8 (1.3)|
|Orthopaedic surgery||26 (22.8)||4.3 (1.6)|
|Hand/wrist specific||43 (37.7)||2.8 (1.6)|
|Cochrane Library||10 (8.8)||5.3 (1.3)|
|Other||17 (14.9)||3.4 (1.5)|
|No||32 (28.1)||3.5 (1.7)|
|Yes||82 (71.9)||3.6 (1.7)|
|Country of primary author|
|North/South Americas||50 (43.9)||3.6 (1.7)|
|Australia/Asia||22 (19.3)||4.2 (1.6)|
|Europe||42 (36.8)||3.3 (1.7)|
|Number of authors|
|1–5||87 (76.3)||3.6 (1.7)|
|>6||27 (23.7)||3.4 (1.7)|
|Hand and wrist pathology|
|Fractures||43 (37.7)||3.8 (1.7)|
|Arthritis||19 (16.7)||3.2 (1.4)|
|Soft-tissue trauma||16 (14.0)||3.7 (1.5)|
|Nerve disorders||10 (8.8)||4.4 (1.8)|
|Connective tissue disorders||8 (7.0)||2.5 (2.1)|
|Other hand and wrist pathology||18 (15.8)||3.5 (1.7)|
|Year of publication|
|Before PRISMA-A (–2012)||49 (43.0)||3.4 (1.6)|
|After PRISMA-A (2013–)||65 (57.0)||3.7 (1.7)|
|No||67 (58.8)||3.2 (1.5)|
|Yes||47 (41.2)||4.2 (1.8)|
|IMRAD||81 (71.0)||3.9 (1.7)|
|Unstructured/other||33 (29.0)||2.9 (1.5)|
|<300 words||88 (77.2)||3.2 (1.5)|
|≥300 words||26 (22.8)||5.0 (1.6)|
|<2||47 (41.2)||3.5 (1.7)|
|≥2||67 (58.8)||3.7 (1.7)|
PRISMA-A checklist assessment
The mean (SD) overall score was 3.6 (1.7), with both the highest (8) and lowest (0) scores observed in hand-specific journals. The proportion of articles adhering to each of the PRISMA items is presented in Table 2. The checklist items that were most reported were title (item 1, 83.3%), study objectives (item 2, 50%) and interpretation of findings (item 10, 58.8%). The remaining items were reported adequately in less than 40 per cent of studies, with the lowest-scoring checklist components relating to risk of bias (item 5, 16.7%), registration (item 12, 0.9%) and funding source (item 11, 0%).
|PRISMA-A item||Adequate||Inadequate||No description|
|n (%)||n (%)||n (%)…|
|1. Title||95 (83.3)||0 (0)||19 (16.7)|
|2. Study objectives||57 (50.0)||45 (39.5)||12 (10.5)|
|3. Eligibility criteria||39 (34.2)||41 (36.0)||34 (29.8)|
|4. Information sources||29 (25.4)||50 (43.9)||35 (30.7)|
|5. Risk of bias||19 (16.7)||11 (9.6)||84 (73.7)|
|6. Included studies||45 (39.5)||55 (48.2)||14 (12.3)|
|7. Synthesis of results||27 (23.7)||79 (69.3)||8 (7.0)|
|8. Description of the effect||32 (28.1)||51 (44.7)||31 (27.2)|
|9. Strengths and limitations||30 (26.3)||0 (0)||84 (73.7)|
|10. Interpretation of findings||67 (58.8)||43 (37.7)||4 (3.5)|
|11. Funding source||0 (0)||0 (0)||114 (100)|
|12. Registration||1 (0.9)||0 (0)||113 (99.1)|
Table 3 displays the univariable and multivariable relationship between study demographics and PRISMA-A score. In the univariable analysis, our results showed higher PRISMA-A scores when systematic reviews incorporated a meta-analysis and an abstract >300 words and were published in the Cochrane Library. Conversely, lower PRISMA-A scores were seen with systematic reviews published in hand and wrist journals, reviews addressing specific clinical topics or abstracts using an unstructured format.
In the multivariable model, our results showed improvements in PRISMA-A scores when the systematic review incorporated an abstract >300 words (MD=3.1; 95% CI [1.5, 4.6]; p<0.001) and meta-analysis (MD=0.64, 95% CI [0.05, 1.22]; p=0.034). Conversely, lower PRISMA-A scores were observed in systematic reviews published in hand and wrist journals (MD=–0.97, 95% CI [–1.89, –0.04]; p=0.04) using an unstructured format (MD=0.65, 95% CI [–1.28, –0.02]; p=0.044).
|Variable||n||Univariate analysis||Multivariate analysis|
|Mean difference (95% CI)||p value||Mean difference (95% CI)||p value|
|Plastic surgery||18||0.0 (ref.)||0.0 (ref.)|
|Orthopaedic surgery||26||0.5 (–0.4, 1.4)||0.29||0.0 (–0.9, 0.9)||0.98|
|Hand/wrist specific||43||–1.0 (–1.8, –0.1)||0.03||–1.1 (–2.0, –0.2)||0.02|
|Cochrane Library||10||1.5 (0.3, 2.7)||0.01||0.2 (–1.2, 1.6)||0.33|
|Other||17||–0.4 (–1.4, 0.6)||0.41||–0.8 (–1.7, 0.2)||0.13|
|No||32||0.0 (ref.)||0.0 (ref.)|
|Yes||82||0.1 (–0.6, 0.8)||0.7||–0.2 (–0.8, 0.5)||0.6|
|Country of primary author|
|North/South Americas||50||0.0 (ref.)||0.0 (ref.)|
|Australia/Asia||22||0.6 (–0.3, 1.4)||0.18||–0.3 (–1.1, 0.5)||0.5|
|Europe||42||–0.3 (–1.0, 0.4)||0.37||–0.3 (–1.0, 0.3)||0.32|
|Number of authors|
|1–5||87||0.0 (ref.)||0.0 (ref.)|
|>6||27||–0.2 (–0.9, 0.5)||0.59||–0.3 (–0.9, 0.4)||0.41|
|Hand and wrist pathology|
|Fractures||43||0.0 (ref.)||0.0 (ref.)|
|Arthritis||19||–0.6 (–1.5, 0.3)||0.21||0.0 (–0.9, 0.8)||0.97|
|Soft-tissue trauma||16||–0.1 (–1.1, 0.9)||0.83||0.4 (–0.4, 1.3)||0.32|
|Nerve disorders||10||0.6 (–0.6, 1.8)||0.3||0.0 (–1.0, 1.1)||0.94|
|Connective tissue disorders||8||–1.3 (–2.6, 0.0)||0.05||–0.9 (–2.0, 0.3)||0.14|
|Other hand and wrist pathology||18||–0.3 (–1.2, 0.6)||0.54||0.2 (–0.7, 1.0)||0.7|
|Year of publication|
|Before PRISMA-A (–2012)||49||0.0 (ref.)||0.0 (ref.)|
|After PRISMA-A (2013–)||65||0.3 (–0.3, 0.9)||0.36||0.7 (0.1, 1.3)||0.031|
|No||67||0.0 (ref.)||0.0 (ref.)|
|Yes||47||0.9 (0.3, 1.6)||0.003||0.7 (0.2, 1.3)||0.01|
|IMRAD||81||0.0 (ref.)||0.0 (ref.)|
|Unstructured/other||33||–1.1 (–1.7, –0.4)||0.002||–0.6 (–1.2, 0.0)||0.06|
|<300 words||88||0.0 (ref.)||0.0 (ref.)|
|>300 words||26||1.8 (1.1, 2.4)||<0.001||1.5 (0.8, 2.2)||<0.001|
|<2||47||0.0 (ref.)||0.0 (ref.)|
|>2||67||0.2 (–0.5, 0.8)||0.57||0.2 (–0.3, 0.8)||0.4|
Summary of findings
The present study investigated the completeness of systematic review abstracts published in the field of hand and wrist pathology using the PRISMA-A checklist. Only three PRISMA-A items were commonly reported more than 50 per cent of the time, with the remaining nine items being infrequently met. While the reporting of abstracts included some description about recording an appropriate title, along with study objectives and details about overall interpretation, the majority of abstracts failed to report adequately on their eligibility criteria, information sources, risk of bias, included studies, methods used for evidence synthesis, description of effect, strengths and limitations, study registration and funding sources. We identified a number of study characteristics that were associated with improved abstract reporting quality. Multivariable analysis revealed that systematic reviews that included a meta-analysis or had an abstract length greater than 300 words had a greater mean score, while publications in hand- or wrist-specific journals had a lower mean score.
Agreements and disagreements with other reviews
While we could not find existing studies that specifically assessed the reporting quality of abstracts with a focus on pathology of the hand and wrist, a number of studies have investigated abstract reporting in other specialties. In a study by Gomez-Garcia and colleagues,17 which investigated adherence to reporting standards and methodological quality using multiple tools including PRISMA-A in 139 systematic reviews on psoriasis interventions, the authors found items such as study objectives, description of effect and overall interpretation to be present in almost all abstracts. However, consistent with the findings of this study, most abstracts failed to adequately report risk of bias, strengths and limitations, study registration details and disclosure of sources of funding. Similarly, Hopewell and colleagues9 evaluated the quality of reporting of systematic review abstracts presented at scientific medical conferences and found that many failed to report the date of search, assessment of risk of bias, and the result for the main efficacy outcomes including the number of studies and participants, harms, strengths and limitations of the evidence, and funding source. Koller and colleagues13 also evaluated the quality of reporting in the abstracts of 182 systematic reviews and found areas that were most lacking included the search process, study registration details, strengths and limitations, and funding sources. Similarly, Bigna, Um and Nansseu12 found the quality of 84 systematic review abstracts to be deteriorating over time with respect to strengths and limitations and funding, whereas Tsou and Treadwell’s11 assessment of 200 randomly selected abstracts of systematic reviews of health interventions noted that less than 50 per cent of abstracts contained a risk of bias assessment.
Study strengths and limitations
This study assessed the reporting quality of systematic review abstracts in hand and wrist surgery, which is a highly relevant topic given the large numbers of studies in the field being published annually. The methodological strengths of our study included a comprehensive search strategy incorporating multiple electronic databases and plastic surgery journals. This allowed us to identify a large number of relevant studies based on our inclusion criteria and also showed that the search strategy was easily replicable. Furthermore, we performed independent study selection, data extraction and PRISMA-A scoring, reducing the risk of human error during this process.
There are also some limitations to this study. Our sample included studies that exclusively focused on a subsection of plastic and orthopaedic surgery literature. As such, the results may not be applicable to other areas of surgery or those relating to medical interventions. We also excluded non-English systematic reviews, which may have led to selection bias. However, very few relevant articles in other languages were noted during our search screening process, and we believe that their exclusion is unlikely to affect our results. In addition, we noted that the PRISMA-A checklist contained items (for example, item 5 risk of bias) that could only be applied to systematic reviews that included a randomised controlled trial (RCT). In our sample, many studies contained few or no RCTs, which may have impacted their ability to satisfy certain items in the checklist. However, the inability of a small proportion of studies to adhere to certain elements of the checklist does not explain the overall suboptimal quality of systematic review abstract reporting observed in this study.
Implications for clinical research and practice
The results of this study indicate that the overall completeness of abstracts within systematic reviews focusing on the pathology of the hand and wrist requires improvement. While a number of journals endorse the PRISMA tool to aid with reporting of systematic reviews, the abstract extension (PRISMA-A) is less widely used. Its endorsement could help authors to become aware of the fundamental elements of abstracts and thereby improve the quality of reporting. Our findings indicated that abstracts that were structured and allowed for a >300-word limit were associated with higher PRISMA-A scores. We suggest that journal editors consider exercising lenience with systematic review abstract word limits to enable authors to better adhere to reporting guidelines.10
Abstracts of systematic reviews published in hand and wrist pathology literature demonstrate suboptimal reporting quality as assessed by the PRISMA-A checklist. Given that abstracts are the first-line tool for authors to convey relevant information within the full text to readers, it is important that efforts be made to improve their reporting. This could be done by endorsement of PRISMA-A guidelines by authors and journals and by reducing constraints on abstract length.
This paper is not based on a previous communication to a society or meeting. The authors have no financial or commercial conflicts of interest to disclose.
- PubMed. Fact sheets [web page]. [Cited 21 June 2018] Bethesda, MD: US National Library of Medicine. Available from: https://www.nlm.nih.gov/pubs/factsheets/pubmed.ht.
- Bastian H, Glasziou P, Chalmers I. Seventy-five trials and eleven systematic reviews a day: how will we ever keep up? PLoS Med. 2010;7:e1000326. https://doi.org/10.1371/journal.pmed.10003 PMid:20877712 PMCid:PMC2943439
- Beller EM, Glasziou PP, Altman DG, Hopewell S, Bastian H, Chalmers I, Lasserson T, Tovey D for the PRISMA for Abstracts Group. PRISMA for Abstracts: reporting systematic reviews in journal and conference abstracts. PLoS Med. 2013;10:e1001419. https://doi.org/10.1371/journal.pmed.10014 PMid:23585737 PMCid:PMC3621753
- Islamaj Dogan R, Murray G, Neveol A, Lu Z. Understanding PubMed® user search behavior through log analysis. Database. 2009; bap018. https://doi.org/10.1093/database/bap0 PMid:20157491 PMCid:PMC2797455
- Hopewell S, Ravaud P, Baron G, Boutron I. Effect of editors’ implementation of CONSORT guidelines on the reporting of abstracts in high impact medical journals: interrupted time series analysis. BMJ. 2012;344:e4178. https://doi.org/10.1136/bmj.e41 PMid:22730543 PMCid:PMC3382226
- Sollaci LB, Pereira MG. The introduction, methods, results, and discussion (IMRAD) structure: a fifty-year survey. J Med Libr Assoc. 2004;92:364–67.
- Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, Clarke M, Devereauz PJ,Kleijnen J, Moher D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009;6:e1000100. https://doi.org/10.1371/journal.pmed.10001 PMid:19621070 PMCid:PMC2707010
- Beller EM, Glasziou PP, Hopewell S, Altman DG. Reporting of effect direction and size in abstracts of systematic reviews. JAMA. 2011;306:1981–82. https://doi.org/10.1001/jama.2011.162PMid:22068989
- Hopewell S, Boutron I, Altman D, Ravaud P. Deficiencies in the publication and reporting of the results of systematic reviews presented at scientific medical conferences. J Clin Epidemiol. 2015;68(12):1488–95. https://doi.org/10.1016/j.jclinepi.2015.03.0 PMid:25890806
- Kiriakou J, Pandis N, Madianos P, Polychronopoulou A. Reporting quality of systematic review abstracts in leading oral implantology journals. J Dent. 2013;41:1181–87. https://doi.org/10.1016/j.jdent.2013.09.0 PMid:24075952
- Tsou A, Treadwell J. Quality and clarity in systematic review abstracts: an empirical study. Res Synth Methods. 2016;7(4):447–58. https://doi.org/10.1002/jrsm.12 PMid:27764903
- Bigna J, Um L, Nansseu J. A comparison of quality of abstracts of systematic reviews including meta-analysis of randomized controlled trials in high-impact general medicine journals before and after the publication of PRISMA extension for abstracts: a systematic review and meta-analysis. Syst Rev. 2016;5(174):1–9. https://doi.org/10.1186/s13643-016-0356 PMid:27737710 PMCid:PMC5064935
- Koller C, Khan S, Holmes J, Herrmann D, Vassar M. Quality of systematic review and meta-analysis abstracts in oncology journals. Cancer Treat Commun. 2016;9:70–74. https://doi.org/10.1016/j.ctarc.2016.08.0
- Rice D, Kloda L, Shrier I, Thombs B. Reporting quality in abstracts of meta-analyses of depression screening tool accuracy: a review of systematic reviews and meta-analyses. BMJ Open. 2016;6(11):e012867. https://doi.org/10.1136/bmjopen-2016-0128 PMid:27864250 PMCid:PMC5128996
- Wasiak J, Shen A, Ware R, O’Donohue T, Faggion C Jr. Methodological quality and reporting of systematic reviews in hand and wrist pathology. J Hand Surg Eur. 2017;42(8):852–56. https://doi.org/10.1177/1753193417712660 PMid:28610464
- Page M, Moher D. Evaluations of the uptake and impact of the preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement and extensions: a scoping review. Syst Rev. 2017;6(263):1–14. https://doi.org/10.1186/s13643-017-0663-8 PMid:292585 PMCid:PMC5738221
- Gómez-García F, Ruano J, Aguilar-Luque M, Alcalde-Mellado P, Gay-Mimbrera J, Hernández-Romero J, Sanz-Cabanillas JL, Maestre-Lopez B, Gonzalez-Padilla M, Carmona-Fernandez PJ, Garcia-Nieto AV, Isla-Tejea B. Abstract analysis method facilitates filtering low-methodological quality and high-bias risk systematic reviews on psoriasis interventions. BMC Med Res Methodol. 2017;17(180):1–11.https://doi.org/10.1186/s12874-017-0460 PMid:29284417 PMCid:PMC5747101