Objective To survey and analyze the quality assessment of the included studies in the Overviews of reviews (Overviews), so as to provide methodology references for Overviews authors. Methods A computerized search was performed for collecting Overviews in The Cochrane Library (Issue 1, 2010), PubMed, EMBASE, and CBM, and the search time ended by December, 2009. Then the relevant data, such as assessment standard etc, were extracted, and the staple standards were analyzed. Results A total of 43 typical Overviews were included. Thirty-two (74.4%) of them assessed the methodology quality of the included systematic reviews with different standards, including OQAQ (34.9%/15), AMSTAR (9.1%/3), Checklist from DARE (4.6%/2), Assendelft scale (4.6%/2), Effective Public Health Practice Project standards (2.3%/1), self-formulated standards (14.0%/ 6), syntaxic standards (2.3%/1), and other standards (4.6%/2). Ten Overviews (23.6%) assessed the quality of evidence, including eight (18.6%) applied the GRADE system. Only 7 studies (16.3%) assessed the quality of evidence and applied the GRADE system as well. Conclusion The quality assessment in Overviews includes the assessment of both methodological quality and evidence quality. But most Overviews do not assess comprehensively. The methodological quality standards applied in current Overviews are numerous and no standard is acknowledged. Yet, the OQAQ and AMSTAR are applied widely and recommended because they are comprehensive and easy to be conducted. It suggests that Overviews authors should choose appropriate methodological quality assessment standards according to concrete conditions. The GRADE system is much more comprehensive and systematic than other systems, so it is recommended that Overviews authors should apply GRADE to assess the quality of evidence in their studies in order to make the study results more comprehensive and easier for clinical application.
ObjectiveTo evaluate the methodological bias and the reliability of the conclusions of systematic reviews (SRs) about traditional Chinese medicine for essential hypertension. MethodsWe comprehensively searched PubMed, EMbase, The Cochrane library (Issue 4, 2014), CBM, CNKI and WanFang Data to collect SRs of traditional Chinese medicine for essential hypertension from the establishment time of databases to April 30th, 2014. The AMSTAR tool was applied for methodological quality assessment of included studies, and the GRADE system was applied for evidence quality assessment of included outcomes of SRs. ResultsA total of 12 SRs involving 31 outcomes were included, of which 11 SRs focused on the comparison of therapeutic effects between traditional Chinese medicine combined with western medicine and western medicine alone. Nine SRs adopted Jadad tool to assess methodological quality of included original studies. The results of assessment using AMSTAR showed that, among 11 items, there were the most problems concerning Item 1 "Was an 'a prior' design provided?" (none of the 12 SRs provided it); followed by Item 11 "Were potential conflict of interest included?" (nine SRs didn't described it), and Item 6 "Were the characteristics of included studies provided" (six SRs didn't provided it). The results of grading showed that, 29 outcomes were graded as "low" or "very low" quality. The main factors contributed to downgrading evidence quality were limitations (31 outcomes), followed by imprecision (12 outcomes), and inconsistency (13 outcomes). ConclusionCurrently, the methodological quality of SRs about traditional Chinese medicine for essential hypertension was poor on the whole, with low quality of evidence as well as lack of enough attention to the end outcomes of patients with essential hypertension. Thus, physicians should apply the evidence to make decision about traditional Chinese medicine for essential hypertension with caution in clinical practice.
ObjectiveTo re-evaluate the systematic review and meta-analysis (SR/MAs) of the efficacy of robot-assisted pedicle screw placement. MethodsThe CNKI, VIP, WanFang Data, SinoMed, PubMed, Embase, Cochrane Library, and Web of Science databases were electronically searched to collect SR/MAs of robot-assisted pedicle screw placement from inception to April 28, 2023. Two reviewers independently screened literature, extracted data and then assessed the quality of reports, methodological quality, risk of bias, and the strength of evidence quality by using PRISMA, AMSTAR-Ⅱ, ROBIS, and GRADE tool. ResultsA total of 20 SR/MAs were included. The results of the included studies showed that robot-assisted pedicle screw placement was more accurate and had a lower number of complications compared with freehand pedicle screw placement. The quality of reports, methodology, and evidence for pedicle screw placement efficiency in all SR/MAs were low or extremely low, with a high risk of bias. The main reasons included high heterogeneity of included studies, unclear research methods and selection criteria, and missing key reporting processes. ConclusionRobot-assisted pedicle screw placement may have better clinical efficiency than traditional freehand pedicle screw placement. But the quality of relational SR/MAs is low.
ObjectivesTo provide an overview of whether the clinical decision support system (CDSS) was effective in reducing medication error and improving medication safety and to assess the quality of available scientific evidence.MethodsPubMed, EMbase, The Cochrane Library, CBM, WanFang Data, VIP and CNKI databases were electronically searched to collect systematic reviews (SRs) on application of clinical decision support system in the medication error and safety from January, 1996 to November, 2018. Two reviewers independently screened literature, extracted data and then evaluated methodological quality of included SRs by using AMSTAR tool.g AMSTAR tool.ResultsA total of 20 SRs including 256 980 healthcare practitioners and 1 683 675 patients were included. Specifically, 16 studies demonstrated moderate quality and 4 demonstrated high quality. 19 SRs evaluated multiple process of care outcome: 9 were sufficient evidence, 6 were limited evidence, and 7 were insufficient evidence which proved that CDSS had a positive effect on process outcome. 13 SRs evaluated reported patient outcomes: 1 with sufficient evidence, 3 with limited evidence, and 9 without sufficient evidence.ConclusionsCDSS reduces medication error by inconsistently improving process of care measures and seldom improving patient outcomes. Larger samples and longer-term studies are required to ensure a larger and more reliable evidence base on the effects of CDSS intervention on patient outcomes.
ObjectiveTo summarize and evaluate the quality of methodology, report and evidence of the systematic reviews and meta-analyses (SRs/MAs) of acupuncture and moxibustion interventions for Parkinson's disease. MethodsEight databases including CNKI, WanFang Data, VIP, CBM, PubMed, EMbase, Cochrane Library and Web of Science were searched from inception to May 1, 2023. The quality of methodology, report and evidence involved in these studies were evaluated by AMSTAR 2, PRISMA and GRADE tool. ResultsA total of 28 SRs/MAs were included, and the findings of included studies showed that acupuncture and moxibustion had a clinical advantage for Parkinson's disease. The methodological quality of all studies was extremely low. Thirteen reports were relatively complete, 14 reports had certain flaws, and 1 report had relatively serious flaws. And of the 126 reports for seven outcomes, 1 was graded as high, 12 as moderate, 57 as low, and 56 as critically low. ConclusionThe current evidence shows that acupuncture and moxibustion have a certain clinical effect for Parkinson's disease, but the methodological quality and evidence quality of related SRs/MAs are low, and the standardization still needs to be improved. The efficacy of acupuncture and moxibustion in Parkinson's disease still needs to be verified by high-quality clinical studies in the future.
ObjectiveTo assess the methodological quality of systematic reviews of Tai Chi for preventing falls in the elderly and the quality of evidence for outcome indicators.MethodsPubMed, Web of Science, The Cochrane Library, EMbase, CNKI, WanFang Data, CBM and VIP databases were electronically retrieved. According to the inclusion criteria and exclusion criteria, the final articles were selected and the relevant literature information was extracted by reading the abstract and the full text. The methodological quality of the included systematic reviews was evaluated using AMSTAR 2 tool, and the quality of the outcome indicators of the included systematic reviews was further graded according to the GRADE system.ResultsA total of 11 systematic reviews/meta-analyses were included. The AMSTAR 2 evaluation showed that 10 studies were in critically-low methodological quality, and 1 study was in low methodological quality. The GRADE evaluation results showed that among the 36 outcome indicators included, there were 10 intermediate quality indicators, 20 low-level quality indicators and 6 extremely low-level quality indicators. Among the indicators of intermediate quality, single-leg stand test (MD = 5.33, 95%CI 3.35 to 7.32, P< 0.01; WMD = 1.76, 95%CI −7.00 to 10.52, P< 0.01), time up and go test (MD = 1.04, 95%CI 0.67 to 1.41, P< 0.01), the berg balance scale (MD = 2.18, 95%CI 0.93 to 3.43, P< 0.01), number of falls (RR = 0.82, 95%CI 0.73 to 0.92), P< 0.01), the incidence of 2-falls (OR = 0.69, 95%CI 0.49 to 0.97, P< 0.01) and the incidence of 3-falls (OR = 0.39, 95%CI 0.21 to 0.73, P< 0.01). The results of the above indicators were statistically significant, indicating that Tai Chi was better than control group.ConclusionsAt present, the methodological quality of relevant systematic reviews of Tai Chi for preventing falls in the elderly was relatively low and the quality of the evidence was not good, so it can’t be proved that Tai Chi can effectively prevent falls in the elderly, which needs to be further studied at a high level.
ObjectiveTo overview of systematic reviews (SRs) of Yiqi Fumai (YQFM) injection in the treatment of chronic heart failure (CHF). MethodsThe PubMed, Cochrane Library, EMbase, Web of Science, CNKI, CBM and WanFang Data databases were electronically searched to collect SRs of YQFM injection in the treatment of CHF from January 1, 2007 to October 31, 2022. Two reviewers independently screened literature, extracted data and assessed methodological quality, risk of bias, report quality and evidence quality by using AMSTAR-2, ROBIS scale, PRISMA, and GRADE system. ResultsA total of 7 SRs were included. The evaluation results showed that the quality of all SRs was low, a few SRs were assessed as having a low risk of bias, and all SRs were relatively completely reported. A total of 46 results were extracted from the included SRs, including 3 with moderate quality evidence, 12 with low quality evidence and 31 with very low quality evidence. ConclusionYQFM may be an effective and safe treatment, but current evidence quality is low.
ObjectiveTo overview the systematic reviews of the efficacy of cancer patient decision aids (PDAs) for treatment decision-making. MethodsThe PubMed, Web of Science, Cochrane Library, Embase, CINAHL, JBI, CNKI, VIP, CBM and WanFang Data databases were electronically searched to collect the systematic reviews relevant to the objective from inception to September 2023. Literature screening, data extraction, methodological quality assessment of the included literature, and summary and grading of the evidence were carried out independently by two researchers, and duplication of original studies in the included systematic evaluations was investigated using the corrected covered area (CCA). ResultsA total of 17 systematic reviews were included, of which 13 (76.47%) were low- or very low-quality studies. A total of 64 pieces of evidence were included, of which only 26 (40.62%) were of moderate quality, and the original studies included in the included literature had a low degree of overlap (CCA=0.05). The results of meta-analysis showed that PDAs could increase decision-related knowledge, reduce decision conflict and regret in cancer patients' treatment decision (P<0.05). However, there was no significant difference in decision satisfaction, anxiety or depression (P>0.05). ConclusionPDAs can improve cancer patients' knowledge related to treatment decision, reduce decision conflicts and regrets, and have no significant negative effects on decision preparation, satisfaction, anxiety, and depression. However, the existing systematic reviews are of low quality and limited to a few cancer types.
Objectives To evaluate the methodological bias and the reliability of the conclusions of systematic reviews on acupuncture for polycystic ovary syndrome. Methods We comprehensively searched PubMed, EMbase, The Cochrane Library, CBM, CNKI and WanFang Data to collect systematic reviews on acupuncture for polycystic ovary syndrome from the establishment time of databases to January 5th, 2018. The AMSTAR tool was applied for methodological quality assessment of included studies and the GRADE system was applied for evidence quality assessment of included outcomes of systematic reviews. Results A total of 11 systematic reviews were included. The results of assessment using AMSTAR showed that, among the 11 items, most problems occurred in Item 5 " Were there any lists of research articles included and excluded”, followed by Item 1" Was an‘a prior’design provided?”and Item 11" Were potential conflict of interest included?”. GRADE grading results showed that quality of evidence for the outcome measure were" low”or" very low”. Conclusions Current acupuncture treatment of polycystic ovary syndrome has a certain effect, however, the quality of evidence is low. Thus, physicians should apply the evidence to make decision on acupuncture for polycystic ovary syndrome with caution in clinical practice and consider the actual situation, combined with the patient’s value preferences and economic factors.
ObjectiveTo overview the systematic reviews of dominant diseases of acupuncture in clinical efficacy.MethodsPubMed, The Cochrane Library, Web of Science, CNKI, CBM, VIP and WanFang Data databases were electronically searched to collect systematic reviews or meta-analyses of dominant diseases of acupuncture in clinical efficacy from inception to December 2020. Two reviewers independently screened literature, extracted data and assessed the quality of the included studies. Then, Excel 2010 and VOS viewer were used for data analysis.ResultsA total of 263 systematic reviews were included. Acupuncture techniques involved electroacupuncture (n=29), point thread-embedding (n=25), dermal needle (n=15), acupoint injection (n=12), spoon needle (n=12), fire needle (n=8), laser (n=8), intradermal needle (n=5), filiform needle (n=4), pricking blood therapy (n=2) and round-sharp needle (n=1). A total of 94 kinds of diseases were identified, and their total effective rate ranged from 4% (bladder cancer) to 98% (bladder stones, renal colic), 72 kinds of which were above 85%.ConclusionsAcupuncture is currently widely used in clinical practice. Based on the clinical effectiveness evidence, this study finally identifies 94 types of dominant diseases. However, the total sample size and total effective rate vary considerably, and the types of acupuncture are not yet specified in this study, which requires to be focused in future research.