ObjectiveTo translate the King’s Brief Interstitial Lung Disease (K-BILD) to Chinese, so as to provide an well reliability and validity assessment instrument for health status of patients with interstitial lung disease.MethodsBrislin’s transition model, six expert’s panel and pre-survey were used for initial Chinese version of K-BILD. Items analysis, exploratory factor analysis (EFA), confirmatory factor analysis (CFA), internal consistency reliability and test-retest reliability were used for validity and reliability test with 122 respondents.ResultsTen-item Chinese version of K-BILD were proved to have great psychometric qualities, two factors were extracted by EFA, which could explain 63.35% of the total variance. Furthermore, the CFA demonstrates the fit indices of two-factors mode: χ2/df=0.797, RMSEA=0.000, NFI=0.848, IFI=1.048, CFI=1.000, TLI=1.071. Cronbach’s α and Guttman Split-half were 0.893 and 0.861, respectively. Besides, the test-retest reliability of the scale was 0.805.ConclusionThe Chinese version of K-BILD scale has good validity and reliability, which is applicable for health status assessment in patient with interstitial lung disease.
Objective To verify the reliability and validity of a self-developed satisfaction evaluation questionnaire for outpatient department employees in public hospitals, and to provide suitable tools for conducting such surveys. Methods Two anonymous surveys were conducted on all employees of the Outpatient Department of West China Hospital of Sichuan University in July 2019 and November 2021, respectively. Questionnaire items were screened using methods such as item distribution, coefficient of variation, and decision value, and the reliability and validity of the questionnaire were evaluated using Spearman-Brown coefficient and Cronbach’s α coefficient, exploratory factor analysis, and confirmatory factor analysis. Results The final questionnaire retained 14 items, which could be divided into two dimensions: work conditions and interpersonal environment, and the overall fit index of structural equation model were as follows: χ2/ν=6.957, the standardized root mean square residual was 0.061, the root mean square error of approximation was 0.147, the goodness-of-fit index was 0.796, the adjusted goodness-of-fit index was 0.719, the normed fit index was 0.849, the relative fit index was 0.819, the incremental fit index was 0.868, the Tucker-Lewis Index was 0.841, and the comparative fit index was 0.867. The combined reliability of the two factors in the questionnaire was 0.94 and 0.91, respectively. The average variance extraction was 0.67 and 0.76, respectively, and the square root of the average variance extraction was 0.82 and 0.87, respectively, both of which were greater than the correlation coefficient of 0.71 between the two factors. The Spearman-Brown coefficient of the final questionnaire was 0.913, and the Cronbach’s α coefficients for the overall and two dimensions were 0.953, 0.937, and 0.910, respectively. Conclusion The reliability and validity of the satisfaction evaluation questionnaire for outpatient department employees in public hospitals are good and the questionnaire can be applied to practical surveys.
ObjectiveBy establishing a set of evaluation system for thoracoscopic clinical function and applicability, to evaluate and compare the advantages and disadvantages of different brands of thoracoscopes, and to provide some suggestions for the innovation and upgrade of thoracoscopes, especially for the domestic thoracoscopes.MethodsThe project coordination team initially formulated the evaluation index system for the clinical function and applicability of thoracoscope by querying literature and brainstorming. The Delphi expert consultation method was used to distribute questionnaires to the selected experts. Experts provided scores which were based on the importance of each indicator, and clarified the basis of their judgment and the familiarity with the evaluation indicators. After two rounds of screening by Delphi method, a thoracoscopic clinical function and applicability satisfactory questionnaire was formed. The appropriate sample for pre-investigation was selected, and the reliability and validity were tested. The index composition was adjusted based on the results of the test to form a final evaluation scale.ResultsThe project coordination team initially formulated 24 thoracoscope-related evaluation indicators. After two rounds of experts consultation, the item "brightness adjustment" was deleted without any additional entries. The positive coefficients of the experts in the first round and the second round were 100.0% and 80.0%, respectively. The two rounds of authoritative coefficients were 0.86 and 0.90, and the coordination coefficients were 0.272 (P<0.001) and 0.523 (P<0.001), respectively. A total of 140 questionnaires were issued in this pre-investigation. The recovery rate was 100.0% and the effective rate was 90.0%. The Cronbach's α value of the scale was 0.936, and the Spearman-Brown split-half reliability coefficient was 0.972. The factor analysis finally extracted 3 common factors. The total variance of the cumulative interpretation was 70.9%. The three common factors were named "operation related", "image related" and "device related".ConclusionThe evaluation index system developed in this study has good reliability and validity, and can be used as a tool to evaluate the clinical function and applicability of thoracoscopes.
Objective To investigate the validity of estimating American Spinal Injury Association Impairment Scale (AIS) grade with a bowel-routine based self-administered questionnaire for assessment of sacral sparing after spinal cord injury (SCI).Methods The 5-item SCI sacral sparing self-report questionnaire was administrated to SCI inpatients from August 2014 to July 2016, followed by an standardized digital rectal examination. Question 1 (perceiving the tissue), Question 2 (identifying the water temperature as warm or cold), Question 3 (perceiving the inserted finger), and Question 4 (perceiving the inserted enema tube) tested the sensory sacral sparing, and Question 5 (holding the enema for more than 1 min) evaluated the voluntary anal sphincter contraction. Based on the answers from each participant, the sensory and motor sacral sparing was implied, and an estimated AIS grade (AIS A, AIS B, or AIS C/D) was recorded. Agreement of the estimated AIS grade and the actual AIS grade according to the physical examination was analyzed. Sensitivity, specificity, and Youden’s index of the questionnaire for estimating completeness of injury were calculated.ResultsA total of 102 SCI patients were enrolled. The general agreement of estimated and actual AIS grades was good (κ=0.681, P<0.001). For the estimation of a complete injury, both the sensitivity (87.10%) and the specificity (100.00%) of this questionnaire were high, with a Youden’s index of 0.87. For the estimation of a motor complete injury, the sensitivity increased (92.00%) while the specificity decreased slightly (75.00%), with a Youden’s index of 0.67.ConclusionsThe validity of this self-report questionnaire for estimation of AIS grade is good. In some situations, it could be considered as an alternative tool for the estimation of sacral sparing as well as the AIS grades within SCI individuals, especially when repeated anorectal examinations are not feasible.
ObjectiveTo evaluate the reliability,validity and feasibility of a patient-reported outcomes (PRO) scale in the subjects with respiratory failure. Methods364 patients with chronic respiratory failure and 97 healthy subjects were face-to-face interviewed by well-trained investigators,and the data of respiratory failure -PRO instrument were collected. The psychometric performance such as reliability,validity,responsiveness and clinical feasibility in the respiratory failure -PRO instrument was evaluated. ResultsThe Cronbach's alpha coefficient of the respiratory failure -PRO instrument and each dimension were greater than 0.7. Factor analysis showed that the instrument had good construct validity. The scores of each of the facets and total scores between the patients and the healthy subjects were different. The recovery rate and the efficient rate of the questionnaire were more than 95%,and the time required to complete a questionnaire was within 15 minutes,indicating that the scale had a high clinical feasibility. ConclusionThe respiratory failure -PRO instrument has good reliability,validity,responsiveness and clinical feasibility.
The COSMIN-RoB checklist includes three sections with a total of 10 boxes, which is used to evaluate risk of bias of studies on content validity, internal structure, and other measurement properties. COSMIN classifies reliability, measurement error, criteria validity, hypothesis testing for construct validity, and responsiveness as other measurement properties, which primarily focus on the quality of the (sub)scale as a whole, rather than on the item level. Among the five measurement properties, reliability, measurement error and criteria validity are the most widely used in the studies. Therefore, this paper aims to interpret COSMIN-RoB checklist with examples to guide researchers to evaluate the risk of bias of the studies on reliability, measurement error and criteria validity of PROMs.
Objective To develop a behavioral assessment scale for medication management plans in women of childbearing age with epilepsy and to test its reliability and validity. Methods Based on the Theory of Planned Behavior, a pool of questionnaire items was initially drafted through literature review and focus group discussions. A two-round Delphi expert consultation was conducted with 15 experts to form a test version of the behavioral assessment scale for medication management plans in women of childbearing age with epilepsy (including 27 items and 5 dimensions). Convenience sampling was used to conduct surveys among women of childbearing age with epilepsy in some tertiary hospitals in Chuxiong, Shenzhen and Wuhan from February to May 2024 (the first time) and from June to October 2024 (the second time). ResultsThe effective recovery rates of the two rounds of questionnaires were 95.5% and 94.6%, respectively. The final scale included 24 items and 5 dimensions, with good reliability and validity: the content validity index (S-CVI) was 0.934, Cronbach's α coefficient was 0.876, split-half reliability was 0.819, and test-retest reliability was 0.901; exploratory factor analysis extracted 5 factors (cumulative variance explained rate 73.97%, item load 0.42~0.85), and confirmatory factor analysis showed that the model had good fit (χ2/df=1.849, RMSEA=0.075, CFI, GFI, AGFI, IFI, TLI all>0.85). Conclusion The scale meets the reliability and validity standards and can be used to assess the medication management plans and behaviors of women of childbearing age with epilepsy.
Objective To evaluate the reliability and validity of the three-dimensional motion capture analysis system COFT-Motion® in evaluating the active range of motion of upper limbs in healthy subjects, and provide objective basis for its clinical application. Methods From January to March 2022, healthy subjects were publicly recruited for enrollment. The evaluator applied the three-dimensional motion capture analysis system COFT-Motion® and angle ruler to evaluate the active range of motion of the shoulder joint (flexion, extension, adduction, abduction) and elbow joint (flexion, extension) in healthy subjects. Pearson correlation analysis was used to evaluate validity, and intraclass correlation coefficient (ICC) was used to evaluate reliability. Results There was a positive correlation between the measurements of COFT-Motion® and the angle ruler of the active range of motion of upper limbs in healthy subjects. The Pearson correlation coefficients for active range of motion of the shoulder joint (flexion, extension, adduction, abduction) and elbow joint (flexion, extension) were 0.913, 0.964, 0.961, 0.941, 0.864, and 0.919, respectively (P<0.05). The results of using COFT-Motion® by different evaluators to evaluate the active range of motion of healthy subjects’ shoulder joints (flexion, extension, adduction, abduction) and elbow joints (flexion, extension) showed that the ICC values were 0.892, 0.942, 0.961, 0.988, 0.989, and 0.928, respectively (P<0.05). The results of repeated evaluations by the same evaluator showed that the ICC values were 0.795, 0.916, 0.900, 0.868, 0.918, and 0.911, respectively (P<0.05). Conclusion The application of the three-dimensional motion capture analysis system COFT-Motion® in healthy subjects has good validity and reliability. However, due to the limited sample size and subject of the study, further promotion and application of the system still need to be further explored.
Objective To evaluate the reliability and validity of IBS-QOL scale in irritable bowel syndrome (IBS) patients. Methods IBS-QOL scale was applied to survey the quality of life of 123 IBS patients. The split-half and internal consistency method were used to evaluate the reliability, and with the construct method to evaluate the validity. Results The split-half reliability was 0.86. Cronbach’s α-coefficient of all domains was between 0.71 and 0.89 except body image and food avoidance; In the correlation analysis, the correlations between items and its subscale structure were above 0.60 (except interference with activity), but there were no correlations between items and other subscale structure. Eight components from factorial analysis were in accordance with theoretical structure.The cumulative contribution rate was 72.7%. Conclusions The reliability and validity of IBS-QOL scale are acceptable. It might be useful for us to assess the QOL of IBS patients in China.