Table 2. Preference for computer-based test and multimedia questions

No Item Degree of agreement Mean(SD)
Strongly agree Agree Neutral Disagree Strongly disagree
1 Overall Satisfaction and Willingness to Adopt CBT Overall, how satisfied were you with the CBT? 15 (50.0%) 9 (30.0%) 4 (13.3%) 2 (6.7%) 0 (0.0%) 4.23 (0.83)
2 Would you be willing to continue using this method for future examinations? 13 (43.3%) 9 (30.0%) 6 (20.0%) 2 (6.7%) 0 (0.0%) 4.10 (0.91)
3 Time Management and Perceived Appropriateness of Evaluation Was the amount of time allocated for responding to each question adequate? 25 (83.3%) 4 (13.3%) 1 (3.3%) 0 (0.0%) 0 (0.0%) 4.80 (0.48)
4 Do you believe that the CBT format is appropriate for assessing academic ability? 8 (26.7%) 9 (30.0%) 13 (43.3%) 0 (0.0%) 0 (0.0%) 3.83 (0.74)
5 System Usability Did you find the computer interface intuitive and easy to use during the test? 13 (43.3%) 10 (33.3%) 6 (20.0%) 1 (3.3%) 0 (0.0%) 4.17 (0.80)
6 Was the computer system stable and functional throughout the exam period? 18 (60.0%) 10 (33.3%) 1 (3.3%) 1 (3.3%) 0 (0.0%) 4.50 (0.73)
29 Did you find the use of a computer or tablet to be comfortable throughout the test? 6 (20.0%) 15 (50.0%) 6 (20.0%) 1 (3.3%) 2 (6.7%) 3.73 (1.03)
7 Multimedia and Visual Presentation Was the layout of the display (e.g., margins, paragraph alignment) appropriate for the readability of the questions? 7 (23.3%) 10 (33.3%) 10 (33.3%) 2 (6.7%) 1 (3.3%) 3.67 (1.05)
8 Was the font size on the display appropriate for the readability of the questions? 10 (33.3%) 15 (50.0%) 5 (16.7%) 0 (0.0%) 0 (0.0%) 4.13 (0.65)
9 Was the font style on the display appropriate for the readability of the questions? 13 (43.3%) 14 (46.7%) 3 (10.0%) 0 (0.0%) 0 (0.0%) 4.33 (0.62)
10 Was the quality of the multimedia content (e.g., images, videos) appropriate for the test? 18 (60.0%) 7 (23.3%) 5 (16.7%) 0 (0.0%) 0 (0.0%) 4.43 (0.73)
11 Were the multimedia materials presented in a realistic and engaging manner? 16 (53.3%) 11 (36.7%) 3 (10.0%) 0 (0.0%) 0 (0.0%) 4.43 (0.68)
12 Do you believe the CBT effectively addressed the limitations of the traditional PBT? 16 (53.3%) 10 (33.3%) 4 (13.3%) 0 (0.0%) 0 (0.0%) 4.40 (0.67)
13 Perceived Effectiveness of the Assessment Do you consider the CBT format suitable for evaluating clinical competencies as a Korean medicine doctor? 11 (36.7%) 15 (50.0%) 4 (13.3%) 0 (0.0%) 0 (0.0%) 4.23 (0.64)
14 Did the CBT contribute to enhancing your problem-solving skills? 9 (30.0%) 13 (43.3%) 6 (20.0%) 2 (6.7%) 0 (0.0%) 3.97 (0.84)
15 Did the CBT assist you in managing your time effectively during the examination? 7 (23.3%) 12 (40.0%) 8 (26.7%) 1 (3.3%) 2 (6.7%) 3.70 (1.05)
16 Was it convenient to select and modify your answers using the system? 14 (46.7%) 8 (26.7%) 5 (16.7%) 1 (3.3%) 2 (6.7%) 4.00 (1.08)
17 Was it easy to comprehend and review the test items using the CBT interface? 8 (26.7%) 9 (30.0%) 10 (33.3%) 1 (3.3%) 2 (6.7%) 3.67 (1.07)
18 Perceptions of Fairness and Concentration Do you believe the CBT environment reduces the likelihood of academic dishonesty? 11 (36.7%) 8 (26.7%) 9 (30.0%) 2 (6.7%) 0 (0.0%) 3.93 (0.97)
19 Did the CBT format help improve your level of concentration during the exam? 5 (16.7%) 6 (20.0%) 13 (43.3%) 4 (13.3%) 2 (6.7%) 3.27 (1.09)
20 Did you experience any inconvenience while reviewing or revising your answers? 6 (20.0%) 4 (13.3%) 8 (26.7%) 11 (36.7%) 1 (3.3%) 2.90 (1.20)
21 Do you think the test format may disadvantage individuals with physical conditions (e.g., visual impairments)? 2 (6.7%) 2 (6.7%) 7 (23.3%) 13 (43.3%) 6 (20.0%) 2.33 (1.13)
22 Physical Fatigue and Disruptions Did you feel that additional time was necessary to complete the examination? 1 (3.3%) 5 (16.7%) 6 (20.0%) 12 (40.0%) 6 (20.0%) 2.23 (1.11)
23 Did eye fatigue interfere with your ability to concentrate during the test? 2 (6.7%) 2 (6.7%) 5 (16.7%) 13 (43.3%) 8 (26.7%) 2.23 (1.19)
24 Did neck or postural fatigue negatively impact your test performance? 1 (3.3%) 3 (10.0%) 4 (13.3%) 13 (43.3%) 9 (30.0%) 2.10 (1.17)
25 Testing Environment Did you have confidence in the reliability of the CBT results? 14 (46.7%) 13 (43.3%) 3 (10.0%) 0 (0.0%) 0 (0.0%) 4.37 (0.63)
26 Do you believe that immediate feedback on performance is feasible in the CBT format? 8 (26.7%) 11 (36.7%) 6 (20.0%) 3 (10.0%) 2 (6.7%) 3.67 (1.12)
27 Was the physical arrangement of the seats appropriate for the testing environment? 8 (26.7%) 11 (36.7%) 8 (26.7%) 3 (10.0%) 0 (0.0%) 3.80 (0.98)
28 Was the spacing between seats adequate to ensure comfort and minimize distractions? 6 (20.0%) 10 (33.3%) 10 (33.3%) 4 (13.3%) 0 (0.0%) 3.60 (0.98)
Abbreviation: CBT, computer-based test; PBT, paper-based test
Values are expressed as number (percentage). The rightmost column presents the mean ± SD for each item on the 5-point Likert scale.