Performance test, mean (SD) | Best CNN model | Without CNN-assistance | With CNN-assistance | P valuea | Without CNN-assistance | With CNN-assistance | P valuea | Without CNN-assistance | With CNN-assistance |
---|---|---|---|---|---|---|---|---|---|
GPs, (Nā=ā35) | DSs, (Nā=ā35) | P value (GP vs. DS)b | |||||||
Accuracy | |||||||||
āAngulation | 0.94 | 0.88 (0.05) | 0.95 (0.03) | ā<ā0.001 | 0.87 (0.05) | 0.94 (0.05) | ā<ā0.001 | 0.426 | 0.412 |
āClass | 0.94 | 0.67 (0.10) | 0.86 (0.08) | ā<ā0.001 | 0.67 (0.10) | 0.81 (0.11) | ā<ā0.001 | 0.922 | 0.035 |
āPosition | 0.90 | 0.71 (0.05) | 0.79 (0.05) | ā<ā0.001 | 0.73 (0.07) | 0.85 (0.06) | ā<ā0.001 | 0.262 | ā<ā0.001 |
āDifficulty index | 0.96 | 0.74 (0.05) | 0.88 (0.06) | ā<ā0.001 | 0.73 (0.05) | 0.86 (0.07) | ā<ā0.001 | 0.849 | 0.364 |
Kappa score | |||||||||
āAngulation | 0.92 | 0.83 (0.07) | 0.93 (0.04) | ā<ā0.001 | 0.82 (0.07) | 0.92 (0.07) | ā<ā0.001 | 0.525 | 0.437 |
āClass | 0.87 | 0.40 (0.12) | 0.72 (0.14) | ā<ā0.001 | 0.39 (0.12) | 0.61 (0.20) | ā<ā0.001 | 0.807 | 0.010 |
āPosition | 0.85 | 0.54 (0.09) | 0.68 (0.08) | ā<ā0.001 | 0.58 (0.11) | 0.77 (0.09) | ā<ā0.001 | 0.143 | ā<ā0.001 |
āDifficulty index | 0.93 | 0.58 (0.08) | 0.81 (0.09) | ā<ā0.001 | 0.58 (0.08) | 0.78 (0.11) | ā<ā0.001 | 0.873 | 0.319 |
Duration (min) | |||||||||
āAngulation | 0.10 | 4.01 (0.89) | 2.59 (0.59) | ā<ā0.001 | 4.44 (1.30) | 2.84 (0.73) | ā<ā0.001 | 0.118 | 0.124 |
āClass | 0.03 | 4.16 (1.05) | 3.05 (0.79) | ā<ā0.001 | 4.86 (1.49) | 3.80 (1.06) | ā<ā0.001 | 0.027 | 0.001 |
āPosition | 0.10 | 3.70 (0.81) | 2.61 (0.59) | ā<ā0.001 | 4.02 (1.25) | 2.68 (0.95) | ā<ā0.001 | 0.209 | 0.713 |
āTotal | 0.23 | 11.88 (1.73) | 8.25 (1.46) | ā<ā0.001 | 13.31 (2.81) | 9.32 (2.40) | ā<ā0.001 | 0.013 | 0.029 |