Cookies on this website
We use cookies to ensure that we give you the best experience on our website. If you click 'Continue' we'll assume that you are happy to receive all cookies and you won't see this message again. Click 'Find out more' for information on how to change your cookie settings.

BACKGROUND: Surgical judgment and decision making require valid methods of assessment. The aim of this study was to evaluate the use of judgment analysis as a technique for quantitative evaluation of surgeons' risk estimates. METHODS: Thirty trainee surgeons' estimates of conversion risk in laparoscopic cholecystectomy were investigated using judgment analysis. Hypothetical cases were created, differing in relevant risk factors. Twenty repeat cases were incorporated to test for reliability. Surgeons' estimates were compared with an outcome-derived gold standard from the published literature. RESULTS: The mean reliability was .77 (range, .47-.98), and regression models indicating the weighting of variables had a mean adjusted R(2) value of .53 (range, .12-.76). Variables were subject to wide variation in weighting. The mean correlation to the gold standard model was .48 (range, .08-.72). CONCLUSIONS: Judgment analysis allows detailed quantitative evaluation of the consistency of surgeons' risk estimates and the influence of different variables on them. Comparison with a gold standard model enables accuracy to be measured.

Original publication

DOI

10.1016/j.amjsurg.2007.09.031

Type

Journal article

Journal

Am J Surg

Publication Date

02/2008

Volume

195

Pages

183 - 188

Keywords

Adult, Cholecystectomy, Cholecystectomy, Laparoscopic, Clinical Competence, Decision Making, Education, Medical, Graduate, Evaluation Studies as Topic, Female, Humans, Judgment, Male, Medical Errors, Models, Theoretical, Program Evaluation, Reproducibility of Results, Risk Assessment, Sensitivity and Specificity