A performance evaluation of the expert system 'Jaundice' in comparison with that of three hepatologists.

The diagnostic performance of an Expert System (Jaundice) designed to discriminate between different causes of jaundice was evaluated in a test sample of 200 consecutive in-patients with serum bilirubin greater than or equal to 51 mumol/l. The average probability assigned to true diagnosis, the non-error rate and the overall accuracy were, respectively, 55%, 77% and 70%. The Expert System's discriminatory ability in probabilistic prediction, assessed by a method based on continuous functions of the diagnostic probabilities (Brier score) was good. We also compared the ability of our Expert System to that of three experienced hepatologists, who were required to give a diagnosis in 20 cases fo…