> Extract global kappa and AUC score from predictions.json

I noticed the predictions.json file is composed of multiple dictionaries with the predicted probabilities from each image. Is there a clean way / script provided to extract the global metrics (kappa and AUC) across all sites and images from this file?

Posted by: Linardos @ July 11, 2022, 2:04 p.m.

Hello,
Metrics are calculate from the best global model results in predictions.json using the following script: https://github.com/Project-MONAI/tutorials/blob/main/federated_learning/breast_density_challenge/challenge_evaluate.py.

Posted by: kschmidt @ July 11, 2022, 5:09 p.m.
Post in this thread