We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
In many classification problems it is desirable to output well-calibrated probabilities on the different classes. We propose a robust, non-parametric method of calibrating probabilities called SplineCalib that utilizes smoothing splines to determine a calibration function. We demonstrate how applying certain transformations as part of the calibration process can improve performance on problems in deep learning and other domains where the scores tend to be "overconfident". We adapt the approach to multi-class problems and find that better calibration can improve accuracy as well as log-loss by better resolving uncertain cases. Finally, we present a cross-validated approach to calibration which conserves data. Significant improvements to log-loss and accuracy are shown on several different problems. We also introduce the ml-insights python package which contains an implementation of the SplineCalib algorithm.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("1809.07751")
get_code_for_paper("1809.07751")
have("1809.07751")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/1809.07751.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/1809.07751)
Connect an agent — have() is free.