Investigating Data Usage for Inductive Conformal Predictors
Jun 1, 2024
ยท
1 min read
Hiring-manager view
This paper is a direct uncertainty-quantification signal: it studies the data and calibration choices behind conformal prediction rather than treating uncertainty estimates as a black box.
Scientific problem
Inductive conformal predictors rely on data splits and calibration sets to produce uncertainty-aware prediction sets. The practical question is how data usage decisions affect validity, efficiency, and downstream model behavior.
Method
- Investigated how data allocation choices influence inductive conformal prediction.
- Focused on calibration behavior, data efficiency, and prediction-set quality.
- Connected empirical model behavior to uncertainty guarantees relevant to safety-sensitive ML systems.
Evaluation signal
The evaluation centers on how calibration and data usage choices change uncertainty quality and reliability, especially when model outputs must support downstream decisions.