Orange: Calibrated Learner

Sumber: https://docs.biolab.si//3/visual-programming/widgets/model/calibratedlearner.html

Membungkus / melanjutkan kerja dari learner lain dengan probability calibration dan decision threshold optimization.

Input

Data: input dataset
Preprocessor: preprocessing method(s)
Base Learner: learner to calibrate

Output

Learner: calibrated learning algorithm
Model: trained model using the calibrated learner

Learner ini menghasilkan sebuah model yang mengkalibrasi distribusi dari class probabilities dan meng-optimizes decision threshold. Widget ini hanya bekerja untuk binary classification task saja.

• The name under which it will appear in other widgets. Default name is composed of the learner, calibration and optimization parameters.
• Probability calibration:
  • Sigmoid calibration
  • Isotonic calibration
  • No calibration

• Decision threshold optimization:
  • Optimize classification accuracy
  • Optimize F1 score
  • No threshold optimization

• Press Apply to commit changes. If Apply Automatically is ticked, changes are committed automatically.

Contoh

A simple example with Calibrated Learner. We are using the titanic data set as the widget requires binary class values (in this case they are ‘survived’ and ‘not survived’).

We will use Logistic Regression as the base learner which will we calibrate with the default settings, that is with sigmoid optimization of distribution values and by optimizing the CA.

Comparing the results with the uncalibrated Logistic Regression model we see that the calibrated model performs better.

Referensi

• https://docs.biolab.si//3/visual-programming/widgets/model/calibratedlearner.html

Pranala Menarik

• Orange