Difference between revisions of "Orange: Calibration Plot"

From OnnoWiki
Jump to navigation Jump to search
(Created page with "Sumber: https://docs.biolab.si//3/visual-programming/widgets/evaluate/calibrationplot.html Shows the match between classifiers’ probability predictions and actual class p...")
 
 
(2 intermediate revisions by the same user not shown)
Line 3: Line 3:
  
  
−
Shows the match between classifiers’ probability predictions and actual class probabilities.
+
Memperlihatkan kecocokan antara prediksi probability classifier dengan probability class yang sebenarnya.
  
−
Inputs
+
==Input==
  
 
     Evaluation Results: results of testing classification algorithms
 
     Evaluation Results: results of testing classification algorithms
  
−
The Calibration Plotplots class probabilities against those predicted by the classifier(s).
+
Widget Calibration Plot mem-plot class probability terhadap probability yang di prediksi oleh classifier.
  
−
../../_images/CalibrationPlot-stamped.png
+
[[File:CalibrationPlot-stamped.png|center|200px|thumb]]
  
−
    Select the desired target class from the drop down menu.
+
* Select the desired target class from the drop down menu.
 +
* Choose which classifiers to plot. The diagonal represents optimal behavior; the closer the classifier’s curve gets, the more accurate its prediction probabilities are. Thus we would use this widget to see whether a classifier is overly optimistic (gives predominantly positive results) or pessimistic (gives predominantly negative results).
 +
* If Show rug is enabled, ticks are displayed at the bottom and the top of the graph, which represent negative and positive examples respectively. Their position corresponds to the classifier’s probability prediction and the color shows the classifier. At the bottom of the graph, the points to the left are those which are (correctly) assigned a low probability of the target class, and those to the right are incorrectly assigned high probabilities. At the top of the graph, the instances to the right are correctly assigned high probabilities and vice versa.
 +
* Press Save Image if you want to save the created image to your computer in a .svg or .png format.
 +
* Produce a report.
  
−
    Choose which classifiers to plot. The diagonal represents optimal behavior; the closer the classifier’s curve gets, the more accurate its prediction probabilities are. Thus we would use this widget to see whether a classifier is overly optimistic (gives predominantly positive results) or pessimistic (gives predominantly negative results).
+
==Contoh==
  
−
    If Show rug is enabled, ticks are displayed at the bottom and the top of the graph, which represent negative and positive examples respectively. Their position corresponds to the classifier’s probability prediction and the color shows the classifier. At the bottom of the graph, the points to the left are those which are (correctly) assigned a low probability of the target class, and those to the right are incorrectly assigned high probabilities. At the top of the graph, the instances to the right are correctly assigned high probabilities and vice versa.
+
Saat ini, satu-satunya widget yang memberikan sinyal yang benar yang dibutuhkan oleh Widget Calibration Plot hanya Widget Test & Score. Oleh karenanya, Widget Calibration Plot selalu mengikuti Widget Test & Score dan, karena dia tidak mempunyai output, maka tidak ada widget lain yang mengikuti-nya.
−
 
 
−
    Press Save Image if you want to save the created image to your computer in a .svg or .png format.
 
−
 
 
−
    Produce a report.
 
−
 
 
−
Example
 
−
 
 
−
At the moment, the only widget which gives the right type of signal needed by the Calibration Plot is Test & Score. The Calibration Plot will hence always follow Test & Score and, since it has no outputs, no other widgets follow it.
 
−
 
 
−
Here is a typical example, where we compare three classifiers (namely Naive Bayes, Tree and Constant) and input them into Test & Score. We used the Titanic dataset. Test & Score then displays evaluation results for each classifier. Then we draw Calibration Plot and ROC Analysis widgets from Test & Score to further analyze the performance of classifiers. Calibration Plot enables you to see prediction accuracy of class probabilities in a plot.
 
−
 
 
−
../../_images/CalibrationPlot-example.png
 
  
 +
Berikut adalah contoh tipikal, dimana kita dapat membandingkan tiga (3) classifier (yaitu, Naive Bayes, Tree dan Constant) dan menjadi input-an ke Widget Test & Score. Kita menggunakan Titanic dataset. Widget Test & Score akan menayangkan hasil evaluasi untuk masing-masing classifier. Kemudian, kita dapat menggambar melalui Widget Calibration Plot dan Widget ROC Analysis dari keluaran Widget Test & Score untuk analisa lebih lanjut akan performance dari masing-masing classifier. Widget Calibration Plot memungkinkan kita untuk melihat prediksi keakuratan dari class probability dalam bentuk plot / gambar.
  
 +
[[File:CalibrationPlot-example.png|center|200px|thumb]]
  
  

Latest revision as of 17:05, 4 March 2020

Sumber: https://docs.biolab.si//3/visual-programming/widgets/evaluate/calibrationplot.html


Memperlihatkan kecocokan antara prediksi probability classifier dengan probability class yang sebenarnya.

Input

   Evaluation Results: results of testing classification algorithms

Widget Calibration Plot mem-plot class probability terhadap probability yang di prediksi oleh classifier.

CalibrationPlot-stamped.png
  • Select the desired target class from the drop down menu.
  • Choose which classifiers to plot. The diagonal represents optimal behavior; the closer the classifier’s curve gets, the more accurate its prediction probabilities are. Thus we would use this widget to see whether a classifier is overly optimistic (gives predominantly positive results) or pessimistic (gives predominantly negative results).
  • If Show rug is enabled, ticks are displayed at the bottom and the top of the graph, which represent negative and positive examples respectively. Their position corresponds to the classifier’s probability prediction and the color shows the classifier. At the bottom of the graph, the points to the left are those which are (correctly) assigned a low probability of the target class, and those to the right are incorrectly assigned high probabilities. At the top of the graph, the instances to the right are correctly assigned high probabilities and vice versa.
  • Press Save Image if you want to save the created image to your computer in a .svg or .png format.
  • Produce a report.

Contoh

Saat ini, satu-satunya widget yang memberikan sinyal yang benar yang dibutuhkan oleh Widget Calibration Plot hanya Widget Test & Score. Oleh karenanya, Widget Calibration Plot selalu mengikuti Widget Test & Score dan, karena dia tidak mempunyai output, maka tidak ada widget lain yang mengikuti-nya.

Berikut adalah contoh tipikal, dimana kita dapat membandingkan tiga (3) classifier (yaitu, Naive Bayes, Tree dan Constant) dan menjadi input-an ke Widget Test & Score. Kita menggunakan Titanic dataset. Widget Test & Score akan menayangkan hasil evaluasi untuk masing-masing classifier. Kemudian, kita dapat menggambar melalui Widget Calibration Plot dan Widget ROC Analysis dari keluaran Widget Test & Score untuk analisa lebih lanjut akan performance dari masing-masing classifier. Widget Calibration Plot memungkinkan kita untuk melihat prediksi keakuratan dari class probability dalam bentuk plot / gambar.

CalibrationPlot-example.png


Referensi

Pranala Menarik

Retrieved from "https://onnocenter.or.id/wiki/index.php?title=Orange:_Calibration_Plot&oldid=60176"