Difference between revisions of "Orange: Neural Network"

From OnnoWiki
Jump to navigation Jump to search
Line 3: Line 3:
 
A multi-layer perceptron (MLP) algorithm with backpropagation.
 
A multi-layer perceptron (MLP) algorithm with backpropagation.
  
Inputs
+
==Input==
  
    Data: input dataset
+
Data: input dataset
    Preprocessor: preprocessing method(s)
+
Preprocessor: preprocessing method(s)
  
Outputs
+
==Output==
  
    Learner: multi-layer perceptron learning algorithm
+
Learner: multi-layer perceptron learning algorithm
    Model: trained model
+
Model: trained model
  
 
The Neural Network widget uses sklearn’s Multi-layer Perceptron algorithm that can learn non-linear models as well as linear.
 
The Neural Network widget uses sklearn’s Multi-layer Perceptron algorithm that can learn non-linear models as well as linear.
Line 17: Line 17:
 
[[File:NeuralNetwork-stamped.png|center|200px|thumb]]
 
[[File:NeuralNetwork-stamped.png|center|200px|thumb]]
  
    A name under which it will appear in other widgets. The default name is “Neural Network”.
+
* A name under which it will appear in other widgets. The default name is “Neural Network”.
    Set model parameters:
+
* Set model parameters:
        Neurons per hidden layer: defined as the ith element represents the number of neurons in the ith hidden layer. E.g. a neural network with 3 layers can be defined as 2, 3, 2.
+
 
        Activation function for the hidden layer:
+
** Neurons per hidden layer: defined as the ith element represents the number of neurons in the ith hidden layer. E.g. a neural network with 3 layers can be defined as 2, 3, 2.
            Identity: no-op activation, useful to implement linear bottleneck
+
** Activation function for the hidden layer:
            Logistic: the logistic sigmoid function
+
*** Identity: no-op activation, useful to implement linear bottleneck
            tanh: the hyperbolic tan function
+
*** Logistic: the logistic sigmoid function
            ReLu: the rectified linear unit function
+
*** tanh: the hyperbolic tan function
        Solver for weight optimization:
+
*** ReLu: the rectified linear unit function
            L-BFGS-B: an optimizer in the family of quasi-Newton methods
+
 
            SGD: stochastic gradient descent
+
** Solver for weight optimization:
            Adam: stochastic gradient-based optimizer
+
*** L-BFGS-B: an optimizer in the family of quasi-Newton methods
        Alpha: L2 penalty (regularization term) parameter
+
*** SGD: stochastic gradient descent
        Max iterations: maximum number of iterations
+
*** Adam: stochastic gradient-based optimizer
    Other parameters are set to sklearn’s defaults.
+
 
    Produce a report.
+
** Alpha: L2 penalty (regularization term) parameter
    When the box is ticked (Apply Automatically), the widget will communicate changes automatically. Alternatively, click Apply.
+
** Max iterations: maximum number of iterations
 +
 
 +
* Other parameters are set to sklearn’s defaults.
 +
* Produce a report.
 +
* When the box is ticked (Apply Automatically), the widget will communicate changes automatically. Alternatively, click Apply.
  
 
==Contoh==
 
==Contoh==
Line 44: Line 48:
  
 
[[File:NN-Example-Predict.png|center|200px|thumb]]
 
[[File:NN-Example-Predict.png|center|200px|thumb]]
 
  
 
Contoh WorkFlow lainnya,
 
Contoh WorkFlow lainnya,

Revision as of 11:12, 28 January 2020

Sumber:https://docs.biolab.si//3/visual-programming/widgets/model/neuralnetwork.html

A multi-layer perceptron (MLP) algorithm with backpropagation.

Input

Data: input dataset
Preprocessor: preprocessing method(s)

Output

Learner: multi-layer perceptron learning algorithm
Model: trained model

The Neural Network widget uses sklearn’s Multi-layer Perceptron algorithm that can learn non-linear models as well as linear.

NeuralNetwork-stamped.png
  • A name under which it will appear in other widgets. The default name is “Neural Network”.
  • Set model parameters:
    • Neurons per hidden layer: defined as the ith element represents the number of neurons in the ith hidden layer. E.g. a neural network with 3 layers can be defined as 2, 3, 2.
    • Activation function for the hidden layer:
      • Identity: no-op activation, useful to implement linear bottleneck
      • Logistic: the logistic sigmoid function
      • tanh: the hyperbolic tan function
      • ReLu: the rectified linear unit function
    • Solver for weight optimization:
      • L-BFGS-B: an optimizer in the family of quasi-Newton methods
      • SGD: stochastic gradient descent
      • Adam: stochastic gradient-based optimizer
    • Alpha: L2 penalty (regularization term) parameter
    • Max iterations: maximum number of iterations
  • Other parameters are set to sklearn’s defaults.
  • Produce a report.
  • When the box is ticked (Apply Automatically), the widget will communicate changes automatically. Alternatively, click Apply.

Contoh

The first example is a classification task on iris dataset. We compare the results of Neural Network with the Logistic Regression.

NN-Example-Test.png

The second example is a prediction task, still using the iris data. This workflow shows how to use the Learner output. We input the Neural Network prediction model into Predictions and observe the predicted values.

NN-Example-Predict.png

Contoh WorkFlow lainnya,


Orange-NN.png


Referensi

Pranala Menarik