{"id":150,"date":"2021-05-23T15:57:33","date_gmt":"2021-05-23T15:57:33","guid":{"rendered":"http:\/\/ai.navagne.com\/?page_id=150"},"modified":"2021-05-25T19:21:54","modified_gmt":"2021-05-25T17:21:54","slug":"technical-terminology","status":"publish","type":"page","link":"http:\/\/ai.navagne.com\/index.php\/technical-terminology\/","title":{"rendered":"Technical terminology"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t

AI & Deep Learning - Technical Terminology<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t

Activation function : <\/b>mechanism whereby a specific neuron is activated or not by its inputs, to deliver an output to the next neurons. Common activation functions include sigmo\u00efd, hyperbolic tangent (tanh), softmax, rectified linear unit (ReLU), exponential linear units(ELUs).\u00a0<\/p>

Batch-size : <\/b>size of the subset of the training data that is used together for training the model<\/p>

CNN : “<\/b>Convolutional neural network” is a type of deep neural network that apply a convolution of an activation mechanism on a subset of a matrix to generate reshaped results<\/p>

Dropout : <\/b>regularization technique where some neurons are randomly \u2018deactivated\u2019, independently from their inputs<\/p>

Epoch : <\/b>one cycle of learning through the full training set, that include the move forward propagation, the loss computation and the backpropagation to adjust the weights of the model<\/p>

Exploding gradient : <\/b>problem encountered in gradient descent optimization causing instability of the model when the error gradients accumulate<\/p>

GAN : “<\/b>Generative Adversarial Networks” is a structure that two neural networks against each other to improve the quality of the overall results, one network is called \u201cgenerator\u201d and competes with the discriminator<\/p>

GRU : “<\/b>Gated Recurrent Unit”, mechanism used in some types of RNN with a relatively low number of parameters<\/p>

Hyper-parameters : <\/b>technical parameters of the AI model. As various architectures or techniques might be used, the list is very broad. It includes among others (list not exhaustive) the number of layers, the number of neurons per layer, the learning rate and forget rate, the activation function(s), the solver(s), the batch-size, the regularization parameters, the number of epochs, the loss function(s), the random state, criteria for impurity measure, the splitter method, \u2026<\/p>

Layer<\/b> : is the basis level of a neural network. A neural network is made of :<\/p>

  • an input layer<\/strong><\/em> that contains the initial adata to feed the neural networks<\/li>
  • one or several hidden layers<\/strong><\/em><\/li>
  • an output layer that produces the result for the given inputs<\/li><\/ul>

    Loss function<\/b> : is the function used to evaluate the difference between the true value “y” and the estimated value “\u0177 or yhat”\u00a0 calculated by the model.\u00a0<\/p>

    LSTM <\/b>: “Long-Short Term Memory” network is a specific RNN architecture. LSTM embeds feedback connections that allow to handle sequences of data (speech, video, time-series,\u2026), with learning and forget functions<\/p>

    Regularization<\/b> : is a set of techniques that make slight modifications to the learning algorithm to improve model generalization and performance<\/p>

    RNN<\/b> : “Recurrent neural networks”, a class of neural network models where connections between neurons form a directed graph along a temporal sequence and that embed a double mechanism of learning and forgetting to regulate the flow of information. It includes GRU and LSTM architectures<\/p>

    SVM<\/b> (or Support Vector Machine) : type of supervised machine learning algorithm through discriminant analysis, to generate a hyperplane to discriminate between datas.<\/p>

    Tree \/ Decision Tree<\/b> : ensemble of techniques used to classify data in determining the relevant features to split the data in order to generate the most homogenous subsets or \u201cleafs\u201d<\/p>

    Vanishing gradient <\/b>: problem encountered in gradient descent optimization causing inability of the model to reach an optimum when the error gradients tend to zero, leading the model to stop learning<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"

    AI & Deep Learning – Technical Terminology Activation function : mechanism whereby a specific neuron is activated or not by its inputs, to deliver an output to the next neurons. Common activation functions include sigmo\u00efd, hyperbolic tangent (tanh), softmax, rectified linear unit (ReLU), exponential linear units(ELUs).\u00a0 Batch-size : size of the subset of the training …<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"om_disable_all_campaigns":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0},"_links":{"self":[{"href":"http:\/\/ai.navagne.com\/index.php\/wp-json\/wp\/v2\/pages\/150"}],"collection":[{"href":"http:\/\/ai.navagne.com\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"http:\/\/ai.navagne.com\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"http:\/\/ai.navagne.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/ai.navagne.com\/index.php\/wp-json\/wp\/v2\/comments?post=150"}],"version-history":[{"count":22,"href":"http:\/\/ai.navagne.com\/index.php\/wp-json\/wp\/v2\/pages\/150\/revisions"}],"predecessor-version":[{"id":301,"href":"http:\/\/ai.navagne.com\/index.php\/wp-json\/wp\/v2\/pages\/150\/revisions\/301"}],"wp:attachment":[{"href":"http:\/\/ai.navagne.com\/index.php\/wp-json\/wp\/v2\/media?parent=150"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}