Artificial Neural Networks

An Artificial Neural Network (ANN) is a kind of computing system (computes outputs based on inputs) inspired by the brain. In particular, an ANN is an arrangement of artificial neurons (units), with each individual neuron potentially being connected to more than one other neuron.

Typically, the units of an ANN are arranged in layers (not always, see GNNs). The input vector will form the first layer, and the output vector will form the final layer. In between we have what are referred to as “hidden layers”.

Very simply put, the activations in one layer affect the activations in the next layer, until we finally obtain the output vector.

As such, an Neural Network can be thought of as a function, taking some inputs, and computing some outputs based on them.

Notes mentioning this note

Here are all the zettels in this zettelkasten, along with their links, visualized as a graph. You may need to zoom and pan around to see something.