AI

Neural network

A computation graph of weighted connections between nodes, where the weights are adjusted during training to approximate a target function.

The architecture - how nodes are connected - determines what the network can represent efficiently. Convolutional networks exploit spatial locality, recurrent networks exploit sequence, and transformers exploit global attention. The choice of architecture is the first design decision.

Related concepts