Back Propagation

Types of Training

• Sequential: Features include, low storage cost, since trainign examples are presented randomly the search for oiptimal weights is stochastic and hence less chance of getting stuck in a local minimum. Howeverit is more difficult to analyze for convergence
• Batch: Requires more storage, can be analyzed to determine the gradient vector and hence convergence is gauranteed for simple systems