An additional challenge involved with neural networks is training the networks is overfitting, where the neural network generates poor results by learning in a way that does not generalize well to inputs outside the training set.