Like the BP neural network, CNN is trained by gradient descent and reverse propagation algorithms, and the gradient formula for the full connection layer is exactly the same as the BP network, which is not repeated here. The gradient formula for convolutional layer and pooled layer is introduced below. ...