Abstract: To improve the recognition rate and speed of the multi-target detection and tracking in the complex background, a tracking method based on neural network Kalman filter with correction mean square error estimation was proposed. Multi-target detection and tracking of the video sequence were achieved. In this method, first of all, the background was extracted accurately through the inter-frame difference method and multi-target detection was achieved combined with background subtraction method,the detection results were optimized utilizing morphological filtering. Then, Kalman_BP neural network filter was used to predict the position of the moving target. The estimation error of the Kalman filter caused by model changing and noise was mainly reduced with BP neural network, which made the predictive results more accurate. Finally, the fast matching of target was achievid via labeling different targets. Target chain was established by using the characteristics that little change of same goal centroid position and the boundary rectangle between the adjacent frames, which brought about the multi-target tracking. Simulation results show that the algorithm can not only track different scenarios targets, but also count the number of targets and display target trajectory rapidly and stably. Compared with the particle filter and other metheds, tracking is more smooth, thus the reliability of the tracking is improved.