王向军, 朱慧. 利用国产FPGA的高帧率目标跟踪方法[J]. 红外与激光工程, 2023, 52(9): 20220905. DOI: 10.3788/IRLA20220905
引用本文: 王向军, 朱慧. 利用国产FPGA的高帧率目标跟踪方法[J]. 红外与激光工程, 2023, 52(9): 20220905. DOI: 10.3788/IRLA20220905
Wang Xiangjun, Zhu Hui. High frame rate target tracking method using domestic FPGA[J]. Infrared and Laser Engineering, 2023, 52(9): 20220905. DOI: 10.3788/IRLA20220905
Citation: Wang Xiangjun, Zhu Hui. High frame rate target tracking method using domestic FPGA[J]. Infrared and Laser Engineering, 2023, 52(9): 20220905. DOI: 10.3788/IRLA20220905

利用国产FPGA的高帧率目标跟踪方法

High frame rate target tracking method using domestic FPGA

  • 摘要: 由于复杂度较高的跟踪算法多数采用国外芯片实现,基于国产FPGA的跟踪方法得到了研究。针对易于FPGA设计的模板匹配算法鲁棒性不足的问题,基于绝对差和(SAD)相似性度量方法,提出了求窗口内最小绝对差和(SMAD)的方法。利用最大值和最小值滤波预先处理窗口内图像数据,再求最小绝对差,将SMAD算法的加减法器资源消耗降低为原来的31.8%。提出的类金字塔的方法在节省逻辑资源的同时,提高了对目标尺度变化的适应性。OTB数据集的实验表明:提出的方法与鲁棒性较高的DDIS算法相比,跟踪成功率和平均重叠率分别提高了1.18%、0.13%,又有易于流水线设计的优势。利用国产FPGA实现了帧率可达100 fps的实验系统并验证其跟踪性能,为在国产FPGA上实现高帧率目标跟踪系统提供了解决方案。

     

    Abstract:
      Objective  Target tracking plays an important role in the military, medical and other fields, and Field Programmable Gate Array (FPGA) is widely used in the direction due to its good performance and high flexibility. However, at present, limited to the complexity of high-precision tracking algorithms, most of the target tracking systems are implemented by foreign high-performance chips, which leads to weak autonomy and controllability. If domestic chips are used to achieve target tracking, it will face the problem that there are few IP cores and most modules need to be designed in Verilog. In addition, the feasibility of the research algorithm in other domestic FPGAs needs to be considered. Therefore, the objective is to study a tracking algorithm that is easy to design in Verilog, has generalization, and improves real-time and robustness.
      Methods  Template matching is easy to design with pipelines and is selected as the basic algorithm, which is widely used due to its simplicity and accuracy. Among them, the template matching algorithm based on Sum of Absolute Difference (SAD) has no multiplication and division operation, which is suitable for FPGA implementation with limited resources. This tracking algorithm has too strict constraints, which leads to the problem of insufficient robustness. Based on the Sum of Absolute Difference (SAD) similarity measurement method, a method for finding the Sum of Minimum Absolute Difference (SMAD) in the window is proposed. In order to reduce resource usage, the maximum and minimum filtering (Fig.3) is used to preprocess the image data in the window and then the minimum absolute difference is obtained, which reduces the resource consumption of the addition and subtraction of the SMAD method to 31.8%. Moreover, a pyramid-like update strategy (Fig.4) that is easy to implement by FPGA hardware is proposed to better adapt to the scale change of the target. In order to verify the tracking performance of proposed algorithm, Unigroup FPGAs are used to implement it and build a real-time target tracking system (Fig.5).
      Results and Discussions   Based on the two indicators of Average Overlap Rate (AOR) and success rate, the algorithm comparison experiment was carried out with the OTB dataset. It verified that the proposed algorithm has certain anti-occlusion and scale adaptability (Fig.10). Compared with the SAD method, the tracking metrics in each scenario are improved. In the scale change and synthesis scenario, after the SMAD method is added to the pyramid-like strategy, its success rate and AOR are improved, which verifies the effectiveness of the pyramid-like update strategy (Tab.2). Compared with the robust DDIS algorithm, the proposed method improves the average success rate and overlap rate by 1.18% and 0.13%, respectively, and is easier to design with FPGA. Then the target tracking system is implemented by domestic FPGAs. The delay time is 16 line synchronization cycles plus 37 clock cycles and tracking frame rate can reach 100 frames per second. Different outdoor backgrounds were selected to test the tracking of the system when the target changed in scale, direction of motion and speed (Fig.12). The anti-occlusion test experiment of the tracking platform shows that (Fig.13) when the target is partially occluded, the tracking system can still successfully track the target, which further verifies the feasibility of the proposed method.
      Conclusions  In order to break the technology monopoly and improve the autonomy of target tracking application products, the traditional SAD template matching method is improved considering the limitations of domestic FPGA and the performance of tracking algorithms. The SMAD method is proposed and its resource consumption is optimized. Combined with a pyramid-like template update strategy, its tracking performance is improved. The experiments of OTB dataset and domestic tracking system verify its tracking effect. It provides a reference scheme for the localization of high frame rate target tracking system.

     

/

返回文章
返回