Abstract: In the view of the gaps of night vision technology between abroad and domestic, a kind of handheld night vision system was designed and implementated, which displays with three channels, respectively. In the different occasions, this system can be chosen infrared display, visible display and fusion display to observe the targets. The ideal of parallel signal processing was proposed and achieved it using dual-DSP and a FPGA, which solves the problem of real time. Aiming at the problem of video muddledness, a kind of adaptive image mosaic method based on FPGA was proposed. According to the results of experiment, the system has good images quality and very strong practicability, meets the need of various occasions.