Abstract: For the color fusion of low-level light and infrared images have the characteristics of strong real-time performance and a large quantity of data, a low-level light and infrared dual channel real-time image fusion system based on multi -core digital signal processor (DSP) and field programmable gate array (FPGA) was put forward. Cyclone IV FPGA of Altera Co.Ltd. with serial transceivers was chose to complete the image information collection, preprocessing and all kinds of control of peripheral equipment, while the newest 8 core high performance fixed point and floating point DSP TMS320C6678 of TI Co. Ltd. was used to realize image fusion. The data transmission was achieved between field programmable gate array and multi -core digital signal processor through the high -speed Serial RapidIO (SRIO) interface, and then color transmission in YUV color space as well. When the color information of the color image in the day light was passed to the fusion image, it was closer to natural color and could reflect richer scene information as much as possible. Experiment shows that this system can realize realtime image fusion and useful color transmission, is suitable for the color fusion system applications of the dual channel video natural sense in the dynamic scenarios.