Abstract: Usually the ability of the space optical camera is degraded by many factors during operation on orbit for the space object observation. The result is induced by variation of some prior parameters such as platform motion, attitude variation, jitter and drift angle during operation on orbit. So it is not satisfying to improve the image quality, only by using the parameters measured on the ground test such as the point response function of the infrared CCD camera. The simulation for the space object observation of the on-board imaging system and the enhancement is proposed here, combining with the information between adjacent spatial and temporal frames. The dynamic model is formulated, representing the characteristic of point response function during multiple exposure times. Furthermore, the enhancement algorithm is proposed based on the correlated information between two adjacent spatial and temporal frames. The norm optimization method is used in the frequency domain. The dynamic point response function of the space object observation system is simulated in the experiment. And the detecting spectrum range is mid-Infrared. The processed result is clear and sharp by the proposed method. The experimental result shows that the proposed method is better than the conventional methods.