Abstract: Aim at problem of stars have interfered with the detection of small target in the drift-scanning image of low signal-to-clutter ratio, a real-time processing method was presented, based on detecting candidate targets in single frame and tracking to judge the real target with multi-frames. The reason of filtering out the star hardly in the image through multi-frames match was analyzed, and then a single frame processing method was adopted. With the order statistics filter, the star endpoint shelter was made to filter out false targets detected in single frame. The candidate targets from the single frame processing were used for particle generation in particle filter, and the likelihood function map based on the target moving information was used for updating the particle weight in particle filter. The above operation made the particle filter can be applied to the processing of small target detection on drift-scanning images. Experiments on the actual low signal-to-clutter ratio drift-scanning image and analysis on the different related methods have shown that the method proposed has improved the ability of dim target detection.