Abstract: Aiming at the ship-target recognition of sea-sky background, an classification algorithm based on machine learning was proposed. In the method, the segmentation algorithm was firstly adopted to extract connected region in infrared image. Then, the corresponding position of the original image was marked and normalized. Afterwards, the high-dimensional feature vector of branded region by using the HOG algorithm was extracted. Finally, the high-dimensional feature vector that came form suspected target area was classified by the SVM classifier which was trained by sample library. Simulation experimental result indicates that the algorithm not only can effectively recognise the infrared ship-targets in complex sea-sky background of interference, but also have good performance.