A background clutter rejection method is presented to reduce false alarm rate and detect targets robustly for imaging infrared surveillance systems. The algorithm consists of the following 4 steps; 1) region splitting and merging; 2) histogram modification; 3) mirror image for horizontal line removal; 4) track management with multi-target tracking. Experimental results indicate that the proposed algorithm has upgraded target detection rate with reduced false alarm rate.