The first is correct. The second might suggest that he often has serious affairs but moves on before marriage. Even that idea is not very natural; if he has a succession of partners, he may be unmarried, but he is often not really single.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.