"My cousin, Peter, is handsome" may imply that you have only one cousin (it is not absolutely clear cut). I see no difference in meaning between the others, but properly I prefer to put the commas in "Peter, my cousin, is handsome". In this sentence, the fact that he is your cousin is slightly de-emphasised compared to the first pair of sentences.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.