1)I swam to that island yesterday.It was easy for me.
This sentence#1 is grammatically correct.
I've never seen the expression "swim to a certain place"
You can say eg I swim to that island every day. It is easy for me.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.