Both are fine. However, a subtle nuance would lead me to suggest "For the man of my dreams."
Using "to" focuses on the one-time action of giving of the gift to him, while using "for" focuses on the long-time action of him having this gift either to use or wear or whatever application it may have (since I don't know what kind of gift it is). Since he's the man of your dreams, I'm assumin