It sounds fine to me. "Thank you for your time" does give the impression that you will not see him/her again, and that you are grateful for him/her sacrificing her time to see you. It is quite formal.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.