Hi, just from common usage, I would say, either way would be okay, but I would us "of work" or "of home" rather than "to work" or "to home". The "of" sounds like what is mostly used.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.