If he or she was either at work or at home, could you ask:
Would you rather have stayed home or gone to work?
The person was at work, but says I would rather have stayed home.
What's the difference between
Would you rather say home or go to work?
Here the person you are asking has done none? You are giving a choice.