Now you have gone beyond the scope of the original question.
Of course, place must be 'to', but that is a different consideration: They've invited me to Chicago. And an activity is a purpose, so you will need 'for': They invited me for chess.
But where there is no clear distinction, as in the original post, either will do: