Hi.
Are you coming with us? is the right question in your context.
when the speakers ask the listeners if they are going to join them,, you should always use come, but if the speakers are talking about the third party, you have to use go.
Ex. Are you coming with us/me?
Ex. Are you going with them/Jack?
I hope you find it usefull.
Cheers
Hamid