In your original, I would say "We have never been anywhere for vacation since" or "Since then, we haven't gone anywhere for vacation." Your rewrite is unnatural. You go someone place for vacation or on vacation, and you can "spend your vacation" somewhere, but not "we went somewhere spending our vacation."