While I agree in a general way TD, I don't think this follows for all dialects or all situations. But it's certainly a good pattern for ESLs to follow.
In American English it's perfectly acceptable. I am not familiar with any rule that requires "to be" to substitute for "to go" either in the context of the present perfect tense or in the context of the adverbial "several times". CJ