Have you gone to the bank? - Fine Have you been to the bank? - You are asking if they have cashed the money/got money out etc. Have you been in the bank? - You are askig if they have seen the interior design.
That's a new restaurant; have you gone to it - No. have you been to it - OK have you been there - most natural.