I thinik the sentence reads better with 'it'. Otherwise, in could be interepreted to mean that 'we visited each other' rather than the museum. Context and audience would determine how much you need 'it'.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.