Formal enough for academe, as is, I would think, 'that having been said' (the passive is always nice for academic dissertations). The thing to watch: it is preferable that the unstated subject of your 'that said/etc' clause match the subject of the main clause:
'That said, I feel that...' 'Having said that, the committee went on to condemn...'