'Let me tell you' (if you are using it right) is a comment clause, and I suggest that it requires a comma. 'That' has nothing to do with commas. Let me tell you, I met her yesterday -- The first is a comment clause, like 'Guess what' or 'Surprise, surprise'.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.