Not quite – in the past, they would also have said "I remembered/recollected that". But they might also have said "I recollected myself" with the separate meaning "I regained my composure".
You might be interested in the current although somewhat formal expression, 'I forgot myself', meaning that I did something carelessly, ie forgetting the reasons why I shouldn't do it.