It is fine grammatically. I'm not sure why you've added "long ago". It doesn't seem usual to say "long ago" with a single case of crying all night. The farther back in time we place the event, the more grand we seem to want it to be!
Long ago, Columbus discovered America. Last week, I got a letter from my brother. Yesterday, the children attended a Christmas part