dismiss sometimes takes the meaning of firing someone from a job, so it's not natural in the case of the maid -- not to my ear, anyway. If I dismiss the maid, she will never come back again, and I'll have to find a new maid. I favor let off in both cases, but I would also place off later in the first example, as you have done in the second.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.