'In case' is not really appropriate there, It would be more natural to say "We talked quietly so as not to wake the baby".
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.
hirashinWe talked quietly so that we wouldn't wake the baby.That's fine.