It is correct. However, because of the distance between the subject (the ladies) and their action (murmuring), it might confuse the reader as to who is doing the murmuring, you or the ladies. That's easily corrected. For example: ...as they murmured, 'You're safe now.'