It means that someone feels bad because they are doing something their parents taught them not to do. So they feel guilty, even though their parents may not be there (or know) to punish them. For example, a minor social transgression such as telling a lie might lead to a guilty mind.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.