In the US "in church" would be used, for example, in the following (you're talking about things located inside the actual the church building): Don't fidget in church. Behave yourself in church. Don't talk in church.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.