No, I don't think it works – I'd agree with "assume" here. "You shouldn't feel" is more likely to turn up in contexts such as: 1. You shouldn't feel you have to pay for lunch, just because it was your idea.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.