From a strictly grammatical point of view, you are right. Dare is sometimes used like a modal/defective auxiliary and in such cases to is not used with it. Cf.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.
Anonymous I've heard saying this "don't you dare stop" , shouldn't it be "don't you dare to stop" ?The first one kind of sounds weird to me.For me, "Don't you dare stop" feels correct and "Don't you dare to stop" seems inferior.