They seem to me to. Except of course when 'regardless' is an adjective modifying a careless person: Regardless of the danger, he rushed into the fray.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.