Both "bye the way" and "anyway" are used to introduce different topics into a conversation. This is what is happening in your first 2 examples and either can be used. "Anyway" is also used to emphasize what is being said.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.