Good question. It is simply that we use the noun ('electricity') with 'supply', but not with 'power', where we use the adjective ('electric'). Hence, these are accepted: electric power electricity supply I am not sure that a general rule can be extrapolated, but you can probably notice that we use 'supply of electricity' but not 'power of electricity'.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.