Hello Vintersorg, welcome to English Forums! The usual sentiment in a ballad would be "it's hard to live without you". In this case, the singer says "you make it hard to live without somebody else".
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.