Had sb to verb?

in Charlie Puth's song, there is:" Thinking back in time when I had you to lose "

could anybody tell me what it means and difference between "have sb doing sth" , "have sb to do sth" and " have sb do sth'?