To give something up or give up something means forgo it or let it go. To give up on something means to lose hope in it or abandon it. "Don't give up on us" in your song probably means "keep hoping we will be happy together".
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.