I think that it should indeed be "as much as I had been". You are talking about a relationship in the past ("while I WAS with him") and so you need the past tense form of the verb "to have".
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.