No, I'm sorry, Maple, but that doesn't make sense.
You could say this without the "time" - in a case something like "Yes, I have that book you wanted to borrow. I would have given it to you this morning when we ran into each other at the store, but I expect to see you earlier today, so I didn't have it with me then."