Strictly, you are wrong, though we hear what you have written often enough. According to formal grammar, these are correct: It would give me such joy if just as I was leaving you said... It will give me such joy if just as I am leaving you say...
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.