Have kids

Hello.

A conversation between a divorced father and his brother. The divorced father only sees his children occasionally as they are living with their mother.

Line of dialogue:

"Have you had the children?"

"No."

"When are you having them?"

"I'll have them next week."

Is "have" okay here instead of "seen" as they are in his possession when he is seeing/having them?