No, "can't have gone" is a perfectly reasonable expression in this case (it implies more immediacy in the start of the search than "couldn't have gone").
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.