Yes. But whether or not it makes sense to do so depends of course on the rest of the sentence.
A sentence beginning with "With respect to ," (or, more commonly, "With all due respect to ,"), is a very POLITE way of saying that doesn't know what they are talking about, or is completely wrong. For example:
"With all due respect to the Emperor, the Death Star will not be finishe
With all due respect to Rommie, it may not necessarily be that the person to whom you refer with such a phrase is incorrect, merely that you disagree with what they are saying.
In this context you are showing respect for another person's opinion before expressing your own. It does not automatically follow that your asserion is correct and their's incorrect, merely different.