The infinitive "to X" should not be split by the presence of any other word or words between "to" and "X". This particular saying is so often used with the split infinitive, however, that I think it can be accepted with "to never give". There are many other cases where this prescriptive rule is relaxed.
CJ