Proverbs, particularly anonymous ones, can take various forms. An early (1826) reference to this already 'old saying' is:
The Rev. Mr. Daly, of Powerscourt, a bible crusader of some celebrity, and who prefers an itinerant mode of life, to the quiet, unostentatious discharge of his pastoral duties at home, reminded his hearers of an