You'd typically hear (in the US): "It's a lot easier to guess a man's age than a woman's." (You have the statement backwards.)
You could say: "It's a lot easier to put an age to a man than to a woman." (It's "put an age to" not "put an age on." This is old-fashioned-sounding, however.)