"Under the water tap" is fine, but the first impression I got from that was that he was washing his legs under the tap, but not using the tap, i.e. the tap wasn't running, and he was using something else to wash his legs.
If in doubt use "He washed his legs under the tap".