Adverb or adjective

Hi. Are the underlined words an adjective or an adverb? If you gave your answer, would you care to give me how they could be in simple terms? Also, is it a correct sentence, either with or without the words in parentheses? Thank you for your anticipated help.

Joe went to see his friend by going to a house south (south from here?).