Hi Kate, Both sentences are grammatical, and the meanings are very slightly different.
"I taught myself HTML" is probably what you want. It means I learnt to write HTML; I became proficient in using it.
"I taught myself about HTML" means I did some study, and found out what HTML is. So I now know some things about it, but I'm necessarily able to use it or write it.