Grammatically, it probably isn't technically wrong. But in everyday conversation, the infinitive is rarely used as a subject while the gerund is common.
The infinitive used with the copula sounds a bit Shakespearian:
To watch TV is to waste your time and fry your brain cells.