Yes, we do use "according to + noun/pronoun". It sounds odd when using it in the affirmative with "me". You could say it if surprised by someone's accusations against you, for example.
Friend: According to you, the moon is made of cheese.
You: According to me? When did I say that? I never said that!
...........
The "in my point of view" sounds rather Spanglish.
The explanation given above is a good one. Did you read it?
To simply express your opinion in everyday conversation, I suggest you do not use "According to me." It's fine for other pronouns and other nouns. According to Mike, according to her, according to the written procedure, but not acording to me.
You can say many other things: I believe, In my opinion, It's my