Yes, the sentence is correct, though I'd write it as follows: "My computer is faster and more expensive than Peter's". Otherwise, you'd think the "more" also concerns "faster".
you can also use "costlier" instead of "more expensive"
Since expense is a negative and speed is a positive, I think the sentence might read better as: "My computer is faster but more expensive than Peter's."