In general both 'Physical Education' and 'PE' should be in capitals, although I would be more comfortable using the second sentence (with the acronym) to get that point across.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.
Well PE should be in capitals because it is an acronym(word shortened down).