To complicate matters, I think both are possible-- though they have different meanings.
"The largest second bedroom" could be said, or written, in a circumstance where 'second bedrooms' are being compared, for instance, between one house and another house.
"The second largest bedroom" would be used when comparing bedrooms within the same house.