Well, in some sense it is physically off the floor because a part of the chair that was previously in contact with the floor but shouldn't be (e.g. the back of the chair) is lifted up off the floor. Sure, the chair is then set back down on the floor on its legs, but "pick up" still works for me.
When applied to a chair, "straighten up" most often refers to putting the chair in its