Members of the offensive team shall carry all gloves and other equipment off the field and to the dugout while their team is at bat. No equipment shall be left lying on the field, either in fair or foul territory.
Until this rule was implemented in 1954, players routinely left their gloves on the field when switching to offense. A glove on the field was in play and simply considered an occupational hazard. Below is a photo from the 1935 World Series. Note the gloves on the field.