Loafers were once a fisherman’s staple. The surprising history of the preppy icon.