Ellsworth was a true sportsman and one of the best all-around athletes that Minesing produced. He was a hockey and baseball star player and coach.  He was known as a great horseshoe player and excelled at the game of curling.  Ellsworth was inducted into the Ontario Horseshoe Hall of Fame in 2001 and was the first person inducted into the former Vespra Recreation Hall of Fame in 1987.