In 2004 he won the Grade III Shakertown Stakes at Keeneland Race Course in Kentucky and at Woodbine Racetrack set a North American record of 1:19.38 for 7 furlongs on turf in winning the Ontario Jockey Club Stakes. Soaring Free also won his second straight Play The King Stakes in 2004 as well as the Highlander Stakes. He then earned the most important win of his career in race record time in the Grade I Atto Mile, a race in which he had finished second the previous year. He ended the year, finishing fourth in the Breeders' Cup Mile, 2¼ lengths behind upset winner Singletary.