McAdoo was raised in Greensboro, North Carolina. His mother taught at his grade school and his father was a custodian at North Carolina A&T University. He attended Ben L. Smith High School, where he not only participated in basketball and track, he was also in the marching band as a saxophone player.