Born in Scotland, Ramsay was brought up in England after his family moved to Stratford-upon-Avon. As a teenager he played football for Oxford United's youth side where he was spotted by a scout for Glasgow Rangers. He completed trials for the Scottish club and became a professional player at the age of 12. He was released from the club following a knee injury, from which he was unable to regain full fitness.
Ramsay's father was a PE instructor who wanted his son to pursue a football career, with the ultimate goal of playing for Celtic United. After being released by the Scottish team, he offered to help Ramsay find a position on a Third Division side. However, Ramsay went against his father's wishes and took up a catering career, which was suggested by his mother.