'X Factor' Judge Simon Cowell Knew Restless Road Were Going Home