The brothers might not see eye-to-eye much these days, but a former royal butler said that they’ve got this in common.