Plus, he reacts to the Season 35 premiere, reveals how he remains impartial as a judge, and more.