Prime Minister Gordon Brown is preparing for the toughest test of his political life when he addresses the Labour Party conference.