James Whittemore, ULC Minister