Patrick Harris, ULC Minister